Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2203.05962
Cited By
Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice
International Conference on Learning Representations (ICLR), 2022
9 March 2022
Peihao Wang
Wenqing Zheng
Tianlong Chen
Zinan Lin
ViT
Re-assign community
ArXiv (abs)
PDF
HTML
Github (79★)
Papers citing
"Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice"
50 / 101 papers shown
Reconstructing KV Caches with Cross-layer Fusion For Enhanced Transformers
H. Lin
Zhiqi Bai
X. Zhang
Sen Yang
Xiang Li
...
Yongchi Zhao
Jiamang Wang
Yuchi Xu
Wenbo Su
B. Zheng
132
0
0
03 Dec 2025
Frequency-Aware Token Reduction for Efficient Vision Transformer
Dong-Jae Lee
Jiwan Hur
Jaehyun Choi
Jaemyung Yu
Junmo Kim
188
0
0
26 Nov 2025
Mechanisms of Non-Monotonic Scaling in Vision Transformers
Anantha Padmanaban Krishna Kumar
123
0
0
26 Nov 2025
On the Role of Hidden States of Modern Hopfield Network in Transformer
Tsubasa Masumura
Masato Taki
120
0
0
24 Nov 2025
DetailSemNet: Elevating Signature Verification through Detail-Semantic Integration
European Conference on Computer Vision (ECCV), 2025
Meng-Cheng Shih
Tsai-Ling Huang
Yu-Heng Shih
Hong-Han Shuai
Hsuan-Tung Liu
Yi-Ren Yeh
Ching-Chun Huang
151
2
0
20 Nov 2025
EPSegFZ: Efficient Point Cloud Semantic Segmentation for Few- and Zero-Shot Scenarios with Language Guidance
Jiahui Wang
H. Zhu
Haoren Guo
Abdullah Al Mamun
Cheng Xiang
Tong-heng Lee
3DPC
VLM
174
0
0
12 Nov 2025
Exploiting Inter-Session Information with Frequency-enhanced Dual-Path Networks for Sequential Recommendation
Peng He
Yanglei Gan
Tingting Dai
Run Lin
Xuexin Li
Yao Liu
Qiao Liu
210
0
0
09 Nov 2025
Beyond Redundancy: Diverse and Specialized Multi-Expert Sparse Autoencoder
Zhen Xu
Zhen Tan
Song Wang
Kaidi Xu
Tianlong Chen
MoE
276
0
0
07 Nov 2025
MapSAM2: Adapting SAM2 for Automatic Segmentation of Historical Map Images and Time Series
Xue Xia
Randall Balestriero
Tao Zhang
Y. Zhou
Andrew Ding
Dev Saini
L. Hurni
AI4TS
133
0
0
31 Oct 2025
Improving Model Representation and Reducing KV Cache via Skip Connections with First Value Heads
Zhoutong Wu
Y. Zhang
Yiming Dong
Chenheng Zhang
Cong Fang
Kun Yuan
Zhouchen Lin
153
0
0
19 Oct 2025
VIPAMIN: Visual Prompt Initialization via Embedding Selection and Subspace Expansion
Jaekyun Park
Hye Won Chung
VPVLM
VLM
205
0
0
18 Oct 2025
Operator Flow Matching for Timeseries Forecasting
Yolanne Y. R. Lee
Kyriakos Flouris
AI4TS
DiffM
219
0
0
16 Oct 2025
SpikePool: Event-driven Spiking Transformer with Pooling Attention
Donghyun Lee
Alex Sima
Yuhang Li
Panos Stinis
Priyadarshini Panda
91
0
0
14 Oct 2025
Revisiting Hallucination Detection with Effective Rank-based Uncertainty
Rui Wang
Zeming Wei
Guanzhang Yue
Meng Sun
UQCV
HILM
225
0
0
09 Oct 2025
Smoothing-Based Conformal Prediction for Balancing Efficiency and Interpretability
Mingyi Zheng
Hongyu Jiang
Yizhou Lu
Jiaye Teng
136
0
0
26 Sep 2025
Robust RGB-T Tracking via Learnable Visual Fourier Prompt Fine-tuning and Modality Fusion Prompt Generation
Hongtao Yang
Bineng Zhong
Qihua Liang
Zhiruo Zhu
Yaozong Zheng
Ning Li
157
0
0
24 Sep 2025
SAM-DCE: Addressing Token Uniformity and Semantic Over-Smoothing in Medical Segmentation
Yingzhen Hu
Yiheng Zhong
Ruobing Li
Yingxue Su
Jiabao An
Feilong Tang
Jionglong Su
Imran Razzak
MedIm
208
0
0
21 Sep 2025
ECG-Soup: Harnessing Multi-Layer Synergy for ECG Foundation Models
P. Nguyen
Huy P Phan
Hieu Pham
Christos Chatzichristos
Bert Vandenberk
M. D. Vos
MedIm
257
1
0
27 Aug 2025
Wavy Transformer
Satoshi Noguchi
Yoshinobu Kawahara
136
0
0
18 Aug 2025
Bubbleformer: Forecasting Boiling with Transformers
Sheikh Md Shakeel Hassan
Xianwei Zou
A. Dhruv
Vishwanath Ganesan
Aparna Chandramowlishwaran
AI4CE
332
1
0
28 Jul 2025
Frequency-Dynamic Attention Modulation for Dense Prediction
Linwei Chen
Lin Gu
Ying Fu
552
3
0
16 Jul 2025
MoiréXNet: Adaptive Multi-Scale Demoiréing with Linear Attention Test-Time Training and Truncated Flow Matching Prior
Liangyan Li
Yimo Ning
Kevin Le
Wei Dong
Yunzhe Li
Jun Chen
Xiaohong Liu
229
0
0
19 Jun 2025
A Gravity-informed Spatiotemporal Transformer for Human Activity Intensity Prediction
Yi-Fei Wang
Zhenghong Wang
Fan Zhang
Chengling Tang
Chaogui Kang
...
Sijie Ruan
W. Zhang
Yu Zheng
Philip S. Yu
Yu Liu
AI4CE
295
0
0
16 Jun 2025
Unsupervised Deformable Image Registration with Structural Nonparametric Smoothing
Information Processing in Medical Imaging (IPMI), 2025
Hang Zhang
Xiang Chen
Renjiu Hu
Rongguang Wang
Jinwei Zhang
Min Liu
Yaonan Wang
Gaolei Li
Xinxing Cheng
Yanfu Zhang
347
4
0
12 Jun 2025
Latent Mamba Operator for Partial Differential Equations
Karn Tiwari
Niladri Dutta
N. M. A. Krishnan
P. PrathoshA
Mamba
AI4CE
304
0
0
25 May 2025
Learning Advanced Self-Attention for Linear Transformers in the Singular Value Domain
International Joint Conference on Artificial Intelligence (IJCAI), 2025
Hyowon Wi
Jeongwhan Choi
Noseong Park
339
2
0
13 May 2025
Cross Paradigm Representation and Alignment Transformer for Image Deraining
Shun Zou
Yi Zou
Jiajun Li
Guangwei Gao
Guojun Qi
307
2
0
23 Apr 2025
Spectral-Adaptive Modulation Networks for Visual Perception
Guhnoo Yun
J. Yoo
Kijung Kim
Jeongho Lee
Paul Hongsuck Seo
Dong Hwan Kim
423
0
0
31 Mar 2025
WaveFormer: A 3D Transformer with Wavelet-Driven Feature Representation for Efficient Medical Image Segmentation
International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2025
Md. Mahfuz Al Hasan
Mahdi Zaman
Abdul Jawad
Alberto Santamaria-Pang
Ho Hin Lee
...
Md Shah Imran
Antika Roy
Y. P. Fallah
Navid Asadizanjani
Reza Forghani
MedIm
231
2
0
31 Mar 2025
Hyperspectral Adapter for Object Tracking based on Hyperspectral Video
Long Gao
Yunhe Zhang
Langkun Chen
Yan Jiang
Weiying Xie
Yunsong Li
VOS
189
0
0
28 Mar 2025
Coeff-Tuning: A Graph Filter Subspace View for Tuning Attention-Based Large Models
Computer Vision and Pattern Recognition (CVPR), 2025
Zichen Miao
Wei Chen
Qiang Qiu
279
7
0
24 Mar 2025
Mitigating Spectral Bias in Neural Operators via High-Frequency Scaling for Physical Systems
Neural Networks (NN), 2025
Siavash Khodakarami
Vivek Oommen
Aniruddha Bora
George Karniadakis
AI4CE
315
15
0
17 Mar 2025
Transformer Meets Twicing: Harnessing Unattended Residual Information
International Conference on Learning Representations (ICLR), 2025
Laziz U. Abdullaev
Tan M. Nguyen
563
4
0
02 Mar 2025
WiFi CSI Based Temporal Activity Detection via Dual Pyramid Network
AAAI Conference on Artificial Intelligence (AAAI), 2024
Zhendong Liu
Le Zhang
Bing Li
Yingjie Zhou
Zhaoyu Chen
Ce Zhu
300
4
0
28 Jan 2025
MoRe: Class Patch Attention Needs Regularization for Weakly Supervised Semantic Segmentation
AAAI Conference on Artificial Intelligence (AAAI), 2024
Zhiwei Yang
Yucong Meng
Kexue Fu
Shuo Wang
Zhijian Song
760
6
0
20 Jan 2025
Boosting ViT-based MRI Reconstruction from the Perspectives of Frequency Modulation, Spatial Purification, and Scale Diversification
AAAI Conference on Artificial Intelligence (AAAI), 2024
Yucong Meng
Zhiwei Yang
Yonghong Shi
Zhijian Song
275
6
0
14 Dec 2024
Unlocking Visual Secrets: Inverting Features with Diffusion Priors for Image Reconstruction
Sai Qian Zhang
Ziyun Li
Chuan Guo
Saeed Mahloujifar
Deeksha Dangwal
Edward Suh
B. D. Salvo
Chiao Liu
DiffM
310
2
0
11 Dec 2024
Adaptive High-Pass Kernel Prediction for Efficient Video Deblurring
Bo Ji
Angela Yao
371
0
0
02 Dec 2024
Enhancing Parameter-Efficient Fine-Tuning of Vision Transformers through Frequency-Based Adaptation
S. Ly
Hien Nguyen
327
4
0
28 Nov 2024
GrokFormer: Graph Fourier Kolmogorov-Arnold Transformers
Guoguo Ai
Guansong Pang
Hezhe Qiao
Yuan Gao
Hui Yan
543
2
0
26 Nov 2024
Length-Induced Embedding Collapse in PLM-based Models
Annual Meeting of the Association for Computational Linguistics (ACL), 2024
Yuqi Zhou
Sunhao Dai
Zhanshuo Cao
Xiao Zhang
Jun Xu
235
3
0
31 Oct 2024
Generalized Probabilistic Attention Mechanism in Transformers
DongNyeong Heo
Heeyoul Choi
277
3
0
21 Oct 2024
CATCH: Channel-Aware multivariate Time Series Anomaly Detection via Frequency Patching
International Conference on Learning Representations (ICLR), 2024
Xingjian Wu
Xiangfei Qiu
Zhengyu Li
Yihang Wang
Jilin Hu
Chenjuan Guo
Hui Xiong
Bin Yang
AI4TS
576
57
0
16 Oct 2024
Spiking Transformer with Spatial-Temporal Attention
Computer Vision and Pattern Recognition (CVPR), 2024
Donghyun Lee
Yuhang Li
Youngeun Kim
Shiting Xiao
Priyadarshini Panda
414
14
0
29 Sep 2024
Down-Sampling Inter-Layer Adapter for Parameter and Computation Efficient Ultra-Fine-Grained Image Recognition
Edwin Arkel Rios
Femiloye Oyerinde
Min-Chun Hu
Bo-Cheng Lai
223
1
0
17 Sep 2024
Hybrid-Segmentor: A Hybrid Approach to Automated Fine-Grained Crack Segmentation in Civil Infrastructure
Automation in Construction (Autom. Constr.), 2024
June Moh Goo
Xenios Milidonis
Alessandro Artusi
Jan Boehm
Carlo Ciliberto
164
31
0
04 Sep 2024
MSA
2
^2
2
Net: Multi-scale Adaptive Attention-guided Network for Medical Image Segmentation
Sina Ghorbani Kolahi
S. K. Chaharsooghi
Toktam Khatibi
Afshin Bozorgpour
Reza Azad
Moein Heidari
Ilker Hacihaliloglu
Dorit Merhof
378
13
0
31 Jul 2024
Attention Is All You Need But You Don't Need All Of It For Inference of Large Language Models
Georgy Tyukin
G. Dovonon
Jean Kaddour
Pasquale Minervini
LRM
207
2
0
22 Jul 2024
Foundation Models for Autonomous Robots in Unstructured Environments
Hossein Naderi
Alireza Shojaei
Lifu Huang
LM&Ro
291
5
0
19 Jul 2024
Adaptive Parametric Activation: Unifying and Generalising Activation Functions Across Tasks
European Conference on Computer Vision (ECCV), 2024
Konstantinos Panagiotis Alexandridis
Jiankang Deng
A. Nguyen
Shan Luo
301
7
0
11 Jul 2024
1
2
3
Next
