Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2203.05962
Cited By
Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice
International Conference on Learning Representations (ICLR), 2022
9 March 2022
Peihao Wang
Wenqing Zheng
Tianlong Chen
Zinan Lin
ViT
Re-assign community
ArXiv (abs)
PDF
HTML
Github (79★)
Papers citing
"Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice"
50 / 101 papers shown
Reconstructing KV Caches with Cross-layer Fusion For Enhanced Transformers
H. Lin
Zhiqi Bai
X. Zhang
Sen Yang
Xiang Li
...
Yongchi Zhao
Jiamang Wang
Yuchi Xu
Wenbo Su
B. Zheng
141
0
0
03 Dec 2025
Frequency-Aware Token Reduction for Efficient Vision Transformer
Dong-Jae Lee
Jiwan Hur
Jaehyun Choi
Jaemyung Yu
Junmo Kim
192
0
0
26 Nov 2025
Mechanisms of Non-Monotonic Scaling in Vision Transformers
Anantha Padmanaban Krishna Kumar
132
0
0
26 Nov 2025
On the Role of Hidden States of Modern Hopfield Network in Transformer
Tsubasa Masumura
Masato Taki
122
0
0
24 Nov 2025
DetailSemNet: Elevating Signature Verification through Detail-Semantic Integration
European Conference on Computer Vision (ECCV), 2025
Meng-Cheng Shih
Tsai-Ling Huang
Yu-Heng Shih
Hong-Han Shuai
Hsuan-Tung Liu
Yi-Ren Yeh
Ching-Chun Huang
155
2
0
20 Nov 2025
EPSegFZ: Efficient Point Cloud Semantic Segmentation for Few- and Zero-Shot Scenarios with Language Guidance
Jiahui Wang
H. Zhu
Haoren Guo
Abdullah Al Mamun
Cheng Xiang
Tong-heng Lee
3DPC
VLM
181
0
0
12 Nov 2025
Exploiting Inter-Session Information with Frequency-enhanced Dual-Path Networks for Sequential Recommendation
Peng He
Yanglei Gan
Tingting Dai
Run Lin
Xuexin Li
Yao Liu
Qiao Liu
224
0
0
09 Nov 2025
Beyond Redundancy: Diverse and Specialized Multi-Expert Sparse Autoencoder
Zhen Xu
Zhen Tan
Song Wang
Kaidi Xu
Tianlong Chen
MoE
281
0
0
07 Nov 2025
MapSAM2: Adapting SAM2 for Automatic Segmentation of Historical Map Images and Time Series
Xue Xia
Randall Balestriero
Tao Zhang
Y. Zhou
Andrew Ding
Dev Saini
L. Hurni
AI4TS
139
0
0
31 Oct 2025
Improving Model Representation and Reducing KV Cache via Skip Connections with First Value Heads
Zhoutong Wu
Y. Zhang
Yiming Dong
Chenheng Zhang
Cong Fang
Kun Yuan
Zhouchen Lin
160
0
0
19 Oct 2025
VIPAMIN: Visual Prompt Initialization via Embedding Selection and Subspace Expansion
Jaekyun Park
Hye Won Chung
VPVLM
VLM
207
0
0
18 Oct 2025
Operator Flow Matching for Timeseries Forecasting
Yolanne Y. R. Lee
Kyriakos Flouris
AI4TS
DiffM
221
0
0
16 Oct 2025
SpikePool: Event-driven Spiking Transformer with Pooling Attention
Donghyun Lee
Alex Sima
Yuhang Li
Panos Stinis
Priyadarshini Panda
92
0
0
14 Oct 2025
Revisiting Hallucination Detection with Effective Rank-based Uncertainty
Rui Wang
Zeming Wei
Guanzhang Yue
Meng Sun
UQCV
HILM
232
0
0
09 Oct 2025
Smoothing-Based Conformal Prediction for Balancing Efficiency and Interpretability
Mingyi Zheng
Hongyu Jiang
Yizhou Lu
Jiaye Teng
140
0
0
26 Sep 2025
Robust RGB-T Tracking via Learnable Visual Fourier Prompt Fine-tuning and Modality Fusion Prompt Generation
Hongtao Yang
Bineng Zhong
Qihua Liang
Zhiruo Zhu
Yaozong Zheng
Ning Li
161
0
0
24 Sep 2025
SAM-DCE: Addressing Token Uniformity and Semantic Over-Smoothing in Medical Segmentation
Yingzhen Hu
Yiheng Zhong
Ruobing Li
Yingxue Su
Jiabao An
Feilong Tang
Jionglong Su
Imran Razzak
MedIm
213
0
0
21 Sep 2025
ECG-Soup: Harnessing Multi-Layer Synergy for ECG Foundation Models
P. Nguyen
Huy P Phan
Hieu Pham
Christos Chatzichristos
Bert Vandenberk
M. D. Vos
MedIm
266
1
0
27 Aug 2025
Wavy Transformer
Satoshi Noguchi
Yoshinobu Kawahara
147
0
0
18 Aug 2025
Bubbleformer: Forecasting Boiling with Transformers
Sheikh Md Shakeel Hassan
Xianwei Zou
A. Dhruv
Vishwanath Ganesan
Aparna Chandramowlishwaran
AI4CE
344
1
0
28 Jul 2025
Frequency-Dynamic Attention Modulation for Dense Prediction
Linwei Chen
Lin Gu
Ying Fu
561
5
0
16 Jul 2025
MoiréXNet: Adaptive Multi-Scale Demoiréing with Linear Attention Test-Time Training and Truncated Flow Matching Prior
Liangyan Li
Yimo Ning
Kevin Le
Wei Dong
Yunzhe Li
Jun Chen
Xiaohong Liu
233
0
0
19 Jun 2025
A Gravity-informed Spatiotemporal Transformer for Human Activity Intensity Prediction
Yi-Fei Wang
Zhenghong Wang
Fan Zhang
Chengling Tang
Chaogui Kang
...
Sijie Ruan
W. Zhang
Yu Zheng
Philip S. Yu
Yu Liu
AI4CE
303
1
0
16 Jun 2025
Unsupervised Deformable Image Registration with Structural Nonparametric Smoothing
Information Processing in Medical Imaging (IPMI), 2025
Hang Zhang
Xiang Chen
Renjiu Hu
Rongguang Wang
Jinwei Zhang
Min Liu
Yaonan Wang
Gaolei Li
Xinxing Cheng
Yanfu Zhang
350
4
0
12 Jun 2025
Latent Mamba Operator for Partial Differential Equations
Karn Tiwari
Niladri Dutta
N. M. A. Krishnan
P. PrathoshA
Mamba
AI4CE
312
0
0
25 May 2025
Learning Advanced Self-Attention for Linear Transformers in the Singular Value Domain
International Joint Conference on Artificial Intelligence (IJCAI), 2025
Hyowon Wi
Jeongwhan Choi
Noseong Park
348
2
0
13 May 2025
Cross Paradigm Representation and Alignment Transformer for Image Deraining
Shun Zou
Yi Zou
Jiajun Li
Guangwei Gao
Guojun Qi
312
4
0
23 Apr 2025
Spectral-Adaptive Modulation Networks for Visual Perception
Guhnoo Yun
J. Yoo
Kijung Kim
Jeongho Lee
Paul Hongsuck Seo
Dong Hwan Kim
429
0
0
31 Mar 2025
WaveFormer: A 3D Transformer with Wavelet-Driven Feature Representation for Efficient Medical Image Segmentation
International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2025
Md. Mahfuz Al Hasan
Mahdi Zaman
Abdul Jawad
Alberto Santamaria-Pang
Ho Hin Lee
...
Md Shah Imran
Antika Roy
Y. P. Fallah
Navid Asadizanjani
Reza Forghani
MedIm
239
2
0
31 Mar 2025
Hyperspectral Adapter for Object Tracking based on Hyperspectral Video
Long Gao
Yunhe Zhang
Langkun Chen
Yan Jiang
Weiying Xie
Yunsong Li
VOS
189
0
0
28 Mar 2025
Coeff-Tuning: A Graph Filter Subspace View for Tuning Attention-Based Large Models
Computer Vision and Pattern Recognition (CVPR), 2025
Zichen Miao
Wei Chen
Qiang Qiu
282
7
0
24 Mar 2025
Mitigating Spectral Bias in Neural Operators via High-Frequency Scaling for Physical Systems
Neural Networks (NN), 2025
Siavash Khodakarami
Vivek Oommen
Aniruddha Bora
George Karniadakis
AI4CE
339
16
0
17 Mar 2025
Transformer Meets Twicing: Harnessing Unattended Residual Information
International Conference on Learning Representations (ICLR), 2025
Laziz U. Abdullaev
Tan M. Nguyen
565
4
0
02 Mar 2025
WiFi CSI Based Temporal Activity Detection via Dual Pyramid Network
AAAI Conference on Artificial Intelligence (AAAI), 2024
Zhendong Liu
Le Zhang
Bing Li
Yingjie Zhou
Zhaoyu Chen
Ce Zhu
300
4
0
28 Jan 2025
MoRe: Class Patch Attention Needs Regularization for Weakly Supervised Semantic Segmentation
AAAI Conference on Artificial Intelligence (AAAI), 2024
Zhiwei Yang
Yucong Meng
Kexue Fu
Shuo Wang
Zhijian Song
760
6
0
20 Jan 2025
Boosting ViT-based MRI Reconstruction from the Perspectives of Frequency Modulation, Spatial Purification, and Scale Diversification
AAAI Conference on Artificial Intelligence (AAAI), 2024
Yucong Meng
Zhiwei Yang
Yonghong Shi
Zhijian Song
279
6
0
14 Dec 2024
Unlocking Visual Secrets: Inverting Features with Diffusion Priors for Image Reconstruction
Sai Qian Zhang
Ziyun Li
Chuan Guo
Saeed Mahloujifar
Deeksha Dangwal
Edward Suh
B. D. Salvo
Chiao Liu
DiffM
312
2
0
11 Dec 2024
Adaptive High-Pass Kernel Prediction for Efficient Video Deblurring
Bo Ji
Angela Yao
375
0
0
02 Dec 2024
Enhancing Parameter-Efficient Fine-Tuning of Vision Transformers through Frequency-Based Adaptation
S. Ly
Hien Nguyen
330
4
0
28 Nov 2024
GrokFormer: Graph Fourier Kolmogorov-Arnold Transformers
Guoguo Ai
Guansong Pang
Hezhe Qiao
Yuan Gao
Hui Yan
551
2
0
26 Nov 2024
Length-Induced Embedding Collapse in PLM-based Models
Annual Meeting of the Association for Computational Linguistics (ACL), 2024
Yuqi Zhou
Sunhao Dai
Zhanshuo Cao
Xiao Zhang
Jun Xu
238
1
0
31 Oct 2024
Generalized Probabilistic Attention Mechanism in Transformers
DongNyeong Heo
Heeyoul Choi
280
3
0
21 Oct 2024
CATCH: Channel-Aware multivariate Time Series Anomaly Detection via Frequency Patching
International Conference on Learning Representations (ICLR), 2024
Xingjian Wu
Xiangfei Qiu
Zhengyu Li
Yihang Wang
Jilin Hu
Chenjuan Guo
Hui Xiong
Bin Yang
AI4TS
581
59
0
16 Oct 2024
Spiking Transformer with Spatial-Temporal Attention
Computer Vision and Pattern Recognition (CVPR), 2024
Donghyun Lee
Yuhang Li
Youngeun Kim
Shiting Xiao
Priyadarshini Panda
420
16
0
29 Sep 2024
Down-Sampling Inter-Layer Adapter for Parameter and Computation Efficient Ultra-Fine-Grained Image Recognition
Edwin Arkel Rios
Femiloye Oyerinde
Min-Chun Hu
Bo-Cheng Lai
229
1
0
17 Sep 2024
Hybrid-Segmentor: A Hybrid Approach to Automated Fine-Grained Crack Segmentation in Civil Infrastructure
Automation in Construction (Autom. Constr.), 2024
June Moh Goo
Xenios Milidonis
Alessandro Artusi
Jan Boehm
Carlo Ciliberto
171
31
0
04 Sep 2024
MSA
2
^2
2
Net: Multi-scale Adaptive Attention-guided Network for Medical Image Segmentation
Sina Ghorbani Kolahi
S. K. Chaharsooghi
Toktam Khatibi
Afshin Bozorgpour
Reza Azad
Moein Heidari
Ilker Hacihaliloglu
Dorit Merhof
387
0
0
31 Jul 2024
Attention Is All You Need But You Don't Need All Of It For Inference of Large Language Models
Georgy Tyukin
G. Dovonon
Jean Kaddour
Pasquale Minervini
LRM
210
2
0
22 Jul 2024
Foundation Models for Autonomous Robots in Unstructured Environments
Hossein Naderi
Alireza Shojaei
Lifu Huang
LM&Ro
295
6
0
19 Jul 2024
Adaptive Parametric Activation: Unifying and Generalising Activation Functions Across Tasks
European Conference on Computer Vision (ECCV), 2024
Konstantinos Panagiotis Alexandridis
Jiankang Deng
A. Nguyen
Shan Luo
308
8
0
11 Jul 2024
1
2
3
Next
Page 1 of 3
