v1v2v3 (latest)

Agent Attention: On the Integration of Softmax and Linear Attention

European Conference on Computer Vision (ECCV), 2023

14 December 2023

Gao Huang

ArXiv (abs)PDF HTML HuggingFace (2 upvotes)Github (621★)

Papers citing "Agent Attention: On the Integration of Softmax and Linear Attention"

50 / 50 papers shown

Title
FlashVGGT: Efficient and Scalable Visual Geometry Transformers with Compressed Descriptor Attention Zipeng Wang Dan Xu ViT 20 0 0 01 Dec 2025
ViT $^3$ : Unlocking Test-Time Training in Vision Dongchen Han Y. Li Tianyu Li Z. Cao Ziming Wang Jun Song Yu Cheng Bo Zheng Gao Huang ViT 20 0 0 01 Dec 2025
MobileI2V: Fast and High-Resolution Image-to-Video on Mobile Devices Shuai Zhang Bao Tang Siyuan Yu Yueting Zhu Jingfeng Yao Ya Zou Shanglin Yuan Li Yu Wenyu Liu Xinggang Wang DiffM VGen 177 0 0 26 Nov 2025
SlideBot: A Multi-Agent Framework for Generating Informative, Reliable, Multi-Modal Presentations Eric Xie Danielle Waterfield Michael Kennedy Aidong Zhang LLMAG 136 0 0 12 Nov 2025
Simulating the Visual World with Artificial Intelligence: A Roadmap Jingtong Yue Z. Huang Z. Chen Xintao Wang Pengfei Wan Ziwei Liu VGen LM&Ro 344 0 0 11 Nov 2025
Adaptive Agent Selection and Interaction Network for Image-to-point cloud Registration Zhixin Cheng Xiaotian Yin Jiacheng Deng Bohao Liao Yujia Chen Xu Zhou Baoqun Yin Tianzhu Zhang 3DPC 150 0 0 08 Nov 2025
Linear Differential Vision Transformer: Learning Visual Contrasts via Pairwise Differentials Yifan Pu Jixuan Ying Qixiu Li Tianzhu Ye Dongchen Han Xiaochen Wang Ziyi Wang Xinyu Shao Gao Huang Xiu Li ViT 109 0 0 02 Nov 2025
Efficient High-Accuracy PDEs Solver with the Linear Attention Neural Operator Ming Zhong Zhenya Yan AI4CE 101 0 0 19 Oct 2025
Task Vectors, Learned Not Extracted: Performance Gains and Mechanistic Insight Haolin Yang Hakaze Cho Kaize Ding Naoya Inoue 160 0 0 29 Sep 2025
FSDENet: A Frequency and Spatial Domains based Detail Enhancement Network for Remote Sensing Semantic SegmentationIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (IEEE J-STARS), 2025 Jiahao Fu Yinfeng Yu Liejun Wang 150 3 0 29 Sep 2025
Towards Interpretable and Efficient Attention: Compressing All by Contracting a Few Qishuai Wen Zhiyuan Huang Chun-Guang Li MQ 299 0 0 21 Sep 2025
Hierarchical Self-Attention: Generalizing Neural Attention Mechanics to Multi-Scale Problems Saeed Amizadeh Sara Abdali Yinheng Li K. Koishida 152 0 0 18 Sep 2025
Novel Category Discovery with X-Agent Attention for Open-Vocabulary Semantic Segmentation Jiahao Li Yang Lu Yachao Zhang Fangyong Wang Yuan Xie Yanyun Qu VLM 106 0 0 01 Sep 2025
Lightweight Backbone Networks Only Require Adaptive Lightweight Self-Attention Mechanisms Fengyun Li Chao Zheng Yangyang Fang Jialiang Lan Jianhua Liang Luhao Zhang Fa Si 153 0 0 02 Aug 2025
DistrAttention: An Efficient and Flexible Self-Attention Mechanism on Modern GPUs Haolin Jin Mengbai Xiao Yuan Yuan Qi. Wang Dongxiao Yu Guanghui Zhang Haoliang Wang 60 0 0 23 Jul 2025
Gated Rotary-Enhanced Linear Attention for Long-term Sequential Recommendation Juntao Hu Wei Zhou Huayi Shen Xiao Du Jie Liao Junhao Wen Min Gao Junhao Wen 187 1 0 16 Jun 2025
Comba: Improving Bilinear RNNs with Closed-loop Control Jiaxi Hu Yongqi Pan Jusen Du Disen Lan Xiaqiang Tang Qingsong Wen Yuxuan Liang Weigao Sun 725 0 0 03 Jun 2025
MSLAU-Net: A Hybird CNN-Transformer Network for Medical Image Segmentation Libin Lan Yanxin Li Xiaojuan Liu Juan Zhou Jianxun Zhang Nannan Huang Yudong Zhang ViT MedIm 191 1 0 24 May 2025
DiCo: Revitalizing ConvNets for Scalable and Efficient Diffusion Modeling Yuang Ai Qihang Fan Xuefeng Hu Zhenheng Yang Xiao-Yu Zhang Huaibo Huang DiffM 314 1 0 16 May 2025
HWA-UNETR: Hierarchical Window Aggregate UNETR for 3D Multimodal Gastric Lesion SegmentationInternational Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2025 Jiaming Liang Lihuan Dai Xiaoqi Sheng Xiangguang Chen Chun Yao Guihua Tao Qibin Leng Hongmin Cai Xi Zhong 355 2 0 15 May 2025
Optimization of Module Transferability in Single Image Super-Resolution: Universality Assessment and Cycle Residual Blocks Haotong Cheng Zhiqi Zhang Hao Li Xinsong Zhang SupR 363 0 0 06 May 2025
Vision Mamba in Remote Sensing: A Comprehensive Survey of Techniques, Applications and Outlook Muyi Bao Shuchang Lyu Zhaoyang Xu Huiyu Zhou Jinchang Ren Shiming Xiang Xuelong Li Guangliang Cheng Mamba 543 6 0 01 May 2025
DMAGaze: Gaze Estimation Based on Feature Disentanglement and Multi-Scale Attention Haohan Chen Hongjia Liu Shiyong Lan Wenwu Wang Yixin Qiao Yao Li Guonan Deng CVBM 272 0 0 15 Apr 2025
DFormerv2: Geometry Self-Attention for RGBD Semantic SegmentationComputer Vision and Pattern Recognition (CVPR), 2025 Bo Yin Jiao-Long Cao Ming-Ming Cheng Qibin Hou 3DPC MDE 238 12 0 07 Apr 2025
Training-free Diffusion Acceleration with Bottleneck Sampling Ye Tian Xin Xia Yuxi Ren Shanchuan Lin Xing Wang Xuefeng Xiao Yunhai Tong L. Yang Tengjiao Wang 349 7 0 24 Mar 2025
TA-V2A: Textually Assisted Video-to-Audio GenerationIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2025 Yuhuan You Xihong Wu T. Qu DiffM 235 3 0 12 Mar 2025
Liger: Linearizing Large Language Models to Gated Recurrent Structures Disen Lan Weigao Sun Jiaxi Hu Jusen Du Yu Cheng 385 11 0 03 Mar 2025
ProxyTransformation: Preshaping Point Cloud Manifold With Proxy Attention For 3D Visual GroundingComputer Vision and Pattern Recognition (CVPR), 2025 Qihang Peng Henry Zheng Gao Huang 3DPC 336 2 0 26 Feb 2025
Surface Vision Mamba: Leveraging Bidirectional State Space Model for Efficient Spherical Manifold RepresentationInternational Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2025 Rongzhao He Weihao Zheng Leilei Zhao Ying Wang Dalin Zhu Dan Wu Bin Hu Mamba 682 3 0 21 Feb 2025
PolaFormer: Polarity-aware Linear Attention for Vision TransformersInternational Conference on Learning Representations (ICLR), 2025 Weikang Meng Yadan Luo Xin Li Shihong Deng Zheng Zhang 988 29 0 25 Jan 2025
Bridging the Divide: Reconsidering Softmax and Linear AttentionNeural Information Processing Systems (NeurIPS), 2024 Dongchen Han Yifan Pu Zhuofan Xia Yizeng Han Xuran Pan Xiu Li Jiwen Lu Shiji Song Gao Huang 237 33 0 09 Dec 2024
TinyViM: Frequency Decoupling for Tiny Hybrid Vision Mamba Xiaowen Ma Zhenliang Ni Xinghao Chen Mamba 346 13 0 26 Nov 2024
CARE Transformer: Mobile-Friendly Linear Visual Transformer via Decoupled Dual InteractionComputer Vision and Pattern Recognition (CVPR), 2024 Yuan Zhou Qingshan Xu Jiequan Cui Junbao Zhou Jing Zhang Richang Hong Han Zhang ViT 231 0 0 25 Nov 2024
ENAT: Rethinking Spatial-temporal Interactions in Token-based Image SynthesisNeural Information Processing Systems (NeurIPS), 2024 Zanlin Ni Yulin Wang Renping Zhou Yizeng Han Jiayi Guo Zhiyuan Liu Xingtai Lv Gao Huang 243 9 0 11 Nov 2024
TexLiverNet: Leveraging Medical Knowledge and Spatial-Frequency Perception for Enhanced Liver Tumor SegmentationIEEE International Symposium on Biomedical Imaging (ISBI), 2024 Xiaoyan Jiang Zhi Zhou HaiLing Wang Guozhong Wang ZhiJun Fang MedIm 181 2 0 07 Nov 2024
DeBiFormer: Vision Transformer with Deformable Agent Bi-level Routing AttentionAsian Conference on Computer Vision (ACCV), 2024 Nguyen Huu Bao Long Chenyu Zhang Yuzhi Shi Tsubasa Hirakawa Takayoshi Yamashita Tohgoroh Matsui H. Fujiyoshi 179 7 0 11 Oct 2024
Dynamic Diffusion TransformerInternational Conference on Learning Representations (ICLR), 2024 Wangbo Zhao Yizeng Han Jiasheng Tang Kai Wang Yibing Song Gao Huang Fan Wang Yang You 273 30 0 04 Oct 2024
AEANet: Affinity Enhanced Attentional Networks for Arbitrary Style Transfer Gen Li Xianqiu Zheng Yujian Li 210 1 0 23 Sep 2024
GateAttentionPose: Enhancing Pose Estimation with Agent Attention and Improved Gated Convolutions Liang Feng Zhixuan Shen Lihua Wen Shiyao Li Ming Xu CVBM 192 0 0 12 Sep 2024
ColorMamba: Towards High-quality NIR-to-RGB Spectral Translation with MambaAsian Conference on Machine Learning (ACML), 2024 Huiyu Zhai Guang Jin Xingxing Yang Guosheng Kang Mamba 173 2 0 15 Aug 2024
End-to-end Semantic-centric Video-based Multimodal Affective Computing Ronghao Lin Ying Zeng Sijie Mai Haifeng Hu VGen 246 2 0 14 Aug 2024
Efficient Diffusion Transformer with Step-wise Dynamic Attention MediatorsEuropean Conference on Computer Vision (ECCV), 2024 Yifan Pu Zhuofan Xia Jiayi Guo Dongchen Han Qixiu Li ... Ji Li Yizeng Han Shiji Song Gao Huang Xiu Li 266 22 0 11 Aug 2024
MacFormer: Semantic Segmentation with Fine Object Boundaries Guoan Xu Wenfeng Huang Tao Wu Ligeng Chen Wenjing Jia Guangwei Gao Xiatian Zhu Stuart W. Perry 240 4 0 11 Aug 2024
DSCENet: Dynamic Screening and Clinical-Enhanced Multimodal Fusion for MPNs Subtype Classification Yuan Zhang Yaolei Qi Xiaoming Qi Yongyue Wei Guanyu Yang 141 3 0 11 Jul 2024
Real-world Image Dehazing with Coherence-based Label Generator and Cooperative Unfolding Network Chengyu Fang Chunming He Fengyang Xiao Yulun Zhang Longxiang Tang Yuelin Zhang Kai Li Xiu Li 262 9 0 12 Jun 2024
Demystify Mamba in Vision: A Linear Attention Perspective Dongchen Han Ziyi Wang Zhuofan Xia Yizeng Han Yifan Pu Chunjiang Ge Jun Song Shiji Song Bo Zheng Gao Huang Mamba 327 148 0 26 May 2024
Referring Flexible Image Restoration Runwei Guan Rongsheng Hu Zhuhao Zhou Tianlang Xue Ka Lok Man Jeremy S. Smith Eng Gee Lim Weiping Ding Yutao Yue 163 0 0 16 Apr 2024
Rethinking Iterative Stereo Matching from Diffusion Bridge Model Perspective Yuguang Shi DiffM 200 2 0 13 Apr 2024
LF Tracy: A Unified Single-Pipeline Approach for Salient Object Detection in Light Field Cameras Fei Teng Kailai Li Jiawei Liu Kunyu Peng Xina Cheng Zhiyong Li Kailun Yang 198 2 0 30 Jan 2024
GSVA: Generalized Segmentation via Multimodal Large Language ModelsComputer Vision and Pattern Recognition (CVPR), 2023 Zhuofan Xia Dongchen Han Yizeng Han Xuran Pan Shiji Song Gao Huang VLM 559 122 0 15 Dec 2023