Is Attention Better Than Matrix Decomposition?

9 September 2021

Papers citing "Is Attention Better Than Matrix Decomposition?"

23 / 23 papers shown

Title
SCSegamba: Lightweight Structure-Aware Vision Mamba for Crack Segmentation in Structures Hui Liu Chen Jia Fan Shi Xu Cheng Shengyong Chen Mamba 47 0 0 03 Mar 2025
SegMAN: Omni-scale Context Modeling with State Space Models and Local Attention for Semantic Segmentation Yunxiang Fu Meng Lou Yizhou Yu 112 1 0 16 Dec 2024
Heuristical Comparison of Vision Transformers Against Convolutional Neural Networks for Semantic Segmentation on Remote Sensing Imagery Ashim Dahal Saydul Akbar Murad Nick Rahimi ViT 29 1 0 14 Nov 2024
FactorizePhys: Matrix Factorization for Multidimensional Attention in Remote Physiological Sensing Jitesh Joshi Sos S. Agaian Youngjun Cho AI4TS 28 1 0 03 Nov 2024
Closed-Loop Long-Horizon Robotic Planning via Equilibrium Sequence Modeling Jinghan Li Zhicheng Sun Fei Li 80 1 0 02 Oct 2024
Staircase Cascaded Fusion of Lightweight Local Pattern Recognition and Long-Range Dependencies for Structural Crack Segmentation Hui Liu Chen Jia Fan Shi Xu Cheng Mianzhao Wang Shengyong Chen 30 1 0 23 Aug 2024
HSVLT: Hierarchical Scale-Aware Vision-Language Transformer for Multi-Label Image Classification Shuyi Ouyang Hongyi Wang Ziwei Niu Zhenjia Bai Shiao Xie Yingying Xu Ruofeng Tong Yen-Wei Chen Lanfen Lin VLM 25 1 0 23 Jul 2024
MeMSVD: Long-Range Temporal Structure Capturing Using Incremental SVD Ioanna Ntinou Enrique Sanchez Georgios Tzimiropoulos 34 0 0 11 Jun 2024
MCANet: Medical Image Segmentation with Multi-Scale Cross-Axis Attention Hao Shao Quansheng Zeng Qibin Hou Jufeng Yang 46 11 0 14 Dec 2023
Real-time Automatic M-mode Echocardiography Measurement with Panel Attention from Local-to-Global Pixels Ching-Hsun Tseng S. Chien Po-Shen Wang Shin-Jye Lee Wei-Huan Hu Bin Pu Xiaojun Zeng 19 1 0 15 Aug 2023
Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers K. Choromanski Shanda Li Valerii Likhosherstov Kumar Avinava Dubey Shengjie Luo Di He Yiming Yang Tamás Sarlós Thomas Weingarten Adrian Weller 11 8 0 03 Feb 2023
Computational Imaging for Machine Perception: Transferring Semantic Segmentation beyond Aberrations Qi Jiang Haowen Shi Shaohua Gao Jiaming Zhang Kailun Yang Lei Sun Huajian Ni Kaiwei Wang 16 5 0 21 Nov 2022
Learning Self-Supervised Low-Rank Network for Single-Stage Weakly and Semi-Supervised Semantic Segmentation Junwen Pan Pengfei Zhu Kaihua Zhang Bing Cao Yu Wang Dingwen Zhang Junwei Han Q. Hu 10 60 0 19 Mar 2022
Factorizer: A Scalable Interpretable Approach to Context Modeling for Medical Image Segmentation Pooya Ashtari Diana Sima L. De Lathauwer D. Sappey-Marinier F. Maes Sabine Van Huffel ViT MedIm 15 35 0 24 Feb 2022
On Training Implicit Models Zhengyang Geng Xinyu Zhang Shaojie Bai Yisen Wang Zhouchen Lin 56 69 0 09 Nov 2021
VQ-GNN: A Universal Framework to Scale up Graph Neural Networks using Vector Quantization Mucong Ding Kezhi Kong Jingling Li Chen Zhu John P. Dickerson Furong Huang Tom Goldstein GNN MQ 25 46 0 27 Oct 2021
Beyond Self-attention: External Attention using Two Linear Layers for Visual Tasks Meng-Hao Guo Zheng-Ning Liu Tai-Jiang Mu Shimin Hu 10 467 0 05 May 2021
JFB: Jacobian-Free Backpropagation for Implicit Networks Samy Wu Fung Howard Heaton Qiuwei Li Daniel McKenzie Stanley Osher W. Yin FedML 25 83 0 23 Mar 2021
Video Transformer Network Daniel Neimark Omri Bar Maya Zohar Dotan Asselmann ViT 193 419 0 01 Feb 2021
Spatial Pyramid Based Graph Reasoning for Semantic Segmentation Xia Li Yibo Yang Qijie Zhao Tiancheng Shen Zhouchen Lin Hong Liu SSeg GNN 102 161 0 23 Mar 2020
Graph-Based Global Reasoning Networks Yunpeng Chen Marcus Rohrbach Zhicheng Yan Shuicheng Yan Jiashi Feng Yannis Kalantidis GNN NAI 249 453 0 30 Nov 2018
A Decomposable Attention Model for Natural Language Inference Ankur P. Parikh Oscar Täckström Dipanjan Das Jakob Uszkoreit 190 1,358 0 06 Jun 2016
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 214 7,687 0 17 Aug 2015