v1v2 (latest)

Pay Attention to MLPs

Neural Information Processing Systems (NeurIPS), 2021

17 May 2021

Papers citing "Pay Attention to MLPs"

50 / 323 papers shown

Title
Coarse-to-Fine Proposal Refinement Framework for Audio Temporal Forgery Detection and Localization Junyan Wu Wei Lu Xiangyang Luo Rui Yang Qian Wang Xiaochun Cao 217 11 0 23 Jul 2024
XTraffic: A Dataset Where Traffic Meets Incidents with Explainability and More Xiaochuan Gou Ziyue Li Tian-Shing Lan Junpeng Lin Zhishuai Li Bingyu Zhao Chen Zhang Haiyan Zhao Xiangliang Zhang AI4TS 188 1 0 16 Jul 2024
Team up GBDTs and DNNs: Advancing Efficient and Effective Tabular Prediction with Tree-hybrid MLPs Jiahuan Yan Jintai Chen Qianxing Wang Benlin Liu Jian Wu 208 6 0 13 Jul 2024
Lite-SAM Is Actually What You Need for Segment Everything Jianhai Fu Yuanjie Yu Ningchuan Li Yi Zhang Qichao Chen Jianping Xiong Jun Yin Zhiyu Xiang VLM 221 5 0 12 Jul 2024
Latent Space Imaging Matheus Souza Yidan Zheng Kaizhang Kang Yogeshwar Nath Mishra Qiang Fu Wolfgang Heidrich 312 1 0 09 Jul 2024
FunOTTA: On-the-Fly Adaptation on Cross-Domain Fundus Image via Stable Test-time TrainingIEEE Transactions on Medical Imaging (IEEE TMI), 2024 Qian Zeng Le Zhang Yipeng Liu Ce Zhu Fan Zhang OOD MedIm 309 2 0 05 Jul 2024
Multi-Convformer: Extending Conformer with Multiple Convolution Kernels Darshan Prabhu Yifan Peng Preethi Jyothi Shinji Watanabe 230 4 0 04 Jul 2024
PosMLP-Video: Spatial and Temporal Relative Position Encoding for Efficient Video Recognition Y. Hao Diansong Zhou Zhicai Wang Chong-Wah Ngo Meng Wang ViT 226 11 0 03 Jul 2024
Multimodal Multilabel Classification by CLIP Yanming Guo VLM 144 1 0 23 Jun 2024
Graph Edge Representation via Tensor Product Graph Convolutional Representation Bo Jiang Sheng Ge Ziyan Zhang Beibei Wang Jin Tang Bin Luo GNN 212 0 0 21 Jun 2024
Molecule Graph Networks with Many-body Equivariant InteractionsJournal of Chemical Theory and Computation (JCTC), 2024 Zetian Mao Jiawen Li Chen Liang Chen Liang Diptesh Das Masato Sumita Kelin Xia Koji Tsuda 314 3 0 19 Jun 2024
SMRU: Split-and-Merge Recurrent-based UNet for Acoustic Echo Cancellation and Noise Suppression Zhihang Sun Andong Li Rilin Chen Hao Zhang Meng Yu Yi Zhou Dong Yu 278 3 0 17 Jun 2024
Spoof Diarization: "What Spoofed When" in Partially Spoofed Audio Lin Zhang Xin Wang Erica Cooper Mireia Díez Federico Landini Nicholas W. D. Evans Junichi Yamagishi 135 3 0 12 Jun 2024
How Do Neural Spoofing Countermeasures Detect Partially Spoofed Audio? Tianchi Liu Lin Zhang Rohan Kumar Das Yi Ma Ruijie Tao Haizhou Li 192 18 0 04 Jun 2024
Correlation-aware Coarse-to-fine MLPs for Deformable Medical Image Registration Mingyuan Meng Da-wei Feng Lei Bi Jinman Kim ViT MedIm 324 42 0 31 May 2024
SFANet: Spatial-Frequency Attention Network for Weather Forecasting Jiaze Wang Hao Chen Hongcan Xu Jinpeng Li Bo-Lan Wang Youssef Attia El Hili Furui Liu Huaxi Chen Guangyong Chen Pheng-Ann Heng 181 2 0 29 May 2024
Aligning in a Compact Space: Contrastive Knowledge Distillation between Heterogeneous Architectures Hongjun Wu Li Xiao Xingkuo Zhang Yining Miao 288 2 0 28 May 2024
ViG: Linear-complexity Visual Sequence Learning with Gated Linear Attention Bencheng Liao Xinggang Wang Lianghui Zhu Qian Zhang Chang Huang 287 8 0 28 May 2024
Various Lengths, Constant Speed: Efficient Language Modeling with Lightning Attention Zhen Qin Weigao Sun Dong Li Xuyang Shen Weixuan Sun Yiran Zhong 231 22 0 27 May 2024
Lateralization MLP: A Simple Brain-inspired Architecture for Diffusion Zizhao Hu Mohammad Rostami 203 0 0 25 May 2024
Scaling Law for Time Series Forecasting Jingzhe Shi Qinwei Ma Huan Ma Lei Li AI4TS 303 20 0 24 May 2024
Activator: GLU Activation Function as the Core Component of a Vision Transformer Abdullah Nazhat Abdullah Tarkan Aydin ViT 284 0 0 24 May 2024
Dielectric Tensor Prediction for Inorganic Materials Using Latent Information from Preferred Potentialnpj Computational Materials (npj Comput. Mater.), 2024 Zetian Mao Wenwen Li Jethro Tan 139 6 0 15 May 2024
Pruning as a Domain-specific LLM Extractor Nan Zhang Yanchi Liu Xujiang Zhao Wei Cheng Runxue Bao Rui Zhang Prasenjit Mitra Haifeng Chen 157 19 0 10 May 2024
An Advanced Features Extraction Module for Remote Sensing Image Super-Resolution Naveed Sultan Amir Hajian S. Aramvith SupR 145 11 0 07 May 2024
Mamba-360: Survey of State Space Models as Transformer Alternative for Long Sequence Modelling: Methods, Applications, and Challenges Badri N. Patro Vijay Srinivas Agneeswaran Mamba 328 73 0 24 Apr 2024
ODMixer: Fine-grained Spatial-temporal MLP for Metro Origin-Destination Prediction Yang Liu Binglin Chen Yongsen Zheng Lechao Cheng Guanbin Li Liang Lin AI4TS 181 12 0 24 Apr 2024
CU-Mamba: Selective State Space Models with Channel Learning for Image Restoration Rui Deng Tianpei Gu Mamba 229 32 0 17 Apr 2024
HGRN2: Gated Linear RNNs with State Expansion Zhen Qin Aaron Courville Weixuan Sun Xuyang Shen Dong Li Weigao Sun Yiran Zhong LRM 316 85 0 11 Apr 2024
SpiralMLP: A Lightweight Vision MLP Architecture Haojie Mu Burhan Ul Tayyab Nicholas Chua 196 1 0 31 Mar 2024
A Survey on Large Language Models from Concept to Implementation Chen Wang Jin Zhao Jiaqi Gong LLMAG LM&MA 367 7 0 27 Mar 2024
Heracles: A Hybrid SSM-Transformer Model for High-Resolution Image and Time-Series Analysis Badri N. Patro Suhas Ranganath Vinay P. Namboodiri Vijay Srinivas Agneeswaran 263 4 0 26 Mar 2024
Fully-fused Multi-Layer Perceptrons on Intel Data Center GPUs Kai Yuan Christoph Bauinger Xiangyi Zhang Pascal Baehr Matthias Kirchhart Darius Dabert Adrien Tousnakhoff Pierre Boudier Michael Paulitsch 148 3 0 26 Mar 2024
Incorporating Exponential Smoothing into MLP: A Simple but Effective Sequence Model Jiqun Chu Zuoquan Lin AI4TS 200 2 0 26 Mar 2024
Neural Clustering based Visual Representation Learning Guikun Chen Xia Li Yi Yang Wenguan Wang SSL 290 14 0 26 Mar 2024
State Space Models as Foundation Models: A Control Theoretic Overview Carmen Amo Alonso Jerome Sieber Melanie Zeilinger AI4CE Mamba 179 20 0 25 Mar 2024
A Comparison of Deep Learning Architectures for Spacecraft Anomaly Detection Daniel Lakey Tim Schlippe 242 8 0 19 Mar 2024
depyf: Open the Opaque Box of PyTorch Compiler for Machine Learning Researchers Kaichao You Runsheng Bai Meng Cao Jianmin Wang Ion Stoica Mingsheng Long VLM 204 0 0 14 Mar 2024
NiNformer: A Network in Network Transformer with Token Mixing Generated Gating Function Abdullah Nazhat Abdullah Tarkan Aydin 400 0 0 04 Mar 2024
Accelerating Greedy Coordinate Gradient via Probe Sampling Yiran Zhao Wenyue Zheng Tianle Cai Xuan Long Do Kenji Kawaguchi Anirudh Goyal Michael Shieh 257 2 0 02 Mar 2024
Mixer is more than just a model Qingfeng Ji Yuxin Wang Letong Sun 160 0 0 28 Feb 2024
Learning to See Through Dazzle Xiaopeng Peng Erin F. Fleet A. Watnik Grover A. Swartzlander GAN AAML 249 6 0 24 Feb 2024
IRConStyle: Image Restoration Framework Using Contrastive Learning and Style Transfer Dongqi Fan Xin Zhao Liang Chang 209 1 0 24 Feb 2024
FViT: A Focal Vision Transformer with Gabor Filter Yulong Shi Mingwei Sun Yongshuai Wang Rui Wang 429 8 0 17 Feb 2024
Few-Shot Learning with Uncertainty-based Quadruplet Selection for Interference Classification in GNSS Data Felix Ott Lucas Heublein Nisha Lakshmana Raichur Tobias Feigl Jonathan Hansen A. Rügamer Christopher Mutschler 303 11 0 09 Feb 2024
NOAH: Learning Pairwise Object Category Attentions for Image Classification Chao Li Aojun Zhou Anbang Yao VLM 206 2 0 04 Feb 2024
LIR: A Lightweight Baseline for Image Restoration Dongqi Fan Ting Yue Xin Zhao Renjing Xu Liang Chang 207 2 0 02 Feb 2024
Multilinear Operator Networks Yixin Cheng Grigorios G. Chrysos Markos Georgopoulos Volkan Cevher 260 10 0 31 Jan 2024
LOCOST: State-Space Models for Long Document Abstractive Summarization Florian Le Bronnec Song Duong Mathieu Ravaut Alexandre Allauzen Nancy F. Chen Vincent Guigue Alberto Lumbreras Laure Soulier Patrick Gallinari 384 14 0 31 Jan 2024
SegMamba: Long-range Sequential Modeling Mamba For 3D Medical Image SegmentationInternational Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2024 Zhaohu Xing Tian-Chun Ye Yijun Yang Guang Liu Lei Zhu Mamba 325 407 0 24 Jan 2024