Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2105.08050
Cited By
v1
v2 (latest)
Pay Attention to MLPs
Neural Information Processing Systems (NeurIPS), 2021
17 May 2021
Hanxiao Liu
Zihang Dai
David R. So
Quoc V. Le
AI4CE
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Pay Attention to MLPs"
50 / 323 papers shown
Enhancing Targeted Attack Transferability via Diversified Weight Pruning
Hung-Jui Wang
Yuehua Wu
Shang-Tse Chen
AAML
277
2
0
18 Aug 2022
giMLPs: Gate with Inhibition Mechanism in MLPs
Cheng Kang
Jindich Prokop
Lei Tong
Huiyu Zhou
Yong Hu
Daneil Novak
163
0
0
01 Aug 2022
Doubly Deformable Aggregation of Covariance Matrices for Few-shot Segmentation
European Conference on Computer Vision (ECCV), 2022
Zhitong Xiong
Haopeng Li
Xiao Xiang Zhu
165
42
0
30 Jul 2022
HorNet: Efficient High-Order Spatial Interactions with Recursive Gated Convolutions
Neural Information Processing Systems (NeurIPS), 2022
Yongming Rao
Wenliang Zhao
Yansong Tang
Jie Zhou
Ser-Nam Lim
Jiwen Lu
ViT
405
332
0
28 Jul 2022
TINYCD: A (Not So) Deep Learning Model For Change Detection
Andrea Codegoni
G. Lombardi
Alessandro Ferrari
231
110
0
26 Jul 2022
SplitMixer: Fat Trimmed From MLP-like Models
Ali Borji
Sikun Lin
188
3
0
21 Jul 2022
Assaying Out-Of-Distribution Generalization in Transfer Learning
Neural Information Processing Systems (NeurIPS), 2022
F. Wenzel
Andrea Dittadi
Peter V. Gehler
Carl-Johann Simon-Gabriel
Max Horn
...
Chris Russell
Thomas Brox
Bernt Schiele
Bernhard Schölkopf
Francesco Locatello
OOD
OODD
AAML
392
85
0
19 Jul 2022
Research Trends and Applications of Data Augmentation Algorithms
João Fonseca
F. Bação
206
7
0
18 Jul 2022
MLP-GAN for Brain Vessel Image Segmentation
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2022
B. Xie
Hao Tang
Bin Duan
Dawen Cai
Yan Yan
MedIm
267
2
0
17 Jul 2022
Parameterization of Cross-Token Relations with Relative Positional Encoding for Vision MLP
ACM Multimedia (ACM MM), 2022
Zhicai Wang
Y. Hao
Xingyu Gao
Hao Zhang
Shuo Wang
Tingting Mu
Xiangnan He
196
8
0
15 Jul 2022
Trans4Map: Revisiting Holistic Bird's-Eye-View Mapping from Egocentric Images to Allocentric Semantics with Vision Transformers
IEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2022
Chang Chen
Kailai Li
Kailun Yang
Kunyu Peng
Rainer Stiefelhagen
ViT
160
8
0
13 Jul 2022
Image and Model Transformation with Secret Key for Vision Transformer
Hitoshi Kiya
Ryota Iijima
Maungmaung Aprilpyone
Yuma Kinoshita
ViT
157
25
0
12 Jul 2022
Branchformer: Parallel MLP-Attention Architectures to Capture Local and Global Context for Speech Recognition and Understanding
International Conference on Machine Learning (ICML), 2022
Yifan Peng
Siddharth Dalmia
Ian Lane
Shinji Watanabe
271
191
0
06 Jul 2022
CoBEVT: Cooperative Bird's Eye View Semantic Segmentation with Sparse Transformers
Conference on Robot Learning (CoRL), 2022
Runsheng Xu
Zhengzhong Tu
Hao Xiang
Wei Shao
Bolei Zhou
Jiaqi Ma
422
310
0
05 Jul 2022
Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structures
Tianze Zhang
Yizhuo Zhang
Wei Cao
Jiang Bian
Xiaohan Yi
Shun Zheng
Jian Li
BDL
AI4TS
343
247
0
04 Jul 2022
Golfer: Trajectory Prediction with Masked Goal Conditioning MnM Network
Xiaocheng Tang
S. S. Eshkevari
Haoyu Chen
Wei Wu
Wei Qian
Xiaoming Wang
118
7
0
02 Jul 2022
QbyE-MLPMixer: Query-by-Example Open-Vocabulary Keyword Spotting using MLPMixer
Interspeech (Interspeech), 2022
Jinmiao Huang
W. Gharbieh
Qianhui Wan
Han Suk Shim
Chul Lee
114
11
0
23 Jun 2022
Time Gated Convolutional Neural Networks for Crop Classification
Longlong Weng
Yashu Kang
Kezhao Jiang
Chun-Tse Chen
138
2
0
20 Jun 2022
Pre-training Vision Transformers with Formula-driven Supervised Learning
Computer Vision and Pattern Recognition (CVPR), 2022
Hirokatsu Kataoka
Ryo Hayamizu
Ryosuke Yamada
Kodai Nakashima
Sora Takashima
Xinyu Zhang
Edgar Josafat Martinez-Noriega
Nakamasa Inoue
Rio Yokota
131
32
0
18 Jun 2022
GraphMLP: A Graph MLP-Like Architecture for 3D Human Pose Estimation
Pattern Recognition (Pattern Recogn.), 2022
Shuheng Zhou
Hong Liu
Tianyu Guo
Runwei Ding
Haoling Tang
3DH
433
64
0
13 Jun 2022
IL-MCAM: An interactive learning and multi-channel attention mechanism-based weakly supervised colorectal histopathology image classification approach
Hao Chen
Chen Li
Xirong Li
M. Rahaman
Weiming Hu
...
Wanli Liu
Changhao Sun
Hongzan Sun
Xinyu Huang
M. Grzegorzek
HAI
157
117
0
07 Jun 2022
MDMLP: Image Classification from Scratch on Small Datasets with MLP
Tianxu Lv
Chongyang Bai
Chaojie Wang
171
7
0
28 May 2022
A Unified Weight Initialization Paradigm for Tensorial Convolutional Neural Networks
International Conference on Machine Learning (ICML), 2022
Yu Pan
Zeyong Su
Ao Liu
Jingquan Wang
Nannan Li
Zenglin Xu
169
14
0
28 May 2022
Transformers from an Optimization Perspective
Neural Information Processing Systems (NeurIPS), 2022
Yongyi Yang
Zengfeng Huang
David Wipf
174
34
0
27 May 2022
AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognition
Neural Information Processing Systems (NeurIPS), 2022
Shoufa Chen
Chongjian Ge
Zhan Tong
Jiangliu Wang
Yibing Song
Jue Wang
Ping Luo
616
932
0
26 May 2022
Augmentation-induced Consistency Regularization for Classification
IEEE International Joint Conference on Neural Network (IJCNN), 2022
Jianguo Wu
Shijing Si
Jianzong Wang
Jing Xiao
223
2
0
25 May 2022
Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022
James Lee-Thorp
Joshua Ainslie
MoE
220
13
0
24 May 2022
Are Message Passing Neural Networks Really Helpful for Knowledge Graph Completion?
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
Juanhui Li
Harry Shomer
Jiayu Ding
Yiqi Wang
Yao Ma
Neil Shah
Shucheng Zhou
D. Yin
247
15
0
21 May 2022
Unraveling Attention via Convex Duality: Analysis and Interpretations of Vision Transformers
International Conference on Machine Learning (ICML), 2022
Arda Sahiner
Tolga Ergen
Batu Mehmet Ozturkler
John M. Pauly
Morteza Mardani
Mert Pilanci
311
36
0
17 May 2022
Sequencer: Deep LSTM for Image Classification
Neural Information Processing Systems (NeurIPS), 2022
Yuki Tatsunami
Masato Taki
VLM
ViT
341
109
0
04 May 2022
Improving Multimodal Speech Recognition by Data Augmentation and Speech Representations
Dan Oneaţă
H. Cucu
118
24
0
27 Apr 2022
GPUNet: Searching the Deployable Convolution Neural Networks for GPUs
Computer Vision and Pattern Recognition (CVPR), 2022
Linnan Wang
Chenhan D. Yu
Satish Salian
Slawomir Kierat
Szymon Migacz
A. Fit-Florea
134
12
0
26 Apr 2022
Application of Transfer Learning and Ensemble Learning in Image-level Classification for Breast Histopathology
Intelligent Medicine (IM), 2022
Yuchao Zheng
Chen Li
Xiaomin Zhou
Hao Chen
Hao Xu
...
Haiqing Zhang
Xirong Li
Hongzan Sun
Xinyu Huang
M. Grzegorzek
201
69
0
18 Apr 2022
Speech Emotion Recognition with Global-Aware Fusion on Multi-scale Feature Representation
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2022
Wenjing Zhu
Xiang Li
102
52
0
12 Apr 2022
The PartialSpoof Database and Countermeasures for the Detection of Short Fake Speech Segments Embedded in an Utterance
IEEE/ACM Transactions on Audio Speech and Language Processing (TASLP), 2022
Lin Zhang
Xin Wang
Erica Cooper
Nicholas W. D. Evans
Junichi Yamagishi
317
86
0
11 Apr 2022
Are We Really Making Much Progress in Text Classification? A Comparative Review
Lukas Galke
Andor Diera
Bao Xin Lin
Bhakti Khera
Tim Meuser
Tushar Singhal
Fabian Karl
A. Scherp
VLM
369
16
0
08 Apr 2022
DaViT: Dual Attention Vision Transformers
European Conference on Computer Vision (ECCV), 2022
Mingyu Ding
Bin Xiao
Noel Codella
Ping Luo
Jingdong Wang
Lu Yuan
ViT
374
343
0
07 Apr 2022
MaxViT: Multi-Axis Vision Transformer
European Conference on Computer Vision (ECCV), 2022
Zhengzhong Tu
Hossein Talebi
Han Zhang
Feng Yang
P. Milanfar
A. Bovik
Yinxiao Li
ViT
487
887
0
04 Apr 2022
InstaFormer: Instance-Aware Image-to-Image Translation with Transformer
Computer Vision and Pattern Recognition (CVPR), 2022
Soohyun Kim
Jongbeom Baek
Jihye Park
Gyeongnyeon Kim
Seung Wook Kim
ViT
307
59
0
30 Mar 2022
Brain-inspired Multilayer Perceptron with Spiking Neurons
Computer Vision and Pattern Recognition (CVPR), 2022
Wenshuo Li
Hanting Chen
Jianyuan Guo
Ziyang Zhang
Yunhe Wang
165
40
0
28 Mar 2022
FAMLP: A Frequency-Aware MLP-Like Architecture For Domain Generalization
Kecheng Zheng
Yang Cao
Kai Zhu
Ruijing Zhao
Zhengjun Zha
181
10
0
24 Mar 2022
Focal Modulation Networks
Neural Information Processing Systems (NeurIPS), 2022
Jianwei Yang
Chunyuan Li
Xiyang Dai
Lu Yuan
Jianfeng Gao
3DPC
343
383
0
22 Mar 2022
Three things everyone should know about Vision Transformers
European Conference on Computer Vision (ECCV), 2022
Hugo Touvron
Matthieu Cord
Alaaeldin El-Nouby
Jakob Verbeek
Edouard Grave
ViT
237
154
0
18 Mar 2022
On the Properties of Adversarially-Trained CNNs
Mattia Carletti
M. Terzi
Gian Antonio Susto
AAML
156
1
0
17 Mar 2022
Learning Audio Representations with MLPs
Mashrur M. Morshed
Ahmad Omar Ahsan
H. Mahmud
Md. Kamrul Hasan
187
4
0
16 Mar 2022
Self-Promoted Supervision for Few-Shot Transformer
European Conference on Computer Vision (ECCV), 2022
Bowen Dong
Pan Zhou
Shuicheng Yan
W. Zuo
ViT
179
51
0
14 Mar 2022
Efficient Language Modeling with Sparse all-MLP
Ping Yu
Mikel Artetxe
Myle Ott
Sam Shleifer
Hongyu Gong
Ves Stoyanov
Xian Li
MoE
184
15
0
14 Mar 2022
Contrastive Learning for Automotive mmWave Radar Detection Points Based Instance Segmentation
Weiyi Xiong
Tao Huang
Yu Xia
Wei Chen
Bing Zhu
Wei Xiang
273
24
0
13 Mar 2022
HyperMixer: An MLP-based Low Cost Alternative to Transformers
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
Florian Mai
Arnaud Pannatier
Fabio Fehr
Haolin Chen
François Marelli
François Fleuret
James Henderson
358
13
0
07 Mar 2022
Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer
Greg Yang
J. E. Hu
Igor Babuschkin
Szymon Sidor
Xiaodong Liu
David Farhi
Nick Ryder
J. Pachocki
Weizhu Chen
Jianfeng Gao
365
223
0
07 Mar 2022
Previous
1
2
3
4
5
6
7
Next
