Hire-MLP: Vision MLP via Hierarchical Rearrangement

30 August 2021

Papers citing "Hire-MLP: Vision MLP via Hierarchical Rearrangement"

50 / 66 papers shown

Title
Image Recognition with Online Lightweight Vision Transformer: A Survey Zherui Zhang Rongtao Xu Jie Zhou Changwei Wang Xingtian Pei ... Jiguang Zhang Li Guo Longxiang Gao W. Xu Shibiao Xu ViT 63 0 0 06 May 2025
Advancing Deformable Medical Image Registration with Multi-axis Cross-covariance Attention Mingyuan Meng M. Fulham Lei Bi Jinman Kim OOD ViT MedIm 27 0 0 24 Dec 2024
Towards Better Multi-head Attention via Channel-wise Sample Permutation Shen Yuan Hongteng Xu 17 1 0 14 Oct 2024
Investigation of Hierarchical Spectral Vision Transformer Architecture for Classification of Hyperspectral Imagery Wei Liu Saurabh Prasad Melba M. Crawford 30 3 0 14 Sep 2024
Hierarchical Network Fusion for Multi-Modal Electron Micrograph Representation Learning with Foundational Large Language Models Sakhinana Sagar Srinivas Geethan Sannidhi Venkataramana Runkana 30 0 0 24 Aug 2024
Team up GBDTs and DNNs: Advancing Efficient and Effective Tabular Prediction with Tree-hybrid MLPs Jiahuan Yan Jintai Chen Qianxing Wang D. Z. Chen Jian Wu 24 3 0 13 Jul 2024
ISWSST: Index-space-wave State Superposition Transformers for Multispectral Remotely Sensed Imagery Semantic Segmentation Chang Li Pengfei Zhang Yu Wang 25 0 0 03 Jul 2024
GeminiFusion: Efficient Pixel-wise Multimodal Fusion for Vision Transformer Ding Jia Jianyuan Guo Kai Han Han Wu Chao Zhang Chang Xu Xinghao Chen ViT 40 15 0 03 Jun 2024
Correlation-aware Coarse-to-fine MLPs for Deformable Medical Image Registration Mingyuan Meng Da-wei Feng Lei Bi Jinman Kim ViT MedIm 28 16 0 31 May 2024
SpiralMLP: A Lightweight Vision MLP Architecture Haojie Mu Burhan Ul Tayyab Nicholas Chua 32 0 0 31 Mar 2024
Heracles: A Hybrid SSM-Transformer Model for High-Resolution Image and Time-Series Analysis Badri N. Patro Suhas Ranganath Vinay P. Namboodiri Vijay Srinivas Agneeswaran 43 2 0 26 Mar 2024
Neural Clustering based Visual Representation Learning Guikun Chen Xia Li Yi Yang Wenguan Wang SSL 27 8 0 26 Mar 2024
A Survey on Transformer Compression Yehui Tang Yunhe Wang Jianyuan Guo Zhijun Tu Kai Han Hailin Hu Dacheng Tao 29 27 0 05 Feb 2024
Multilinear Operator Networks Yixin Cheng Grigorios G. Chrysos Markos Georgopoulos V. Cevher 16 7 0 31 Jan 2024
PanGu- $π$ : Enhancing Language Model Architectures via Nonlinearity Compensation Yunhe Wang Hanting Chen Yehui Tang Tianyu Guo Kai Han ... Qinghua Xu Qun Liu Jun Yao Chao Xu Dacheng Tao 59 15 0 27 Dec 2023
Dimension Mixer: A Generalized Method for Structured Sparsity in Deep Neural Networks Suman Sapkota Binod Bhattarai 29 0 0 30 Nov 2023
Full-resolution MLPs Empower Medical Dense Prediction Mingyuan Meng Yuxin Xue Da-wei Feng Lei Bi Jinman Kim MedIm 17 4 0 28 Nov 2023
Scattering Vision Transformer: Spectral Mixing Matters Badri N. Patro Vijay Srinivas Agneeswaran 21 14 0 02 Nov 2023
One-for-All: Bridge the Gap Between Heterogeneous Architectures in Knowledge Distillation Zhiwei Hao Jianyuan Guo Kai Han Yehui Tang Han Hu Yunhe Wang Chang Xu 36 55 0 30 Oct 2023
Dynamic Spectrum Mixer for Visual Recognition Zhiqiang Hu Tao Yu 16 3 0 13 Sep 2023
CS-Mixer: A Cross-Scale Vision MLP Model with Spatial-Channel Mixing Jianwei Cui David A. Araujo Suman Saha Md Faisal Kabir BDL 20 0 0 25 Aug 2023
Strip-MLP: Efficient Token Interaction for Vision MLP Guiping Cao Shengda Luo Wen-Fong Huang X. Lan D. Jiang Yaowei Wang Jianguo Zhang 23 10 0 21 Jul 2023
ParameterNet: Parameters Are All You Need Kai Han Yunhe Wang Jianyuan Guo Enhua Wu VLM AI4CE 6 22 0 26 Jun 2023
Scaling MLPs: A Tale of Inductive Bias Gregor Bachmann Sotiris Anagnostidis Thomas Hofmann 24 38 0 23 Jun 2023
TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecasting Vijayabharathi Ekambaram Arindam Jati Nam H. Nguyen Phanwadee Sinthong Jayant Kalagnanam AI4TS 29 131 0 14 Jun 2023
CVSNet: A Computer Implementation for Central Visual System of The Brain Ruimin Gao Hao-Li Zou Zhekai Duan 11 3 0 31 May 2023
Caterpillar: A Pure-MLP Architecture with Shifted-Pillars-Concatenation J. Sun Xiaoshuang Shi Zhiyuan Weng Kaidi Xu H. Shen Xiao-lan Zhu MLLM 17 2 0 28 May 2023
TriMLP: Revenge of a MLP-like Architecture in Sequential Recommendation Yiheng Jiang Yuanbo Xu Yongjian Yang Funing Yang Pengyang Wang Hui Xiong 12 2 0 24 May 2023
Transformer-Based Visual Segmentation: A Survey Xiangtai Li Henghui Ding Haobo Yuan Wenwei Zhang Jiangmiao Pang Guangliang Cheng Kai-xiang Chen Ziwei Liu Chen Change Loy ViT MedIm 37 132 0 19 Apr 2023
SpectFormer: Frequency and Attention is what you need in a Vision Transformer Badri N. Patro Vinay P. Namboodiri Vijay Srinivas Agneeswaran ViT 11 47 0 13 Apr 2023
MC-MLP:Multiple Coordinate Frames in all-MLP Architecture for Vision Zhimin Zhu Jianguo Zhao Tong Mu Yuliang Yang Mengyu Zhu 18 0 0 08 Apr 2023
Graph-Guided MLP-Mixer for Skeleton-Based Human Motion Prediction Xinshun Wang Qiongjie Cui Chen Chen Shen Zhao Mengyuan Liu 3DH 11 2 0 07 Apr 2023
Efficiency 360: Efficient Vision Transformers Badri N. Patro Vijay Srinivas Agneeswaran 19 6 0 16 Feb 2023
BiMLP: Compact Binary Architectures for Vision Multi-Layer Perceptrons Yixing Xu Xinghao Chen Yunhe Wang MQ 22 8 0 29 Dec 2022
BALF: Simple and Efficient Blur Aware Local Feature Detector Zhenjun Zhao Yuwei Zhai Ben Chen Peidong Liu 17 4 0 27 Nov 2022
Multi-Step Short-Term Wind Speed Prediction with Rank Pooling and Fast Fourier Transformation Hailong Shu 14 3 0 23 Nov 2022
gSwin: Gated MLP Vision Model with Hierarchical Structure of Shifted Window Mocho Go Hideyuki Tachibana ViT 16 9 0 24 Aug 2022
Improved Image Classification with Token Fusion Keong-Hun Choi Jin-Woo Kim Yaolong Wang J. Ha ViT 12 0 0 19 Aug 2022
Transformer Vs. MLP-Mixer: Exponential Expressive Gap For NLP Problems D. Navon A. Bronstein MoE 20 0 0 17 Aug 2022
CubeMLP: An MLP-based Model for Multimodal Sentiment Analysis and Depression Estimation Hao Sun Hongyi Wang Jiaqing Liu Yen-Wei Chen Lanfen Lin 11 95 0 28 Jul 2022
Parameterization of Cross-Token Relations with Relative Positional Encoding for Vision MLP Zhicai Wang Y. Hao Xingyu Gao Hao Zhang Shuo Wang Tingting Mu Xiangnan He 8 8 0 15 Jul 2022
SimA: Simple Softmax-free Attention for Vision Transformers Soroush Abbasi Koohpayegani Hamed Pirsiavash 14 24 0 17 Jun 2022
Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectives Jun Li Junyu Chen Yucheng Tang Ce Wang Bennett A. Landman S. K. Zhou ViT OOD MedIm 13 18 0 02 Jun 2022
Vision GNN: An Image is Worth Graph of Nodes Kai Han Yunhe Wang Jianyuan Guo Yehui Tang Enhua Wu GNN 3DH 7 350 0 01 Jun 2022
MDMLP: Image Classification from Scratch on Small Datasets with MLP Tianxu Lv Chongyang Bai Chaojie Wang 14 5 0 28 May 2022
Sequencer: Deep LSTM for Image Classification Yuki Tatsunami Masato Taki VLM ViT 13 77 0 04 May 2022
Brain-inspired Multilayer Perceptron with Spiking Neurons Wenshuo Li Hanting Chen Jianyuan Guo Ziyang Zhang Yunhe Wang 20 34 0 28 Mar 2022
Focal Modulation Networks Jianwei Yang Chunyuan Li Xiyang Dai Lu Yuan Jianfeng Gao 3DPC 22 261 0 22 Mar 2022
HyperMixer: An MLP-based Low Cost Alternative to Transformers Florian Mai Arnaud Pannatier Fabio Fehr Haolin Chen François Marelli F. Fleuret James Henderson 9 11 0 07 Mar 2022
Mixing and Shifting: Exploiting Global and Local Dependencies in Vision MLPs Huangjie Zheng Pengcheng He Weizhu Chen Mingyuan Zhou 8 14 0 14 Feb 2022