RIFormer: Keep Your Vision Backbone Effective While Removing Token Mixer

RIFormer: Keep Your Vision Backbone Effective While Removing Token Mixer

12 April 2023

Yong Liu

Yujiu Yang

Ping Luo

Papers citing "RIFormer: Keep Your Vision Backbone Effective While Removing Token Mixer"

15 / 15 papers shown

Title
Partial Convolution Meets Visual Attention Haiduo Huang Fuwei Yang D. Li Ji Liu Lu Tian Jinzhang Peng Pengju Ren E. Barsoum 3DH 148 0 0 05 Mar 2025
Fully Aligned Network for Referring Image Segmentation Yong-Jin Liu Ruihao Xu Yansong Tang 29 0 0 29 Sep 2024
LoCa: Logit Calibration for Knowledge Distillation Runming Yang Taiqiang Wu Yujiu Yang 38 0 0 07 Sep 2024
Hierarchical Associative Memory, Parallelized MLP-Mixer, and Symmetry Breaking Ryo Karakida Toshihiro Ota Masato Taki 27 2 0 18 Jun 2024
Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models Taiqiang Wu Chaofan Tao Jiahao Wang Zhe Zhao Ngai Wong ALM 46 14 0 03 Apr 2024
Infrared Small Target Detection with Scale and Location Sensitivity Qiankun Liu Rui Liu Bolun Zheng Hongkui Wang Ying Fu 35 23 0 28 Mar 2024
Dense Vision Transformer Compression with Few Samples Hanxiao Zhang Yifan Zhou Guo-Hua Wang Jianxin Wu ViT VLM 31 1 0 27 Mar 2024
Spike-driven Transformer V2: Meta Spiking Neural Network Architecture Inspiring the Design of Next-generation Neuromorphic Chips Man Yao Jiakui Hu Tianxiang Hu Yifan Xu Zhaokun Zhou Yonghong Tian Boxing Xu Guoqi Li 29 55 0 15 Feb 2024
A Survey on Transformer Compression Yehui Tang Yunhe Wang Jianyuan Guo Zhijun Tu Kai Han Hailin Hu Dacheng Tao 29 27 0 05 Feb 2024
Weight-Inherited Distillation for Task-Agnostic BERT Compression Taiqiang Wu Cheng-An Hou Shanshan Lao Jiayi Li Ngai Wong Zhe Zhao Yujiu Yang 60 10 0 16 May 2023
Conv2Former: A Simple Transformer-Style ConvNet for Visual Recognition Qibin Hou Cheng Lu Mingg-Ming Cheng Jiashi Feng ViT 23 129 0 22 Nov 2022
ResNet strikes back: An improved training procedure in timm Ross Wightman Hugo Touvron Hervé Jégou AI4TS 207 487 0 01 Oct 2021
MLP-Mixer: An all-MLP Architecture for Vision Ilya O. Tolstikhin N. Houlsby Alexander Kolesnikov Lucas Beyer Xiaohua Zhai ... Andreas Steiner Daniel Keysers Jakob Uszkoreit Mario Lucic Alexey Dosovitskiy 239 2,600 0 04 May 2021
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions Wenhai Wang Enze Xie Xiang Li Deng-Ping Fan Kaitao Song Ding Liang Tong Lu Ping Luo Ling Shao ViT 263 3,622 0 24 Feb 2021
RepVGG: Making VGG-style ConvNets Great Again Xiaohan Ding X. Zhang Ningning Ma Jungong Han Guiguang Ding Jian-jun Sun 122 1,544 0 11 Jan 2021