Reversible Vision Transformers

Computer Vision and Pattern Recognition (CVPR), 2022

9 February 2023

Christoph Feichtenhofer

Jitendra Malik

ViT

ArXiv (abs)PDF HTML Github (6964★)

Papers citing "Reversible Vision Transformers"

32 / 32 papers shown

Title
Reversing Large Language Models for Efficient Training and Fine-Tuning Eshed Gal Moshe Eliasof Javier S. Turek Uri M. Ascher Eran Treister Eldad Haber 24 0 0 27 Nov 2025
DeepRFTv2: Kernel-level Learning for Image Deblurring Xintian Mao Haofei Song Y. Liu Qingli Li Yan Wang 196 0 0 26 Nov 2025
On Surjectivity of Neural Networks: Can you elicit any behavior from your model? Haozhe Jiang Nika Haghtalab 160 2 0 26 Aug 2025
Active Inference AI Systems for Scientific Discovery Karthik Duraisamy AI4CE LRM 411 1 0 26 Jun 2025
Scalable Meta-Learning via Mixed-Mode Differentiation Iurii Kemaev Dan A. Calian Luisa M. Zintgraf Gregory Farquhar H. V. Hasselt 249 2 0 01 May 2025
A Semantic-Enhanced Heterogeneous Graph Learning Method for Flexible Objects Recognition Kunshan Yang Tonglan Xie Yuguo Hu Jiafu Yan Mengmeng Jing Yongqi Ding 180 1 0 28 Mar 2025
Stochastic Communication Avoidance for Recommendation Systems Lutfi Eren Erdogan Vijay Anand Raghava Kanakagiri Kurt Keutzer Zhen Dong 221 1 0 03 Nov 2024
Token Turing Machines are Efficient Vision ModelsIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2024 Purvish Jajal Nick Eliopoulos Benjamin Shiue-Hal Chou George K. Thiravathukal James C. Davis Yung-Hsiang Lu 325 2 0 11 Sep 2024
Safetywashing: Do AI Safety Benchmarks Actually Measure Safety Progress? Richard Ren Steven Basart Adam Khoja Alice Gatti Long Phan ... Alexander Pan Gabriel Mukobi Ryan H. Kim Stephen Fitz Dan Hendrycks ELM 265 46 0 31 Jul 2024
This Probably Looks Exactly Like That: An Invertible Prototypical Network Zachariah Carmichael Timothy Redgrave Daniel Gonzalez Cedre Walter J. Scheirer BDL 313 5 0 16 Jul 2024
On Exact Bit-level Reversible Transformers Without Changing Architectures Guoqiang Zhang J. P. Lewis W. Kleijn MQ AI4CE 209 1 0 12 Jul 2024
SHERL: Synthesizing High Accuracy and Efficient Memory for Resource-Limited Transfer Learning Haiwen Diao Bo Wan Xu Jia Yunzhi Zhuge Ying Zhang Huchuan Lu Long Chen VLM 231 11 0 10 Jul 2024
AdaRevD: Adaptive Patch Exiting Reversible Decoder Pushes the Limit of Image Deblurring Xintian Mao Qingli Li Yan Wang 244 35 0 13 Jun 2024
PETRA: Parallel End-to-end Training with Reversible Architectures Stéphane Rivaud Louis Fournier Thomas Pumir Eugene Belilovsky Michael Eickenberg Edouard Oyallon 351 3 0 04 Jun 2024
High-Performance Temporal Reversible Spiking Neural Networks with $O(L)$ Training Memory and $O(1)$ Inference Cost Jiakui Hu Man Yao Xuerui Qiu Yuhong Chou Yuxuan Cai Ning Qiao Yonghong Tian Boxing Xu Guoqi Li AI4CE 214 20 0 26 May 2024
Data-independent Module-aware Pruning for Hierarchical Vision Transformers Yang He Qiufeng Wang ViT 211 7 0 21 Apr 2024
Invertible Diffusion Models for Compressed Sensing Bin Chen Ying Tai Weiqi Li Chen Zhao Jiwen Yu Shijie Zhao Jie Chen Jian Zhang DiffM 400 12 0 25 Mar 2024
Training Neural Networks from Scratch with Parallel Low-Rank Adapters Minyoung Huh Brian Cheung Jeremy Bernstein Phillip Isola Pulkit Agrawal 250 15 0 26 Feb 2024
Moonwalk: Inverse-Forward Differentiation Dmitrii Krylov Armin Karamzade Roy Fox 137 1 0 22 Feb 2024
Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data Shufan Li Harkanwar Singh Aditya Grover Mamba 443 101 0 08 Feb 2024
Dr $^2$ Net: Dynamic Reversible Dual-Residual Networks for Memory-Efficient FinetuningComputer Vision and Pattern Recognition (CVPR), 2024 Chen Zhao Shuming Liu K. Mangalam Guocheng Qian Fatimah Zohra Abdulmohsen Alghannam Jitendra Malik Guohao Li 221 8 0 08 Jan 2024
Training a Large Video Model on a Single Machine in a Day Yue Zhao Philipp Krahenbuhl VLM 261 22 0 28 Sep 2023
UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and MemoryComputer Vision and Pattern Recognition (CVPR), 2023 Haiwen Diao Bo Wan Yanzhe Zhang Xuecong Jia Huchuan Lu Long Chen VLM 205 27 0 28 Aug 2023
Towards Zero Memory Footprint Spiking Neural Network Training Bin Lei Sheng Lin Pei-Hung Lin C. Liao Caiwen Ding 239 0 0 16 Aug 2023
PaReprop: Fast Parallelized Reversible Backpropagation Tyler Lixuan Zhu K. Mangalam 214 2 0 15 Jun 2023
Make Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-TuningNeural Information Processing Systems (NeurIPS), 2023 Baohao Liao Shaomu Tan Christof Monz KELM 330 32 0 01 Jun 2023
Leaping Into Memories: Space-Time Deep Feature SynthesisIEEE International Conference on Computer Vision (ICCV), 2023 Alexandros Stergiou Nikos Deligiannis 179 0 0 17 Mar 2023
Skip-Attention: Improving Vision Transformers by Paying Less AttentionInternational Conference on Learning Representations (ICLR), 2023 Shashanka Venkataramanan Amir Ghodrati Yuki M. Asano Fatih Porikli A. Habibian ViT 216 37 0 05 Jan 2023
Reversible Column NetworksInternational Conference on Learning Representations (ICLR), 2022 Yuxuan Cai Yi Zhou Qi Han Jianjian Sun Xiangwen Kong Jun Yu Li Xiangyu Zhang VLM 254 87 0 22 Dec 2022
Re^2TAL: Rewiring Pretrained Video Backbones for Reversible Temporal Action LocalizationComputer Vision and Pattern Recognition (CVPR), 2022 Chen Zhao Shuming Liu K. Mangalam Guohao Li 266 27 0 25 Nov 2022
COPILOT: Human-Environment Collision Prediction and Localization from Egocentric VideosIEEE International Conference on Computer Vision (ICCV), 2022 Boxiao Pan Bokui Shen Davis Rempe Despoina Paschalidou Kaichun Mo Yanchao Yang Leonidas Guibas 140 3 0 04 Oct 2022
LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer LearningNeural Information Processing Systems (NeurIPS), 2022 Yi-Lin Sung Jaemin Cho Joey Tianyi Zhou VLM 308 291 0 13 Jun 2022