Fine-tuning Image Transformers using Learnable Memory

29 March 2022

Papers citing "Fine-tuning Image Transformers using Learnable Memory"

36 / 36 papers shown

Title
EDIT: Enhancing Vision Transformers by Mitigating Attention Sink through an Encoder-Decoder Architecture Wenfeng Feng Guoying Sun 26 0 0 09 Apr 2025
Transport-Related Surface Detection with Machine Learning: Analyzing Temporal Trends in Madrid and Vienna Miguel Ureña Pliego Rubén Martínez Marín Nianfang Shi Takeru Shibayama Ulrich Leth Miguel Marchamalo Sacristán 53 0 0 19 Mar 2025
A Unified View of Delta Parameter Editing in Post-Trained Large-Scale Models Qiaoyu Tang Le Yu Bowen Yu Hongyu Lin K. Lu Y. Lu Xianpei Han Le Sun MoMe 32 1 0 17 Oct 2024
Token Turing Machines are Efficient Vision Models Purvish Jajal Nick Eliopoulos Benjamin Shiue-Hal Chou George K. Thiravathukal James C. Davis Yung-Hsiang Lu 85 0 0 11 Sep 2024
Adaptive Query Prompting for Multi-Domain Landmark Detection Qiusen Wei Guoheng Huang Xiaochen Yuan Xuhang Chen Guo Zhong Jianwen Huang Jiajie Huang MedIm 25 2 0 01 Apr 2024
Medical Visual Prompting (MVP): A Unified Framework for Versatile and High-Quality Medical Image Segmentation Yulin Chen Guoheng Huang Kai Huang Zijin Lin Guo Zhong Shenghong Luo Jie Deng Jian Zhou MedIm 35 0 0 01 Apr 2024
Explicit Motion Handling and Interactive Prompting for Video Camouflaged Object Detection Xin Zhang Tao Xiao Gepeng Ji Xuan Wu Keren Fu Qijun Zhao 47 2 0 04 Mar 2024
Fine-tuning Reinforcement Learning Models is Secretly a Forgetting Mitigation Problem Maciej Wolczyk Bartłomiej Cupiał M. Ostaszewski Michal Bortkiewicz Michal Zajkac Razvan Pascanu Lukasz Kuciñski Piotr Milo's CLL 46 13 0 05 Feb 2024
Evaluating LLM -- Generated Multimodal Diagnosis from Medical Images and Symptom Analysis Dimitrios P. Panagoulias M. Virvou G. Tsihrintzis LM&MA 34 21 0 28 Jan 2024
Spectral Prompt Tuning:Unveiling Unseen Classes for Zero-Shot Semantic Segmentation Wenhao Xu Rongtao Xu Changwei Wang Shibiao Xu Li Guo Man Zhang Xiaopeng Zhang VLM 28 10 0 20 Dec 2023
Adaptive Human Trajectory Prediction via Latent Corridors Neerja Thakkar K. Mangalam Andrea V. Bajcsy Jitendra Malik 20 4 0 11 Dec 2023
LT-ViT: A Vision Transformer for multi-label Chest X-ray classification Umar Marikkar Sara Atito Muhammad Awais Adam Mahdi MedIm ViT 35 8 0 13 Nov 2023
TSP-Transformer: Task-Specific Prompts Boosted Transformer for Holistic Scene Understanding Shuo Wang Jing Li Zibo Zhao Dongze Lian Binbin Huang Xiaomei Wang Zhengxin Li Shenghua Gao 22 4 0 06 Nov 2023
Heterogenous Memory Augmented Neural Networks Zihan Qiu Zhen Liu Shuicheng Yan Shanghang Zhang Jie Fu 13 0 0 17 Oct 2023
Interpreting and Controlling Vision Foundation Models via Text Explanations Haozhe Chen Junfeng Yang Carl Vondrick Chengzhi Mao 16 2 0 16 Oct 2023
DiffPrompter: Differentiable Implicit Visual Prompts for Semantic-Segmentation in Adverse Conditions Sanket Kalwar Mihir Ungarala Shruti Jain Aaron Monis Krishna Reddy Konda Sourav Garg K. M. Krishna VLM 23 0 0 06 Oct 2023
Vision Transformers Need Registers Zilong Chen Maxime Oquab Julien Mairal Huaping Liu ViT 37 311 0 28 Sep 2023
Hydra: Multi-head Low-rank Adaptation for Parameter Efficient Fine-tuning Sanghyeon Kim Hyunmo Yang Younghyun Kim Youngjoon Hong Eunbyung Park AI4CE 18 16 0 13 Sep 2023
FashionNTM: Multi-turn Fashion Image Retrieval via Cascaded Memory Anwesan Pal Sahil Wadhwa Ayush Jaiswal Xu Zhang Yue Wu Rakesh Chada P. Natarajan Henrik I. Christensen 10 5 0 20 Aug 2023
PM-DETR: Domain Adaptive Prompt Memory for Object Detection with Transformers Peidong Jia Jiaming Liu Senqiao Yang Jiarui Wu Xiaodong Xie Shanghang Zhang VLM 37 2 0 01 Jul 2023
Explicit Visual Prompting for Universal Foreground Segmentations Weihuang Liu Xi Shen Chi-Man Pun Xiaodong Cun VPVLM VLM 22 14 0 29 May 2023
CEMFormer: Learning to Predict Driver Intentions from In-Cabin and External Cameras via Spatial-Temporal Transformers Yunsheng Ma Wenqian Ye Xu Cao Amr Abdelraouf Kyungtae Han Rohit Gupta Ziran Wang 35 11 0 13 May 2023
Learning Expressive Prompting With Residuals for Vision Transformers Rajshekhar Das Yonatan Dukler Avinash Ravichandran A. Swaminathan VLM VPVLM 25 21 0 27 Mar 2023
Explicit Visual Prompting for Low-Level Structure Segmentations Weihuang Liu Xi Shen Chi-Man Pun Xiaodong Cun VPVLM VLM 11 116 0 20 Mar 2023
Exploring Sparse Visual Prompt for Domain Adaptive Dense Prediction Senqiao Yang Jiarui Wu Jiaming Liu Xiaoqi Li Qizhe Zhang Mingjie Pan Yulu Gan Zehui Chen Shanghang Zhang MDE VLM 32 18 0 17 Mar 2023
Your representations are in the network: composable and parallel adaptation for large scale models Yonatan Dukler Alessandro Achille Hao-Yu Yang Varsha Vivek L. Zancato Benjamin Bowman Avinash Ravichandran Charless C. Fowlkes A. Swaminathan Stefano Soatto 16 3 0 07 Mar 2023
À-la-carte Prompt Tuning (APT): Combining Distinct Data Via Composable Prompting Benjamin Bowman Alessandro Achille L. Zancato Matthew Trager Pramuditha Perera Giovanni Paolini Stefano Soatto VPVLM 21 19 0 15 Feb 2023
Understanding Zero-Shot Adversarial Robustness for Large-Scale Models Chengzhi Mao Scott Geng Junfeng Yang Xin Eric Wang Carl Vondrick VLM 29 59 0 14 Dec 2022
Doubly Right Object Recognition: A Why Prompt for Visual Rationales Chengzhi Mao Revant Teotia Amrutha Sundar Sachit Menon Junfeng Yang Xin Eric Wang Carl Vondrick 11 29 0 12 Dec 2022
NeuMap: Neural Coordinate Mapping by Auto-Transdecoder for Camera Localization Shitao Tang Sicong Tang Andrea Tagliasacchi Ping Tan Yasutaka Furukawa 3DPC 17 17 0 21 Nov 2022
Bayesian Prompt Learning for Image-Language Model Generalization Mohammad Mahdi Derakhshani Enrique Sanchez Adrian Bulat Victor G. Turrisi da Costa Cees G. M. Snoek Georgios Tzimiropoulos Brais Martínez VPVLM VLM 92 34 0 05 Oct 2022
Visual Prompt Tuning Menglin Jia Luming Tang Bor-Chun Chen Claire Cardie Serge J. Belongie Bharath Hariharan Ser-Nam Lim VLM VPVLM 40 1,514 0 23 Mar 2022
A Survey of Visual Transformers Yang Liu Yao Zhang Yixin Wang Feng Hou Jin Yuan Jiang Tian Yang Zhang Zhongchao Shi Jianping Fan Zhiqiang He 3DGS ViT 69 330 0 11 Nov 2021
Finding Materialized Models for Model Reuse Minjun Zhao Lu Chen Keyu Yang Yuntao Du Yunjun Gao 21 1 0 13 Oct 2021
Transformers in Vision: A Survey Salman Khan Muzammal Naseer Munawar Hayat Syed Waqas Zamir F. Khan M. Shah ViT 227 2,428 0 04 Jan 2021
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 251 2,012 0 28 Jul 2020