Surgical Fine-Tuning Improves Adaptation to Distribution Shifts

20 October 2022

Papers citing "Surgical Fine-Tuning Improves Adaptation to Distribution Shifts"

50 / 132 papers shown

Title
Intermediate Layer Classifiers for OOD generalization Arnas Uselis Seong Joon Oh OOD 44 0 0 07 Apr 2025
Concept-Aware LoRA for Domain-Aligned Segmentation Dataset Generation Minho Park S. Park Jungsoo Lee Hyojin Park Kyuwoong Hwang Fatih Porikli Jaegul Choo Sungha Choi 29 0 0 28 Mar 2025
SURGEON: Memory-Adaptive Fully Test-Time Adaptation via Dynamic Activation Sparsity Ke Ma Jiaqi Tang B. Guo Fan Dang Sicong Liu ... Lei Wu Cheng Fang Ying-Cong Chen Zhiwen Yu Yunhao Liu TTA 76 0 0 26 Mar 2025
Iterative Prompt Relocation for Distribution-Adaptive Visual Prompt Tuning Chikai Shang Mengke Li Yiqun Zhang Zhen Chen Jinlin Wu Fangqing Gu Yang Lu Yiu-ming Cheung VLM 66 0 0 10 Mar 2025
AIM-Fair: Advancing Algorithmic Fairness via Selectively Fine-Tuning Biased Models with Contextual Synthetic Data Zengqun Zhao Ziquan Liu Yu Cao Shaogang Gong Ioannis Patras 40 0 0 07 Mar 2025
Robust Learning of Diverse Code Edits Tushar Aggarwal Swayam Singh Abhijeet Awasthi Aditya Kanade Nagarajan Natarajan SyDa 103 0 0 05 Mar 2025
A Guide to Failure in Machine Learning: Reliability and Robustness from Foundations to Practice Eric Heim Oren Wright David Shriver OOD FaML 63 0 0 01 Mar 2025
GeneralizeFormer: Layer-Adaptive Model Generation across Test-Time Distribution Shifts Sameer Ambekar Zehao Xiao Xiantong Zhen Cees G. M. Snoek OOD 60 0 0 15 Feb 2025
Differentiable Prompt Learning for Vision Language Models Zhenhan Huang Tejaswini Pedapati Pin-Yu Chen Jianxi Gao VLM 21 0 0 03 Jan 2025
Adaptive Concept Bottleneck for Foundation Models Under Distribution Shifts Jihye Choi Jayaram Raghuram Yixuan Li Somesh Jha 101 4 0 18 Dec 2024
TrimLLM: Progressive Layer Dropping for Domain-Specific LLMs Lanxiang Hu Tajana Rosing Hao Zhang 79 0 0 15 Dec 2024
ReC-TTT: Contrastive Feature Reconstruction for Test-Time Training Marco Colussi S. Mascetti Jose Dolz Christian Desrosiers 62 0 0 26 Nov 2024
Poor Man's Training on MCUs: A Memory-Efficient Quantized Back-Propagation-Free Approach Yequan Zhao Hai Li Ian Young Zheng-Wei Zhang MQ 24 2 0 07 Nov 2024
Rethinking Weight Decay for Robust Fine-Tuning of Foundation Models Junjiao Tian Chengyue Huang Z. Kira 28 1 0 03 Nov 2024
A Simple Remedy for Dataset Bias via Self-Influence: A Mislabeled Sample Perspective Yeonsung Jung Jaeyun Song J. Yang Jin-Hwa Kim Sung-Yub Kim Eunho Yang 37 2 0 01 Nov 2024
KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation Rambod Azimi Rishav Rishav M. Teichmann Samira Ebrahimi Kahou ALM 26 0 0 28 Oct 2024
ArterialNet: Reconstructing Arterial Blood Pressure Waveform with Wearable Pulsatile Signals, a Cohort-Aware Approach Sicong Huang R. Jafari B. Mortazavi OOD 26 0 0 24 Oct 2024
Layer-wise Importance Matters: Less Memory for Better Performance in Parameter-efficient Fine-tuning of Large Language Models Kai Yao P. Gao Lichun Li Yuan Zhao Xiaofeng Wang W. Wang Jianke Zhu 19 1 0 15 Oct 2024
Guarantees for Nonlinear Representation Learning: Non-identical Covariates, Dependent Data, Fewer Samples Thomas T. Zhang Bruce D. Lee Ingvar M. Ziemann George J. Pappas Nikolai Matni CML OOD 31 0 0 15 Oct 2024
AdaShadow: Responsive Test-time Model Adaptation in Non-stationary Mobile Environments Cheng Fang Sicong Liu Zimu Zhou Bin Guo Jiaqi Tang Ke Ma Zhiwen Yu TTA 24 1 0 10 Oct 2024
Leveraging free energy in pretraining model selection for improved fine-tuning Michael Munn Susan Wei 24 0 0 08 Oct 2024
Trained Models Tell Us How to Make Them Robust to Spurious Correlation without Group Annotation Mahdi Ghaznavi Hesam Asadollahzadeh Fahimeh Hosseini Noohdani Soroush Vafaie Tabar Hosein Hasani Taha Akbari Alvanagh M. Rohban M. Baghshah 29 0 0 07 Oct 2024
OD-Stega: LLM-Based Near-Imperceptible Steganography via Optimized Distributions Yu-Shin Huang Peter Just Krishna Narayanan Chao Tian 32 3 0 06 Oct 2024
DaWin: Training-free Dynamic Weight Interpolation for Robust Adaptation Changdae Oh Yixuan Li Kyungwoo Song Sangdoo Yun Dongyoon Han OOD MoMe 41 4 0 03 Oct 2024
PACE: Marrying generalization in PArameter-efficient fine-tuning with Consistency rEgularization Yao Ni Shan Zhang Piotr Koniusz 78 2 0 25 Sep 2024
SPARK: Self-supervised Personalized Real-time Monocular Face Capture Kelian Baert Shrisha Bharadwaj Fabien Castan Benoit Maujean Marc Christie Victoria Fernandez-Abrevaya A. Boukhayma CVBM 3DH 50 2 0 12 Sep 2024
SpectralEarth: Training Hyperspectral Foundation Models at Scale Nassim Ait Ali Braham C. Albrecht Julien Mairal J. Chanussot Yi Wang X. Zhu 36 10 0 15 Aug 2024
DECIDER: Leveraging Foundation Model Priors for Improved Model Failure Detection and Explanation Rakshith Subramanyam Kowshik Thopalli V. Narayanaswamy Jayaraman J.Thiagarajan 18 2 0 01 Aug 2024
DINOv2 Rocks Geological Image Analysis: Classification, Segmentation, and Interpretability Florent Brondolo Samuel Beaussant AI4CE 24 0 0 25 Jul 2024
Model editing for distribution shifts in uranium oxide morphological analysis Davis Brown Cody Nizinski Madelyn Shapiro Corey Fallon Tianzhixi Yin Henry Kvinge Jonathan Tu 33 0 0 22 Jul 2024
Learn to Preserve and Diversify: Parameter-Efficient Group with Orthogonal Regularization for Domain Generalization Jiajun Hu Jian Zhang Lei Qi Yinghuan Shi Yang Gao OOD 33 4 0 21 Jul 2024
Seq-to-Final: A Benchmark for Tuning from Sequential Distributions to a Final Time Point Christina X. Ji Ahmed M. Alaa David Sontag OOD 42 0 0 12 Jul 2024
OCCAM: Online Continuous Controller Adaptation with Meta-Learned Models Hersh Sanghvi Spencer Folk Camillo J. Taylor 32 2 0 25 Jun 2024
Comparison of fine-tuning strategies for transfer learning in medical image classification Ana Davila Jacinto Colan Yasuhisa Hasegawa 19 17 0 14 Jun 2024
CARES: A Comprehensive Benchmark of Trustworthiness in Medical Vision Language Models Peng Xia Ze Chen Juanxi Tian Yangrui Gong Ruibo Hou ... Jimeng Sun Zongyuan Ge Gang Li James Zou Huaxiu Yao MU VLM 61 31 0 10 Jun 2024
Better Late Than Never: Formulating and Benchmarking Recommendation Editing Chengyu Lai Sheng Zhou Zhimeng Jiang Qiaoyu Tan Yuanchen Bei Jiawei Chen Ningyu Zhang Jiajun Bu OffRL KELM 30 0 0 06 Jun 2024
Feature contamination: Neural networks learn uncorrelated features and fail to generalize Tianren Zhang Chujie Zhao Guanyu Chen Yizhou Jiang Feng Chen OOD MLT OODD 69 3 0 05 Jun 2024
Using Self-supervised Learning Can Improve Model Fairness Sofia Yfantidou Dimitris Spathis Marios Constantinides Athena Vakali Daniele Quercia F. Kawsar 59 4 0 04 Jun 2024
Views Can Be Deceiving: Improved SSL Through Feature Space Augmentation Kimia Hamidieh Haoran Zhang Swami Sankaranarayanan Marzyeh Ghassemi 38 0 0 28 May 2024
Understanding Linear Probing then Fine-tuning Language Models from NTK Perspective Akiyoshi Tomihari Issei Sato 24 3 0 27 May 2024
A Textbook Remedy for Domain Shifts: Knowledge Priors for Medical Image Analysis Yue Yang Mona Gandhi Yufei Wang Yifan Wu Michael S. Yao Christopher Callison-Burch James C. Gee Mark Yatskar 43 3 0 23 May 2024
Surgical Feature-Space Decomposition of LLMs: Why, When and How? Arnav Chavan Nahush Lele Deepak Gupta 30 2 0 17 May 2024
Towards Incremental Learning in Large Language Models: A Critical Review M. Jovanovic Peter Voss ELM CLL KELM 26 5 0 28 Apr 2024
Lowering PyTorch's Memory Consumption for Selective Differentiation Samarth Bhatia Felix Dangel 14 1 0 15 Apr 2024
FedSelect: Personalized Federated Learning with Customized Selection of Parameters for Fine-Tuning Rishub Tamirisa Chulin Xie Wenxuan Bao Andy Zhou Ron Arel Aviv Shamsian 19 6 0 03 Apr 2024
Model Stock: All we need is just a few fine-tuned models Dong-Hwan Jang Sangdoo Yun Dongyoon Han OODD MoMe 24 38 0 28 Mar 2024
Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learning Huiyi Wang Haodong Lu Lina Yao Dong Gong KELM CLL 40 8 0 27 Mar 2024
DPStyler: Dynamic PromptStyler for Source-Free Domain Generalization Yunlong Tang Yuxuan Wan Lei Qi Xin Geng VLM 31 4 0 25 Mar 2024
Towards Low-Energy Adaptive Personalization for Resource-Constrained Devices Yushan Huang Josh Millar Yuxuan Long Yuchen Zhao Hamed Haddadi 28 0 0 23 Mar 2024
R2SNet: Scalable Domain Adaptation for Object Detection in Cloud-Based Robotic Ecosystems via Proposal Refinement Michele Antonazzi Matteo Luperto N. A. Borghese Nicola Basilico 19 1 0 18 Mar 2024