Surgical Fine-Tuning Improves Adaptation to Distribution Shifts

20 October 2022

Papers citing "Surgical Fine-Tuning Improves Adaptation to Distribution Shifts"

50 / 133 papers shown

Title
R2SNet: Scalable Domain Adaptation for Object Detection in Cloud-Based Robotic Ecosystems via Proposal Refinement Michele Antonazzi Matteo Luperto N. A. Borghese Nicola Basilico 19 1 0 18 Mar 2024
Unleashing the Power of Meta-tuning for Few-shot Generalization Through Sparse Interpolated Experts Shengzhuang Chen Jihoon Tack Yunqiao Yang Yee Whye Teh Jonathan Richard Schwarz Ying Wei MoE 35 1 0 13 Mar 2024
Overcoming Reward Overoptimization via Adversarial Policy Optimization with Lightweight Uncertainty Estimation Xiaoying Zhang Jean-François Ton Wei Shen Hongning Wang Yang Liu 29 13 0 08 Mar 2024
Any-Shift Prompting for Generalization over Distributions Zehao Xiao Jiayi Shen Mohammad Mahdi Derakhshani Shengcai Liao Cees G. M. Snoek OOD VPVLM VLM 32 8 0 15 Feb 2024
Active Few-Shot Fine-Tuning Jonas Hübotter Bhavya Sukhija Lenart Treven Yarden As Andreas Krause 28 1 0 13 Feb 2024
LEVI: Generalizable Fine-tuning via Layer-wise Ensemble of Different Views Yuji Roh Qingyun Liu Huan Gui Zhe Yuan Yujin Tang ... Liang Liu Shuchao Bi Lichan Hong Ed H. Chi Zhe Zhao 33 1 0 07 Feb 2024
Clarify: Improving Model Robustness With Natural Language Corrections Yoonho Lee Michelle S. Lam Helena Vasconcelos Michael S. Bernstein Chelsea Finn 23 6 0 06 Feb 2024
Toward Human-AI Alignment in Large-Scale Multi-Player Games Sugandha Sharma Guy Davidson Khimya Khetarpal Anssi Kanervisto Udit Arora Katja Hofmann Ida Momennejad 17 0 0 05 Feb 2024
Cross-modality debiasing: using language to mitigate sub-population shifts in imaging Yijiang Pang Hoang Bao Jiayu Zhou 17 0 0 02 Feb 2024
Development and Adaptation of Robotic Vision in the Real-World: the Challenge of Door Detection Michele Antonazzi Matteo Luperto N. A. Borghese Nicola Basilico 25 1 0 31 Jan 2024
AutoFT: Learning an Objective for Robust Fine-Tuning Caroline Choi Yoonho Lee Annie S. Chen Allan Zhou Aditi Raghunathan Chelsea Finn OOD 31 0 0 18 Jan 2024
HCVP: Leveraging Hierarchical Contrastive Visual Prompt for Domain Generalization Guanglin Zhou Zhongyi Han Shiming Chen Biwei Huang Liming Zhu Tongliang Liu Lina Yao Kun Zhang 32 3 0 18 Jan 2024
The Truth is in There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction Pratyusha Sharma Jordan T. Ash Dipendra Kumar Misra LRM 11 77 0 21 Dec 2023
Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision Collin Burns Pavel Izmailov Jan Hendrik Kirchner Bowen Baker Leo Gao ... Adrien Ecoffet Manas Joglekar Jan Leike Ilya Sutskever Jeff Wu ELM 34 259 0 14 Dec 2023
Towards On-device Learning on the Edge: Ways to Select Neurons to Update under a Budget Constraint Ael Quélennec Enzo Tartaglione Pavlo Mozharovskyi Van-Tam Nguyen 12 2 0 08 Dec 2023
Sim-to-Real Causal Transfer: A Metric Learning Approach to Causally-Aware Interaction Representations Yuejiang Liu Ahmad Rahimi Po-Chien Luan Frano Rajic Alexandre Alahi 25 3 0 07 Dec 2023
An Empirical Study of Automated Mislabel Detection in Real World Vision Datasets Maya Srikanth Jeremy Irvin Brian Wesley Hill Felipe Godoy Ishan Sabane Andrew Y. Ng 26 2 0 02 Dec 2023
Slot-Mixup with Subsampling: A Simple Regularization for WSI Classification Seongho Keum Sanghyun Kim Soojeong Lee Juho Lee 37 2 0 29 Nov 2023
Layer-wise Auto-Weighting for Non-Stationary Test-Time Adaptation Junyoung Park Jin-Hwa Kim Hyeongjun Kwon Ilhoon Yoon Kwanghoon Sohn 25 7 0 10 Nov 2023
The Fairness Stitch: Unveiling the Potential of Model Stitching in Neural Network De-Biasing Modar Sulaiman Kallol Roy 14 0 0 06 Nov 2023
Towards Calibrated Robust Fine-Tuning of Vision-Language Models Changdae Oh Hyesu Lim Mijoo Kim Dongyoon Han Junhyeok Park Euiseog Jeong Alexander G. Hauptmann Zhi-Qi Cheng Kyungwoo Song VLM 16 13 0 03 Nov 2023
Invariant-Feature Subspace Recovery: A New Class of Provable Domain Generalization Algorithms Haoxiang Wang Gargi Balasubramaniam Haozhe Si Bo Li Han Zhao OOD 14 1 0 02 Nov 2023
Spuriosity Rankings for Free: A Simple Framework for Last Layer Retraining Based on Object Detection Mohammad Azizmalayeri Reza Abbasi Amir Hosein Haji Mohammad Rezaie Reihaneh Zohrabi Mahdi Amiri M. T. Manzuri M. Rohban 11 0 0 31 Oct 2023
Fast Trainable Projection for Robust Fine-Tuning Junjiao Tian Yen-Cheng Liu James Seale Smith Z. Kira OOD 25 11 0 29 Oct 2023
Adaptive Test-Time Personalization for Federated Learning Wenxuan Bao Tianxin Wei Haohan Wang Jingrui He TTA OOD 23 14 0 28 Oct 2023
PockEngine: Sparse and Efficient Fine-tuning in a Pocket Ligeng Zhu Lanxiang Hu Ji Lin Wei-Chen Wang Wei-Ming Chen Chuang Gan Song Han 17 19 0 26 Oct 2023
On Surgical Fine-tuning for Language Encoders Abhilasha Lodha Gayatri Belapurkar Saloni Chalkapurkar Yuanming Tao Reshmi Ghosh Samyadeep Basu Dmitrii Petrov Soundararajan Srinivasan 6 3 0 25 Oct 2023
ClusT3: Information Invariant Test-Time Training G. A. V. Hakim David Osowiechi Mehrdad Noori Milad Cheraghalikhani Ismail Ben Ayed Christian Desrosiers TTA OOD 18 10 0 18 Oct 2023
A Recent Survey of Heterogeneous Transfer Learning Runxue Bao Yiming Sun Yuhe Gao Jindong Wang Qiang Yang Zhi-Hong Mao Ye Ye 17 4 0 12 Oct 2023
TAIL: Task-specific Adapters for Imitation Learning with Large Pretrained Models Zuxin Liu Jesse Zhang Kavosh Asadi Yao Liu Ding Zhao Shoham Sabach Rasool Fakoor ALM AI4CE 21 24 0 09 Oct 2023
Test-Time Training for Speech Sri Harsha Dumpala Chandramouli Shama Sastry Sageev Oore 25 1 0 19 Sep 2023
Mitigating the Alignment Tax of RLHF Yong Lin Hangyu Lin Wei Xiong Shizhe Diao Zeming Zheng ... Han Zhao Nan Jiang Heng Ji Yuan Yao Tong Zhang MoMe CLL 24 63 0 12 Sep 2023
Zero-Shot Robustification of Zero-Shot Models Dyah Adila Changho Shin Lin Cai Frederic Sala 29 18 0 08 Sep 2023
REALM: Robust Entropy Adaptive Loss Minimization for Improved Single-Sample Test-Time Adaptation Skyler Seto B. Theobald Federico Danieli Navdeep Jaitly Dan Busbridge TTA OOD 28 6 0 07 Sep 2023
EasyEdit: An Easy-to-use Knowledge Editing Framework for Large Language Models Peng Wang Ningyu Zhang Bo Tian Zekun Xi Yunzhi Yao ... Shuyang Cheng Kangwei Liu Yuansheng Ni Guozhou Zheng Huajun Chen KELM 27 41 0 14 Aug 2023
SYNAuG: Exploiting Synthetic Data for Data Imbalance Problems Moon Ye-Bin Nam Hyeon-Woo Wonseok Choi Nayeong Kim Suha Kwak Tae-Hyun Oh DiffM 21 3 0 02 Aug 2023
Improving Generalization of Adversarial Training via Robust Critical Fine-Tuning Kaijie Zhu Jindong Wang Xixu Hu Xingxu Xie G. Yang AAML 17 23 0 01 Aug 2023
PromptStyler: Prompt-driven Style Generation for Source-free Domain Generalization Junhyeong Cho Gilhyun Nam Sungyeon Kim Hunmin Yang Suha Kwak VLM OOD TTA 19 47 0 27 Jul 2023
Revisiting Fine-Tuning Strategies for Self-supervised Medical Imaging Analysis Muhammad Osama Khan Yi Fang 12 3 0 20 Jul 2023
FedBug: A Bottom-Up Gradual Unfreezing Framework for Federated Learning Chia-Hsiang Kao Yu-Chiang Frank Wang FedML 9 1 0 19 Jul 2023
What Happens During Finetuning of Vision Transformers: An Invariance Based Investigation Gabriele Merlin Vedant Nanda Ruchit Rawal Mariya Toneva 10 3 0 12 Jul 2023
Advances and Challenges in Meta-Learning: A Technical Review Anna Vettoruzzo Mohamed-Rafik Bouguelia Joaquin Vanschoren Thorsteinn Rögnvaldsson K. Santosh OffRL 19 70 0 10 Jul 2023
Surgical fine-tuning for Grape Bunch Segmentation under Visual Domain Shifts Agnese Chiatti R. Bertoglio Nicolás Catalano Matteo Gatti Matteo Matteucci 18 4 0 03 Jul 2023
FedSelect: Customized Selection of Parameters for Fine-Tuning during Personalized Federated Learning Rishub Tamirisa John Won Chengjun Lu Ron Arel Andy Zhou FedML 20 3 0 23 Jun 2023
Confidence-Based Model Selection: When to Take Shortcuts for Subpopulation Shifts Annie S. Chen Yoonho Lee Amrith Rajagopal Setlur Sergey Levine Chelsea Finn OOD 14 5 0 19 Jun 2023
Simple and Fast Group Robustness by Automatic Feature Reweighting Shi Qiu Andres Potapczynski Pavel Izmailov A. Wilson OOD 57 53 0 19 Jun 2023
Neural Priming for Sample-Efficient Adaptation Matthew Wallingford Vivek Ramanujan Alex Fang Aditya Kusupati Roozbeh Mottaghi Aniruddha Kembhavi Ludwig Schmidt Ali Farhadi VLM 106 13 0 16 Jun 2023
Modularity Trumps Invariance for Compositional Robustness I. Mason Anirban Sarkar Tomotake Sasaki Xavier Boix OOD 11 1 0 15 Jun 2023
Background Prompting for Improved Object Depth Manel Baradad Yuanzhen Li Forrester Cole Michael Rubinstein Antonio Torralba William T. Freeman Varun Jampani VLM MDE 11 1 0 08 Jun 2023
Quick-Tune: Quickly Learning Which Pretrained Model to Finetune and How Sebastian Pineda Arango Fabio Ferreira Arlind Kadra Frank Hutter Frank Hutter Josif Grabocka 24 15 0 06 Jun 2023