Rethinking the Hyperparameters for Fine-tuning

19 February 2020

Hao Li

Papers citing "Rethinking the Hyperparameters for Fine-tuning"

27 / 27 papers shown

Title
Transfer Learning with Pre-trained Conditional Generative Models Shinýa Yamaguchi Sekitoshi Kanai Atsutoshi Kumagai Daiki Chijiwa H. Kashima VLM CLL BDL DiffM 127 5 0 21 Feb 2025
Double-Bayesian Learning Stefan Jaeger BDL UD 11 0 0 16 Oct 2024
The Performance of Transferability Metrics does not Translate to Medical Tasks Levy G. Chaves Alceu Bissoto Eduardo Valle Sandra Avila 19 4 0 14 Aug 2023
Quick-Tune: Quickly Learning Which Pretrained Model to Finetune and How Sebastian Pineda Arango Fabio Ferreira Arlind Kadra Frank Hutter Frank Hutter Josif Grabocka 29 15 0 06 Jun 2023
Overwriting Pretrained Bias with Finetuning Data Angelina Wang Olga Russakovsky 21 29 0 10 Mar 2023
Fine-Tuning Is All You Need to Mitigate Backdoor Attacks Zeyang Sha Xinlei He Pascal Berrang Mathias Humbert Yang Zhang AAML 13 33 0 18 Dec 2022
A New Linear Scaling Rule for Private Adaptive Hyperparameter Optimization Ashwinee Panda Xinyu Tang Saeed Mahloujifar Vikash Sehwag Prateek Mittal 29 11 0 08 Dec 2022
Classification of Colorectal Cancer Polyps via Transfer Learning and Vision-Based Tactile Sensing Nethra Venkatayogi Ozdemir Can Kara Jeff Bonyun N. Ikoma Farshid Alambeigi 14 15 0 08 Nov 2022
Surgical Fine-Tuning Improves Adaptation to Distribution Shifts Yoonho Lee Annie S. Chen Fahim Tajwar Ananya Kumar Huaxiu Yao Percy Liang Chelsea Finn OOD 47 197 0 20 Oct 2022
Efficient Multi-Prize Lottery Tickets: Enhanced Accuracy, Training, and Inference Speed Hao-Ran Cheng Pu Zhao Yize Li Xue Lin James Diffenderfer R. Goldhahn B. Kailkhura MQ 23 0 0 26 Sep 2022
How to Fine-tune Models with Few Samples: Update, Data Augmentation, and Test-time Augmentation Yujin Kim Jaehoon Oh Sungnyun Kim Se-Young Yun 29 6 0 13 May 2022
Robust and Explainable Autoencoders for Unsupervised Time Series Outlier Detection---Extended Version Tung Kieu B. Yang Chenjuan Guo Christian S. Jensen Yan Zhao Feiteng Huang Kai Zheng AI4TS 27 37 0 07 Apr 2022
Improved Regularization and Robustness for Fine-tuning in Neural Networks Dongyue Li Hongyang R. Zhang NoLa 47 54 0 08 Nov 2021
SCSS-Net: Solar Corona Structures Segmentation by Deep Learning Š. Mackovjak Martin Harman V. Maslej-Krešňáková P. Butka 17 10 0 22 Sep 2021
DHA: End-to-End Joint Optimization of Data Augmentation Policy, Hyper-parameter and Architecture Kaichen Zhou Lanqing Hong Shuailiang Hu Fengwei Zhou Binxin Ru Jiashi Feng Zhenguo Li 51 10 0 13 Sep 2021
Robust fine-tuning of zero-shot models Mitchell Wortsman Gabriel Ilharco Jong Wook Kim Mike Li Simon Kornblith ... Raphael Gontijo-Lopes Hannaneh Hajishirzi Ali Farhadi Hongseok Namkoong Ludwig Schmidt VLM 23 688 0 04 Sep 2021
FREE: Feature Refinement for Generalized Zero-Shot Learning Shiming Chen Wenjie Wang Beihao Xia Qinmu Peng Xinge You Feng Zheng Ling Shao VLM 8 132 0 29 Jul 2021
End-to-end Neural Diarization: From Transformer to Conformer Yi Y. Liu Eunjung Han Chul Lee A. Stolcke 11 40 0 14 Jun 2021
Low-Fidelity End-to-End Video Encoder Pre-training for Temporal Action Localization Mengmeng Xu Juan-Manuel Perez-Rua Xiatian Zhu Bernard Ghanem Brais Martinez 15 27 0 28 Mar 2021
LogME: Practical Assessment of Pre-trained Models for Transfer Learning Kaichao You Yong Liu Jianmin Wang Mingsheng Long 16 178 0 22 Feb 2021
A linearized framework and a new benchmark for model selection for fine-tuning Aditya Deshpande Alessandro Achille Avinash Ravichandran Hao Li L. Zancato Charless C. Fowlkes Rahul Bhotika Stefano Soatto Pietro Perona ALM 107 46 0 29 Jan 2021
Neural Prototype Trees for Interpretable Fine-grained Image Recognition Meike Nauta Ron van Bree C. Seifert 55 261 0 03 Dec 2020
Hyperparameter Transfer Across Developer Adjustments Daniel Stoll Jörg K.H. Franke Diane Wagner Simon Selg Frank Hutter 17 12 0 25 Oct 2020
Predicting Training Time Without Training L. Zancato Alessandro Achille Avinash Ravichandran Rahul Bhotika Stefano Soatto 16 24 0 28 Aug 2020
Bag of Tricks for Image Classification with Convolutional Neural Networks Tong He Zhi-Li Zhang Hang Zhang Zhongyue Zhang Junyuan Xie Mu Li 216 1,398 0 04 Dec 2018
A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decay L. Smith 191 1,019 0 26 Mar 2018
Borrowing Treasures from the Wealthy: Deep Transfer Learning through Selective Joint Fine-tuning Weifeng Ge Yizhou Yu 86 233 0 28 Feb 2017