A linearized framework and a new benchmark for model selection for fine-tuning

29 January 2021

Hao Li

Papers citing "A linearized framework and a new benchmark for model selection for fine-tuning"

39 / 39 papers shown

Title
Exploring Structural Degradation in Dense Representations for Self-supervised Learning Siran Dai Qianqian Xu Peisong Wen Yang Liu Qingming Huang 104 1 0 20 Oct 2025
Estimating Time Series Foundation Model Transferability via In-Context Learning Qingren Yao Ming Jin Chengqi Zhang Chao-Han Huck Yang Jun Qi Shirui Pan AI4TS 100 0 0 28 Sep 2025
Toward a Holistic Approach to Continual Model Merging Hoang Phan Sungmin Cha Tung Lam Tran Qi Lei MoMe CLL 158 0 0 28 Sep 2025
One-Embedding-Fits-All: Efficient Zero-Shot Time Series Forecasting by a Model Zoo Hao-Nan Shi Ting Huang Lu Han De-Chuan Zhan Han-Jia Ye AI4TS 142 0 0 04 Sep 2025
Match & Choose: Model Selection Framework for Fine-tuning Text-to-Image Diffusion Models Basile Lewandowski Robert Birke Lydia Y. Chen 125 0 0 14 Aug 2025
Optimal Transport-Guided Source-Free Adaptation for Face Anti-SpoofingComputer Vision and Pattern Recognition (CVPR), 2025 Tianying Wang Tianchen Zhao Xiang Xu Zheng Zhang Zhihua Li Xuanbai Chen Qin Zhang Alessandro Bergamo Anil K. Jain Yifan Xing 195 2 0 29 Mar 2025
k-NN as a Simple and Effective Estimator of Transferability Moein Sorkhei Christos Matsoukas Johan Fredin Haslum Emir Konuk Kevin Smith 261 0 0 24 Mar 2025
Capability Instruction Tuning: A New Paradigm for Dynamic LLM RoutingAAAI Conference on Artificial Intelligence (AAAI), 2025 Yi-Kai Zhang De-Chuan Zhan Han-Jia Ye ALM ELM LRM 423 11 0 24 Feb 2025
Adopting Trustworthy AI for Sleep Disorder Prediction: Deep Time Series Analysis with Temporal Attention Mechanism and Counterfactual ExplanationsBigData Congress [Services Society] (BSS), 2024 Pegah Ahadian Wei Xu Sherry Wang Qiang Guan AI4TS 110 0 0 25 Dec 2024
Transferring Knowledge from Large Foundation Models to Small Downstream Models Shikai Qiu Boran Han Danielle C. Maddix Shuai Zhang Yuyang Wang Andrew Gordon Wilson 175 6 0 11 Jun 2024
Model Selection with Model Zoo via Graph Learning Ziyu Li Hilco van der Wilk Danning Zhan Megha Khosla A. Bozzon Rihan Hai 210 6 0 05 Apr 2024
CMAT: A Multi-Agent Collaboration Tuning Framework for Enhancing Small Language Models Xuechen Liang Meiling Tao Yinghui Xia Yiting Xie Jun Wang JingSong Yang LLMAG 395 29 0 02 Apr 2024
Which Model to Transfer? A Survey on Transferability Estimation Yuhe Ding Bo Jiang Aijing Yu Aihua Zheng Jian Liang 244 14 0 23 Feb 2024
Selecting Large Language Model to Fine-tune via Rectified Scaling Law Haowei Lin Baizhou Huang Haotian Ye Qinyu Chen Zihao Wang Sujian Li Jianzhu Ma Xiaojun Wan James Zou Yitao Liang 294 28 0 04 Feb 2024
Simple Transferability Estimation for Regression TasksConference on Uncertainty in Artificial Intelligence (UAI), 2023 Cuong N. Nguyen Phong Tran L. Ho Vu C. Dinh Anh Tran Tal Hassner Cuong V Nguyen 235 6 0 01 Dec 2023
On Characterizing the Evolution of Embedding Space of Neural Networks using Algebraic Topology Suryaka Suresh Bishshoy Das V. Abrol Sumantra Dutta Roy 150 6 0 08 Nov 2023
Towards Robust and Efficient Continual Language Learning Adam Fisch Amal Rannen-Triki Razvan Pascanu J. Bornschein Angeliki Lazaridou E. Gribovskaya MarcÁurelio Ranzato CLL 137 3 0 11 Jul 2023
Kernels, Data & PhysicsJournal of Statistical Mechanics: Theory and Experiment (J. Stat. Mech.), 2023 Francesco Cagnetta Deborah Oliveira Mahalakshmi Sabanayagam Nikolaos Tsilivis Julia Kempe 187 0 0 05 Jul 2023
Model Spider: Learning to Rank Pre-Trained Models EfficientlyNeural Information Processing Systems (NeurIPS), 2023 Yi-Kai Zhang Ting Huang Yao-Xiang Ding De-Chuan Zhan Han-Jia Ye 238 39 0 06 Jun 2023
Task Arithmetic in the Tangent Space: Improved Editing of Pre-Trained ModelsNeural Information Processing Systems (NeurIPS), 2023 Guillermo Ortiz-Jiménez Alessandro Favero P. Frossard MoMe 543 171 0 22 May 2023
Train/Test-Time Adaptation with RetrievalComputer Vision and Pattern Recognition (CVPR), 2023 Luca Zancato Alessandro Achille Tian Yu Liu Matthew Trager Pramuditha Perera Stefano Soatto TTA OOD 159 14 0 25 Mar 2023
TRAK: Attributing Model Behavior at ScaleInternational Conference on Machine Learning (ICML), 2023 Sung Min Park Kristian Georgiev Andrew Ilyas Guillaume Leclerc Aleksander Madry TDI 348 224 0 24 Mar 2023
Your representations are in the network: composable and parallel adaptation for large scale modelsNeural Information Processing Systems (NeurIPS), 2023 Yonatan Dukler Alessandro Achille Hao Yang Varsha Vivek Luca Zancato Benjamin Bowman Avinash Ravichandran Charless C. Fowlkes A. Swaminathan Stefano Soatto 261 3 0 07 Mar 2023
The Role of Pre-training Data in Transfer Learning R. Entezari Mitchell Wortsman O. Saukh M. Shariatnia Hanie Sedghi Ludwig Schmidt 173 27 0 27 Feb 2023
Supervision Complexity and its Role in Knowledge DistillationInternational Conference on Learning Representations (ICLR), 2023 Hrayr Harutyunyan A. S. Rawat A. Menon Seungyeon Kim Surinder Kumar 236 17 0 28 Jan 2023
Cold Posteriors through PAC-Bayes Konstantinos Pitas Julyan Arbel 228 5 0 22 Jun 2022
SHiFT: An Efficient, Flexible Search Engine for Transfer LearningProceedings of the VLDB Endowment (PVLDB), 2022 Cédric Renggli Xiaozhe Yao Luka Kolar Luka Rimanic Ana Klimovic Ce Zhang OOD 264 7 0 04 Apr 2022
Demystifying the Neural Tangent Kernel from a Practical Perspective: Can it be trusted for Neural Architecture Search without training?Computer Vision and Pattern Recognition (CVPR), 2022 J. Mok Byunggook Na Ji-Hoon Kim Dongyoon Han Sungroh Yoon AAML 203 28 0 28 Mar 2022
Demystify Optimization and Generalization of Over-parameterized PAC-Bayesian Learning Wei Huang Chunrui Liu Yilan Chen Tianyu Liu R. Xu BDL MLT 154 2 0 04 Feb 2022
DIVA: Dataset Derivative of a Learning Task Yonatan Dukler Alessandro Achille Giovanni Paolini Avinash Ravichandran M. Polito Stefano Soatto 166 6 0 18 Nov 2021
Scalable Diverse Model Selection for Accessible Transfer LearningNeural Information Processing Systems (NeurIPS), 2021 Daniel Bolya Rohit Mittapalli Judy Hoffman OODD 171 53 0 12 Nov 2021
Deep Active Learning by Leveraging Training Dynamics Haonan Wang Wei Huang Ziwei Wu A. Margenot Hanghang Tong Jingrui He AI4CE 178 41 0 16 Oct 2021
Newer is not always better: Rethinking transferability metrics, their peculiarities, stability and performance Shibal Ibrahim Natalia Ponomareva Rahul Mazumder AAML 367 21 0 13 Oct 2021
Representation Consolidation for Training Expert Students Zhizhong Li Avinash Ravichandran Charless C. Fowlkes M. Polito Rahul Bhotika Stefano Soatto 115 6 0 16 Jul 2021
Unsupervised Model Drift Estimation with Batch Normalization Statistics for Dataset Shift Detection and Model Selection Won-Jo Lee Seokhyun Byun Jooeun Kim Minje Park Kirill Chechil AI4TS 144 2 0 01 Jul 2021
Frustratingly Easy Transferability EstimationInternational Conference on Machine Learning (ICML), 2021 Long-Kai Huang Ying Wei Yu Rong Qiang Yang Junzhou Huang 394 67 0 17 Jun 2021
What can linearized neural networks actually say about generalization?Neural Information Processing Systems (NeurIPS), 2021 Guillermo Ortiz-Jiménez Seyed-Mohsen Moosavi-Dezfooli P. Frossard 210 54 0 12 Jun 2021
What to Pre-Train on? Efficient Intermediate Task SelectionConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Clifton A. Poth Jonas Pfeiffer Andreas Rucklé Iryna Gurevych 226 103 0 16 Apr 2021
Which Model to Transfer? Finding the Needle in the Growing Haystack Cédric Renggli André Susano Pinto Luka Rimanic J. Puigcerver C. Riquelme Ce Zhang Mario Lucic 223 31 0 13 Oct 2020