PACTran: PAC-Bayesian Metrics for Estimating the Transferability of Pretrained Models to Classification Tasks

10 March 2022

Papers citing "PACTran: PAC-Bayesian Metrics for Estimating the Transferability of Pretrained Models to Classification Tasks"

20 / 20 papers shown

Title
Benchmarking Transferability: A Framework for Fair and Robust Evaluation Alireza Kazemi Helia Rezvani Mahsa Baktashmotlagh 24 0 0 28 Apr 2025
k-NN as a Simple and Effective Estimator of Transferability Moein Sorkhei Christos Matsoukas Johan Fredin Haslum Kevin Smith 52 0 0 24 Mar 2025
Capability Instruction Tuning: A New Paradigm for Dynamic LLM Routing Yi-Kai Zhang De-Chuan Zhan Han-Jia Ye ALM ELM LRM 36 1 0 24 Feb 2025
Leveraging Estimated Transferability Over Human Intuition for Model Selection in Text Ranking Jun Bai Zhuofan Chen Zhenzi Li Hanhua Hong Jianfei Zhang Chen Li Chenghua Lin Wenge Rong 19 0 0 24 Sep 2024
Back to the Basics on Predicting Transfer Performance Levy G. Chaves Eduardo Valle Alceu Bissoto Sandra Avila MedIm 37 0 0 30 May 2024
Efficient Transferability Assessment for Selection of Pre-trained Detectors Zhao Wang Aoxue Li Zhenguo Li Qi Dou 27 0 0 14 Mar 2024
Which Model to Transfer? A Survey on Transferability Estimation Yuhe Ding Bo Jiang Aijing Yu Aihua Zheng Jian Liang 35 4 0 23 Feb 2024
Green Runner: A tool for efficient deep learning component selection Jai Kannan 17 2 0 29 Jan 2024
How to Determine the Most Powerful Pre-trained Language Model without Brute Force Fine-tuning? An Empirical Survey Jun Bai Xiaofeng Zhang Chen Li Hanhua Hong Xi Xu Chenghua Lin Wenge Rong 18 10 0 08 Dec 2023
Exploring Model Transferability through the Lens of Potential Energy Xiaotong Li Zixuan Hu Yixiao Ge Ying Shan Ling-Yu Duan 19 7 0 29 Aug 2023
Foundation Model is Efficient Multimodal Multitask Model Selector Fanqing Meng Wenqi Shao Zhanglin Peng Chong Jiang Kaipeng Zhang Yu Qiao Ping Luo 25 13 0 11 Aug 2023
ETran: Energy-Based Transferability Estimation Mohsen Gholami Mohammad Akbari Xinglu Wang Behnam Kamranian Yong Zhang 13 9 0 03 Aug 2023
LOVM: Language-Only Vision Model Selection O. Zohar Shih-Cheng Huang Kuan-Chieh Jackson Wang Serena Yeung MLLM 42 13 0 15 Jun 2023
Model Spider: Learning to Rank Pre-Trained Models Efficiently Yi-Kai Zhang Ting Huang Yao-Xiang Ding De-Chuan Zhan Han-Jia Ye 19 23 0 06 Jun 2023
Demystifying Structural Disparity in Graph Neural Networks: Can One Size Fit All? Haitao Mao Zhikai Chen Wei Jin Haoyu Han Yao Ma Tong Zhao Neil Shah Jiliang Tang 23 31 0 02 Jun 2023
To transfer or not transfer: Unified transferability metric and analysis Qianshan Zhan Xiaohui Zeng 13 2 0 12 May 2023
PAC-Bayes Compression Bounds So Tight That They Can Explain Generalization Sanae Lotfi Marc Finzi Sanyam Kapoor Andres Potapczynski Micah Goldblum A. Wilson BDL MLT AI4CE 11 51 0 24 Nov 2022
Improving Robust Generalization by Direct PAC-Bayesian Bound Minimization Zifa Wang Nan Ding Tomer Levinboim Xi Chen Radu Soricut AAML 30 5 0 22 Nov 2022
Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Concepts Soravit Changpinyo P. Sharma Nan Ding Radu Soricut VLM 273 1,081 0 17 Feb 2021
Transferability and Hardness of Supervised Classification Tasks Anh Tran Cuong V Nguyen Tal Hassner 134 163 0 21 Aug 2019