What is being transferred in transfer learning?

26 August 2020

Papers citing "What is being transferred in transfer learning?"

50 / 88 papers shown

Title
Dynamic Fisher-weighted Model Merging via Bayesian Optimization Sanwoo Lee Jiahao Liu Qifan Wang J. Wang Xunliang Cai Yunfang Wu MoMe 125 0 0 26 Apr 2025
Param $Δ$ for Direct Weight Mixing: Post-Train Large Language Model at Zero Cost Sheng Cao Mingrui Wu Karthik Prasad Yuandong Tian Zechun Liu MoMe 80 0 0 23 Apr 2025
Representational Similarity via Interpretable Visual Concepts Neehar Kondapaneni Oisin Mac Aodha Pietro Perona DRL 142 0 0 19 Mar 2025
SplatPose: Geometry-Aware 6-DoF Pose Estimation from Single RGB Image via 3D Gaussian Splatting Linqi Yang Xiongwei Zhao Qihao Sun Ke Wang Ao Chen Peng Kang 3DGS 76 0 0 07 Mar 2025
RAAD-LLM: Adaptive Anomaly Detection Using LLMs and RAG Integration Alicia Russell-Gilbert Sudip Mittal Shahram Rahimi Maria Seale Joseph E. Jabour Thomas Arnold Joshua Church 41 0 0 04 Mar 2025
Optimal Transfer Learning for Missing Not-at-Random Matrix Completion Akhil Jalan Yassir Jedra Arya Mazumdar Soumendu Sundar Mukherjee Purnamrita Sarkar 117 0 0 28 Feb 2025
Bayesian Comparisons Between Representations Heiko H. Schütt FAtt 152 0 0 20 Feb 2025
Uncovering, Explaining, and Mitigating the Superficial Safety of Backdoor Defense Rui Min Zeyu Qin Nevin L. Zhang Li Shen Minhao Cheng AAML 31 4 0 13 Oct 2024
Wolf2Pack: The AutoFusion Framework for Dynamic Parameter Fusion Bowen Tian Songning Lai Yutao Yue MoMe 30 0 0 08 Oct 2024
TSCLIP: Robust CLIP Fine-Tuning for Worldwide Cross-Regional Traffic Sign Recognition Guoyang Zhao Fulong Ma Weiqing Qi Chenguang Zhang Yuxuan Liu Ming Liu Jun Ma VLM CLIP 100 3 0 23 Sep 2024
Transfer Learning Applied to Computer Vision Problems: Survey on Current Progress, Limitations, and Opportunities Aaryan Panda Damodar Panigrahi Shaswata Mitra Sudip Mittal Shahram Rahimi 23 0 0 12 Sep 2024
WARP: On the Benefits of Weight Averaged Rewarded Policies Alexandre Ramé Johan Ferret Nino Vieillard Robert Dadashi Léonard Hussenot Pierre-Louis Cedoz Pier Giuseppe Sessa Sertan Girgin Arthur Douillard Olivier Bachem 50 13 0 24 Jun 2024
Transfer Learning for Latent Variable Network Models Akhil Jalan Arya Mazumdar Soumendu Sundar Mukherjee Purnamrita Sarkar 38 1 0 05 Jun 2024
Fractals as Pre-training Datasets for Anomaly Detection and Localization C. Ugwu S. Casarin O. Lanz 27 0 0 11 May 2024
KITE: A Kernel-based Improved Transferability Estimation Method Yunhui Guo 43 0 0 01 May 2024
DIMAT: Decentralized Iterative Merging-And-Training for Deep Learning Models Nastaran Saadati Minh Pham Nasla Saleem Joshua R. Waite Aditya Balu Zhanhong Jiang Chinmay Hegde Soumik Sarkar MoMe 35 1 0 11 Apr 2024
Arcee's MergeKit: A Toolkit for Merging Large Language Models Charles Goddard Shamane Siriwardhana Malikeh Ehghaghi Luke Meyers Vladimir Karpukhin Brian Benedict Mark McQuade Jacob Solawetz MoMe KELM 82 77 0 20 Mar 2024
Adversarial Example Soups: Improving Transferability and Stealthiness for Free Bo Yang Hengwei Zhang Jin-dong Wang Yulong Yang Chenhao Lin Chao Shen Zhengyu Zhao SILM AAML 59 1 0 27 Feb 2024
Geometric Data Augmentations to Mitigate Distribution Shifts in Pollen Classification from Microscopic Images Nam Cao O. Saukh 16 2 0 18 Nov 2023
Model Merging by Uncertainty-Based Gradient Matching Nico Daheim Thomas Möllenhoff E. Ponti Iryna Gurevych Mohammad Emtiyaz Khan MoMe FedML 32 43 0 19 Oct 2023
A Foundation Language-Image Model of the Retina (FLAIR): Encoding Expert Knowledge in Text Supervision Julio Silva-Rodríguez H. Chakor Riadh Kobbi Jose Dolz Ismail Ben Ayed VLM MedIm 64 33 0 15 Aug 2023
Universal Domain Adaptation from Foundation Models: A Baseline Study Bin Deng K. Jia VLM 16 6 0 18 May 2023
How good are variational autoencoders at transfer learning? Lisa Bonheme M. Grzes OOD DRL 23 2 0 21 Apr 2023
Generalization Matters: Loss Minima Flattening via Parameter Hybridization for Efficient Online Knowledge Distillation Tianli Zhang Mengqi Xue Jiangtao Zhang Haofei Zhang Yu Wang Lechao Cheng Jie Song Mingli Song 28 5 0 26 Mar 2023
Pretrained ViTs Yield Versatile Representations For Medical Images Christos Matsoukas Johan Fredin Haslum Magnus P Soderberg Kevin Smith MedIm ViT 16 11 0 13 Mar 2023
Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together! Shiwei Liu Tianlong Chen Zhenyu (Allen) Zhang Xuxi Chen Tianjin Huang Ajay Jaiswal Zhangyang Wang 24 29 0 03 Mar 2023
The Role of Pre-training Data in Transfer Learning R. Entezari Mitchell Wortsman O. Saukh M. Shariatnia Hanie Sedghi Ludwig Schmidt 46 20 0 27 Feb 2023
Revisiting Pre-training in Audio-Visual Learning Ruoxuan Feng Wenke Xia Di Hu 17 1 0 07 Feb 2023
Interpretations of Domain Adaptations via Layer Variational Analysis H. Tseng Hsin-Yi Lin Kuo-Hsuan Hung Yu Tsao FAtt 22 3 0 03 Feb 2023
Dataless Knowledge Fusion by Merging Weights of Language Models Xisen Jin Xiang Ren Daniel Preotiuc-Pietro Pengxiang Cheng FedML MoMe 13 211 0 19 Dec 2022
Leveraging Unlabeled Data to Track Memorization Mahsa Forouzesh Hanie Sedghi Patrick Thiran NoLa TDI 30 3 0 08 Dec 2022
Editing Models with Task Arithmetic Gabriel Ilharco Marco Tulio Ribeiro Mitchell Wortsman Suchin Gururangan Ludwig Schmidt Hannaneh Hajishirzi Ali Farhadi KELM MoMe MU 43 424 0 08 Dec 2022
Topic Segmentation in the Wild: Towards Segmentation of Semi-structured & Unstructured Chats R. Ghosh Harjeet Singh Kajal Sharanya Kamath Dhuri Shrivastava S. Basu Soundararajan Srinivasan 14 4 0 27 Nov 2022
FeTrIL: Feature Translation for Exemplar-Free Class-Incremental Learning Grégoire Petit Adrian Daniel Popescu Hugo Schindler David Picard Bertrand Delezoide CLL 19 111 0 23 Nov 2022
ModelDiff: A Framework for Comparing Learning Algorithms Harshay Shah Sung Min Park Andrew Ilyas A. Madry SyDa 46 26 0 22 Nov 2022
Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations Peng Jin Jinfa Huang Fenglin Liu Xian Wu Shen Ge Guoli Song David A. Clifton Jing Chen VLM 29 63 0 21 Nov 2022
On the Effect of Pre-training for Transformer in Different Modality on Offline Reinforcement Learning S. Takagi OffRL 18 7 0 17 Nov 2022
Cross-Reality Re-Rendering: Manipulating between Digital and Physical Realities Siddhartha Datta 25 0 0 15 Nov 2022
Seeded iterative clustering for histology region identification Eduard Chelebian F. Ciompi C. Wählby 17 2 0 14 Nov 2022
AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning Yaqing Wang Sahaj Agarwal Subhabrata Mukherjee Xiaodong Liu Jing Gao Ahmed Hassan Awadallah Jianfeng Gao MoE 11 118 0 31 Oct 2022
Weight Averaging: A Simple Yet Effective Method to Overcome Catastrophic Forgetting in Automatic Speech Recognition Steven Vander Eeckt Hugo Van hamme CLL MoMe 58 14 0 27 Oct 2022
Exploring Mode Connectivity for Pre-trained Language Models Yujia Qin Cheng Qian Jing Yi Weize Chen Yankai Lin Xu Han Zhiyuan Liu Maosong Sun Jie Zhou 27 20 0 25 Oct 2022
Surgical Fine-Tuning Improves Adaptation to Distribution Shifts Yoonho Lee Annie S. Chen Fahim Tajwar Ananya Kumar Huaxiu Yao Percy Liang Chelsea Finn OOD 49 197 0 20 Oct 2022
lo-fi: distributed fine-tuning without communication Mitchell Wortsman Suchin Gururangan Shen Li Ali Farhadi Ludwig Schmidt Michael G. Rabbat Ari S. Morcos 19 24 0 19 Oct 2022
Tiny-Attention Adapter: Contexts Are More Important Than the Number of Parameters Hongyu Zhao Hao Tan Hongyuan Mei MoE 31 16 0 18 Oct 2022
Wasserstein Barycenter-based Model Fusion and Linear Mode Connectivity of Neural Networks A. K. Akash Sixu Li Nicolas García Trillos 24 12 0 13 Oct 2022
SynBench: Task-Agnostic Benchmarking of Pretrained Representations using Synthetic Data Ching-Yun Ko Pin-Yu Chen Jeet Mohapatra Payel Das Lucani E. Daniel 19 3 0 06 Oct 2022
Disentangling Transfer in Continual Reinforcement Learning Maciej Wołczyk Michal Zajkac Razvan Pascanu Lukasz Kuciñski Piotr Milo's CLL 60 27 0 28 Sep 2022
Inducing Data Amplification Using Auxiliary Datasets in Adversarial Training Saehyung Lee Hyungyu Lee AAML 22 2 0 27 Sep 2022
Causes of Catastrophic Forgetting in Class-Incremental Semantic Segmentation Tobias Kalb Jürgen Beyerer CLL 23 8 0 16 Sep 2022