On the Theory of Transfer Learning: The Importance of Task Diversity

20 June 2020

Papers citing "On the Theory of Transfer Learning: The Importance of Task Diversity"

50 / 54 papers shown

Title
FloE: On-the-Fly MoE Inference on Memory-constrained GPU Yuxin Zhou Zheng Li J. Zhang Jue Wang Yanjie Wang Zhongle Xie Ke Chen Lidan Shou MoE 52 0 0 09 May 2025
GeoERM: Geometry-Aware Multi-Task Representation Learning on Riemannian Manifolds Aoran Chen Yang Feng 31 0 0 05 May 2025
Optimal Transfer Learning for Missing Not-at-Random Matrix Completion Akhil Jalan Yassir Jedra Arya Mazumdar Soumendu Sundar Mukherjee Purnamrita Sarkar 153 0 0 28 Feb 2025
On The Statistical Complexity of Offline Decision-Making Thanh Nguyen-Tang R. Arora OffRL 43 1 0 10 Jan 2025
Deep Transfer Learning: Model Framework and Error Analysis Yuling Jiao Huazhen Lin Yuchen Luo Jerry Zhijian Yang 44 1 0 12 Oct 2024
Transfer Learning for Latent Variable Network Models Akhil Jalan Arya Mazumdar Soumendu Sundar Mukherjee Purnamrita Sarkar 38 1 0 05 Jun 2024
Feature contamination: Neural networks learn uncorrelated features and fail to generalize Tianren Zhang Chujie Zhao Guanyu Chen Yizhou Jiang Feng Chen OOD MLT OODD 77 3 0 05 Jun 2024
Understanding Optimal Feature Transfer via a Fine-Grained Bias-Variance Analysis Yufan Li Subhabrata Sen Ben Adlam MLT 51 1 0 18 Apr 2024
On Sample-Efficient Offline Reinforcement Learning: Data Diversity, Posterior Sampling, and Beyond Thanh Nguyen-Tang Raman Arora OffRL 33 3 0 06 Jan 2024
Physics-Informed Neural Networks for High-Frequency and Multi-Scale Problems using Transfer Learning Abdul Hannan Mustajab Hao Lyu Z. Rizvi Frank Wuttke AI4CE PINN 20 9 0 05 Jan 2024
4M: Massively Multimodal Masked Modeling David Mizrahi Roman Bachmann Ouguzhan Fatih Kar Teresa Yeo Mingfei Gao Afshin Dehghan Amir Zamir MLLM 50 63 0 11 Dec 2023
Divert More Attention to Vision-Language Object Tracking Mingzhe Guo Zhipeng Zhang Li Jing Haibin Ling Heng Fan VLM 40 3 0 19 Jul 2023
Learning to Generalize for Cross-domain QA Yingjie Niu Linyi Yang Ruihai Dong Yue Zhang 21 6 0 14 May 2023
DAC-MR: Data Augmentation Consistency Based Meta-Regularization for Meta-Learning Jun Shu Xiang Yuan Deyu Meng Zongben Xu 28 4 0 13 May 2023
EvoluNet: Advancing Dynamic Non-IID Transfer Learning on Graphs Haohui Wang Yuzhen Mao Yujun Yan Yaoqing Yang Jianhui Sun ... Si Zhang Alison Hu Edward Bowen Tyler Cody Dawei Zhou 44 2 0 01 May 2023
Limits of Model Selection under Transfer Learning Steve Hanneke Samory Kpotufe Yasaman Mahdaviyeh 39 6 0 29 Apr 2023
Deep Learning for Cross-Domain Few-Shot Visual Recognition: A Survey Huali Xu Shuaifeng Zhi Shuzhou Sun Vishal M. Patel Li Liu 35 13 0 15 Mar 2023
Provable Pathways: Learning Multiple Tasks over Multiple Paths Yingcong Li Samet Oymak MoE 26 4 0 08 Mar 2023
On the Provable Advantage of Unsupervised Pretraining Jiawei Ge Shange Tang Jianqing Fan Chi Jin SSL 33 16 0 02 Mar 2023
Multi-Task Imitation Learning for Linear Dynamical Systems Thomas T. Zhang Katie Kang Bruce D. Lee Claire Tomlin Sergey Levine Stephen Tu Nikolai Matni 38 23 0 01 Dec 2022
GLUE-X: Evaluating Natural Language Understanding Models from an Out-of-distribution Generalization Perspective Linyi Yang Shuibai Zhang Libo Qin Yafu Li Yidong Wang Hanmeng Liu Jindong Wang Xingxu Xie Yue Zhang ELM 44 79 0 15 Nov 2022
Transfer learning with affine model transformation Shunya Minami Kenji Fukumizu Yoshihiro Hayashi Ryo Yoshida 27 1 0 18 Oct 2022
Universal Prompt Tuning for Graph Neural Networks Taoran Fang Yunchao Zhang Yang Yang Chunping Wang Lei Chen 24 49 0 30 Sep 2022
MLink: Linking Black-Box Models from Multiple Domains for Collaborative Inference Mu Yuan Lan Zhang Zimu Zheng Yi-Nan Zhang Xiang-Yang Li 25 2 0 28 Sep 2022
InFi: End-to-End Learning to Filter Input for Resource-Efficiency in Mobile-Centric Inference Mu Yuan Lan Zhang Fengxiang He Xueting Tong Miao-Hui Song Zhengyuan Xu Xiang-Yang Li 32 2 0 28 Sep 2022
Blessing of Class Diversity in Pre-training Yulai Zhao Jianshu Chen S. Du AI4CE 17 3 0 07 Sep 2022
Divert More Attention to Vision-Language Tracking Mingzhe Guo Zhipeng Zhang Heng Fan Li Jing 29 53 0 03 Jul 2022
On Hypothesis Transfer Learning of Functional Linear Models Haotian Lin M. Reimherr 27 3 0 09 Jun 2022
Neural Collapse: A Review on Modelling Principles and Generalization Vignesh Kothapalli 25 71 0 08 Jun 2022
Provable Benefits of Representational Transfer in Reinforcement Learning Alekh Agarwal Yuda Song Wen Sun Kaiwen Wang Mengdi Wang Xuezhou Zhang OffRL 23 33 0 29 May 2022
FedAvg with Fine Tuning: Local Updates Lead to Representation Learning Liam Collins Hamed Hassani Aryan Mokhtari Sanjay Shakkottai FedML 32 75 0 27 May 2022
Alleviating Representational Shift for Continual Fine-tuning Shibo Jie Zhi-Hong Deng Ziheng Li CLL 35 11 0 22 Apr 2022
MultiMAE: Multi-modal Multi-task Masked Autoencoders Roman Bachmann David Mizrahi Andrei Atanov Amir Zamir 41 265 0 04 Apr 2022
Nearly Minimax Algorithms for Linear Bandits with Shared Representation Jiaqi Yang Qi Lei Jason D. Lee S. Du 40 16 0 29 Mar 2022
PACTran: PAC-Bayesian Metrics for Estimating the Transferability of Pretrained Models to Classification Tasks Nan Ding Xi Chen Tomer Levinboim Soravit Changpinyo Radu Soricut 22 26 0 10 Mar 2022
Discriminability-Transferability Trade-Off: An Information-Theoretic Perspective Quan Cui Bingchen Zhao Zhao-Min Chen Borui Zhao Renjie Song Jiajun Liang Boyan Zhou Osamu Yoshie 24 18 0 08 Mar 2022
Combining Observational and Randomized Data for Estimating Heterogeneous Treatment Effects Tobias Hatt Jeroen Berrevoets Alicia Curth Stefan Feuerriegel M. Schaar CML 52 29 0 25 Feb 2022
Adaptive and Robust Multi-Task Learning Yaqi Duan Kaizheng Wang 75 23 0 10 Feb 2022
Learning Mixtures of Linear Dynamical Systems Yanxi Chen H. Vincent Poor 20 17 0 26 Jan 2022
Variational Model Inversion Attacks Kuan-Chieh Jackson Wang Yanzhe Fu Ke Li Ashish Khisti R. Zemel Alireza Makhzani MIACV 16 95 0 26 Jan 2022
Non-Stationary Representation Learning in Sequential Linear Bandits Yuzhen Qin Tommaso Menara Samet Oymak ShiNung Ching Fabio Pasqualetti OffRL 40 17 0 13 Jan 2022
Learning Curves for Continual Learning in Neural Networks: Self-Knowledge Transfer and Forgetting Ryo Karakida S. Akaho CLL 32 11 0 03 Dec 2021
Linear Speedup in Personalized Collaborative Learning El Mahdi Chayti Sai Praneeth Karimireddy Sebastian U. Stich Nicolas Flammarion Martin Jaggi FedML 18 13 0 10 Nov 2021
Exploiting a Zoo of Checkpoints for Unseen Tasks Jiaji Huang Qiang Qiu Kenneth Ward Church 27 4 0 05 Nov 2021
Provable Hierarchy-Based Meta-Reinforcement Learning Kurtland Chua Qi Lei Jason D. Lee 22 5 0 18 Oct 2021
A Scaling Law for Synthetic-to-Real Transfer: How Much Is Your Pre-training Effective? Hiroaki Mikami Kenji Fukumizu Shogo Murai Shuji Suzuki Yuta Kikuchi Taiji Suzuki S. Maeda Kohei Hayashi 40 12 0 25 Aug 2021
Adversarial Training Helps Transfer Learning via Better Representations Zhun Deng Linjun Zhang Kailas Vodrahalli Kenji Kawaguchi James Zou GAN 36 52 0 18 Jun 2021
Bridging Multi-Task Learning and Meta-Learning: Towards Efficient Training and Effective Adaptation Haoxiang Wang Han Zhao Bo-wen Li 37 88 0 16 Jun 2021
On the Power of Multitask Representation Learning in Linear MDP Rui Lu Gao Huang S. Du 27 28 0 15 Jun 2021
Meta-Adaptive Nonlinear Control: Theory and Algorithms Guanya Shi Kamyar Azizzadenesheli Michael O'Connell Soon-Jo Chung Yisong Yue 29 41 0 11 Jun 2021