Phase Transitions in Transfer Learning for High-Dimensional Perceptrons

6 January 2021

Papers citing "Phase Transitions in Transfer Learning for High-Dimensional Perceptrons"

16 / 16 papers shown

Title
TrajDiffuse: A Conditional Diffusion Model for Environment-Aware Trajectory Prediction Qingze Liu Danrui Li Samuel S. Sohn Sejong Yoon Mubbasir Kapadia Vladimir Pavlovic 18 0 0 14 Oct 2024
Optimal Protocols for Continual Learning via Statistical Physics and Control Theory Francesco Mori Stefano Sarao Mannelli Francesca Mignacco 28 3 0 26 Sep 2024
Disentangling and Mitigating the Impact of Task Similarity for Continual Learning Naoki Hiratani CLL 35 2 0 30 May 2024
Eight challenges in developing theory of intelligence Haiping Huang 16 6 0 20 Jun 2023
The RL Perceptron: Generalisation Dynamics of Policy Learning in High Dimensions Nishil Patel Sebastian Lee Stefano Sarao Mannelli Sebastian Goldt Adrew Saxe OffRL 20 3 0 17 Jun 2023
Generalization Performance of Transfer Learning: Overparameterized and Underparameterized Regimes Peizhong Ju Sen Lin M. Squillante Yitao Liang Ness B. Shroff 22 2 0 08 Jun 2023
Optimal transfer protocol by incremental layer defrosting Federica Gerace Diego Doimo Stefano Sarao Mannelli Luca Saglietti A. Laio CLL 17 2 0 02 Mar 2023
Statistical mechanics of continual learning: variational principle and mean-field potential Chan Li Zhenye Huang Wenxuan Zou Haiping Huang 28 5 0 06 Dec 2022
Gaussian Universality of Perceptrons with Random Labels Federica Gerace Florent Krzakala Bruno Loureiro Ludovic Stephan Lenka Zdeborová 43 23 0 26 May 2022
Maslow's Hammer for Catastrophic Forgetting: Node Re-Use vs Node Activation Sebastian Lee Stefano Sarao Mannelli Claudia Clopath Sebastian Goldt Andrew M. Saxe CLL 39 12 0 18 May 2022
A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning Yehuda Dar Vidya Muthukumar Richard G. Baraniuk 24 71 0 06 Sep 2021
Continual Learning in the Teacher-Student Setup: Impact of Task Similarity Sebastian Lee Sebastian Goldt Andrew M. Saxe CLL 24 73 0 09 Jul 2021
Probing transfer learning with a model of synthetic correlated datasets Federica Gerace Luca Saglietti Stefano Sarao Mannelli Andrew M. Saxe Lenka Zdeborová OOD 11 30 0 09 Jun 2021
The Common Intuition to Transfer Learning Can Win or Lose: Case Studies for Linear Regression Yehuda Dar Daniel LeJeune Richard G. Baraniuk MLT 13 5 0 09 Mar 2021
On the Inherent Regularization Effects of Noise Injection During Training Oussama Dhifallah Yue M. Lu 19 29 0 15 Feb 2021
Double Double Descent: On Generalization Errors in Transfer Learning between Linear Regression Tasks Yehuda Dar Richard G. Baraniuk 18 19 0 12 Jun 2020