An Analytical Theory of Curriculum Learning in Teacher-Student Networks

15 June 2021

Papers citing "An Analytical Theory of Curriculum Learning in Teacher-Student Networks"

15 / 15 papers shown

Title
A Computational Model of Inclusive Pedagogy: From Understanding to Application Francesco Balzan Pedro P. Santos Maurizio Gabbrielli Mahault Albarracin Manuel Lopes 27 0 0 02 May 2025
Enlightenment Period Improving DNN Performance Tiantian Liu Weishi Xu Meng Wan Jue Wang 31 0 0 02 Apr 2025
The impact of allocation strategies in subset learning on the expressive power of neural networks Ofir Schlisselberg Ran Darshan 91 0 0 10 Feb 2025
Quantifying artificial intelligence through algebraic generalization Takuya Ito Murray Campbell L. Horesh Tim Klinger Parikshit Ram ELM 48 0 0 08 Nov 2024
Human-inspired Perspectives: A Survey on AI Long-term Memory Zihong He Weizhe Lin Hao Zheng Fan Zhang Matt Jones Laurence Aitchison X. Xu Miao Liu Per Ola Kristensson Junxiao Shen 77 2 0 01 Nov 2024
Optimal Protocols for Continual Learning via Statistical Physics and Control Theory Francesco Mori Stefano Sarao Mannelli Francesca Mignacco 28 3 0 26 Sep 2024
Tilting the Odds at the Lottery: the Interplay of Overparameterisation and Curricula in Neural Networks Stefano Sarao Mannelli Yaraslau Ivashinka Andrew M. Saxe Luca Saglietti 37 2 0 03 Jun 2024
Meta-Learning Strategies through Value Maximization in Neural Networks Rodrigo Carrasco-Davis Javier Masís Andrew M. Saxe 27 1 0 30 Oct 2023
Instruction Tuning with Human Curriculum Bruce W. Lee Hyunsoo Cho Kang Min Yoo 40 3 0 14 Oct 2023
Connecting NTK and NNGP: A Unified Theoretical Framework for Wide Neural Network Learning Dynamics Yehonatan Avidan Qianyi Li H. Sompolinsky 60 8 0 08 Sep 2023
A Quantitative Approach to Predicting Representational Learning and Performance in Neural Networks Ryan Pyle Sebastian Musslick Jonathan D. Cohen Ankit B. Patel 17 0 0 14 Jul 2023
Provable Advantage of Curriculum Learning on Parity Targets with Mixed Inputs Emmanuel Abbe Elisabetta Cornacchia Aryo Lotfi 28 11 0 29 Jun 2023
The RL Perceptron: Generalisation Dynamics of Policy Learning in High Dimensions Nishil Patel Sebastian Lee Stefano Sarao Mannelli Sebastian Goldt Adrew Saxe OffRL 28 3 0 17 Jun 2023
A Mathematical Model for Curriculum Learning for Parities Elisabetta Cornacchia Elchanan Mossel 34 10 0 31 Jan 2023
Maslow's Hammer for Catastrophic Forgetting: Node Re-Use vs Node Activation Sebastian Lee Stefano Sarao Mannelli Claudia Clopath Sebastian Goldt Andrew M. Saxe CLL 42 12 0 18 May 2022