The committee machine: Computational to statistical gaps in learning a
two-layers neural network

The committee machine: Computational to statistical gaps in learning a two-layers neural network

14 June 2018

Antoine Maillard

Florent Krzakala

Lenka Zdeborová

Papers citing "The committee machine: Computational to statistical gaps in learning a two-layers neural network"

14 / 14 papers shown

Title
Information-theoretic reduction of deep neural networks to linear models in the overparametrized proportional regime Francesco Camilli D. Tieplova Eleonora Bergamin Jean Barbier 82 0 0 06 May 2025
How a student becomes a teacher: learning and forgetting through Spectral methods Lorenzo Giambagli L. Buffoni Lorenzo Chicchi Duccio Fanelli 13 7 0 19 Oct 2023
Annihilation of Spurious Minima in Two-Layer ReLU Networks Yossi Arjevani M. Field 16 8 0 12 Oct 2022
Learning curves for the multi-class teacher-student perceptron Elisabetta Cornacchia Francesca Mignacco R. Veiga Cédric Gerbelot Bruno Loureiro Lenka Zdeborová 12 21 0 22 Mar 2022
Phase diagram of Stochastic Gradient Descent in high-dimensional two-layer neural networks R. Veiga Ludovic Stephan Bruno Loureiro Florent Krzakala Lenka Zdeborová MLT 10 31 0 01 Feb 2022
Overview frequency principle/spectral bias in deep learning Z. Xu Yaoyu Zhang Tao Luo FaML 25 64 0 19 Jan 2022
Analytic Study of Families of Spurious Minima in Two-Layer ReLU Neural Networks: A Tale of Symmetry II Yossi Arjevani M. Field 28 18 0 21 Jul 2021
Understanding Robustness in Teacher-Student Setting: A New Perspective Zhuolin Yang Zhaoxi Chen Tiffany Cai Xinyun Chen Bo-wen Li Yuandong Tian AAML 24 2 0 25 Feb 2021
Align, then memorise: the dynamics of learning with feedback alignment Maria Refinetti Stéphane dÁscoli Ruben Ohana Sebastian Goldt 20 36 0 24 Nov 2020
The Gaussian equivalence of generative models for learning with shallow neural networks Sebastian Goldt Bruno Loureiro Galen Reeves Florent Krzakala M. Mézard Lenka Zdeborová BDL 30 100 0 25 Jun 2020
Generalisation error in learning with random features and the hidden manifold model Federica Gerace Bruno Loureiro Florent Krzakala M. Mézard Lenka Zdeborová 22 165 0 21 Feb 2020
Inference in Multi-Layer Networks with Matrix-Valued Unknowns Parthe Pandit Mojtaba Sahraee-Ardakan S. Rangan P. Schniter A. Fletcher 13 6 0 26 Jan 2020
Hidden Unit Specialization in Layered Neural Networks: ReLU vs. Sigmoidal Activation Elisa Oostwal Michiel Straat Michael Biehl MLT 56 54 0 16 Oct 2019
Modelling the influence of data structure on learning in neural networks: the hidden manifold model Sebastian Goldt M. Mézard Florent Krzakala Lenka Zdeborová BDL 21 51 0 25 Sep 2019