Overparameterized Neural Networks Implement Associative Memory

Overparameterized Neural Networks Implement Associative Memory

26 September 2019

Adityanarayanan Radhakrishnan

Papers citing "Overparameterized Neural Networks Implement Associative Memory"

13 / 13 papers shown

Title
Key-value memory in the brain Samuel J. Gershman Ila Fiete Kazuki Irie 34 7 0 06 Jan 2025
Empirical Capacity Model for Self-Attention Neural Networks Aki Härmä M. Pietrasik Anna Wilbik 34 1 0 22 Jul 2024
Rethinking the Relationship between Recurrent and Non-Recurrent Neural Networks: A Study in Sparsity Quincy Hershey Randy Paffenroth Harsh Nilesh Pathak Simon Tavener 64 1 0 01 Apr 2024
Unified machine learning tasks and datasets for enhancing renewable energy Arsam Aryandoust Thomas Rigoni Francesco di Stefano Anthony Patt 37 0 0 12 Nov 2023
How Much Training Data is Memorized in Overparameterized Autoencoders? An Inverse Problem Perspective on Memorization Evaluation Koren Abitbul Yehuda Dar TDI 20 2 0 04 Oct 2023
Fundamental Limits of Deep Learning-Based Binary Classifiers Trained with Hinge Loss T. Getu Georges Kaddoum M. Bennis 34 1 0 13 Sep 2023
On the Relationship Between Variational Inference and Auto-Associative Memory Louis Annabi Alexandre Pitti M. Quoy BDL 27 5 0 14 Oct 2022
Bird-Eye Transformers for Text Generation Models Lei Sha Yuhang Song Yordan Yordanov Tommaso Salvatori Thomas Lukasiewicz 19 0 0 08 Oct 2022
Associative Memories via Predictive Coding Tommaso Salvatori Yuhang Song Yujian Hong Simon Frieder Lei Sha Zhenghua Xu Rafal Bogacz Thomas Lukasiewicz 21 61 0 16 Sep 2021
Simple, Fast, and Flexible Framework for Matrix Completion with Infinite Width Neural Networks Adityanarayanan Radhakrishnan George Stefanakis M. Belkin Caroline Uhler 30 25 0 31 Jul 2021
A Mechanism for Producing Aligned Latent Spaces with Autoencoders Saachi Jain Adityanarayanan Radhakrishnan Caroline Uhler 14 9 0 29 Jun 2021
Associative Memory in Iterated Overparameterized Sigmoid Autoencoders Yibo Jiang C. Pehlevan 13 13 0 30 Jun 2020
Pixel Recurrent Neural Networks Aaron van den Oord Nal Kalchbrenner Koray Kavukcuoglu SSeg GAN 233 2,547 0 25 Jan 2016