On Sparse Modern Hopfield Model

22 September 2023

Jerry Yao-Chieh Hu

Papers citing "On Sparse Modern Hopfield Model"

24 / 24 papers shown

Title
Fast and Low-Cost Genomic Foundation Models via Outlier Removal Haozheng Luo Chenghao Qiu Maojiang Su Zhihan Zhou Zoe Mehta Guo Ye Jerry Yao-Chieh Hu Han Liu AAML 53 0 0 01 May 2025
PLADIS: Pushing the Limits of Attention in Diffusion Models at Inference Time by Leveraging Sparsity Kwanyoung Kim Byeongsu Sim DiffM VLM 50 0 0 10 Mar 2025
Video Latent Flow Matching: Optimal Polynomial Projections for Video Interpolation and Extrapolation Yang Cao Zhao-quan Song Chiwun Yang VGen 44 2 0 01 Feb 2025
Dense Associative Memory Through the Lens of Random Features Benjamin Hoover Duen Horng Chau Hendrik Strobelt Parikshit Ram Dmitry Krotov BDL 41 5 0 31 Oct 2024
Bypassing the Exponential Dependency: Looped Transformers Efficiently Learn In-context by Multi-step Gradient Descent Bo Chen Xiaoyu Li Yingyu Liang Zhenmei Shi Zhao-quan Song 77 18 0 15 Oct 2024
HSR-Enhanced Sparse Attention Acceleration Bo Chen Yingyu Liang Zhizhou Sha Zhenmei Shi Zhao-quan Song 75 17 0 14 Oct 2024
Fine-grained Attention I/O Complexity: Comprehensive Analysis for Backward Passes Xiaoyu Li Yingyu Liang Zhenmei Shi Zhao-quan Song Yufa Zhou 47 15 0 12 Oct 2024
Predictive Attractor Models R. Mounir Sudeep Sarkar 16 0 0 03 Oct 2024
Do LLMs dream of elephants (when told not to)? Latent concept association and associative memory in transformers Yibo Jiang Goutham Rajendran Pradeep Ravikumar Bryon Aragam CLL KELM 26 6 0 26 Jun 2024
Decoupled Alignment for Robust Plug-and-Play Adaptation Haozheng Luo Jiahao Yu Wenxin Zhang Jialong Li Jerry Yao-Chieh Hu Xingyu Xing Han Liu 38 10 0 03 Jun 2024
Beyond Scaling Laws: Understanding Transformer Performance with Associative Memory Xueyan Niu Bo Bai Lei Deng Wei Han 28 6 0 14 May 2024
BiSHop: Bi-Directional Cellular Learning for Tabular Data with Generalized Sparse Modern Hopfield Model Chenwei Xu Yu-Chao Huang Jerry Yao-Chieh Hu Weijian Li Ammar Gilani H. Goan Han Liu 37 19 0 04 Apr 2024
Outlier-Efficient Hopfield Layers for Large Transformer-Based Models Jerry Yao-Chieh Hu Pei-Hsuan Chang Haozheng Luo Hong-Yu Chen Weijian Li Wei-Po Wang Han Liu 31 25 0 04 Apr 2024
CoRMF: Criticality-Ordered Recurrent Mean Field Ising Solver Zhenyu Pan Ammar Gilani En-Jui Kuo Zhuo Liu LRM 29 4 0 05 Mar 2024
Sparse and Structured Hopfield Networks Saul Santos Vlad Niculae Daniel McNamee Andre F. T. Martins 23 4 0 21 Feb 2024
Beyond PID Controllers: PPO with Neuralized PID Policy for Proton Beam Intensity Control in Mu2e Chenwei Xu Jerry Yao-Chieh Hu A. Narayanan M. Thieme V. Nagaslaev ... Rui Shi S. Memik A. Shuping Kyle Hazelwood Han Liu 11 2 0 28 Dec 2023
In-Context Exemplars as Clues to Retrieving from Large Associative Memory Jiachen Zhao 6 7 0 06 Nov 2023
The Closeness of In-Context Learning and Weight Shifting for Softmax Regression Shuai Li Zhao-quan Song Yu Xia Tong Yu Tianyi Zhou 28 36 0 26 Apr 2023
FiLM: Frequency improved Legendre Memory Model for Long-term Time Series Forecasting Tian Zhou Ziqing Ma Xue Wang Qingsong Wen Liang Sun Tao Yao Wotao Yin Rong Jin AI4TS 115 165 0 18 May 2022
CLOOB: Modern Hopfield Networks with InfoLOOB Outperform CLIP Andreas Fürst Elisabeth Rumetshofer Johannes Lehner Viet-Hung Tran Fei Tang ... David P. Kreil Michael K Kopp G. Klambauer Angela Bitto-Nemling Sepp Hochreiter VLM CLIP 190 101 0 21 Oct 2021
Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting Haoyi Zhou Shanghang Zhang J. Peng Shuai Zhang Jianxin Li Hui Xiong Wan Zhang AI4TS 161 3,799 0 14 Dec 2020
Open-Ended Multi-Modal Relational Reasoning for Video Question Answering Haozheng Luo Ruiyang Qin Chenwei Xu Guo Ye Zening Luo 43 4 0 01 Dec 2020
Modern Hopfield Networks and Attention for Immune Repertoire Classification Michael Widrich Bernhard Schafl Hubert Ramsauer Milena Pavlović Lukas Gruber ... Johannes Brandstetter G. K. Sandve Victor Greiff Sepp Hochreiter G. Klambauer 173 117 0 16 Jul 2020
Question Classification with Deep Contextualized Transformer Haozheng Luo Ningwei Liu Charles Feng 38 2 0 17 Oct 2019