Focus Your Attention (with Adaptive IIR Filters)

24 May 2023

Papers citing "Focus Your Attention (with Adaptive IIR Filters)"

9 / 9 papers shown

Title
Do Robot Snakes Dream like Electric Sheep? Investigating the Effects of Architectural Inductive Biases on Hallucination Jerry Huang Prasanna Parthasarathi Mehdi Rezagholizadeh Boxing Chen Sarath Chandar 48 0 0 22 Oct 2024
The Hidden Attention of Mamba Models Ameen Ali Itamar Zimerman Lior Wolf Mamba 29 57 0 03 Mar 2024
Attendre: Wait To Attend By Retrieval With Evicted Queries in Memory-Based Transformers for Long Context Processing Zi Yang Nan Hua RALM 29 4 0 10 Jan 2024
On the Long Range Abilities of Transformers Itamar Zimerman Lior Wolf 13 7 0 28 Nov 2023
Transformer-VQ: Linear-Time Transformers via Vector Quantization Albert Mohwald 19 15 0 28 Sep 2023
Multi-Dimensional Hyena for Spatial Inductive Bias Itamar Zimerman Lior Wolf ViT 20 4 0 24 Sep 2023
LLMZip: Lossless Text Compression using Large Language Models Chandra Shekhara Kaushik Valmeekam Krishna R. Narayanan D. Kalathil J. Chamberland S. Shakkottai 11 28 0 06 Jun 2023
Resurrecting Recurrent Neural Networks for Long Sequences Antonio Orvieto Samuel L. Smith Albert Gu Anushan Fernando Çağlar Gülçehre Razvan Pascanu Soham De 88 258 0 11 Mar 2023
OCD: Learning to Overfit with Conditional Diffusion Models Shahar Lutati Lior Wolf DiffM 13 8 0 02 Oct 2022