Dissecting the Interplay of Attention Paths in a Statistical Mechanics Theory of Transformers

24 May 2024

Papers citing "Dissecting the Interplay of Attention Paths in a Statistical Mechanics Theory of Transformers"

3 / 3 papers shown

Title
Intra-neuronal attention within language models Relationships between activation and semantics Michael Pichat William Pogrund Paloma Pichat Armanouche Gasparian Samuel Demarchi Corbet Alois Georgeon Michael Veillet-Guillem MILM 38 0 0 17 Mar 2025
Optimal Protocols for Continual Learning via Statistical Physics and Control Theory Francesco Mori Stefano Sarao Mannelli Francesca Mignacco 23 2 0 26 Sep 2024
Towards Understanding Inductive Bias in Transformers: A View From Infinity Itay Lavie Guy Gur-Ari Z. Ringel 24 1 0 07 Feb 2024