The Asymptotic Behavior of Attention in Transformers

v1v2 (latest)

The Asymptotic Behavior of Attention in Transformers

3 December 2024

Álvaro Rodríguez Abella

João Pedro Silvestre

ArXiv (abs)PDF HTML Github (2★)

Papers citing "The Asymptotic Behavior of Attention in Transformers"

5 / 5 papers shown

Title
Context-Selective State Space Models: Feedback is All You Need Riccardo Zattra Giacomo Baggio Umberto Casti Augusto Ferrante Francesco Ticozzi Mamba 128 0 0 15 Oct 2025
Localmax dynamics for attention in transformers and its asymptotic behavior Henri Cimetière Maria Teresa Chiri Bahman Gharesifard 71 1 0 19 Sep 2025
Synchronization of mean-field models on the circle Yury Polyanskiy Philippe Rigollet Andrew Yao 84 6 0 30 Jul 2025
Dual Filter: A Mathematical Framework for Inference using Transformer-like Architectures Heng-Sheng Chang P. Mehta 235 1 0 01 May 2025
Quantitative Clustering in Mean-Field Transformer Models Shi Chen Zhengjiang Lin Yury Polyanskiy Philippe Rigollet 340 13 0 20 Apr 2025