The Quarks of Attention

The Quarks of Attention

Artificial Intelligence (AIJ), 2022

15 February 2022

Roman Vershynin

ArXiv (abs)PDF HTML

Papers citing "The Quarks of Attention"

7 / 7 papers shown

Title
Particle Hit Clustering and Identification Using Point Set Transformers in Liquid Argon Time Projection ChambersJournal of Instrumentation (JINST), 2025 Edgar E. Robles A. Yankelevich Wenjie Wu J. Bian Pierre Baldi 203 2 0 11 Apr 2025
Implicit Bias and Fast Convergence Rates for Self-attention Bhavya Vasudeva Puneesh Deora Christos Thrampoulidis 349 26 0 08 Feb 2024
On the Optimization and Generalization of Multi-head Attention Puneesh Deora Rouzbeh Ghaderi Hossein Taheri Christos Thrampoulidis MLT 244 41 0 19 Oct 2023
Transformers as Support Vector Machines Davoud Ataee Tarzanagh Yingcong Li Christos Thrampoulidis Samet Oymak 428 58 0 31 Aug 2023
On the Role of Attention in Prompt-tuningInternational Conference on Machine Learning (ICML), 2023 Samet Oymak A. S. Rawat Mahdi Soltanolkotabi Christos Thrampoulidis MLT LRM 194 59 0 06 Jun 2023
Inductive biases in deep learning models for weather prediction Jannik Thümmel Matthias Karlbauer S. Otte C. Zarfl Georg Martius ... Thomas Scholten Ulrich Friedrich V. Wulfmeyer B. Goswami Martin Volker Butz AI4CE 259 8 0 06 Apr 2023
Interpretable Joint Event-Particle Reconstruction for Neutrino Physics at NOvA with Sparse CNNs and Transformers Alexander Shmakov A. Yankelevich Jianming Bian Pierre Baldi BDL ViT 150 2 0 10 Mar 2023