Normalized Attention Without Probability Cage

Normalized Attention Without Probability Cage

19 May 2020

Roger Wattenhofer

Papers citing "Normalized Attention Without Probability Cage"

6 / 6 papers shown

Title
Encryption-Friendly LLM Architecture Donghwan Rho Taeseong Kim Minje Park Jung Woo Kim Hyunsik Chae Jung Hee Cheon Ernest K. Ryu 52 1 0 24 Feb 2025
The CLRS Algorithmic Reasoning Benchmark Petar Velivcković Adria Puigdomenech Badia David Budden Razvan Pascanu Andrea Banino Mikhail Dashevskiy R. Hadsell Charles Blundell 157 87 0 31 May 2022
Graph Neural Networks are Dynamic Programmers Andrew Dudzik Petar Velickovic 26 62 0 29 Mar 2022
TrimBERT: Tailoring BERT for Trade-offs S. N. Sridhar Anthony Sarah Sairam Sundaresan MQ 14 4 0 24 Feb 2022
Which transformer architecture fits my data? A vocabulary bottleneck in self-attention Noam Wies Yoav Levine Daniel Jannai Amnon Shashua 24 20 0 09 May 2021
Combinatorial optimization and reasoning with graph neural networks Quentin Cappart Didier Chételat Elias Boutros Khalil Andrea Lodi Christopher Morris Petar Velickovic AI4CE 30 345 0 18 Feb 2021