Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2410.18613
Cited By
Rethinking Softmax: Self-Attention with Polynomial Activations
24 October 2024
Hemanth Saratchandran
Jianqiao Zheng
Yiping Ji
Wenbo Zhang
Simon Lucey
Re-assign community
ArXiv
PDF
HTML
Papers citing
"Rethinking Softmax: Self-Attention with Polynomial Activations"
2 / 2 papers shown
Title
Always Skip Attention
Yiping Ji
Hemanth Saratchandran
Peyman Moghaddam
Simon Lucey
64
0
0
04 May 2025
Softpick: No Attention Sink, No Massive Activations with Rectified Softmax
Zayd Muhammad Kawakibi Zuhri
Erland Hilman Fuadi
Alham Fikri Aji
31
0
0
29 Apr 2025
1
