Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
All Papers
0 / 0 papers shown
Title
Home
Papers
2504.18929
Cited By
Revisiting Transformers through the Lens of Low Entropy and Dynamic Sparsity
26 April 2025
Ruifeng Ren
Yong Liu
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Revisiting Transformers through the Lens of Low Entropy and Dynamic Sparsity"
3 / 3 papers shown
Title
Scaling White-Box Transformers for Vision
Jinrui Yang
Xianhang Li
Druv Pai
Yuyin Zhou
Yi-An Ma
Yaodong Yu
Cihang Xie
ViT
488
13
0
30 May 2024
Understanding Emergent Abilities of Language Models from the Loss Perspective
Neural Information Processing Systems (NeurIPS), 2024
Zhengxiao Du
Aohan Zeng
Yuxiao Dong
Jie Tang
UQCV
LRM
359
76
0
23 Mar 2024
Implicit Bias and Fast Convergence Rates for Self-attention
Bhavya Vasudeva
Puneesh Deora
Christos Thrampoulidis
321
26
0
08 Feb 2024
1