Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2504.18929
Cited By
Revisiting Transformers through the Lens of Low Entropy and Dynamic Sparsity
26 April 2025
Ruifeng Ren
Yong Liu
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Revisiting Transformers through the Lens of Low Entropy and Dynamic Sparsity"
3 / 3 papers shown
Title
Scaling White-Box Transformers for Vision
Jinrui Yang
Xianhang Li
Druv Pai
Yuyin Zhou
Yi-An Ma
Yaodong Yu
Cihang Xie
ViT
456
13
0
30 May 2024
Understanding Emergent Abilities of Language Models from the Loss Perspective
Neural Information Processing Systems (NeurIPS), 2024
Zhengxiao Du
Aohan Zeng
Yuxiao Dong
Jie Tang
UQCV
LRM
347
76
0
23 Mar 2024
Implicit Bias and Fast Convergence Rates for Self-attention
Bhavya Vasudeva
Puneesh Deora
Christos Thrampoulidis
301
26
0
08 Feb 2024
1