Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2411.13476
Cited By
When Precision Meets Position: BFloat16 Breaks Down RoPE in Long-Context Training
20 November 2024
Haonan Wang
Qian Liu
Chao Du
Tongyao Zhu
Cunxiao Du
Kenji Kawaguchi
Tianyu Pang
Re-assign community
ArXiv
PDF
HTML
Papers citing
"When Precision Meets Position: BFloat16 Breaks Down RoPE in Long-Context Training"
3 / 3 papers shown
Title
SkyLadder: Better and Faster Pretraining via Context Window Scheduling
Tongyao Zhu
Qian Liu
Haonan Wang
Shiqi Chen
Xiangming Gu
Tianyu Pang
Min-Yen Kan
36
0
0
19 Mar 2025
Efficient Many-Shot In-Context Learning with Dynamic Block-Sparse Attention
Emily Xiao
Chin-Jou Li
Yilin Zhang
Graham Neubig
Amanda Bertsch
BDL
63
0
0
11 Mar 2025
Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMs
Longxu Dou
Qian Liu
Fan Zhou
Changyu Chen
Zili Wang
...
Tianyu Pang
Chao Du
Xinyi Wan
Wei Lu
Min Lin
82
1
0
18 Feb 2025
1
