Memory Efficient Mixed-Precision Optimizers

21 September 2023

Papers citing "Memory Efficient Mixed-Precision Optimizers"

2 / 2 papers shown

Title
Language Adaptation on a Tight Academic Compute Budget: Tokenizer Swapping Works and Pure bfloat16 Is Enough Konstantin Dobler Gerard de Melo 50 1 0 28 Aug 2024
FP8 Formats for Deep Learning Paulius Micikevicius Dusan Stosic N. Burgess Marius Cornea Pradeep Dubey ... Naveen Mellempudi S. Oberman M. Shoeybi Michael Siu Hao Wu BDL VLM MQ 69 121 0 12 Sep 2022