Adaptive Loss Scaling for Mixed Precision Training

28 October 2019

Papers citing "Adaptive Loss Scaling for Mixed Precision Training"

4 / 4 papers shown

Title
8-bit Numerical Formats for Deep Neural Networks Badreddine Noune Philip Jones Daniel Justus Dominic Masters Carlo Luschi MQ 146 37 0 06 Jun 2022
Learning to Predict Gradients for Semi-Supervised Continual LearningIEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2022 Yan Luo Yongkang Wong Mohan S. Kankanhalli Qi Zhao SSL CLL 134 12 0 23 Jan 2022
Representation range needs for 16-bit neural network training Valentina Popescu Abhinav Venigalla Di Wu R. Schreiber MQ 60 2 0 29 Mar 2021
Contrastive Weight Regularization for Large Minibatch SGD Qiwei Yuan Weizhe Hua Yi Zhou Cunxi Yu OffRL 140 1 0 17 Nov 2020