In-Hindsight Quantization Range Estimation for Quantized Training

10 May 2021

Papers citing "In-Hindsight Quantization Range Estimation for Quantized Training"

5 / 5 papers shown

Title
Toward INT4 Fixed-Point Training via Exploring Quantization Error for Gradients Jeimin Jeon Junghyup Lee Jeimin Jeon Jaehyeon Moon Bumsub Ham MQ 219 2 0 17 Jul 2024
Hadamard Domain Training with Integers for Class Incremental Quantized Learning Martin Schiemer Clemens J. S. Schaefer Jayden Parker Vap Mark Horeni Yu Emma Wang Juan Ye Siddharth Joshi 154 2 0 05 Oct 2023
FP8 versus INT8 for efficient deep learning inference M. V. Baalen Andrey Kuzmin Suparna S. Nair Yuwei Ren E. Mahurin ... Sundar Subramanian Sanghyuk Lee Markus Nagel Joseph B. Soriaga Tijmen Blankevoort MQ 197 55 0 31 Mar 2023
AskewSGD : An Annealed interval-constrained Optimisation method to train Quantized Neural NetworksInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2022 Louis Leconte S. Schechtman Eric Moulines 191 4 0 07 Nov 2022
Accurate Neural Training with 4-bit Matrix Multiplications at Standard FormatsInternational Conference on Learning Representations (ICLR), 2021 Brian Chmiel Ron Banner Elad Hoffer Hilla Ben Yaacov Daniel Soudry MQ 277 28 0 19 Dec 2021