SmoothQuant+: Accurate and Efficient 4-bit Post-Training WeightQuantization for LLM

6 December 2023

Papers citing "SmoothQuant+: Accurate and Efficient 4-bit Post-Training WeightQuantization for LLM"

6 / 6 papers shown

Title
QArtSR: Quantization via Reverse-Module and Timestep-Retraining in One-Step Diffusion based Image Super-Resolution Libo Zhu Haotong Qin Kaicheng Yang W. J. Li Yong Guo Yulun Zhang Susanto Rahardja Xiaokang Yang MQ DiffM 59 0 0 07 Mar 2025
PassionSR: Post-Training Quantization with Adaptive Scale in One-Step Diffusion based Image Super-Resolution Libo Zhu J. Li Haotong Qin W. J. Li Yulun Zhang Yong Guo Xiaokang Yang DiffM MQ 64 1 0 26 Nov 2024
ASER: Activation Smoothing and Error Reconstruction for Large Language Model Quantization Weibo Zhao Yubin Shi Xinyu Lyu Wanchen Sui Shen Li Yong Li MQ 47 1 0 12 Nov 2024
QuantMoE-Bench: Examining Post-Training Quantization for Mixture-of-Experts Pingzhi Li Xiaolong Jin Yu Cheng Tianlong Chen Tianlong Chen MQ MoE 21 1 0 12 Jun 2024
Scalable MatMul-free Language Modeling Rui-Jie Zhu Yu Zhang Ethan Sifferman Tyler Sheaves Yiqiao Wang Dustin Richmond P. Zhou Jason Eshraghian 26 17 0 04 Jun 2024
The Pile: An 800GB Dataset of Diverse Text for Language Modeling Leo Gao Stella Biderman Sid Black Laurence Golding Travis Hoppe ... Horace He Anish Thite Noa Nabeshima Shawn Presser Connor Leahy AIMat 245 1,977 0 31 Dec 2020