Papers citing 'SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot'

Title
Inference with Reference: Lossless Acceleration of Large Language Models Nan Yang Tao Ge Liang Wang Binxing Jiao Daxin Jiang Linjun Yang Rangan Majumder Furu Wei 227 70 0 10 Apr 2023
Blockwise Compression of Transformer-based Models without RetrainingNeural Networks (Neural Netw.), 2023 Gaochen Dong W. Chen 88 3 0 04 Apr 2023
RPTQ: Reorder-based Post-training Quantization for Large Language Models Zhihang Yuan Lin Niu Jia-Wen Liu Wenyu Liu Xinggang Wang Yuzhang Shang Guangyu Sun Qiang Wu Jiaxiang Wu Bingzhe Wu MQ 524 110 0 03 Apr 2023
Dense Sparse Retrieval: Using Sparse Language Models for Inference Efficient Dense Retrieval Daniel Fernando Campos ChengXiang Zhai 105 1 0 31 Mar 2023
Vision Models Can Be Efficiently Specialized via Few-Shot Task-Aware Compression Denis Kuznedelev Soroush Tabesh Kimia Noorbakhsh Elias Frantar Sara Beery Eldar Kurtic Dan Alistarh MQ VLM 177 3 0 25 Mar 2023
ZeroQuant-V2: Exploring Post-training Quantization in LLMs from Comprehensive Study to Low Rank Compensation Z. Yao Xiaoxia Wu Cheng-rong Li Stephen Youn Yuxiong He MQ 348 69 0 15 Mar 2023
FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPUInternational Conference on Machine Learning (ICML), 2023 Ying Sheng Lianmin Zheng Binhang Yuan Zhuohan Li Max Ryabinin ... Joseph E. Gonzalez Abigail Z. Jacobs Christopher Ré Ion Stoica Ce Zhang 412 551 0 13 Mar 2023
Streaming Kernel PCA Algorithm With Small Space Yichuan Deng Zhao Song Zifan Wang Hangke Zhang 292 4 0 08 Mar 2023
Complex QA and language models hybrid architectures, Survey Xavier Daull P. Bellot Emmanuel Bruno Vincent Martin Elisabeth Murisasco ELM 623 20 0 17 Feb 2023
A Comprehensive Review and a Taxonomy of Edge Machine Learning: Requirements, Paradigms, and TechniquesApplied Informatics (AI), 2023 Wenbin Li Hakim Hacid Ebtesam Almazrouei Merouane Debbah 279 19 0 16 Feb 2023
Ten Lessons We Have Learned in the New "Sparseland": A Short Handbook for Sparse Neural Network Researchers Shiwei Liu Zinan Lin 377 34 0 06 Feb 2023
Broken Neural Scaling LawsInternational Conference on Learning Representations (ICLR), 2022 Ethan Caballero Kshitij Gupta Irina Rish David M. Krueger 960 98 0 26 Oct 2022
CAP: Correlation-Aware Pruning for Highly-Accurate Sparse Vision ModelsNeural Information Processing Systems (NeurIPS), 2022 Denis Kuznedelev Eldar Kurtic Elias Frantar Dan Alistarh VLM ViT 172 21 0 14 Oct 2022
An Information Theory-inspired Strategy for Automatic Network Pruning Xiawu Zheng Yuexiao Ma Teng Xi Gang Zhang Errui Ding Yuchao Li Jie Chen Yonghong Tian Rongrong Ji 545 17 0 19 Aug 2021