Lottery Jackpots Exist in Pre-trained Models

Lottery Jackpots Exist in Pre-trained Models

18 April 2021

Papers citing "Lottery Jackpots Exist in Pre-trained Models"

9 / 9 papers shown

Title
A Convex-optimization-based Layer-wise Post-training Pruner for Large Language Models Pengxiang Zhao Hanyu Hu Ping Li Yi Zheng Zhefeng Wang Xiaoming Yuan 31 1 0 07 Aug 2024
BESA: Pruning Large Language Models with Blockwise Parameter-Efficient Sparsity Allocation Peng-Tao Xu Wenqi Shao Mengzhao Chen Shitao Tang Kai-Chuang Zhang Peng Gao Fengwei An Yu Qiao Ping Luo MoE 24 27 0 18 Feb 2024
Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLMs Yu-xin Zhang Lirui Zhao Mingbao Lin Yunyun Sun Yiwu Yao Xingjia Han Jared Tanner Shiwei Liu Rongrong Ji SyDa 29 40 0 13 Oct 2023
Exploiting the Partly Scratch-off Lottery Ticket for Quantization-Aware Training Yunshan Zhong Gongrui Nan Yu-xin Zhang Fei Chao Rongrong Ji MQ 16 3 0 12 Nov 2022
Parameter-Efficient Sparsity for Large Language Models Fine-Tuning Yuchao Li Fuli Luo Chuanqi Tan Mengdi Wang Songfang Huang Shen Li Junjie Bai MQ 35 31 0 23 May 2022
Dimensionality Reduced Training by Pruning and Freezing Parts of a Deep Neural Network, a Survey Paul Wimmer Jens Mehnert A. P. Condurache DD 14 20 0 17 May 2022
OptG: Optimizing Gradient-driven Criteria in Network Sparsity Yu-xin Zhang Mingbao Lin Mengzhao Chen Fei Chao Rongrong Ji 25 5 0 30 Jan 2022
Fine-grained Data Distribution Alignment for Post-Training Quantization Yunshan Zhong Mingbao Lin Mengzhao Chen Ke Li Yunhang Shen Fei Chao Yongjian Wu Rongrong Ji MQ 60 18 0 09 Sep 2021
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand M. Andreetto Hartwig Adam 3DH 948 20,471 0 17 Apr 2017