ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large
Language Models

ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models

12 June 2024

Xiang Meng

Papers citing "ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models"

7 / 7 papers shown

Title
SPAP: Structured Pruning via Alternating Optimization and Penalty Methods Hanyu Hu Xiaoming Yuan 34 0 0 06 May 2025
Dynamic Low-Rank Sparse Adaptation for Large Language Models Weizhong Huang Yuxin Zhang Xiawu Zheng Y. Liu Jing Lin Yiwu Yao Rongrong Ji 75 0 0 21 Feb 2025
Preserving Deep Representations In One-Shot Pruning: A Hessian-Free Second-Order Optimization Framework Ryan Lucas Rahul Mazumder 59 0 0 27 Nov 2024
Sparks of Artificial General Intelligence: Early experiments with GPT-4 Sébastien Bubeck Varun Chandrasekaran Ronen Eldan J. Gehrke Eric Horvitz ... Scott M. Lundberg Harsha Nori Hamid Palangi Marco Tulio Ribeiro Yi Zhang ELM AI4MH AI4CE ALM 197 2,953 0 22 Mar 2023
Accelerated Sparse Neural Training: A Provable and Efficient Method to Find N:M Transposable Masks Itay Hubara Brian Chmiel Moshe Island Ron Banner S. Naor Daniel Soudry 36 89 0 16 Feb 2021
The Lottery Ticket Hypothesis for Pre-trained BERT Networks Tianlong Chen Jonathan Frankle Shiyu Chang Sijia Liu Yang Zhang Zhangyang Wang Michael Carbin 145 345 0 23 Jul 2020
What is the State of Neural Network Pruning? Davis W. Blalock Jose Javier Gonzalez Ortiz Jonathan Frankle John Guttag 172 1,018 0 06 Mar 2020