Parameter-Efficient Sparsity for Large Language Models Fine-Tuning

Parameter-Efficient Sparsity for Large Language Models Fine-Tuning

23 May 2022

Chuanqi Tan

Mengdi Wang

Shen Li

Papers citing "Parameter-Efficient Sparsity for Large Language Models Fine-Tuning"

7 / 7 papers shown

Title
Efficient Shapley Value-based Non-Uniform Pruning of Large Language Models Chuan Sun Han Yu Lizhen Cui Xiaoxiao Li 63 0 0 03 May 2025
Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning Naibin Gu Peng Fu Xiyu Liu Bowen Shen Zheng-Shen Lin Weiping Wang 30 6 0 06 Jun 2024
ProMoAI: Process Modeling with Generative AI Humam Kourani Alessandro Berti Daniel Schuster Wil M.P. van der Aalst LLMAG 24 7 0 07 Mar 2024
PERP: Rethinking the Prune-Retrain Paradigm in the Era of LLMs Max Zimmer Megi Andoni Christoph Spiegel S. Pokutta VLM 50 10 0 23 Dec 2023
What Matters In The Structured Pruning of Generative Language Models? Michael Santacroce Zixin Wen Yelong Shen Yuan-Fang Li 18 32 0 07 Feb 2023
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 280 3,843 0 18 Apr 2021
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,943 0 20 Apr 2018