Data-Efficient Structured Pruning via Submodular Optimization

9 March 2022

Papers citing "Data-Efficient Structured Pruning via Submodular Optimization"

15 / 15 papers shown

Title
Post-Training Non-Uniform Quantization for Convolutional Neural Networks Ahmed Luqman Khuzemah Qazi Imdadullah Khan MQ 67 0 0 10 Dec 2024
AlphaPruning: Using Heavy-Tailed Self Regularization Theory for Improved Layer-wise Pruning of Large Language Models Haiquan Lu Yefan Zhou Shiwei Liu Zhangyang Wang Michael W. Mahoney Yaoqing Yang 23 0 0 14 Oct 2024
A Greedy Hierarchical Approach to Whole-Network Filter-Pruning in CNNs Kiran Purohit Anurag Parvathgari Sourangshu Bhattacharya VLM 25 0 0 22 Aug 2024
ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models Xiang Meng Kayhan Behdin Haoyue Wang Rahul Mazumder 37 3 0 12 Jun 2024
A Survey of Lottery Ticket Hypothesis Bohan Liu Zijie Zhang Peixiong He Zhensen Wang Yang Xiao Ruimeng Ye Yang Zhou Wei-Shinn Ku Bo Hui UQCV 37 12 0 07 Mar 2024
SequentialAttention++ for Block Sparsification: Differentiable Pruning Meets Combinatorial Optimization T. Yasuda Kyriakos Axiotis Gang Fu M. Bateni Vahab Mirrokni 39 0 0 27 Feb 2024
Talking Models: Distill Pre-trained Knowledge to Downstream Models via Interactive Communication Zhe Zhao Qingyun Liu Huan Gui Bang An Lichan Hong Ed H. Chi 15 1 0 04 Oct 2023
Neural Network Reduction with Guided Regularizers Ali Haisam Muhammad Rafid Adrian Sandu 69 1 0 29 May 2023
Submodular Minimax Optimization: Finding Effective Sets Loay Mualem Ethan R. Elenberg Moran Feldman Amin Karbasi 14 5 0 26 May 2023
Rethinking the Role of Scale for In-Context Learning: An Interpretability-based Case Study at 66 Billion Scale Hritik Bansal Karthik Gopalakrishnan Saket Dingliwal S. Bodapati Katrin Kirchhoff Dan Roth LRM 22 48 0 18 Dec 2022
Sequential Attention for Feature Selection T. Yasuda M. Bateni Lin Chen Matthew Fahrbach Gang Fu Vahab Mirrokni 29 11 0 29 Sep 2022
DASS: Differentiable Architecture Search for Sparse neural networks H. Mousavi Mohammad Loni Mina Alibeigi Masoud Daneshtalab 28 11 0 14 Jul 2022
Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks Torsten Hoefler Dan Alistarh Tal Ben-Nun Nikoli Dryden Alexandra Peste MQ 139 684 0 31 Jan 2021
Very Fast Streaming Submodular Function Maximization Sebastian Buschjäger Philipp-Jan Honysz Lukas Pfahler K. Morik 19 9 0 20 Oct 2020
What is the State of Neural Network Pruning? Davis W. Blalock Jose Javier Gonzalez Ortiz Jonathan Frankle John Guttag 183 1,027 0 06 Mar 2020