Proving the Lottery Ticket Hypothesis: Pruning is All You Need

3 February 2020

Papers citing "Proving the Lottery Ticket Hypothesis: Pruning is All You Need"

50 / 179 papers shown

Title
Communication-Efficient Personalized Distributed Learning with Data and Node Heterogeneity Zhuojun Tian Zhaoyang Zhang Yiwei Li Mehdi Bennis 32 0 0 24 Apr 2025
PRISM: Privacy-Preserving Improved Stochastic Masking for Federated Generative Models Kyeongkook Seo Dong-Jun Han Jaejun Yoo 40 0 0 11 Mar 2025
Iterative Prompt Relocation for Distribution-Adaptive Visual Prompt Tuning Chikai Shang Mengke Li Yiqun Zhang Zhen Chen Jinlin Wu Fangqing Gu Yang Lu Yiu-ming Cheung VLM 71 0 0 10 Mar 2025
Sparse Brains are Also Adaptive Brains: Cognitive-Load-Aware Dynamic Activation for LLMs Yiheng Yang Yujie Wang Chi Ma Lei Yu Emmanuele Chersoni Chu-Ren Huang 74 0 0 26 Feb 2025
The impact of allocation strategies in subset learning on the expressive power of neural networks Ofir Schlisselberg Ran Darshan 91 0 0 10 Feb 2025
Information Consistent Pruning: How to Efficiently Search for Sparse Networks? Soheil Gharatappeh S. Y. Sekeh 54 0 0 28 Jan 2025
Playing the Lottery With Concave Regularizers for Sparse Trainable Neural Networks Giulia Fracastoro Sophie M. Fosson Andrea Migliorati G. Calafiore 38 1 0 19 Jan 2025
Pushing the Limits of Sparsity: A Bag of Tricks for Extreme Pruning Andy Li A. Durrant Milan Markovic Lu Yin Georgios Leontidis Tianlong Chen Lu Yin Georgios Leontidis 70 0 0 20 Nov 2024
Over-parameterized Student Model via Tensor Decomposition Boosted Knowledge Distillation Yu-Liang Zhan Zhong-Yi Lu Hao-Lun Sun Ze-Feng Gao 30 0 0 10 Nov 2024
Finding Strong Lottery Ticket Networks with Genetic Algorithms Philipp Altmann Julian Schonberger Maximilian Zorn Thomas Gabor 24 1 0 07 Nov 2024
Navigating Extremes: Dynamic Sparsity in Large Output Spaces Nasib Ullah Erik Schultheis Mike Lasby Yani Andrew Ioannou Rohit Babbar 33 0 0 05 Nov 2024
Uncovering Capabilities of Model Pruning in Graph Contrastive Learning Wu Junran Chen Xueyuan Li Shangzhe 29 1 0 27 Oct 2024
The Propensity for Density in Feed-forward Models Nandi Schoots Alex Jackson Ali Kholmovaia Peter McBurney Murray Shanahan CVBM 21 0 0 18 Oct 2024
Self-Masking Networks for Unsupervised Adaptation Alfonso Taboada Warmerdam Mathilde Caron Yuki M. Asano 39 1 0 11 Sep 2024
3D Point Cloud Network Pruning: When Some Weights Do not Matter Amrijit Biswas M. Hossain M. M. L. Elahi A. Cheraghian Fuad Rahman Nabeel Mohammed Shafin Rahman 3DPC 20 1 0 26 Aug 2024
First Activations Matter: Training-Free Methods for Dynamic Activation in Large Language Models Chi Ma Mincong Huang Ying Zhang Chao Wang Yujie Wang Lei Yu Chuan Liu Wei Lin AI4CE LLMSV 46 2 0 21 Aug 2024
Mask in the Mirror: Implicit Sparsification Tom Jacobs R. Burkholz 40 3 0 19 Aug 2024
Masked Random Noise for Communication Efficient Federaetd Learning Shiwei Li Yingyi Cheng Haozhao Wang Xing Tang Shijie Xu Weihong Luo Yuhua Li Dugang Liu Xiuqiang He and Ruixuan Li FedML 45 1 0 06 Aug 2024
Sparsest Models Elude Pruning: An Exposé of Pruning's Current Capabilities Stephen Zhang V. Papyan 23 0 0 04 Jul 2024
Expressivity of Neural Networks with Random Weights and Learned Biases Ezekiel Williams Avery Hee-Woon Ryoo Thomas Jiralerspong Alexandre Payeur M. Perich Luca Mazzucato Guillaume Lajoie 31 2 0 01 Jul 2024
MOYU: A Theoretical Study on Massive Over-activation Yielded Uplifts in LLMs Chi Ma Mincong Huang Chao Wang Yujie Wang Lei Yu AI4CE 17 0 0 18 Jun 2024
Optimal Eye Surgeon: Finding Image Priors through Sparse Generators at Initialization Avrajit Ghosh Xitong Zhang Kenneth K. Sun Qing Qu S. Ravishankar Rongrong Wang MedIm 35 5 0 07 Jun 2024
Optimal Recurrent Network Topologies for Dynamical Systems Reconstruction Christoph Jurgen Hemmer Manuel Brenner Florian Hess Daniel Durstewitz 34 3 0 07 Jun 2024
Cyclic Sparse Training: Is it Enough? Advait Gadhikar Sree Harsha Nelaturu R. Burkholz CLL 40 0 0 04 Jun 2024
Sparser, Better, Deeper, Stronger: Improving Sparse Training with Exact Orthogonal Initialization A. Nowak Lukasz Gniecki Filip Szatkowski Jacek Tabor 27 0 0 03 Jun 2024
Survival of the Fittest Representation: A Case Study with Modular Addition Xiaoman Delores Ding Zifan Carl Guo Eric J. Michaud Ziming Liu Max Tegmark 34 3 0 27 May 2024
ONNXPruner: ONNX-Based General Model Pruning Adapter Dongdong Ren Wenbin Li Tianyu Ding Lei Wang Qi Fan Jing Huo Hongbing Pan Yang Gao 27 3 0 10 Apr 2024
Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey Zeyu Han Chao Gao Jinyang Liu Jeff Zhang Sai Qian Zhang 139 308 0 21 Mar 2024
A Survey of Lottery Ticket Hypothesis Bohan Liu Zijie Zhang Peixiong He Zhensen Wang Yang Xiao Ruimeng Ye Yang Zhou Wei-Shinn Ku Bo Hui UQCV 37 12 0 07 Mar 2024
Masks, Signs, And Learning Rate Rewinding Advait Gadhikar R. Burkholz 55 8 0 29 Feb 2024
How Uniform Random Weights Induce Non-uniform Bias: Typical Interpolating Neural Networks Generalize with Narrow Teachers G. Buzaglo I. Harel Mor Shpigel Nacson Alon Brutzkus Nathan Srebro Daniel Soudry 54 3 0 09 Feb 2024
Less is KEN: a Universal and Simple Non-Parametric Pruning Algorithm for Large Language Models Michele Mastromattei Fabio Massimo Zanzotto VLM 23 1 0 05 Feb 2024
KS-Lottery: Finding Certified Lottery Tickets for Multilingual Language Models Fei Yuan Chang Ma Shuai Yuan Qiushi Sun Lei Li 34 3 0 05 Feb 2024
Defining Neural Network Architecture through Polytope Structures of Dataset Sangmin Lee Abbas Mammadov Jong Chul Ye 54 0 0 04 Feb 2024
Multicoated and Folded Graph Neural Networks with Strong Lottery Tickets Jiale Yan Hiroaki Ito Ángel López García-Arias Yasuyuki Okoshi Hikari Otsuka Kazushi Kawamura Thiem Van Chu Masato Motomura 25 1 0 06 Dec 2023
Transformers are uninterpretable with myopic methods: a case study with bounded Dyck grammars Kaiyue Wen Yuchen Li Bing Liu Andrej Risteski 21 21 0 03 Dec 2023
Using Cooperative Game Theory to Prune Neural Networks M. Diaz-Ortiz Benjamin Kempinski Daphne Cornelisse Yoram Bachrach Tal Kachman 33 2 0 17 Nov 2023
Polynomially Over-Parameterized Convolutional Neural Networks Contain Structured Strong Winning Lottery Tickets A. D. Cunha Francesco d’Amore Emanuele Natale MLT 19 1 0 16 Nov 2023
Bridging Lottery Ticket and Grokking: Understanding Grokking from Inner Structure of Networks Gouki Minegishi Yusuke Iwasawa Yutaka Matsuo 11 3 0 30 Oct 2023
Proving Linear Mode Connectivity of Neural Networks via Optimal Transport Damien Ferbach Baptiste Goujaud Gauthier Gidel Aymeric Dieuleveut MoMe 21 16 0 29 Oct 2023
Successfully Applying Lottery Ticket Hypothesis to Diffusion Model Chao Jiang Bo Hui Bohan Liu Da Yan DiffM 29 14 0 28 Oct 2023
Sample Complexity Bounds for Score-Matching: Causal Discovery and Generative Modeling Zhenyu Zhu Francesco Locatello V. Cevher 26 6 0 27 Oct 2023
Winning Prize Comes from Losing Tickets: Improve Invariant Learning by Exploring Variant Parameters for Out-of-Distribution Generalization Zhuo Huang Muyang Li Li Shen Jun-chen Yu Chen Gong Bo Han Tongliang Liu OOD 38 8 0 25 Oct 2023
One is More: Diverse Perspectives within a Single Network for Efficient DRL Yiqin Tan Ling Pan Longbo Huang OffRL 30 0 0 21 Oct 2023
A Primer on Bayesian Neural Networks: Review and Debates Federico Danieli Konstantinos Pitas M. Vladimirova Vincent Fortuin BDL AAML 56 18 0 28 Sep 2023
Adaptive Consensus: A network pruning approach for decentralized optimization S. Shah A. Berahas Raghu Bollapragada 14 2 0 06 Sep 2023
Equitable-FL: Federated Learning with Sparsity for Resource-Constrained Environment Indrajeet Kumar Sinha Shekhar Verma Krishna Pratap Singh FedML 24 0 0 02 Sep 2023
FAM: fast adaptive federated meta-learning Indrajeet Kumar Sinha Shekhar Verma Krishna Pratap Singh FedML 22 0 0 26 Aug 2023
An Intentional Forgetting-Driven Self-Healing Method For Deep Reinforcement Learning Systems Ahmed Haj Yahmed Rached Bouchoucha Houssem Ben Braiek Foutse Khomh CLL AI4CE 25 0 0 23 Aug 2023
The Snowflake Hypothesis: Training Deep GNN with One Node One Receptive field Kun Wang Guohao Li Shilong Wang Guibin Zhang K. Wang Yang You Xiaojiang Peng Yuxuan Liang Yang Wang 26 8 0 19 Aug 2023