v1v2v3v4v5 (latest)

The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks

9 March 2018

Jonathan Frankle

Michael Carbin

ArXiv (abs)PDF HTML

Papers citing "The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks"

50 / 2,186 papers shown

Sharp Generalization Bounds for Foundation Models with Asymmetric Randomized Low-Rank Adapters

Anastasis Kratsios

Tin Sum Cheng

Aurelien Lucchi

Haitz Sáez de Ocáriz Borde

210

17 Jun 2025

Dynamic Acoustic Model Architecture Optimization in Training for ASR

215

16 Jun 2025

The Butterfly Effect: Neural Network Training Trajectories Are Highly Sensitive to Initial Conditions

407

16 Jun 2025

MaskPro: Linear-Space Probabilistic Learning for Strict (N:M)-Sparsity on Large Language Models

199

15 Jun 2025

Compression Aware Certified Training

Changming Xu

Gagandeep Singh

162

13 Jun 2025

Auto-Compressing Networks

Vaggelis Dorovatas

Georgios Paraskevopoulos

Alexandros Potamianos

393

11 Jun 2025

The Emergence of Abstract Thought in Large Language Models Beyond Any Language

185

11 Jun 2025

Olica: Efficient Structured Pruning of Large Language Models without Retraining

Jiujun He

Huazhen Lin

172

10 Jun 2025

On the Stability of the Jacobian Matrix in Deep Neural Networks

387

10 Jun 2025

Hyperpruning: Efficient Search through Pruned Variants of Recurrent Neural Networks Leveraging Lyapunov Spectrum

Caleb Zheng

Eli Shlizerman

166

09 Jun 2025

PrunePEFT: Iterative Hybrid Pruning for Parameter-Efficient Fine-tuning of LLMs

152

09 Jun 2025

Deep RL Needs Deep Behavior Analysis: Exploring Implicit Planning by Model-Free Agents in Open-Ended Environments

239

08 Jun 2025

SAFE: Finding Sparse and Flat Minima to Improve Pruning

293

07 Jun 2025

Neural Network Reprogrammability: A Unified Theme on Model Reprogramming, Prompt Tuning, and Prompt Instruction

649

05 Jun 2025

Weisfeiler and Leman Go Gambling: Why Expressive Lottery Tickets Win

208

04 Jun 2025

HAM: A Hyperbolic Step to Regulate Implicit Bias

217

03 Jun 2025

Brain-Like Processing Pathways Form in Models With Heterogeneous Experts

237

03 Jun 2025

Computation- and Communication-Efficient Online FL for Resource-Constrained Aerial Vehicles

Md Ferdous Pervej

Richeng Jin

Md Moin Uddin Chowdhury

Simran Singh

Ismail Güvenç

H. Dai

213

03 Jun 2025

The Future of Continual Learning in the Era of Foundation Models: Three Key Directions

260

03 Jun 2025

Frugal Machine Learning for Energy-efficient, and Resource-aware Artificial Intelligence

John Violos

Konstantina-Christina Diamanti

I. Kompatsiaris

Symeon Papadopoulos

210

02 Jun 2025

Smooth Model Compression without Fine-Tuning

Carola-Bibiane Schönlieb

Michael Moeller

245

30 May 2025

Learning Interpretable Differentiable Logic Networks for Tabular Regression

C. Yue

N. Jha

352

29 May 2025

ACE: Exploring Activation Cosine Similarity and Variance for Accurate and Calibration-Efficient LLM Pruning

239

28 May 2025

M-Wanda: Improving One-Shot Pruning for Multilingual LLMs

Rochelle Choenni

Ivan Titov

219

27 May 2025

Sparsified State-Space Models are Efficient Highway Networks

340

27 May 2025

$Global Minimizers of $\ell^p$-Regularized Objectives Yield the Sparsest ReLU Neural Networks$

Global Minimizers of

\ell^p

-Regularized Objectives Yield the Sparsest ReLU Neural Networks

Julia B. Nakhleh

Robert D. Nowak

264

27 May 2025

DLP: Dynamic Layerwise Pruning in Large Language Models

258

27 May 2025

Binarized Neural Networks Converge Toward Algorithmic Simplicity: Empirical Support for the Learning-as-Compression Hypothesis

Ricardo Ribeiro Gudwin

Hector Zenil

376

27 May 2025

WINA: Weight Informed Neuron Activation for Accelerating Large Language Model Inference

177

26 May 2025

GraSS: Scalable Data Attribution with Gradient Sparsification and Sparse Projection

577

25 May 2025

PacTrain: Pruning and Adaptive Sparse Gradient Compression for Efficient Collective Communication in Distributed Deep LearningDesign Automation Conference (DAC), 2025

355

24 May 2025

μ

-MoE: Test-Time Pruning as Micro-Grained Mixture-of-Experts

213

24 May 2025

Learning without Isolation: Pathway Protection for Continual Learning

Zhikang Chen

Abudukelimu Wuerkaixi

...

187

24 May 2025

Meta Pruning via Graph Metanetworks : A Universal Meta Learning Framework for Network Pruning

345

24 May 2025

How Many Parameters Does Your Task Really Need? Task Specific Pruning with LLM-Sieve

Waleed Reda

Abhinav Jangda

Krishna Chintalapudi

295

23 May 2025

The Unreasonable Effectiveness of Model Merging for Cross-Lingual Transfer in LLMs

Lucas Bandarkar

Nanyun Peng

MoMe LRM

308

23 May 2025

Structured Linear CDEs: Maximally Expressive and Parallel-in-Time Sequence Models

362

23 May 2025

Generalized Fisher-Weighted SVD: Scalable Kronecker-Factored Fisher Approximation for Compressing Large Language Models

415

23 May 2025

PreMoe: Lightening MoEs on Constrained Memory by Expert Pruning and Retrieval

172

23 May 2025

Model Editing with Graph-Based External Memory

204

23 May 2025

Locate-then-Merge: Neuron-Level Parameter Fusion for Mitigating Catastrophic Forgetting in Multimodal LLMs

Zeping Yu

Sophia Ananiadou

MoMe KELM CLL

254

22 May 2025

TRIM: Achieving Extreme Sparsity with Targeted Row-wise Iterative Metric-driven Pruning

Florentin Beck

William Rudman

Carsten Eickhoff

374

22 May 2025

DeFTX: Denoised Sparse Fine-Tuning for Zero-Shot Cross-Lingual Transfer

Sona Elza Simon

Preethi Jyothi

VLM

305

21 May 2025

Balanced and Elastic End-to-end Training of Dynamic LLMs

Mohamed Wahib

Muhammed Abdullah Soyturk

Didem Unat

MoE

327

20 May 2025

Reinforcement Learning Finetunes Small Subnetworks in Large Language Models

283

16 May 2025

MID-L: Matrix-Interpolated Dropout Layer with Layer-wise Neuron Selection

Pouya Shaeri

Ariane Middel

16 May 2025

Uniform Loss vs. Specialized Optimization: A Comparative Analysis in Multi-Task Learning

Gabriel S. Gama

Valdir Grassi Jr

MoMe

301

15 May 2025

BINGO: A Novel Pruning Mechanism to Reduce the Size of Neural Networks

Aditya Panangat

260

15 May 2025

Are Spatial-Temporal Graph Convolution Networks for Human Action Recognition Over-Parameterized?Computer Vision and Pattern Recognition (CVPR), 2025

247

15 May 2025

Low-Complexity Inference in Continual Learning via Compressed Knowledge Transfer

312

13 May 2025