The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks

9 March 2018

Papers citing "The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks"

50 / 2,184 papers shown

Title
Interpreting Deep Learning-Based Networking Systems Zili Meng Minhu Wang Jia-Ju Bai Mingwei Xu Hongzi Mao Hongxin Hu AI4CE 150 3 0 09 Oct 2019
Differentiable Sparsification for Deep Neural Networks Yognjin Lee 272 7 0 08 Oct 2019
Convolutional Neural Networks for Speech Controlled Prosthetic Hands Yichao Fu Runlong Su BDL 154 5 0 03 Oct 2019
$Distillation $\approx$ Early Stopping? Harvesting Dark Knowledge Utilizing Anisotropic Information Retrieval For Overparameterized Neural Network$ Distillation $\approx$ Early Stopping? Harvesting Dark Knowledge Utilizing Anisotropic Information Retrieval For Overparameterized Neural Network Bin Dong Jikai Hou Yiping Lu Zhihua Zhang 152 42 0 02 Oct 2019
ConfusionFlow: A model-agnostic visualization for temporal analysis of classifier confusionIEEE Transactions on Visualization and Computer Graphics (IEEE TVCG), 2019 A. Hinterreiter Peter Ruch Holger Stitz Martin Ennemoser J. Bernard Hendrik Strobelt M. Streit 144 50 0 02 Oct 2019
How does topology influence gradient propagation and model performance of deep networks with DenseNet-type skip connections? Kartikeya Bhardwaj Guihong Li R. Marculescu 222 1 0 02 Oct 2019
Global Sparse Momentum SGD for Pruning Very Deep Neural NetworksNeural Information Processing Systems (NeurIPS), 2019 Xiaohan Ding Guiguang Ding Xiangxin Zhou Yuchen Guo Jungong Han Ji Liu 260 183 0 27 Sep 2019
Pruning from ScratchAAAI Conference on Artificial Intelligence (AAAI), 2019 Yulong Wang Xiaolu Zhang Lingxi Xie Jun Zhou Hang Su Bo Zhang Xiaolin Hu 170 215 0 27 Sep 2019
In-training Matrix Factorization for Parameter-frugal Neural Machine Translation Zachary Kaden Teven Le Scao R. Olivier 138 1 0 27 Sep 2019
Optimizing Speech Recognition For The Edge Yuan Shangguan Jian Li Qiao Liang R. Álvarez Ian McGraw 186 64 0 26 Sep 2019
Model Pruning Enables Efficient Federated Learning on Edge DevicesIEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2019 Yuang Jiang Maroun Touma Victor Valls Bongjun Ko Yan Koyfman Kin K. Leung Leandros Tassiulas 460 559 0 26 Sep 2019
Mixed Dimension Embeddings with Application to Memory-Efficient Recommendation SystemsInternational Symposium on Information Theory (ISIT), 2019 Antonio A. Ginart Maxim Naumov Dheevatsa Mudigere Jiyan Yang James Zou 324 107 0 25 Sep 2019
Wider Networks Learn Better Features D. Gilboa Guy Gur-Ari 87 7 0 25 Sep 2019
Class-dependent Compression of Deep Neural Networks R. Entezari O. Saukh 194 7 0 23 Sep 2019
GEN: Highly Efficient SMILES Explorer Using Autodidactic Generative Examination NetworksJournal of Cheminformatics (J Cheminform), 2019 R. V. Deursen P. Ertl Igor V. Tetko Guillaume Godin 93 36 0 10 Sep 2019
RNN Architecture Learning with Sparse RegularizationConference on Empirical Methods in Natural Language Processing (EMNLP), 2019 Jesse Dodge Roy Schwartz Hao Peng Noah A. Smith 214 11 0 06 Sep 2019
LCA: Loss Change Allocation for Neural Network TrainingNeural Information Processing Systems (NeurIPS), 2019 Janice Lan Rosanne Liu Hattie Zhou J. Yosinski 192 27 0 03 Sep 2019
Learning Digital Circuits: A Journey Through Weight Invariant Self-Pruning Neural Networks Amey Agrawal Rohit Karlupia 55 0 0 30 Aug 2019
Image Captioning with Sparse Recurrent Neural Network J. Tan Chee Seng Chan Joon Huang Chuah VLM 141 7 0 28 Aug 2019
Revealing the Dark Secrets of BERTConference on Empirical Methods in Natural Language Processing (EMNLP), 2019 Olga Kovaleva Alexey Romanov Anna Rogers Anna Rumshisky 344 602 0 21 Aug 2019
A deep-learning-based surrogate model for data assimilation in dynamic subsurface flow problemsJournal of Computational Physics (JCP), 2019 Meng Tang Yimin Liu L. Durlofsky AI4CE 190 303 0 16 Aug 2019
Group Pruning using a Bounded-Lp norm for Group Gating and RegularizationGerman Conference on Pattern Recognition (DAGM), 2019 Chaithanya Kumar Mummadi Tim Genewein Dan Zhang Thomas Brox Volker Fischer 106 4 0 09 Aug 2019
Convolutional Dictionary Learning in Hierarchical NetworksIEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP), 2019 Javier Zazo Bahareh Tolooshams Demba E. Ba BDL 135 5 0 23 Jul 2019
Light Multi-segment Activation for Model CompressionAAAI Conference on Artificial Intelligence (AAAI), 2019 Zhenhui Xu Guolin Ke Jia Zhang Jiang Bian Tie-Yan Liu 94 2 0 16 Jul 2019
Padé Activation Units: End-to-end Learning of Flexible Activation Functions in Deep NetworksInternational Conference on Learning Representations (ICLR), 2019 Alejandro Molina P. Schramowski Kristian Kersting ODL 162 104 0 15 Jul 2019
Batch-Shaping for Learning Conditional Channel Gated NetworksInternational Conference on Learning Representations (ICLR), 2019 B. Bejnordi Tijmen Blankevoort Max Welling AI4CE 262 80 0 15 Jul 2019
Bringing Giant Neural Networks Down to Earth with Unlabeled Data Yehui Tang Shan You Chang Xu Boxin Shi Chao Xu 171 11 0 13 Jul 2019
Deep network as memory space: complexity, generalization, disentangled representation and interpretability X. Dong L. Zhou 85 1 0 12 Jul 2019
Sparsely Activated NetworksIEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2019 Paschalis A. Bizopoulos D. Koutsouris 358 15 0 12 Jul 2019
Sparse Networks from Scratch: Faster Training without Losing Performance Tim Dettmers Luke Zettlemoyer 261 356 0 10 Jul 2019
Reinforcement Learning with Chromatic Networks for Compact Architecture Search Xingyou Song K. Choromanski Jack Parker-Holder Yunhao Tang Wenbo Gao Aldo Pacchiano Tamás Sarlós Deepali Jain Yuxiang Yang 214 1 0 10 Jul 2019
XNect: Real-time Multi-Person 3D Motion Capture with a Single RGB CameraACM Transactions on Graphics (TOG), 2019 Dushyant Mehta Oleksandr Sotnychenko Franziska Mueller Weipeng Xu Mohamed A. Elgharib Pascal Fua Hans-Peter Seidel Helge Rhodin Gerard Pons-Moll Christian Theobalt 3DH 268 179 0 01 Jul 2019
Dissecting Pruned Neural Networks Jonathan Frankle David Bau 96 9 0 29 Jun 2019
Selection via Proxy: Efficient Data Selection for Deep LearningInternational Conference on Learning Representations (ICLR), 2019 Cody Coleman Christopher Yeh Stephen Mussmann Baharan Mirzasoleiman Peter Bailis Abigail Z. Jacobs J. Leskovec Matei A. Zaharia 288 419 0 26 Jun 2019
BatchBALD: Efficient and Diverse Batch Acquisition for Deep Bayesian Active LearningNeural Information Processing Systems (NeurIPS), 2019 Andreas Kirsch Joost R. van Amersfoort Y. Gal FedML 330 699 0 19 Jun 2019
Finding the Needle in the Haystack with Convolutions: on the benefits of architectural biasNeural Information Processing Systems (NeurIPS), 2019 Stéphane dÁscoli Levent Sagun Joan Bruna Giulio Biroli 158 37 0 16 Jun 2019
A Signal Propagation Perspective for Pruning Neural Networks at InitializationInternational Conference on Learning Representations (ICLR), 2019 Namhoon Lee Thalaiyasingam Ajanthan Stephen Gould Juil Sock AAML 174 164 0 14 Jun 2019
Towards Compact and Robust Deep Neural Networks Vikash Sehwag Shiqi Wang Prateek Mittal Suman Jana AAML 129 41 0 14 Jun 2019
Large Scale Structure of Neural Network Loss LandscapesNeural Information Processing Systems (NeurIPS), 2019 Stanislav Fort Stanislaw Jastrzebski 195 93 0 11 Jun 2019
Taxonomy of Saliency Metrics for Channel PruningIEEE Access (IEEE Access), 2019 Kaveena Persand Andrew Anderson David Gregg 162 8 0 11 Jun 2019
Weight Agnostic Neural NetworksNeural Information Processing Systems (NeurIPS), 2019 Adam Gaier David R Ha OOD 190 254 0 11 Jun 2019
BlockSwap: Fisher-guided Block Substitution for Network Compression on a BudgetInternational Conference on Learning Representations (ICLR), 2019 Jack Turner Elliot J. Crowley Michael F. P. O'Boyle Amos Storkey Gavia Gray 147 47 0 10 Jun 2019
The Generalization-Stability Tradeoff In Neural Network PruningNeural Information Processing Systems (NeurIPS), 2019 Brian Bartoldson Ari S. Morcos Adrian Barbu G. Erlebacher 273 84 0 09 Jun 2019
One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizersNeural Information Processing Systems (NeurIPS), 2019 Ari S. Morcos Haonan Yu Michela Paganini Yuandong Tian 180 242 0 06 Jun 2019
Playing the lottery with rewards and multiple languages: lottery tickets in RL and NLPInternational Conference on Learning Representations (ICLR), 2019 Haonan Yu Sergey Edunov Yuandong Tian Ari S. Morcos 181 152 0 06 Jun 2019
Gated recurrent units viewed through the lens of continuous time dynamical systemsFrontiers in Computational Neuroscience (Front. Comput. Neurosci.), 2019 I. Jordan Piotr A. Sokól Il Memming Park 164 62 0 03 Jun 2019
Discovering Neural WiringsNeural Information Processing Systems (NeurIPS), 2019 Mitchell Wortsman Ali Farhadi Mohammad Rastegari AI4CE 449 127 0 03 Jun 2019
DeepShift: Towards Multiplication-Less Neural Networks Mostafa Elhoushi Zihao Chen F. Shafiq Ye Tian Joey Yiwei Li MQ 373 119 0 30 May 2019
SpArSe: Sparse Architecture Search for CNNs on Resource-Constrained MicrocontrollersNeural Information Processing Systems (NeurIPS), 2019 Igor Fedorov Ryan P. Adams Matthew Mattina P. Whatmough 220 173 0 28 May 2019
Self-supervised audio representation learning for mobile devices Marco Tagliasacchi Beat Gfeller Félix de Chaumont Quitry Dominik Roblek SSL AI4TS 133 47 0 24 May 2019