Exploring Lottery Ticket Hypothesis in Spiking Neural Networks

4 July 2022

Youngeun Kim

Yuhang Li

Papers citing "Exploring Lottery Ticket Hypothesis in Spiking Neural Networks"

36 / 36 papers shown

Title
Neuroplasticity in Artificial Intelligence -- An Overview and Inspirations on Drop In & Out Learning Yupei Li M. Milling Björn Schuller AI4CE 102 0 0 27 Mar 2025
Spiking Transformer with Spatial-Temporal Attention Donghyun Lee Yuhang Li Youngeun Kim Shiting Xiao Priyadarshini Panda 16 1 0 29 Sep 2024
Research Advances and New Paradigms for Biology-inspired Spiking Neural Networks Tianyu Zheng Liyuan Han Tielin Zhang AI4CE 20 0 0 26 Aug 2024
When In-memory Computing Meets Spiking Neural Networks -- A Perspective on Device-Circuit-System-and-Algorithm Co-design Abhishek Moitra Abhiroop Bhattacharjee Yuhang Li Youngeun Kim Priyadarshini Panda 20 1 0 22 Aug 2024
Online Pseudo-Zeroth-Order Training of Neuromorphic Spiking Neural Networks Mingqing Xiao Qingyan Meng Zongpeng Zhang D.K. He Zhouchen Lin 27 0 0 17 Jul 2024
Exploiting Heterogeneity in Timescales for Sparse Recurrent Spiking Neural Networks for Energy-Efficient Edge Computing Biswadeep Chakraborty Saibal Mukhopadhyay 34 2 0 08 Jul 2024
Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Models Rishav Mukherji Mark Schöne Khaleelulla Khan Nazeer Christian Mayr David Kappel Anand Subramoney 35 1 0 01 May 2024
Direct Training Needs Regularisation: Anytime Optimal Inference Spiking Neural Network Dengyu Wu Yi Qi Kaiwen Cai Gao Jin Xinping Yi Xiaowei Huang 24 3 0 15 Apr 2024
A Survey of Lottery Ticket Hypothesis Bohan Liu Zijie Zhang Peixiong He Zhensen Wang Yang Xiao Ruimeng Ye Yang Zhou Wei-Shinn Ku Bo Hui UQCV 32 12 0 07 Mar 2024
Sparse Spiking Neural Network: Exploiting Heterogeneity in Timescales for Pruning Recurrent SNN Biswadeep Chakraborty Beomseok Kang H. Kumar Saibal Mukhopadhyay 36 8 0 06 Mar 2024
LitE-SNN: Designing Lightweight and Efficient Spiking Neural Network through Spatial-Temporal Compressive Network Search and Joint Optimization Qianhui Liu Jiaqi Yan Malu Zhang Gang Pan Haizhou Li 27 4 0 26 Jan 2024
Pursing the Sparse Limitation of Spiking Deep Learning Structures Hao-Ran Cheng Jiahang Cao Erjia Xiao Mengshu Sun Le Yang Jize Zhang Xue Lin B. Kailkhura Kaidi Xu Renjing Xu 11 1 0 18 Nov 2023
Activity Sparsity Complements Weight Sparsity for Efficient RNN Inference Rishav Mukherji Mark Schöne Khaleelulla Khan Nazeer Christian Mayr Anand Subramoney 17 2 0 13 Nov 2023
Highly Efficient SNNs for High-speed Object Detection Nemin Qiu Zhiguo Li Yuan Li Chuang Zhu 15 0 0 27 Sep 2023
Gaining the Sparse Rewards by Exploring Lottery Tickets in Spiking Neural Network Hao Cheng Jiahang Cao Erjia Xiao Mengshu Sun Renjing Xu 20 2 0 23 Sep 2023
Are SNNs Truly Energy-efficient? $-$ A Hardware Perspective Abhiroop Bhattacharjee Ruokai Yin Abhishek Moitra Priyadarshini Panda 17 7 0 06 Sep 2023
Direct Learning-Based Deep Spiking Neural Networks: A Review Yu-Zhu Guo Xuhui Huang Zhe Ma AI4CE 64 45 0 31 May 2023
Sharing Leaky-Integrate-and-Fire Neurons for Memory-Efficient Spiking Neural Networks Youngeun Kim Yuhang Li Abhishek Moitra Ruokai Yin Priyadarshini Panda 20 10 0 26 May 2023
Probabilistic Modeling: Proving the Lottery Ticket Hypothesis in Spiking Neural Network Man Yao Yu-Liang Chou Guangshe Zhao Xiawu Zheng Yonghong Tian Boxing Xu Guoqi Li 28 4 0 20 May 2023
Uncovering the Representation of Spiking Neural Networks Trained with Surrogate Gradient Yuhang Li Youngeun Kim Hyoungseob Park Priyadarshini Panda 25 16 0 25 Apr 2023
Neurogenesis Dynamics-inspired Spiking Neural Network Training Acceleration Shaoyi Huang Haowen Fang Kaleel Mahmood Bowen Lei Nuo Xu Bin Lei Yue Sun Dongkuan Xu Wujie Wen Caiwen Ding 9 10 0 24 Apr 2023
Structured Pruning for Deep Convolutional Neural Networks: A survey Yang He Lingao Xiao 3DPC 18 115 0 01 Mar 2023
A Unified Framework for Soft Threshold Pruning Yanqing Chen Zhengyu Ma Wei Fang Xiawu Zheng Zhaofei Yu Yonghong Tian 67 19 0 25 Feb 2023
Workload-Balanced Pruning for Sparse Spiking Neural Networks Ruokai Yin Youngeun Kim Yuhang Li Abhishek Moitra Nitin Satpute Anna Hambitzer Priyadarshini Panda 18 18 0 13 Feb 2023
Hoyer regularizer is all you need for ultra low-latency spiking neural networks Gourav Datta Zeyu Liu P. Beerel 19 9 0 20 Dec 2022
Exploring Temporal Information Dynamics in Spiking Neural Networks Youngeun Kim Yuhang Li Hyoungseob Park Yeshwanth Venkatesha Anna Hambitzer Priyadarshini Panda 11 31 0 26 Nov 2022
Wearable-based Human Activity Recognition with Spatio-Temporal Spiking Neural Networks Yuhang Li Ruokai Yin Hyoungseob Park Youngeun Kim Priyadarshini Panda 13 14 0 14 Nov 2022
Converting Artificial Neural Networks to Spiking Neural Networks via Parameter Calibration Yuhang Li Shi-Wee Deng Xin Dong Shi Gu 43 23 0 06 May 2022
SATA: Sparsity-Aware Training Accelerator for Spiking Neural Networks Ruokai Yin Abhishek Moitra Abhiroop Bhattacharjee Youngeun Kim Priyadarshini Panda 8 50 0 11 Apr 2022
Temporal Efficient Training of Spiking Neural Network via Gradient Re-weighting Shi-Wee Deng Yuhang Li Shanghang Zhang Shi Gu 112 240 0 24 Feb 2022
Sparsity Winning Twice: Better Robust Generalization from More Efficient Training Tianlong Chen Zhenyu (Allen) Zhang Pengju Wang Santosh Balachandra Haoyu Ma Zehao Wang Zhangyang Wang OOD AAML 74 46 0 20 Feb 2022
Deep Residual Learning in Spiking Neural Networks Wei Fang Zhaofei Yu Yanqing Chen Tiejun Huang T. Masquelier Yonghong Tian 121 470 0 08 Feb 2021
The Lottery Ticket Hypothesis for Object Recognition Sharath Girish Shishira R. Maiya Kamal Gupta Hao Chen L. Davis Abhinav Shrivastava 73 60 0 08 Dec 2020
The Lottery Ticket Hypothesis for Pre-trained BERT Networks Tianlong Chen Jonathan Frankle Shiyu Chang Sijia Liu Yang Zhang Zhangyang Wang Michael Carbin 148 345 0 23 Jul 2020
Enabling Deep Spiking Neural Networks with Hybrid Conversion and Spike Timing Dependent Backpropagation Nitin Rathi G. Srinivasan Priyadarshini Panda Kaushik Roy 116 292 0 04 May 2020
Long short-term memory and learning-to-learn in networks of spiking neurons G. Bellec Darjan Salaj Anand Subramoney R. Legenstein Wolfgang Maass 111 477 0 26 Mar 2018