Enhancing the Performance of Transformer-based Spiking Neural Networks
by SNN-optimized Downsampling with Precise Gradient Backpropagation

Enhancing the Performance of Transformer-based Spiking Neural Networks by SNN-optimized Downsampling with Precise Gradient Backpropagation

10 May 2023

Yonghong Tian

Papers citing "Enhancing the Performance of Transformer-based Spiking Neural Networks by SNN-optimized Downsampling with Precise Gradient Backpropagation"

13 / 13 papers shown

Title
Temporal Separation with Entropy Regularization for Knowledge Distillation in Spiking Neural Networks Kairong Yu Chengting Yu Tianqing Zhang Xiaochen Zhao Shu Yang Hongwei Wang Qiang Zhang Qi Xu 66 2 0 05 Mar 2025
BKDSNN: Enhancing the Performance of Learning-based Spiking Neural Networks Training with Blurred Knowledge Distillation Zekai Xu Kang You Qinghai Guo Xiang Wang Zhezhi He 21 3 0 12 Jul 2024
Direct Training High-Performance Deep Spiking Neural Networks: A Review of Theories and Methods Chenlin Zhou Han Zhang Liutao Yu Yumin Ye Zhaokun Zhou Liwei Huang Zhengyu Ma Xiaopeng Fan Huihui Zhou Yonghong Tian 41 9 0 06 May 2024
QKFormer: Hierarchical Spiking Transformer using Q-K Attention Chenlin Zhou Han Zhang Zhaokun Zhou Liutao Yu Liwei Huang Xiaopeng Fan Liuliang Yuan Zhengyu Ma Huihui Zhou Yonghong Tian 42 13 0 25 Mar 2024
Spikformer V2: Join the High Accuracy Club on ImageNet with an SNN Ticket Zhaokun Zhou Kaiwei Che Wei Fang Keyu Tian Yuesheng Zhu Shuicheng Yan Yonghong Tian Liuliang Yuan ViT 37 27 0 04 Jan 2024
SpikeCLIP: A Contrastive Language-Image Pretrained Spiking Neural Network Tianlong Li Wenhao Liu Changze Lv Jianhan Xu Cenyuan Zhang Muling Wu Xiaoqing Zheng Xuanjing Huang CLIP VLM 7 1 0 10 Oct 2023
Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networks Tong Bu Wei Fang Jianhao Ding Penglin Dai Zhaofei Yu Tiejun Huang 105 193 0 08 Mar 2023
Spikformer: When Spiking Neural Network Meets Transformer Zhaokun Zhou Yuesheng Zhu Chao He Yaowei Wang Shuicheng Yan Yonghong Tian Liuliang Yuan 143 236 0 29 Sep 2022
Temporal Efficient Training of Spiking Neural Network via Gradient Re-weighting Shi-Wee Deng Yuhang Li Shanghang Zhang Shi Gu 112 242 0 24 Feb 2022
Training Feedback Spiking Neural Networks by Implicit Differentiation on the Equilibrium State Mingqing Xiao Qingyan Meng Zongpeng Zhang Yisen Wang Zhouchen Lin 98 59 0 29 Sep 2021
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions Wenhai Wang Enze Xie Xiang Li Deng-Ping Fan Kaitao Song Ding Liang Tong Lu Ping Luo Ling Shao ViT 263 3,604 0 24 Feb 2021
Deep Residual Learning in Spiking Neural Networks Wei Fang Zhaofei Yu Yanqing Chen Tiejun Huang T. Masquelier Yonghong Tian 121 474 0 08 Feb 2021
Enabling Deep Spiking Neural Networks with Hybrid Conversion and Spike Timing Dependent Backpropagation Nitin Rathi G. Srinivasan Priyadarshini Panda Kaushik Roy 119 292 0 04 May 2020