Spikformer: When Spiking Neural Network Meets Transformer

29 September 2022

Yaowei Wang

Yonghong Tian

Papers citing "Spikformer: When Spiking Neural Network Meets Transformer"

21 / 21 papers shown

Title
CogniSNN: A First Exploration to Random Graph Architecture based Spiking Neural Networks with Enhanced Expandability and Neuroplasticity Yongsheng Huang Peibo Duan Zhipeng Liu Kai Sun Changsheng Zhang Bin Zhang Mingkun Xu GNN 24 0 0 09 May 2025
Head-Tail-Aware KL Divergence in Knowledge Distillation for Spiking Neural Networks Tianqing Zhang Zixin Zhu Kairong Yu Hongwei Wang 49 0 0 29 Apr 2025
ES-Parkour: Advanced Robot Parkour with Bio-inspired Event Camera and Spiking Neural Network Qiang Zhang Jiahang Cao Jingkai Sun Yecheng Shao Gang Han Wen Zhao Yijie Guo Renjing Xu 38 0 0 13 Mar 2025
Temporal Separation with Entropy Regularization for Knowledge Distillation in Spiking Neural Networks Kairong Yu Chengting Yu Tianqing Zhang Xiaochen Zhao Shu Yang Hongwei Wang Qiang Zhang Qi Xu 66 2 0 05 Mar 2025
STAA-SNN: Spatial-Temporal Attention Aggregator for Spiking Neural Networks Tianqing Zhang Kairong Yu Xian Zhong Hongwei Wang Qi Xu Qiang Zhang 83 0 0 04 Mar 2025
Towards High-performance Spiking Transformers from ANN to SNN Conversion Zihan Huang Xinyu Shi Zecheng Hao Tong Bu Jianhao Ding Zhaofei Yu Tiejun Huang 26 7 0 28 Feb 2025
Spiking Transformer:Introducing Accurate Addition-Only Spiking Self-Attention for Transformer Yufei Guo Xiaode Liu Y. Chen Weihang Peng Yuhan Zhang Zhe Ma MQ 29 0 0 28 Feb 2025
CLIF: Complementary Leaky Integrate-and-Fire Neuron for Spiking Neural Networks Yulong Huang Xiaopeng Lin Hongwei Ren Haotian Fu Yue Zhou Zunchang Liu Biao Pan Bojun Cheng 45 8 0 20 Feb 2025
Channel-wise Parallelizable Spiking Neuron with Multiplication-free Dynamics and Large Temporal Receptive Fields Peng Xue Wei Fang Zhengyu Ma Zihan Huang Zhaokun Zhou Yonghong Tian T. Masquelier Huihui Zhou 41 0 0 24 Jan 2025
ViT-LCA: A Neuromorphic Approach for Vision Transformers Sanaz Mahmoodi Takaghaj ViT 28 0 0 31 Oct 2024
A Novel Spike Transformer Network for Depth Estimation from Event Cameras via Cross-modality Knowledge Distillation Xin Zhang Liangxiu Han Tam Sobeih Lianghao Han Darren Dancey 31 1 0 26 Apr 2024
Spiking-PhysFormer: Camera-Based Remote Photoplethysmography with Parallel Spike-driven Transformer Mingxuan Liu Jiankai Tang Haoxiang Li Jiahao Qi Siwei Li Kegang Wang Yuntao wang Hong Chen Yuntao Wang Hong Chen 74 13 0 07 Feb 2024
Delving Deeper Into Astromorphic Transformers Md. Zesun Ahmed Mia Malyaban Bal Abhronil Sengupta 24 1 0 18 Dec 2023
SSTFormer: Bridging Spiking Neural Network and Memory Support Transformer for Frame-Event based Recognition Xiao Wang Zong-Yao Wu Yao Rong Lin Zhu Bowei Jiang Jin Tang Yonghong Tian ViT 64 14 0 08 Aug 2023
Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networks Tong Bu Wei Fang Jianhao Ding Penglin Dai Zhaofei Yu Tiejun Huang 100 191 0 08 Mar 2023
Temporal Efficient Training of Spiking Neural Network via Gradient Re-weighting Shi-Wee Deng Yuhang Li Shanghang Zhang Shi Gu 107 240 0 24 Feb 2022
UFO-ViT: High Performance Linear Vision Transformer without Softmax Jeonggeun Song ViT 98 16 0 29 Sep 2021
Training Feedback Spiking Neural Networks by Implicit Differentiation on the Equilibrium State Mingqing Xiao Qingyan Meng Zongpeng Zhang Yisen Wang Zhouchen Lin 82 50 0 29 Sep 2021
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions Wenhai Wang Enze Xie Xiang Li Deng-Ping Fan Kaitao Song Ding Liang Tong Lu Ping Luo Ling Shao ViT 263 3,538 0 24 Feb 2021
Deep Residual Learning in Spiking Neural Networks Wei Fang Zhaofei Yu Yanqing Chen Tiejun Huang T. Masquelier Yonghong Tian 119 314 0 08 Feb 2021
Enabling Deep Spiking Neural Networks with Hybrid Conversion and Spike Timing Dependent Backpropagation Nitin Rathi G. Srinivasan Priyadarshini Panda Kaushik Roy 114 264 0 04 May 2020