ShiftAddNet: A Hardware-Inspired Deep Network

24 October 2020

Papers citing "ShiftAddNet: A Hardware-Inspired Deep Network"

47 / 47 papers shown

Title
Compound and Parallel Modes of Tropical Convolutional Neural Networks Mingbo Li Liying Liu Ye Luo 25 0 0 09 Apr 2025
Channel-wise Parallelizable Spiking Neuron with Multiplication-free Dynamics and Large Temporal Receptive Fields Peng Xue Wei Fang Zhengyu Ma Zihan Huang Zhaokun Zhou Yonghong Tian T. Masquelier Huihui Zhou 45 0 0 24 Jan 2025
Threshold Neuron: A Brain-inspired Artificial Neuron for Efficient On-device Inference Zihao Zheng Yuanchun Li Jiayu Chen Peng Zhou Xiang Chen Yunxin Liu 66 0 0 18 Dec 2024
NASH: Neural Architecture and Accelerator Search for Multiplication-Reduced Hybrid Models Yang Xu Huihong Shi Zhongfeng Wang 20 0 0 07 Sep 2024
ShiftAddAug: Augment Multiplication-Free Tiny Neural Network with Hybrid Computation Yipin Guo Zihao Li Yilin Lang Qinyuan Ren 41 0 0 03 Jul 2024
ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization Haoran You Yipin Guo Yichao Fu Wei Zhou Huihong Shi Xiaofan Zhang Souvik Kundu Amir Yazdanbakhsh Y. Lin KELM 27 7 0 10 Jun 2024
Lightweight Deep Learning for Resource-Constrained Environments: A Survey Hou-I Liu Marco Galindo Hongxia Xie Lai-Kuan Wong Hong-Han Shuai Yung-Hui Li Wen-Huang Cheng 35 45 0 08 Apr 2024
PikeLPN: Mitigating Overlooked Inefficiencies of Low-Precision Neural Networks Marina Neseem Conor McCullough Randy Hsin Chas Leichner Shan Li ... Andrew G. Howard Lukasz Lew Sherief Reda Ville Rautio Daniele Moro MQ 25 0 0 29 Mar 2024
Attention, Distillation, and Tabularization: Towards Practical Neural Network-Based Prefetching Pengmiao Zhang Neelesh Gupta Rajgopal Kannan Viktor K. Prasanna 23 0 0 23 Dec 2023
When Bio-Inspired Computing meets Deep Learning: Low-Latency, Accurate, & Energy-Efficient Spiking Neural Networks from Artificial Neural Networks Gourav Datta Zeyu Liu James Diffenderfer B. Kailkhura P. Beerel 27 0 0 12 Dec 2023
Ternary Singular Value Decomposition as a Better Parameterized Form in Linear Mapping Boyu Chen Hanxuan Chen Jiao He Fengyu Sun Shangling Jui 28 3 0 15 Aug 2023
A Survey of Techniques for Optimizing Transformer Inference Krishna Teja Chitty-Venkata Sparsh Mittal M. Emani V. Vishwanath Arun Somani 12 56 0 16 Jul 2023
ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer Haoran You Huihong Shi Yipin Guo Yingyan Lin Lin 14 16 0 10 Jun 2023
DietCNN: Multiplication-free Inference for Quantized CNNs Swarnava Dey P. Dasgupta P. Chakrabarti MQ 26 1 0 09 May 2023
Ultra-low Precision Multiplication-free Training for Deep Neural Networks Chang-Shu Liu Rui Zhang Xishan Zhang Yifan Hao Zidong Du Xingui Hu Ling Li Qi Guo MQ 13 1 0 28 Feb 2023
Sparse Mixture Once-for-all Adversarial Training for Efficient In-Situ Trade-Off Between Accuracy and Robustness of DNNs Souvik Kundu Sairam Sundaresan S. N. Sridhar Shunlin Lu Han Tang P. Beerel AAML MoE 17 4 0 27 Dec 2022
EuclidNets: An Alternative Operation for Efficient Inference of Deep Learning Models Xinlin Li Mariana Parazeres Adam M. Oberman Alireza Ghaffari M. Asgharian V. Nia 22 4 0 22 Dec 2022
Redistribution of Weights and Activations for AdderNet Quantization Ying Nie Kai Han Haikang Diao Chuanjian Liu Enhua Wu Yunhe Wang MQ 14 5 0 20 Dec 2022
NASA: Neural Architecture Search and Acceleration for Hardware Inspired Hybrid Networks Huihong Shi Haoran You Yang Katie Zhao Zhongfeng Wang Yingyan Lin 39 7 0 24 Oct 2022
Reducing Computational Complexity of Neural Networks in Optical Channel Equalization: From Concepts to Implementation Pedro J. Freire A. Napoli D. A. Ron B. Spinnler M. Anderson W. Schairer T. Bex N. Costa S. Turitsyn Jaroslaw E. Prilepsky 10 28 0 26 Aug 2022
DenseShift: Towards Accurate and Efficient Low-Bit Power-of-Two Quantization Xinlin Li Bangya Liu Ruizhi Yang Vanessa Courville Chao Xing V. Nia MQ 15 2 0 20 Aug 2022
PECAN: A Product-Quantized Content Addressable Memory Network Jie Ran R. Lin Jason Chun Lok Li Jiajun Zhou Ngai Wong MQ 29 6 0 13 Aug 2022
Low-bit Shift Network for End-to-End Spoken Language Understanding Anderson R. Avila Khalil Bibi Ruizhi Yang Xinlin Li Chao Xing Xiao Chen MQ 17 4 0 15 Jul 2022
Computational Complexity Evaluation of Neural Network Applications in Signal Processing Pedro J. Freire S. Srivallapanondh A. Napoli Jaroslaw E. Prilepsky S. Turitsyn 17 1 0 24 Jun 2022
Universal Learned Image Compression With Low Computational Cost Bowen Li Xin Yao Youneng Bao Fanyang Meng Yongsheng Liang Wen-Tao Tan 19 0 0 23 Jun 2022
ShiftAddNAS: Hardware-Inspired Search for More Accurate and Efficient Neural Networks Haoran You Baopu Li Huihong Shi Y. Fu Yingyan Lin 12 17 0 17 May 2022
ShiftNAS: Towards Automatic Generation of Advanced Mulitplication-Less Neural Networks Xiaoxuan Lou Guowen Xu Kangjie Chen Guanlin Li Jiwei Li Tianwei Zhang OOD MQ 8 0 0 07 Apr 2022
Power-of-Two Quantization for Low Bitwidth and Hardware Compliant Neural Networks Dominika Przewlocka-Rus Syed Shakib Sarwar H. Sumbul Yuecheng Li B. D. Salvo MQ 13 29 0 09 Mar 2022
Standard Deviation-Based Quantization for Deep Neural Networks Amir Ardakani A. Ardakani B. Meyer J. Clark W. Gross MQ 16 1 0 24 Feb 2022
Energy awareness in low precision neural networks Nurit Spingarn-Eliezer Ron Banner Elad Hoffer Hilla Ben-Yaacov T. Michaeli 19 0 0 06 Feb 2022
An Empirical Study of Adder Neural Networks for Object Detection Xinghao Chen Chang Xu Minjing Dong Chunjing Xu Yunhe Wang 66 14 0 27 Dec 2021
RCNet: Reverse Feature Pyramid and Cross-scale Shift Network for Object Detection Zhuofan Zong Qianggang Cao B. Leng ObjD 10 13 0 23 Oct 2021
GhostShiftAddNet: More Features from Energy-Efficient Operations Jia Bi Jonathon S. Hare G. Merrett 16 0 0 20 Sep 2021
Token Shift Transformer for Video Classification Hao Zhang Y. Hao Chong-Wah Ngo ViT 13 115 0 05 Aug 2021
$S^3$ : Sign-Sparse-Shift Reparametrization for Effective Training of Low-bit Shift Networks Xinlin Li Bang Liu Yaoliang Yu Wulong Liu Chunjing Xu V. Nia MQ 15 5 0 07 Jul 2021
Auto-NBA: Efficient and Effective Search Over the Joint Space of Networks, Bitwidths, and Accelerators Yonggan Fu Yongan Zhang Yang Zhang David D. Cox Yingyan Lin MQ 33 17 0 11 Jun 2021
Multiplierless MP-Kernel Machine For Energy-efficient Edge Devices Abhishek Ramdas Nair P. Nath S. Chakrabartty Chetan Singh Thakur 16 14 0 03 Jun 2021
"BNN - BN = ?": Training Binary Neural Networks without Batch Normalization Tianlong Chen Zhenyu (Allen) Zhang Xu Ouyang Zechun Liu Zhiqiang Shen Zhangyang Wang MQ 10 34 0 16 Apr 2021
HW-NAS-Bench:Hardware-Aware Neural Architecture Search Benchmark Chaojian Li Zhongzhi Yu Yonggan Fu Yongan Zhang Yang Katie Zhao Haoran You Qixuan Yu Yue Wang Yingyan Lin 14 104 0 19 Mar 2021
Manifold Regularized Dynamic Network Pruning Yehui Tang Yunhe Wang Yixing Xu Yiping Deng Chao Xu Dacheng Tao Chang Xu 11 90 0 10 Mar 2021
AdderNet and its Minimalist Hardware Design for Energy-Efficient Artificial Intelligence Yunhe Wang Mingqiang Huang Kai Han Hanting Chen Wei Zhang Chunjing Xu Dacheng Tao 18 33 0 25 Jan 2021
GhostSR: Learning Ghost Features for Efficient Image Super-Resolution Ying Nie Kai Han Zhenhua Liu Chunjing Xu Yunhe Wang OOD 24 22 0 21 Jan 2021
SmartDeal: Re-Modeling Deep Network Weights for Efficient Inference and Training Xiaohan Chen Yang Katie Zhao Yue Wang Pengfei Xu Haoran You Chaojian Li Y. Fu Yingyan Lin Zhangyang Wang 22 1 0 04 Jan 2021
AdderSR: Towards Energy Efficient Image Super-Resolution Dehua Song Yunhe Wang Hanting Chen Chang Xu Chunjing Xu Dacheng Tao SupR 8 80 0 18 Sep 2020
Distillation Guided Residual Learning for Binary Convolutional Neural Networks Jianming Ye Shiliang Zhang Jingdong Wang MQ 8 19 0 10 Jul 2020
Training High-Performance and Large-Scale Deep Neural Networks with Full 8-bit Integers Yukuan Yang Shuang Wu Lei Deng Tianyi Yan Yuan Xie Guoqi Li MQ 91 108 0 05 Sep 2019
DeepShift: Towards Multiplication-Less Neural Networks Mostafa Elhoushi Zihao Chen F. Shafiq Ye Tian Joey Yiwei Li MQ 8 92 0 30 May 2019