Training Binary Neural Networks using the Bayesian Learning Rule

25 February 2020

Xiangming Meng

Roman Bachmann

Mohammad Emtiyaz Khan

BDL

ArXiv PDF HTML

Papers citing "Training Binary Neural Networks using the Bayesian Learning Rule"

29 / 29 papers shown

Title
Long-Tailed Recognition on Binary Networks by Calibrating A Pre-trained Model Jihun Kim Dahyun Kim Hyungrok Jung Taeil Oh Jonghyun Choi MQ 47 0 0 30 Mar 2024
Bayesian Inference Accelerator for Spiking Neural Networks Prabodh Katti Anagha Nimbekar Chen Li Amit Acharyya Bashir M. Al-Hashimi Bipin Rajendran TPM 15 2 0 27 Jan 2024
Efficient Neural Networks for Tiny Machine Learning: A Comprehensive Review M. Lê Pierre Wolinski Julyan Arbel 32 8 0 20 Nov 2023
AutoReP: Automatic ReLU Replacement for Fast Private Network Inference Hongwu Peng Shaoyi Huang Tong Zhou Yukui Luo Chenghong Wang ... Tony Geng Kaleel Mahmood Wujie Wen Xiaolin Xu Caiwen Ding OffRL 32 38 0 20 Aug 2023
Effective Neural Network $L_0$ Regularization With BinMask Kai Jia Martin Rinard 21 3 0 21 Apr 2023
The Lie-Group Bayesian Learning Rule E. M. Kıral Thomas Möllenhoff Mohammad Emtiyaz Khan BDL 15 2 0 08 Mar 2023
Understanding weight-magnitude hyperparameters in training binary networks Joris Quist Yun-qiang Li J. C. V. Gemert MQ 26 0 0 04 Mar 2023
Quantum HyperNetworks: Training Binary Neural Networks in Quantum Superposition Juan Carrasquilla Mohamed Hibat-Allah E. Inack Alireza Makhzani Kirill Neklyudov Graham Taylor G. Torlai MQ 11 8 0 19 Jan 2023
AskewSGD : An Annealed interval-constrained Optimisation method to train Quantized Neural Networks Louis Leconte S. Schechtman Eric Moulines 27 4 0 07 Nov 2022
SAM as an Optimal Relaxation of Bayes Thomas Möllenhoff Mohammad Emtiyaz Khan BDL 29 32 0 04 Oct 2022
Seeking Interpretability and Explainability in Binary Activated Neural Networks Benjamin Leblanc Pascal Germain FAtt 29 1 0 07 Sep 2022
Bayesian Continual Learning via Spiking Neural Networks N. Skatchkovsky Hyeryung Jang Osvaldo Simeone BDL 30 17 0 29 Aug 2022
Supplementing Recurrent Neural Networks with Annealing to Solve Combinatorial Optimization Problems Shoummo Ahsan Khandoker Jawaril Munshad Abedin Mohamed Hibat-Allah 18 8 0 17 Jul 2022
Low-Precision Stochastic Gradient Langevin Dynamics Ruqi Zhang A. Wilson Chris De Sa BDL 13 14 0 20 Jun 2022
AdaSTE: An Adaptive Straight-Through Estimator to Train Binary Neural Networks Huu Le R. Høier Che-Tsung Lin Christopher Zach 42 16 0 06 Dec 2021
BaLeNAS: Differentiable Architecture Search via the Bayesian Learning Rule Miao Zhang Jilin Hu Steven W. Su Shirui Pan Xiaojun Chang B. Yang Gholamreza Haffari OOD 37 15 0 25 Nov 2021
Bias-Variance Tradeoffs in Single-Sample Binary Gradient Estimators Alexander Shekhovtsov MQ 26 4 0 07 Oct 2021
The Bayesian Learning Rule Mohammad Emtiyaz Khan Håvard Rue BDL 55 73 0 09 Jul 2021
Quantized Proximal Averaging Network for Analysis Sparse Coding Kartheek Kumar Reddy Nareddy Mani Madhoolika Bulusu P. Pokala C. Seelamantula MQ 18 1 0 13 May 2021
BiSNN: Training Spiking Neural Networks with Binary Weights via Bayesian Learning Hyeryung Jang N. Skatchkovsky Osvaldo Simeone 29 17 0 15 Dec 2020
A Review of Recent Advances of Binary Neural Networks for Edge Computing Wenyu Zhao Teli Ma Xuan Gong Baochang Zhang David Doermann MQ 18 22 0 24 Nov 2020
A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges Moloud Abdar Farhad Pourpanah Sadiq Hussain Dana Rezazadegan Li Liu ... Xiaochun Cao Abbas Khosravi U. Acharya V. Makarenkov S. Nahavandi BDL UQCV 37 1,877 0 12 Nov 2020
Sparsity-Control Ternary Weight Networks Xiang Deng Zhongfei Zhang MQ 10 8 0 01 Nov 2020
Understanding the Mechanics of SPIGOT: Surrogate Gradients for Latent Structure Learning Tsvetomila Mihaylova Vlad Niculae André F. T. Martins SyDa 13 7 0 05 Oct 2020
Training Restricted Boltzmann Machines with Binary Synapses using the Bayesian Learning Rule Xiangming Meng 20 0 0 09 Jul 2020
Reintroducing Straight-Through Estimators as Principled Methods for Stochastic Binary Networks Alexander Shekhovtsov Dmitry Molchanov MQ 15 15 0 11 Jun 2020
Synaptic Metaplasticity in Binarized Neural Networks Axel Laborieux M. Ernoult T. Hirtzlin D. Querlioz CLL 22 62 0 07 Mar 2020
Fast and Scalable Bayesian Deep Learning by Weight-Perturbation in Adam Mohammad Emtiyaz Khan Didrik Nielsen Voot Tangkaratt Wu Lin Y. Gal Akash Srivastava ODL 74 266 0 13 Jun 2018
Variational Optimization J. Staines David Barber DRL 59 53 0 18 Dec 2012