BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong Learning

17 February 2020

Jimmy Ba

Papers citing "BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong Learning"

42 / 92 papers shown

Title
RegMixup: Mixup as a Regularizer Can Surprisingly Improve Accuracy and Out Distribution Robustness Francesco Pinto Harry Yang Ser-Nam Lim Philip H. S. Torr P. Dokania UQCV 25 34 0 29 Jun 2022
Batch-Ensemble Stochastic Neural Networks for Out-of-Distribution Detection Xiongjie Chen Yunpeng Li Yongxin Yang UQCV OODD 11 3 0 26 Jun 2022
Functional Ensemble Distillation Coby Penso Idan Achituve Ethan Fetaya FedML 23 2 0 05 Jun 2022
LiDAR-MIMO: Efficient Uncertainty Estimation for LiDAR-based 3D Object Detection Matthew A. Pitropov Chengjie Huang Vahdat Abdelzad Krzysztof Czarnecki Steven Waslander 3DPC 16 3 0 01 Jun 2022
A Simple Approach to Improve Single-Model Deep Uncertainty via Distance-Awareness J. Liu Shreyas Padhy Jie Jessie Ren Zi Lin Yeming Wen Ghassen Jerfel Zachary Nado Jasper Snoek Dustin Tran Balaji Lakshminarayanan UQCV BDL 16 48 0 01 May 2022
Parameter-efficient Model Adaptation for Vision Transformers Xuehai He Chunyuan Li Pengchuan Zhang Jianwei Yang X. Wang 22 84 0 29 Mar 2022
Self-Distribution Distillation: Efficient Uncertainty Estimation Yassir Fathullah Mark J. F. Gales UQCV 14 11 0 15 Mar 2022
Deep Ensembles Work, But Are They Necessary? Taiga Abe E. Kelly Buchanan Geoff Pleiss R. Zemel John P. Cunningham OOD UQCV 34 59 0 14 Feb 2022
Maximum Likelihood Uncertainty Estimation: Robustness to Outliers Deebul Nair Nico Hochgeschwender Miguel A. Olivares-Mendez OOD 22 7 0 03 Feb 2022
Improving the performance of bagging ensembles for data streams through mini-batching G. Cassales Heitor Murilo Gomes Albert Bifet Bernhard Pfahringer H. Senger AI4TS 8 12 0 18 Dec 2021
Spatial-Temporal-Fusion BNN: Variational Bayesian Feature Layer Shiye Lei Zhuozhuo Tu Leszek Rutkowski Feng Zhou Li Shen Fengxiang He Dacheng Tao BDL 19 2 0 12 Dec 2021
On the Effectiveness of Neural Ensembles for Image Classification with Small Datasets Lorenzo Brigato Luca Iocchi UQCV 20 0 0 29 Nov 2021
DyTox: Transformers for Continual Learning with DYnamic TOken eXpansion Arthur Douillard Alexandre Ramé Guillaume Couairon Matthieu Cord CLL 30 295 0 22 Nov 2021
Diversity Matters When Learning From Ensembles G. Nam Jongmin Yoon Yoonho Lee Juho Lee UQCV FedML VLM 23 36 0 27 Oct 2021
Graph Posterior Network: Bayesian Predictive Uncertainty for Node Classification Maximilian Stadler Bertrand Charpentier Simon Geisler Daniel Zügner Stephan Günnemann UQCV BDL 28 80 0 26 Oct 2021
No One Representation to Rule Them All: Overlapping Features of Training Methods Raphael Gontijo-Lopes Yann N. Dauphin E. D. Cubuk 18 58 0 20 Oct 2021
The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networks R. Entezari Hanie Sedghi O. Saukh Behnam Neyshabur MoMe 35 215 0 12 Oct 2021
DEBOSH: Deep Bayesian Shape Optimization N. Durasov Artem Lukoyanov Jonathan Donier Pascal Fua UQCV AI4CE 27 15 0 28 Sep 2021
Leveraging Uncertainty for Improved Static Malware Detection Under Extreme False Positive Constraints A. Nguyen Edward Raff Charles K. Nicholas James Holt 26 21 0 09 Aug 2021
Robust Semantic Segmentation with Superpixel-Mix Gianni Franchi Nacim Belkhir Mai Lan Ha Yufei Hu Andrei Bursuc V. Blanz Angela Yao UQCV 20 22 0 02 Aug 2021
A Survey of Uncertainty in Deep Neural Networks J. Gawlikowski Cedrique Rovile Njieutcheu Tassi Mohsin Ali Jongseo Lee Matthias Humt ... R. Roscher Muhammad Shahzad Wen Yang R. Bamler Xiaoxiang Zhu BDL UQCV OOD 30 1,108 0 07 Jul 2021
Deep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic Sparsity Shiwei Liu Tianlong Chen Zahra Atashgahi Xiaohan Chen Ghada Sokar Elena Mocanu Mykola Pechenizkiy Zhangyang Wang D. Mocanu OOD 23 49 0 28 Jun 2021
Repulsive Deep Ensembles are Bayesian Francesco DÁngelo Vincent Fortuin UQCV BDL 41 93 0 22 Jun 2021
Compacter: Efficient Low-Rank Hypercomplex Adapter Layers Rabeeh Karimi Mahabadi James Henderson Sebastian Ruder MoE 30 466 0 08 Jun 2021
Orthogonal Ensemble Networks for Biomedical Image Segmentation Agostina J. Larrazabal Cesar E. Martínez Jose Dolz Enzo Ferrante UQCV 10 22 0 22 May 2021
Priors in Bayesian Deep Learning: A Review Vincent Fortuin UQCV BDL 29 124 0 14 May 2021
Efficient Weight factorization for Multilingual Speech Recognition Ngoc-Quan Pham Tuan-Nam Nguyen S. Stueker A. Waibel 35 19 0 07 May 2021
Structured Ensembles: an Approach to Reduce the Memory Footprint of Ensemble Methods Jary Pomponi Simone Scardapane A. Uncini UQCV 38 7 0 06 May 2021
Deep Learning for Bayesian Optimization of Scientific Problems with High-Dimensional Structure Samuel Kim Peter Y. Lu Charlotte Loh Jamie Smith Jasper Snoek M. Soljavcić BDL AI4CE 55 17 0 23 Apr 2021
Efficient Feature Transformations for Discriminative and Generative Continual Learning Vinay K. Verma Kevin J Liang Nikhil Mehta Piyush Rai Lawrence Carin CLL 30 76 0 25 Mar 2021
Learning Neural Network Subspaces Mitchell Wortsman Maxwell Horton Carlos Guestrin Ali Farhadi Mohammad Rastegari UQCV 11 85 0 20 Feb 2021
DEUP: Direct Epistemic Uncertainty Prediction Salem Lahlou Moksh Jain Hadi Nekoei V. Butoi Paul Bertin Jarrid Rector-Brooks Maksym Korablyov Yoshua Bengio PER UQLM UQCV UD 200 81 0 16 Feb 2021
BinPlay: A Binary Latent Autoencoder for Generative Replay Continual Learning Kamil Deja Pawel Wawrzyñski Daniel Marczak Wojciech Masarczyk Tomasz Trzciñski SyDa 11 9 0 25 Nov 2020
Combining Ensembles and Data Augmentation can Harm your Calibration Yeming Wen Ghassen Jerfel Rafael Muller Michael W. Dusenberry Jasper Snoek Balaji Lakshminarayanan Dustin Tran UQCV 24 63 0 19 Oct 2020
Training independent subnetworks for robust prediction Marton Havasi Rodolphe Jenatton Stanislav Fort Jeremiah Zhe Liu Jasper Snoek Balaji Lakshminarayanan Andrew M. Dai Dustin Tran UQCV OOD 19 208 0 13 Oct 2020
Beyond Point Estimate: Inferring Ensemble Prediction Variation from Neuron Activation Strength in Recommender Systems Zhe Chen Yuyan Wang Dong Lin D. Cheng Lichan Hong Ed H. Chi Claire Cui 26 16 0 17 Aug 2020
Diverse Ensembles Improve Calibration Asa Cooper Stickland Iain Murray UQCV FedML 14 26 0 08 Jul 2020
Supermasks in Superposition Mitchell Wortsman Vivek Ramanujan Rosanne Liu Aniruddha Kembhavi Mohammad Rastegari J. Yosinski Ali Farhadi SSL CLL 17 279 0 26 Jun 2020
Hyperparameter Ensembles for Robustness and Uncertainty Quantification F. Wenzel Jasper Snoek Dustin Tran Rodolphe Jenatton UQCV 22 203 0 24 Jun 2020
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 268 5,660 0 05 Dec 2016
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Z. Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 716 6,740 0 26 Sep 2016
Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning Y. Gal Zoubin Ghahramani UQCV BDL 247 9,134 0 06 Jun 2015