Deep Ensembles: A Loss Landscape Perspective

5 December 2019

Stanislav Fort

Huiyi Hu

Balaji Lakshminarayanan

OOD

UQCV

ArXiv PDF HTML

Papers citing "Deep Ensembles: A Loss Landscape Perspective"

50 / 122 papers shown

Title
Quality Not Quantity: On the Interaction between Dataset Design and Robustness of CLIP Thao Nguyen Gabriel Ilharco Mitchell Wortsman Sewoong Oh Ludwig Schmidt CLIP VLM 42 97 0 10 Aug 2022
The Neural Race Reduction: Dynamics of Abstraction in Gated Networks Andrew M. Saxe Shagun Sodhani Sam Lewallen AI4CE 28 34 0 21 Jul 2022
Latent Discriminant deterministic Uncertainty Gianni Franchi Xuanlong Yu Andrei Bursuc Emanuel Aldea Séverine Dubuisson David Filliat UQCV 22 18 0 20 Jul 2022
Single Model Uncertainty Estimation via Stochastic Data Centering Jayaraman J. Thiagarajan Rushil Anirudh V. Narayanaswamy P. Bremer UQCV OOD 22 26 0 14 Jul 2022
Transfer learning for ensembles: reducing computation time and keeping the diversity Ilya Shashkov Nikita Balabin Evgeny Burnaev Alexey Zaytsev 11 1 0 27 Jun 2022
Influence of uncertainty estimation techniques on false-positive reduction in liver lesion detection Ishaan Bhat J. Pluim M. Viergever Hugo J. Kuijf MedIm 21 4 0 22 Jun 2022
Balanced Product of Calibrated Experts for Long-Tailed Recognition Emanuel Sanchez Aimar Arvi Jonnarth M. Felsberg Marco Kuhlmann 15 22 0 10 Jun 2022
Ensembles for Uncertainty Estimation: Benefits of Prior Functions and Bootstrapping Vikranth Dwaracherla Zheng Wen Ian Osband Xiuyuan Lu S. Asghari Benjamin Van Roy UQCV 24 16 0 08 Jun 2022
Revisiting the Importance of Amplifying Bias for Debiasing Jungsoo Lee Jeonghoon Park Daeyoung Kim Juyoung Lee E. Choi Jaegul Choo 39 21 0 29 May 2022
Sample-Efficient Optimisation with Probabilistic Transformer Surrogates A. Maraval Matthieu Zimmer Antoine Grosnit Rasul Tutunov Jun Wang H. Ammar 25 2 0 27 May 2022
Deep interpretable ensembles Lucas Kook Andrea Götschi Philipp F. M. Baumann Torsten Hothorn Beate Sick UQCV 22 8 0 25 May 2022
Interpolating Compressed Parameter Subspaces Siddhartha Datta N. Shadbolt 34 5 0 19 May 2022
A Simple Approach to Improve Single-Model Deep Uncertainty via Distance-Awareness J. Liu Shreyas Padhy Jie Jessie Ren Zi Lin Yeming Wen Ghassen Jerfel Zachary Nado Jasper Snoek Dustin Tran Balaji Lakshminarayanan UQCV BDL 16 48 0 01 May 2022
Low-Loss Subspace Compression for Clean Gains against Multi-Agent Backdoor Attacks Siddhartha Datta N. Shadbolt AAML 21 6 0 07 Mar 2022
Scalable Uncertainty Quantification for Deep Operator Networks using Randomized Priors Yibo Yang Georgios Kissas P. Perdikaris BDL UQCV 22 40 0 06 Mar 2022
Engineering the Neural Automatic Passenger Counter Nico Jahn Michael Siebert 13 2 0 02 Mar 2022
Theoretical Error Analysis of Entropy Approximation for Gaussian Mixture Takashi Furuya Hiroyuki Kusumoto K. Taniguchi Naoya Kanno Kazuma Suetake 13 1 0 26 Feb 2022
Multiple Importance Sampling ELBO and Deep Ensembles of Variational Approximations Oskar Kviman Harald Melin Hazal Koptagel Victor Elvira J. Lagergren DRL 65 17 0 22 Feb 2022
Deep Ensembles Work, But Are They Necessary? Taiga Abe E. Kelly Buchanan Geoff Pleiss R. Zemel John P. Cunningham OOD UQCV 36 59 0 14 Feb 2022
PFGE: Parsimonious Fast Geometric Ensembling of DNNs Hao Guo Jiyong Jin B. Liu FedML 18 1 0 14 Feb 2022
Evaluating natural language processing models with generalization metrics that do not need access to any training or testing data Yaoqing Yang Ryan Theisen Liam Hodgkinson Joseph E. Gonzalez Kannan Ramchandran Charles H. Martin Michael W. Mahoney 86 17 0 06 Feb 2022
Backdoors Stuck At The Frontdoor: Multi-Agent Backdoor Attacks That Backfire Siddhartha Datta N. Shadbolt AAML 24 7 0 28 Jan 2022
Representation Topology Divergence: A Method for Comparing Neural Network Representations S. Barannikov I. Trofimov Nikita Balabin Evgeny Burnaev 3DPC 28 45 0 31 Dec 2021
Forward Compatible Training for Large-Scale Embedding Retrieval Systems Vivek Ramanujan Pavan Kumar Anasosalu Vasu Ali Farhadi Oncel Tuzel Hadi Pouransari VLM 19 16 0 06 Dec 2021
Towards Lightweight Controllable Audio Synthesis with Conditional Implicit Neural Representations Jan Zuiderveld Marco Federici Erik J. Bekkers AI4CE 29 6 0 14 Nov 2021
On Efficient Uncertainty Estimation for Resource-Constrained Mobile Applications J. Rock Tiago Azevedo R. D. Jong Daniel Ruiz-Munoz Partha P. Maji UQCV 13 5 0 11 Nov 2021
Asynchronous Collaborative Localization by Integrating Spatiotemporal Graph Learning with Model-Based Estimation Peng Gao Brian Reily Rui Guo Hongsheng Lu Qingzhao Zhu Hao Zhang 44 5 0 05 Nov 2021
Diversity Matters When Learning From Ensembles G. Nam Jongmin Yoon Yoonho Lee Juho Lee UQCV FedML VLM 37 36 0 27 Oct 2021
Practical Galaxy Morphology Tools from Deep Supervised Representation Learning Mike Walmsley Anna M. M. Scaife Chris J. Lintott Michelle Lochner Yu Zhu ... Xibo Ma Sandor Kruk Zhen Lei G. Guo B. Simmons 14 29 0 25 Oct 2021
No One Representation to Rule Them All: Overlapping Features of Training Methods Raphael Gontijo-Lopes Yann N. Dauphin E. D. Cubuk 18 60 0 20 Oct 2021
The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networks R. Entezari Hanie Sedghi O. Saukh Behnam Neyshabur MoMe 37 215 0 12 Oct 2021
Connecting Low-Loss Subspace for Personalized Federated Learning S. Hahn Minwoo Jeong Junghye Lee FedML 16 18 0 16 Sep 2021
Leveraging Uncertainty for Improved Static Malware Detection Under Extreme False Positive Constraints A. Nguyen Edward Raff Charles K. Nicholas James Holt 33 21 0 09 Aug 2021
Robust Semantic Segmentation with Superpixel-Mix Gianni Franchi Nacim Belkhir Mai Lan Ha Yufei Hu Andrei Bursuc V. Blanz Angela Yao UQCV 30 22 0 02 Aug 2021
A Survey of Uncertainty in Deep Neural Networks J. Gawlikowski Cedrique Rovile Njieutcheu Tassi Mohsin Ali Jongseo Lee Matthias Humt ... R. Roscher Muhammad Shahzad Wen Yang R. Bamler Xiaoxiang Zhu BDL UQCV OOD 32 1,109 0 07 Jul 2021
What can linear interpolation of neural network loss landscapes tell us? Tiffany J. Vlaar Jonathan Frankle MoMe 22 27 0 30 Jun 2021
Detecting Errors and Estimating Accuracy on Unlabeled Data with Self-training Ensembles Jiefeng Chen Frederick Liu Besim Avci Xi Wu Yingyu Liang S. Jha 24 60 0 29 Jun 2021
Deep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic Sparsity Shiwei Liu Tianlong Chen Zahra Atashgahi Xiaohan Chen Ghada Sokar Elena Mocanu Mykola Pechenizkiy Zhangyang Wang D. Mocanu OOD 28 49 0 28 Jun 2021
Revisiting Deep Learning Models for Tabular Data Yu. V. Gorishniy Ivan Rubachev Valentin Khrulkov Artem Babenko LMTD 21 696 0 22 Jun 2021
Repulsive Deep Ensembles are Bayesian Francesco DÁngelo Vincent Fortuin UQCV BDL 46 93 0 22 Jun 2021
Extracting Global Dynamics of Loss Landscape in Deep Learning Models Mohammed Eslami Hamed Eramian Marcio Gameiro W. Kalies Konstantin Mischaikow 16 1 0 14 Jun 2021
Structured Ensembles: an Approach to Reduce the Memory Footprint of Ensemble Methods Jary Pomponi Simone Scardapane A. Uncini UQCV 41 7 0 06 May 2021
Deep Learning for Bayesian Optimization of Scientific Problems with High-Dimensional Structure Samuel Kim Peter Y. Lu Charlotte Loh Jamie Smith Jasper Snoek M. Soljavcić BDL AI4CE 63 17 0 23 Apr 2021
Distill on the Go: Online knowledge distillation in self-supervised learning Prashant Bhat Elahe Arani Bahram Zonooz SSL 22 28 0 20 Apr 2021
Automated Cleanup of the ImageNet Dataset by Model Consensus, Explainability and Confident Learning Csaba Kertész VLM SSL 23 45 0 30 Mar 2021
Accurate and Reliable Forecasting using Stochastic Differential Equations Peng Cui Zhijie Deng Wenbo Hu Jun Zhu UQCV 28 1 0 28 Mar 2021
Probabilistic Spatial Analysis in Quantitative Microscopy with Uncertainty-Aware Cell Detection using Deep Bayesian Regression of Density Maps Alvaro Gomariz Tiziano Portenier C. Nombela-Arrieta O. Goksel UQCV 16 6 0 23 Feb 2021
Learning Neural Network Subspaces Mitchell Wortsman Maxwell Horton Carlos Guestrin Ali Farhadi Mohammad Rastegari UQCV 22 85 0 20 Feb 2021
Locally Adaptive Label Smoothing for Predictive Churn Dara Bahri Heinrich Jiang NoLa 32 8 0 09 Feb 2021
Uncertainty Estimation with Deep Learning for Rainfall-Runoff Modelling D. Klotz Frederik Kratzert M. Gauch A. Sampson G. Klambauer Sepp Hochreiter G. Nearing BDL UQCV 13 106 0 15 Dec 2020