Deep Ensembles: A Loss Landscape Perspective

5 December 2019

Stanislav Fort

Huiyi Hu

Balaji Lakshminarayanan

OOD

UQCV

ArXiv PDF HTML

Papers citing "Deep Ensembles: A Loss Landscape Perspective"

50 / 117 papers shown

Title
Sparse Training from Random Initialization: Aligning Lottery Ticket Masks using Weight Symmetry Mohammed Adnan Rohan Jain Ekansh Sharma Rahul Krishnan Yani Andrew Ioannou 56 0 0 08 May 2025
The effect of the number of parameters and the number of local feature patches on loss landscapes in distributed quantum neural networks Yoshiaki Kawase 73 0 0 27 Apr 2025
FedBEns: One-Shot Federated Learning based on Bayesian Ensemble Jacopo Talpini Marco Savi Giovanni Neglia FedML Presented at ResearchTrend Connect \| FedML on 07 May 2025 76 0 0 19 Mar 2025
Contextual Similarity Distillation: Ensemble Uncertainties with a Single Model Moritz A. Zanger Pascal R. van der Vaart Wendelin Bohmer M. Spaan UQCV BDL 140 0 0 14 Mar 2025
Self-Ensembling Gaussian Splatting for Few-Shot Novel View Synthesis Chen Zhao Xuan Wang Tong Zhang Saqib Javed Mathieu Salzmann 3DGS 185 0 0 13 Mar 2025
SplatPose: Geometry-Aware 6-DoF Pose Estimation from Single RGB Image via 3D Gaussian Splatting Linqi Yang Xiongwei Zhao Qihao Sun Ke Wang Ao Chen Peng Kang 3DGS 78 2 0 07 Mar 2025
SuperMerge: An Approach For Gradient-Based Model Merging Haoyu Yang Zheng Zhang Saket Sathe MoMe 125 0 0 17 Feb 2025
Early Failure Detection in Autonomous Surgical Soft-Tissue Manipulation via Uncertainty Quantification Jordan Thompson Ronald Koe Anthony Le Gabriella Goodman Daniel S. Brown Alan Kuntz 47 1 0 17 Jan 2025
TabM: Advancing Tabular Deep Learning with Parameter-Efficient Ensembling Yury Gorishniy Akim Kotelnikov Artem Babenko LMTD MoE 89 6 0 31 Oct 2024
Uncertainty Quantification in Seismic Inversion Through Integrated Importance Sampling and Ensemble Methods Luping Qu Mauricio Araya-Polo Laurent Demanet 61 0 0 10 Sep 2024
Input Space Mode Connectivity in Deep Neural Networks Jakub Vrabel Ori Shem-Ur Yaron Oz David Krueger 48 1 0 09 Sep 2024
Network Fission Ensembles for Low-Cost Self-Ensembles Hojung Lee Jong-Seok Lee UQCV 54 0 0 05 Aug 2024
Regularized Multi-Decoder Ensemble for an Error-Aware Scene Representation Network Tianyu Xiong Skylar W. Wurster Hanqi Guo Tom Peterka Han-Wei Shen UQCV 53 1 0 26 Jul 2024
Relaxed Quantile Regression: Prediction Intervals for Asymmetric Noise T. Pouplin Alan Jeffares Nabeel Seedat Mihaela van der Schaar 50 3 0 05 Jun 2024
Ensemble Successor Representations for Task Generalization in Offline-to-Online Reinforcement Learning Changhong Wang Xudong Yu Chenjia Bai Qiaosheng Zhang Zhen Wang 40 1 0 12 May 2024
Predicting Safety Misbehaviours in Autonomous Driving Systems using Uncertainty Quantification Ruben Grewal Paolo Tonella Andrea Stocco 48 11 0 29 Apr 2024
NTK-Guided Few-Shot Class Incremental Learning Jingren Liu Zhong Ji Yanwei Pang Yunlong Yu CLL 34 3 0 19 Mar 2024
A Scalable and Transferable Time Series Prediction Framework for Demand Forecasting Young-Jin Park Donghyun Kim Frédéric Odermatt Juho Lee KyungHyun Kim AI4TS 42 3 0 29 Feb 2024
On the Byzantine-Resilience of Distillation-Based Federated Learning Christophe Roux Max Zimmer S. Pokutta AAML 49 1 0 19 Feb 2024
Artificial Intelligence for Digital and Computational Pathology Andrew H. Song Guillaume Jaume Drew F. K. Williamson Ming Y. Lu Anurag J. Vaidya Tiffany R. Miller Faisal Mahmood AI4CE 30 129 0 13 Dec 2023
From Pointwise to Powerhouse: Initialising Neural Networks with Generative Models Christian Harder Moritz Fuchs Yuri Tolkach Anirban Mukhopadhyay 25 0 0 25 Oct 2023
Benchmarking Scalable Epistemic Uncertainty Quantification in Organ Segmentation Jadie Adams Shireen Elhabian UQCV 18 5 0 15 Aug 2023
U-CE: Uncertainty-aware Cross-Entropy for Semantic Segmentation S. Landgraf Markus Hillemann Kira Wursthorn Markus Ulrich SSeg UQCV 26 6 0 19 Jul 2023
Generative Meta-Learning Robust Quality-Diversity Portfolio K. Yuksel 11 2 0 15 Jul 2023
Layer-wise Linear Mode Connectivity Linara Adilova Maksym Andriushchenko Michael Kamp Asja Fischer Martin Jaggi FedML FAtt MoMe 28 15 0 13 Jul 2023
CUED at ProbSum 2023: Hierarchical Ensemble of Summarization Models Potsawee Manakul Yassir Fathullah Adian Liusie Vyas Raina Vatsal Raina Mark J. F. Gales 27 12 0 08 Jun 2023
Theoretical Guarantees of Learning Ensembling Strategies with Applications to Time Series Forecasting Hilaf Hasson Danielle C. Maddix Yuyang Wang Gaurav Gupta Youngsuk Park UQCV AI4TS FedML 27 3 0 25 May 2023
When are ensembles really effective? Ryan Theisen Hyunsuk Kim Yaoqing Yang Liam Hodgkinson Michael W. Mahoney FedML UQCV 27 15 0 21 May 2023
Measuring and Mitigating Local Instability in Deep Neural Networks Arghya Datta Subhrangshu Nandi Jingcheng Xu Greg Ver Steeg He Xie Anoop Kumar Aram Galstyan 15 3 0 18 May 2023
Integrating Uncertainty into Neural Network-based Speech Enhancement Hu Fang Dennis Becker S. Wermter Timo Gerkmann UQCV 29 2 0 15 May 2023
Similarity of Neural Network Models: A Survey of Functional and Representational Measures Max Klabunde Tobias Schumacher M. Strohmaier Florian Lemmerich 52 64 0 10 May 2023
On the Limitations of Model Stealing with Uncertainty Quantification Models David Pape Sina Daubener Thorsten Eisenhofer Antonio Emanuele Cinà Lea Schonherr 30 3 0 09 May 2023
On the Variance of Neural Network Training with respect to Test Sets and Distributions Keller Jordan OOD 16 10 0 04 Apr 2023
Scalable Bayesian optimization with high-dimensional outputs using randomized prior networks Mohamed Aziz Bhouri M. Joly Robert Yu S. Sarkar P. Perdikaris BDL UQCV AI4CE 11 1 0 14 Feb 2023
Benchmarking Probabilistic Deep Learning Methods for License Plate Recognition Franziska Schirrmacher Benedikt Lorch Anatol Maier Christian Riess UQCV 28 4 0 02 Feb 2023
Pathologies of Predictive Diversity in Deep Ensembles Taiga Abe E. Kelly Buchanan Geoff Pleiss John P. Cunningham UQCV 38 13 0 01 Feb 2023
Joint Training of Deep Ensembles Fails Due to Learner Collusion Alan Jeffares Tennison Liu Jonathan Crabbé M. Schaar FedML 44 15 0 26 Jan 2023
Bayesian posterior approximation with stochastic ensembles Oleksandr Balabanov Bernhard Mehlig H. Linander BDL UQCV 27 5 0 15 Dec 2022
Scalable Bayesian Uncertainty Quantification for Neural Network Potentials: Promise and Pitfalls Stephan Thaler Gregor Doehner J. Zavadlav 27 21 0 15 Dec 2022
Editing Models with Task Arithmetic Gabriel Ilharco Marco Tulio Ribeiro Mitchell Wortsman Suchin Gururangan Ludwig Schmidt Hannaneh Hajishirzi Ali Farhadi KELM MoMe MU 45 424 0 08 Dec 2022
Unveiling the Tapestry: the Interplay of Generalization and Forgetting in Continual Learning Zenglin Shi Jing Jie Ying Sun J. Lim Mengmi Zhang CLL 36 1 0 21 Nov 2022
Introduction and Exemplars of Uncertainty Decomposition Shuo Chen UD UQCV PER 30 0 0 17 Nov 2022
REPAIR: REnormalizing Permuted Activations for Interpolation Repair Keller Jordan Hanie Sedghi O. Saukh R. Entezari Behnam Neyshabur MoMe 46 94 0 15 Nov 2022
Packed-Ensembles for Efficient Uncertainty Estimation Olivier Laurent Adrien Lafage Enzo Tartaglione Geoffrey Daniel Jean-Marc Martinez Andrei Bursuc Gianni Franchi OODD 44 32 0 17 Oct 2022
Multi-CLS BERT: An Efficient Alternative to Traditional Ensembling Haw-Shiuan Chang Ruei-Yao Sun Kathryn Ricci Andrew McCallum 43 14 0 10 Oct 2022
Automatic Neural Network Hyperparameter Optimization for Extrapolation: Lessons Learned from Visible and Near-Infrared Spectroscopy of Mango Fruit Matthew C. Dirks David Poole 15 16 0 03 Oct 2022
On the Factory Floor: ML Engineering for Industrial-Scale Ads Recommendation Models Rohan Anil S. Gadanho Danya Huang Nijith Jacob Zhuoshu Li ... Cristina Pop Kevin Regan G. Shamir Rakesh Shivanna Qiqi Yan 3DV 16 41 0 12 Sep 2022
Quality Not Quantity: On the Interaction between Dataset Design and Robustness of CLIP Thao Nguyen Gabriel Ilharco Mitchell Wortsman Sewoong Oh Ludwig Schmidt CLIP VLM 42 97 0 10 Aug 2022
The Neural Race Reduction: Dynamics of Abstraction in Gated Networks Andrew M. Saxe Shagun Sodhani Sam Lewallen AI4CE 28 34 0 21 Jul 2022
Latent Discriminant deterministic Uncertainty Gianni Franchi Xuanlong Yu Andrei Bursuc Emanuel Aldea Séverine Dubuisson David Filliat UQCV 22 18 0 20 Jul 2022