Why M Heads are Better than One: Training a Diverse Ensemble of Deep Networks

19 November 2015

Papers citing "Why M Heads are Better than One: Training a Diverse Ensemble of Deep Networks"

50 / 71 papers shown

Title
Self-Ensembling Gaussian Splatting for Few-Shot Novel View Synthesis Chen Zhao Xuan Wang Tong Zhang Saqib Javed Mathieu Salzmann 3DGS 233 0 0 13 Mar 2025
Fairness of Deep Ensembles: On the interplay between per-group task difficulty and under-representation Estanislao Claucich Sara Hooker Diego H. Milone Enzo Ferrante Rodrigo Echeveste FedML 49 0 0 24 Jan 2025
Early Failure Detection in Autonomous Surgical Soft-Tissue Manipulation via Uncertainty Quantification Jordan Thompson Ronald Koe Anthony Le Gabriella Goodman Daniel S. Brown Alan Kuntz 52 1 0 17 Jan 2025
TabM: Advancing Tabular Deep Learning with Parameter-Efficient Ensembling Yury Gorishniy Akim Kotelnikov Artem Babenko LMTD MoE 94 6 0 31 Oct 2024
Network Fission Ensembles for Low-Cost Self-Ensembles Hojung Lee Jong-Seok Lee UQCV 64 0 0 05 Aug 2024
Hierarchical Uncertainty Exploration via Feedforward Posterior Trees E. Nehme Rotem Mulayoff T. Michaeli UQCV 48 2 0 24 May 2024
RADIN: Souping on a Budget Thibaut Menes Olivier Risser-Maroix MoMe 52 1 0 31 Jan 2024
Stochastic Subnetwork Annealing: A Regularization Technique for Fine Tuning Pruned Subnetworks Tim Whitaker Darrell Whitley 33 0 0 16 Jan 2024
Deep Anti-Regularized Ensembles provide reliable out-of-distribution uncertainty quantification Antoine de Mathelin Francois Deheeger Mathilde Mougeot Nicolas Vayatis OOD UQCV 25 2 0 08 Apr 2023
Pathologies of Predictive Diversity in Deep Ensembles Taiga Abe E. Kelly Buchanan Geoff Pleiss John P. Cunningham UQCV 40 13 0 01 Feb 2023
Towards Inference Efficient Deep Ensemble Learning Ziyue Li Kan Ren Yifan Yang Xinyang Jiang Yuqing Yang Dongsheng Li BDL 29 12 0 29 Jan 2023
Joint Training of Deep Ensembles Fails Due to Learner Collusion Alan Jeffares Tennison Liu Jonathan Crabbé M. Schaar FedML 56 15 0 26 Jan 2023
TMS-Net: A Segmentation Network Coupled With A Run-time Quality Control Method For Robust Cardiac Image Segmentation F. Uslu Anil A. Bharath 39 14 0 21 Dec 2022
Deep Learning for Brain Age Estimation: A Systematic Review Md. Iftekhar Tanveer M. A. Ganaie I. Beheshti Tripti Goel Nehal Ahmad Kuan-Ting Lai Kaizhu Huang Yudong Zhang Javier Del Ser Chin-Teng Lin 25 86 0 07 Dec 2022
Weighted Ensemble Self-Supervised Learning Yangjun Ruan Saurabh Singh Warren Morningstar Alexander A. Alemi Sergey Ioffe Ian S. Fischer Joshua V. Dillon FedML 29 15 0 18 Nov 2022
Learning New Tasks from a Few Examples with Soft-Label Prototypes Avyav Kumar Singh Ekaterina Shutova H. Yannakoudakis VLM 33 0 0 31 Oct 2022
Packed-Ensembles for Efficient Uncertainty Estimation Olivier Laurent Adrien Lafage Enzo Tartaglione Geoffrey Daniel Jean-Marc Martinez Andrei Bursuc Gianni Franchi OODD 44 32 0 17 Oct 2022
Two-stage Modeling for Prediction with Confidence Dangxing Chen OODD OOD 14 0 0 19 Sep 2022
Deep learning in a bilateral brain with hemispheric specialization C. Rajagopalan D. Rawlinson E. Goldberg Gideon Kowadlo 19 4 0 09 Sep 2022
Probing Contextual Diversity for Dense Out-of-Distribution Detection Silvio Galesso M. A. Bravo Mehdi Naouar Thomas Brox 21 4 0 30 Aug 2022
Transfer learning for ensembles: reducing computation time and keeping the diversity Ilya Shashkov Nikita Balabin Evgeny Burnaev Alexey Zaytsev 22 1 0 27 Jun 2022
LiDAR-MIMO: Efficient Uncertainty Estimation for LiDAR-based 3D Object Detection Matthew A. Pitropov Chengjie Huang Vahdat Abdelzad Krzysztof Czarnecki Steven Waslander 3DPC 19 3 0 01 Jun 2022
Towards efficient feature sharing in MIMO architectures Rémy Sun Alexandre Ramé Clément Masson Nicolas Thome Matthieu Cord 78 6 0 20 May 2022
Simple Regularisation for Uncertainty-Aware Knowledge Distillation Martin Ferianc Miguel R. D. Rodrigues UQCV 47 0 0 19 May 2022
Transframer: Arbitrary Frame Prediction with Generative Models C. Nash João Carreira Jacob Walker Iain Barr Andrew Jaegle Mateusz Malinowski Peter W. Battaglia ViT 27 37 0 17 Mar 2022
Raman Spectrum Matching with Contrastive Representation Learning Bo-wen Li Mikkel N. Schmidt T. S. Alstrøm 31 10 0 25 Feb 2022
Highlighting Object Category Immunity for the Generalization of Human-Object Interaction Detection Xinpeng Liu Yong-Lu Li Cewu Lu 19 13 0 19 Feb 2022
Deep Ensembles Work, But Are They Necessary? Taiga Abe E. Kelly Buchanan Geoff Pleiss R. Zemel John P. Cunningham OOD UQCV 44 60 0 14 Feb 2022
Verification-Aided Deep Ensemble Selection Guy Amir Tom Zelazny Guy Katz Michael Schapira AAML 30 18 0 08 Feb 2022
A Cheap Bootstrap Method for Fast Inference H. Lam 29 11 0 31 Jan 2022
Improving robustness and calibration in ensembles with diversity regularization H. A. Mehrtens Camila González Anirban Mukhopadhyay UQCV 19 7 0 26 Jan 2022
Representation Topology Divergence: A Method for Comparing Neural Network Representations S. Barannikov I. Trofimov Nikita Balabin Evgeny Burnaev 3DPC 40 45 0 31 Dec 2021
Efficient Diversity-Driven Ensemble for Deep Neural Networks Wentao Zhang Jiawei Jiang Yingxia Shao Tengjiao Wang 26 17 0 26 Dec 2021
Generalisation effects of predictive uncertainty estimation in deep learning for digital pathology Milda Pocevičiūtė Gabriel Eilertsen Sofia Jarkman Claes Lundström OOD UQCV 33 24 0 17 Dec 2021
Uncertainty Estimation via Response Scaling for Pseudo-mask Noise Mitigation in Weakly-supervised Semantic Segmentation Yi Li Yiqun Duan Zhanghui Kuang Yimin Chen Wayne Zhang Xiaomeng Li 30 72 0 14 Dec 2021
DyTox: Transformers for Continual Learning with DYnamic TOken eXpansion Arthur Douillard Alexandre Ramé Guillaume Couairon Matthieu Cord CLL 30 295 0 22 Nov 2021
Aggressive Q-Learning with Ensembles: Achieving Both High Sample Efficiency and High Asymptotic Performance Yanqiu Wu Xinyue Chen Che Wang Yiming Zhang Keith Ross OffRL 9 9 0 17 Nov 2021
Which Model to Trust: Assessing the Influence of Models on the Performance of Reinforcement Learning Algorithms for Continuous Control Tasks Giacomo Arcieri David Wölfle Eleni Chatzi OffRL 27 5 0 25 Oct 2021
Quantifying Epistemic Uncertainty in Deep Learning Ziyi Huang H. Lam Haofeng Zhang UQCV BDL UD PER 24 12 0 23 Oct 2021
Using Soft Labels to Model Uncertainty in Medical Image Segmentation Joao Lourencco Silva Arlindo L. Oliveira UQCV 24 19 0 26 Sep 2021
Robust Semantic Segmentation with Superpixel-Mix Gianni Franchi Nacim Belkhir Mai Lan Ha Yufei Hu Andrei Bursuc V. Blanz Angela Yao UQCV 36 22 0 02 Aug 2021
A Survey of Uncertainty in Deep Neural Networks J. Gawlikowski Cedrique Rovile Njieutcheu Tassi Mohsin Ali Jongseo Lee Matthias Humt ... R. Roscher Muhammad Shahzad Wen Yang R. Bamler Xiaoxiang Zhu BDL UQCV OOD 59 1,111 0 07 Jul 2021
Deep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic Sparsity Shiwei Liu Tianlong Chen Zahra Atashgahi Xiaohan Chen Ghada Sokar Elena Mocanu Mykola Pechenizkiy Zhangyang Wang Decebal Constantin Mocanu OOD 31 49 0 28 Jun 2021
Quantifying Uncertainty in Deep Spatiotemporal Forecasting Dongxian Wu Liyao (Mars) Gao X. Xiong Matteo Chinazzi Alessandro Vespignani Yi Ma Rose Yu AI4TS 13 68 0 25 May 2021
Coarse to Fine Multi-Resolution Temporal Convolutional Network Dipika Singhania R. Rahaman Angela Yao AI4TS 16 55 0 23 May 2021
Structured Ensembles: an Approach to Reduce the Memory Footprint of Ensemble Methods Jary Pomponi Simone Scardapane A. Uncini UQCV 49 7 0 06 May 2021
Uncertainty Quantification by Ensemble Learning for Computational Optical Form Measurements L. Hoffmann I. Fortmeier Clemens Elster UQCV 25 28 0 01 Mar 2021
DICE: Diversity in Deep Ensembles via Conditional Redundancy Adversarial Estimation Alexandre Ramé Matthieu Cord FedML 53 51 0 14 Jan 2021
Parallel Blockwise Knowledge Distillation for Deep Neural Network Compression Cody Blakeney Xiaomin Li Yan Yan Ziliang Zong 46 39 0 05 Dec 2020
Generalized Negative Correlation Learning for Deep Ensembling Sebastian Buschjäger Lukas Pfahler K. Morik FedML BDL UQCV 9 17 0 05 Nov 2020