Snapshot Ensembles: Train 1, get M for free

1 April 2017

Gao Huang

Papers citing "Snapshot Ensembles: Train 1, get M for free"

50 / 441 papers shown

Title
Left Heavy Tails and the Effectiveness of the Policy and Value Networks in DNN-based best-first search for Sokoban Planning Dieqiao Feng Carla P. Gomes B. Selman 20 2 0 28 Jun 2022
Effective training-time stacking for ensembling of deep neural networks P. Proskura Alexey Zaytsev 9 6 0 27 Jun 2022
Transfer learning for ensembles: reducing computation time and keeping the diversity Ilya Shashkov Nikita Balabin Evgeny Burnaev Alexey Zaytsev 8 1 0 27 Jun 2022
A Geometric Method for Improved Uncertainty Estimation in Real-time Gabriella Chouraqui L. Cohen Gil Einziger Liel Leman 6 0 0 23 Jun 2022
When Does Re-initialization Work? Sheheryar Zaidi Tudor Berariu Hyunjik Kim J. Bornschein Claudia Clopath Yee Whye Teh Razvan Pascanu 35 10 0 20 Jun 2022
Modeling Generalized Specialist Approach To Train Quality Resilient Snapshot Ensemble G. Tahir C. K. Loo Zongying Liu AAML 14 0 0 12 Jun 2022
Confidence-aware Self-Semantic Distillation on Knowledge Graph Embedding Yichen Liu C. Wang Defang Chen Zhehui Zhou Yan Feng Chun-Yen Chen 11 0 0 07 Jun 2022
Star algorithm for NN ensembling Sergey Zinchenko Dmitry Lishudi FedML 11 0 0 01 Jun 2022
FiLM-Ensemble: Probabilistic Deep Learning via Feature-wise Linear Modulation Mehmet Özgür Türkoglu Alexander Becker H. Gündüz Mina Rezaei Bernd Bischl Rodrigo Caye Daudt Stefano Dáronco Jan Dirk Wegner Konrad Schindler FedML UQCV 38 25 0 31 May 2022
Superposing Many Tickets into One: A Performance Booster for Sparse Neural Network Training Lu Yin Vlado Menkovski Meng Fang Tianjin Huang Yulong Pei Mykola Pechenizkiy D. Mocanu Shiwei Liu 24 8 0 30 May 2022
ELODI: Ensemble Logit Difference Inhibition for Positive-Congruent Training Yue Zhao Yantao Shen Yuanjun Xiong Shuo Yang Wei Xia Z. Tu Bernt Shiele Stefano Soatto BDL 38 6 0 12 May 2022
Jacobian Ensembles Improve Robustness Trade-offs to Adversarial Attacks Kenneth T. Co David Martínez-Rego Zhongyuan Hau Emil C. Lupu AAML 17 4 0 19 Apr 2022
RubCSG at SemEval-2022 Task 5: Ensemble learning for identifying misogynous MEMEs Wentao Yu Benedikt T. Boenninghoff Jonas Roehrig D. Kolossa 20 3 0 08 Apr 2022
DeepTensor: Low-Rank Tensor Decomposition with Deep Network Priors Vishwanath Saragadam Randall Balestriero Ashok Veeraraghavan Richard G. Baraniuk 17 15 0 07 Apr 2022
Discovering and forecasting extreme events via active learning in neural operators Ethan Pickering Stephen Guth George Karniadakis T. Sapsis AI4CE 11 57 0 05 Apr 2022
Learning Structured Gaussians to Approximate Deep Ensembles Ivor J. A. Simpson Sara Vicente Neill D. F. Campbell UQCV 27 9 0 29 Mar 2022
Single Model Ensemble for Subword Regularized Models in Low-Resource Machine Translation Sho Takase Tatsuya Hiraoka Naoaki Okazaki 8 5 0 25 Mar 2022
RD-Optimized Trit-Plane Coding of Deep Compressed Image Latent Tensors S. Jeon Jae-Han Lee Chang-Su Kim 14 2 0 25 Mar 2022
Hyperbolic Uncertainty Aware Semantic Segmentation Bike Chen Wei Peng Xiaofeng Cao Juha Roning UQCV 16 15 0 16 Mar 2022
Layer Ensembles: A Single-Pass Uncertainty Estimation in Deep Learning for Segmentation Kaisar Kushibar Víctor M. Campello Lidia Garrucho Moras Akis Linardos P. Radeva Karim Lekadir UQCV 6 18 0 16 Mar 2022
Reducing Flipping Errors in Deep Neural Networks Xiang Deng Yun Xiao Bo Long Zhongfei Zhang AAML 27 3 0 16 Mar 2022
Structure and Distribution Metric for Quantifying the Quality of Uncertainty: Assessing Gaussian Processes, Deep Neural Nets, and Deep Neural Operators for Regression Ethan Pickering T. Sapsis UQCV 14 6 0 09 Mar 2022
Boosted Ensemble Learning based on Randomized NNs for Time Series Forecasting Grzegorz Dudek AI4TS 6 1 0 02 Mar 2022
Learn From the Past: Experience Ensemble Knowledge Distillation Chaofei Wang Shaowei Zhang S. Song Gao Huang 25 4 0 25 Feb 2022
Embedded Ensembles: Infinite Width Limit and Operating Regimes Maksim Velikanov Roma Kail Ivan Anokhin Roman Vashurin Maxim Panov Alexey Zaytsev Dmitry Yarotsky 12 1 0 24 Feb 2022
Prune and Tune Ensembles: Low-Cost Ensemble Learning With Sparse Independent Subnetworks Tim Whitaker L. D. Whitley UQCV 11 23 0 23 Feb 2022
Continual Learning Beyond a Single Model T. Doan Seyed Iman Mirzadeh Mehrdad Farajtabar CLL 26 16 0 20 Feb 2022
Ensemble Learning techniques for object detection in high-resolution satellite images A. Vilhelm Matthieu Limbert Clement Audebert Tugdual Ceillier ObjD 12 1 0 16 Feb 2022
ActionFormer: Localizing Moments of Actions with Transformers Chen-Da Liu-Zhang Jianxin Wu Yin Li ViT 23 328 0 16 Feb 2022
Deep Ensembles Work, But Are They Necessary? Taiga Abe E. Kelly Buchanan Geoff Pleiss R. Zemel John P. Cunningham OOD UQCV 36 59 0 14 Feb 2022
PFGE: Parsimonious Fast Geometric Ensembling of DNNs Hao Guo Jiyong Jin B. Liu FedML 11 1 0 14 Feb 2022
When Do Flat Minima Optimizers Work? Jean Kaddour Linqing Liu Ricardo M. A. Silva Matt J. Kusner ODL 11 58 0 01 Feb 2022
Learning Proximal Operators to Discover Multiple Optima Lingxiao Li Noam Aigerman Vladimir G. Kim Jiajin Li Kristjan Greenewald Mikhail Yurochkin Justin Solomon 42 1 0 28 Jan 2022
Improving robustness and calibration in ensembles with diversity regularization H. A. Mehrtens Camila González Anirban Mukhopadhyay UQCV 14 7 0 26 Jan 2022
ML4CO-KIDA: Knowledge Inheritance in Dataset Aggregation Zixuan Cao Yang Xu Zhewei Huang Shuchang Zhou 84 7 0 25 Jan 2022
EASY: Ensemble Augmented-Shot Y-shaped Learning: State-Of-The-Art Few-Shot Classification with Simple Ingredients Yassir Bendou Yuqing Hu Raphael Lafargue G. Lioi Bastien Pasdeloup S. Pateux Vincent Gripon VLM 28 37 0 24 Jan 2022
Stochastic Weight Averaging Revisited Hao Guo Jiyong Jin B. Liu 20 29 0 03 Jan 2022
SAE: Sequential Anchored Ensembles Arnaud Delaunoy Gilles Louppe UQCV BDL 11 0 0 30 Dec 2021
Semi-supervised Salient Object Detection with Effective Confidence Estimation Jiawei Liu Jing Zhang Nick Barnes 31 4 0 28 Dec 2021
Efficient Diversity-Driven Ensemble for Deep Neural Networks Wentao Zhang Jiawei Jiang Yingxia Shao Bin Cui 10 17 0 26 Dec 2021
DPICT: Deep Progressive Image Compression Using Trit-Planes Jae-Han Lee S. Jeon K. Choi Youngo Park Chang-Su Kim 8 29 0 12 Dec 2021
Model-Value Inconsistency as a Signal for Epistemic Uncertainty Angelos Filos Eszter Vértes Zita Marinho Gregory Farquhar Diana Borsa A. Friesen Feryal M. P. Behbahani Tom Schaul André Barreto Simon Osindero 44 7 0 08 Dec 2021
On the Effectiveness of Mode Exploration in Bayesian Model Averaging for Neural Networks J. Holodnak Allan B. Wollaber UQCV BDL 19 0 0 07 Dec 2021
Challenges and Opportunities in Approximate Bayesian Deep Learning for Intelligent IoT Systems Meet P. Vadera Benjamin M. Marlin UQCV BDL 13 5 0 03 Dec 2021
Explore the Potential Performance of Vision-and-Language Navigation Model: a Snapshot Ensemble Method Wenda Qin Teruhisa Misu Derry Wijaya UQCV LM&Ro 19 5 0 28 Nov 2021
Efficient Self-Ensemble for Semantic Segmentation Walid Bousselham Guillaume Thibault Lucas Pagano Archana Machireddy Joe W. Gray Y. Chang Xubo B. Song ViT 25 24 0 26 Nov 2021
Unsupervised Time Series Outlier Detection with Diversity-Driven Convolutional Ensembles -- Extended Version David Campos Tung Kieu Chenjuan Guo Feiteng Huang Kai Zheng B. Yang Christian S. Jensen AI4TS 23 51 0 22 Nov 2021
Towards Comprehensive Monocular Depth Estimation: Multiple Heads Are Better Than One Shuwei Shao Ran Li Z. Pei Zhong Liu Weihai Chen Wentao Zhu Xingming Wu Baochang Zhang ViT MDE 25 11 0 16 Nov 2021
On Efficient Uncertainty Estimation for Resource-Constrained Mobile Applications J. Rock Tiago Azevedo R. D. Jong Daniel Ruiz-Munoz Partha P. Maji UQCV 13 5 0 11 Nov 2021
Reconstructing Training Data from Diverse ML Models by Ensemble Inversion Qian Wang Daniel Kurz 12 9 0 05 Nov 2021