Understanding deep learning requires rethinking generalization

10 November 2016

Benjamin Recht

Papers citing "Understanding deep learning requires rethinking generalization"

50 / 1,110 papers shown

Title
PAC Confidence Sets for Deep Neural Networks via Calibrated Prediction Sangdon Park Osbert Bastani Nikolai Matni Insup Lee UQCV 152 68 0 31 Dec 2019
Robust Aggregation for Federated Learning Krishna Pillutla Sham Kakade Zaïd Harchaoui FedML 50 632 0 31 Dec 2019
Measuring Dataset Granularity Huayu Chen Zeqi Gu D. Mahajan Laurens van der Maaten Serge J. Belongie Ser-Nam Lim 29 13 0 21 Dec 2019
Locality and compositionality in zero-shot learning Tristan Sylvain Linda Petrini R. Devon Hjelm 24 56 0 20 Dec 2019
Making Better Mistakes: Leveraging Class Hierarchies with Deep Networks Luca Bertinetto Romain Mueller Konstantinos Tertikas Sina Samangooei Nicholas A. Lord OOD 34 132 0 19 Dec 2019
Optimization for deep learning: theory and algorithms Ruoyu Sun ODL 43 168 0 19 Dec 2019
A Shape Transformation-based Dataset Augmentation Framework for Pedestrian Detection Zhe Chen Wanli Ouyang Tongliang Liu Dacheng Tao ViT 24 22 0 15 Dec 2019
In Defense of Uniform Convergence: Generalization via derandomization with an application to interpolating predictors Jeffrey Negrea Gintare Karolina Dziugaite Daniel M. Roy AI4CE 40 64 0 09 Dec 2019
Deep learning with noisy labels: exploring techniques and remedies in medical image analysis Davood Karimi Haoran Dou Simon K. Warfield Ali Gholipour NoLa 37 536 0 05 Dec 2019
Insights into Ordinal Embedding Algorithms: A Systematic Evaluation L. C. Vankadara Siavash Haghiri Michael Lohaus Faiz Ul Wahab U. V. Luxburg 18 8 0 03 Dec 2019
Towards Understanding the Spectral Bias of Deep Learning Yuan Cao Zhiying Fang Yue Wu Ding-Xuan Zhou Quanquan Gu 43 215 0 03 Dec 2019
Optimizing Data Usage via Differentiable Rewards Xinyi Wang Hieu H. Pham Paul Michel Antonios Anastasopoulos J. Carbonell Graham Neubig 23 60 0 22 Nov 2019
Forecasting significant stock price changes using neural networks F. Kamalov AIFin 24 80 0 21 Nov 2019
Robustness Certificates for Sparse Adversarial Attacks by Randomized Ablation Alexander Levine S. Feizi AAML 34 105 0 21 Nov 2019
Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalization Shiori Sagawa Pang Wei Koh Tatsunori B. Hashimoto Percy Liang OOD 16 1,202 0 20 Nov 2019
Collaborative Unsupervised Domain Adaptation for Medical Image Diagnosis Yifan Zhang Ying Wei P. Zhao Shuaicheng Niu Qingyao Wu Mingkui Tan Junzhou Huang OOD 31 145 0 17 Nov 2019
Understanding and Improving Layer Normalization Jingjing Xu Xu Sun Zhiyuan Zhang Guangxiang Zhao Junyang Lin FAtt 41 342 0 16 Nov 2019
Rate-Regularization and Generalization in VAEs Alican Bozkurt Babak Esmaeili Jean-Baptiste Tristan Dana H. Brooks Jennifer G. Dy Jan-Willem van de Meent DRL 38 7 0 11 Nov 2019
Rethinking Generalisation Antonia Marcu Adam Prugel-Bennett 19 0 0 11 Nov 2019
An empirical study of the relation between network architecture and complexity Emir Konuk Kevin Smith 27 7 0 11 Nov 2019
Location Attention for Extrapolation to Longer Sequences Yann Dubois Gautier Dagan Dieuwke Hupkes Elia Bruni 23 41 0 10 Nov 2019
Global Convergence of Gradient Descent for Deep Linear Residual Networks Lei Wu Qingcan Wang Chao Ma ODL AI4CE 40 22 0 02 Nov 2019
Confident Learning: Estimating Uncertainty in Dataset Labels Curtis G. Northcutt Lu Jiang Isaac L. Chuang NoLa 69 677 0 31 Oct 2019
RIGA: Covert and Robust White-Box Watermarking of Deep Neural Networks Tianhao Wang Florian Kerschbaum AAML 27 36 0 31 Oct 2019
On Generalization Bounds of a Family of Recurrent Neural Networks Minshuo Chen Xingguo Li T. Zhao 21 70 0 28 Oct 2019
Mixup-breakdown: a consistency training method for improving generalization of speech separation models Max W. Y. Lam Jun Wang Dan Su Dong Yu 38 22 0 28 Oct 2019
BAIL: Best-Action Imitation Learning for Batch Deep Reinforcement Learning Xinyue Chen Zijian Zhou Junyao Xing Che Wang Yanqiu Wu Keith Ross OffRL 35 121 0 27 Oct 2019
LUTNet: Learning FPGA Configurations for Highly Efficient Neural Network Inference Erwei Wang James J. Davis P. Cheung George A. Constantinides MQ 9 41 0 24 Oct 2019
From complex to simple : hierarchical free-energy landscape renormalized in deep neural networks H. Yoshino 22 6 0 22 Oct 2019
Robust Training with Ensemble Consensus Jisoo Lee Sae-Young Chung NoLa 22 28 0 22 Oct 2019
MUTE: Data-Similarity Driven Multi-hot Target Encoding for Neural Network Design Mayoore S. Jaiswal Bumboo Kang Jinho Lee Minsik Cho 21 2 0 15 Oct 2019
The Local Elasticity of Neural Networks Hangfeng He Weijie J. Su 47 44 0 15 Oct 2019
Fast and Furious Convergence: Stochastic Second Order Methods under Interpolation S. Meng Sharan Vaswani I. Laradji Mark Schmidt Simon Lacoste-Julien 27 32 0 11 Oct 2019
The Implicit Regularization of Ordinary Least Squares Ensembles Daniel LeJeune Hamid Javadi Richard G. Baraniuk 24 43 0 10 Oct 2019
Improved Sample Complexities for Deep Networks and Robust Classification via an All-Layer Margin Colin Wei Tengyu Ma AAML OOD 38 85 0 09 Oct 2019
Algorithm-Dependent Generalization Bounds for Overparameterized Deep Residual Networks Spencer Frei Yuan Cao Quanquan Gu ODL 17 31 0 07 Oct 2019
Meta-Learning Deep Energy-Based Memory Models Sergey Bartunov Jack W. Rae Simon Osindero Timothy Lillicrap 45 34 0 07 Oct 2019
SELF: Learning to Filter Noisy Labels with Self-Ensembling Philipp Kratzer Marc Toussaint Thi Phuong Nhung Ngo T. Nguyen Jim Mainprice Thomas Brox NoLa 42 310 0 04 Oct 2019
Harnessing the Power of Infinitely Wide Deep Nets on Small-data Tasks Sanjeev Arora S. Du Zhiyuan Li Ruslan Salakhutdinov Ruosong Wang Dingli Yu AAML 22 161 0 03 Oct 2019
Partial differential equation regularization for supervised machine learning Jillian R. Fisher 35 2 0 03 Oct 2019
How does topology influence gradient propagation and model performance of deep networks with DenseNet-type skip connections? Kartikeya Bhardwaj Guihong Li R. Marculescu 38 1 0 02 Oct 2019
A Closer Look at Data Bias in Neural Extractive Summarization Models Ming Zhong Danqing Wang Pengfei Liu Xipeng Qiu Xuanjing Huang 53 42 0 30 Sep 2019
Overparameterized Neural Networks Implement Associative Memory Adityanarayanan Radhakrishnan M. Belkin Caroline Uhler BDL 35 71 0 26 Sep 2019
Adversarial Deep Embedded Clustering: on a better trade-off between Feature Randomness and Feature Drift Nairouz Mrabah Mohamed Bouguessa Riadh Ksantini OOD 24 53 0 26 Sep 2019
Neural networks are a priori biased towards Boolean functions with low entropy Chris Mingard Joar Skalse Guillermo Valle Pérez David Martínez-Rubio Vladimir Mikulik A. Louis FAtt AI4CE 30 37 0 25 Sep 2019
Mixup Inference: Better Exploiting Mixup to Defend Adversarial Attacks Tianyu Pang Kun Xu Jun Zhu AAML 28 103 0 25 Sep 2019
Deep Convolutions for In-Depth Automated Rock Typing E. E. Baraboshkin L. Ismailova D. Orlov E. Zhukovskaya G. Kalmykov O. V. Khotylev E. Baraboshkin D. Koroteev 36 84 0 23 Sep 2019
Deep Model Reference Adaptive Control Girish Joshi Girish Chowdhary BDL AI4CE 23 59 0 18 Sep 2019
Generating Accurate Pseudo-labels in Semi-Supervised Learning and Avoiding Overconfident Predictions via Hermite Polynomial Activations Vishnu Suresh Lokhande Songwong Tasneeyapant Abhay Venkatesh Sathya Ravi Vikas Singh 27 29 0 12 Sep 2019
Deep Metric Learning with Density Adaptivity Yehao Li Ting Yao Yingwei Pan Hongyang Chao Tao Mei 30 11 0 09 Sep 2019