Understanding deep learning requires rethinking generalization

10 November 2016

Benjamin Recht

Papers citing "Understanding deep learning requires rethinking generalization"

50 / 1,157 papers shown

Title
On Generalization Bounds of a Family of Recurrent Neural Networks Minshuo Chen Xingguo Li T. Zhao 21 70 0 28 Oct 2019
Mixup-breakdown: a consistency training method for improving generalization of speech separation models Max W. Y. Lam Jun Wang Dan Su Dong Yu 38 22 0 28 Oct 2019
Thieves on Sesame Street! Model Extraction of BERT-based APIs Kalpesh Krishna Gaurav Singh Tomar Ankur P. Parikh Nicolas Papernot Mohit Iyyer MIACV MLAU 36 196 0 27 Oct 2019
BAIL: Best-Action Imitation Learning for Batch Deep Reinforcement Learning Xinyue Chen Zijian Zhou Ziyi Wang Che Wang Yanqiu Wu Keith Ross OffRL 35 121 0 27 Oct 2019
LUTNet: Learning FPGA Configurations for Highly Efficient Neural Network Inference Erwei Wang James J. Davis P. Cheung George A. Constantinides MQ 9 41 0 24 Oct 2019
From complex to simple : hierarchical free-energy landscape renormalized in deep neural networks H. Yoshino 22 6 0 22 Oct 2019
Robust Training with Ensemble Consensus Jisoo Lee Sae-Young Chung NoLa 22 28 0 22 Oct 2019
MUTE: Data-Similarity Driven Multi-hot Target Encoding for Neural Network Design Mayoore S. Jaiswal Bumboo Kang Jinho Lee Minsik Cho 21 2 0 15 Oct 2019
The Local Elasticity of Neural Networks Hangfeng He Weijie J. Su 47 44 0 15 Oct 2019
Fast and Furious Convergence: Stochastic Second Order Methods under Interpolation S. Meng Sharan Vaswani I. Laradji Mark Schmidt Simon Lacoste-Julien 29 32 0 11 Oct 2019
The Implicit Regularization of Ordinary Least Squares Ensembles Daniel LeJeune Hamid Javadi Richard G. Baraniuk 24 43 0 10 Oct 2019
Improved Sample Complexities for Deep Networks and Robust Classification via an All-Layer Margin Colin Wei Tengyu Ma AAML OOD 38 85 0 09 Oct 2019
Algorithm-Dependent Generalization Bounds for Overparameterized Deep Residual Networks Spencer Frei Yuan Cao Quanquan Gu ODL 17 31 0 07 Oct 2019
Meta-Learning Deep Energy-Based Memory Models Sergey Bartunov Jack W. Rae Simon Osindero Timothy Lillicrap 45 34 0 07 Oct 2019
SELF: Learning to Filter Noisy Labels with Self-Ensembling Philipp Kratzer Marc Toussaint Thi Phuong Nhung Ngo T. Nguyen Jim Mainprice Thomas Brox NoLa 42 311 0 04 Oct 2019
Harnessing the Power of Infinitely Wide Deep Nets on Small-data Tasks Sanjeev Arora S. Du Zhiyuan Li Ruslan Salakhutdinov Ruosong Wang Dingli Yu AAML 22 161 0 03 Oct 2019
Partial differential equation regularization for supervised machine learning Jillian R. Fisher 35 2 0 03 Oct 2019
How does topology influence gradient propagation and model performance of deep networks with DenseNet-type skip connections? Kartikeya Bhardwaj Guihong Li R. Marculescu 38 1 0 02 Oct 2019
How noise affects the Hessian spectrum in overparameterized neural networks Ming-Bo Wei D. Schwab 30 27 0 01 Oct 2019
A Closer Look at Data Bias in Neural Extractive Summarization Models Ming Zhong Danqing Wang Pengfei Liu Xipeng Qiu Xuanjing Huang 67 42 0 30 Sep 2019
Overparameterized Neural Networks Implement Associative Memory Adityanarayanan Radhakrishnan M. Belkin Caroline Uhler BDL 35 71 0 26 Sep 2019
Adversarial Deep Embedded Clustering: on a better trade-off between Feature Randomness and Feature Drift Nairouz Mrabah Mohamed Bouguessa Riadh Ksantini OOD 26 53 0 26 Sep 2019
Neural networks are a priori biased towards Boolean functions with low entropy Chris Mingard Joar Skalse Guillermo Valle Pérez David Martínez-Rubio Vladimir Mikulik A. Louis FAtt AI4CE 30 37 0 25 Sep 2019
Mixup Inference: Better Exploiting Mixup to Defend Adversarial Attacks Tianyu Pang Kun Xu Jun Zhu AAML 28 104 0 25 Sep 2019
Deep Convolutions for In-Depth Automated Rock Typing E. E. Baraboshkin L. Ismailova D. Orlov E. Zhukovskaya G. Kalmykov O. V. Khotylev E. Baraboshkin D. Koroteev 36 84 0 23 Sep 2019
Deep Model Reference Adaptive Control Girish Joshi Girish Chowdhary BDL AI4CE 23 59 0 18 Sep 2019
[Extended version] Rethinking Deep Neural Network Ownership Verification: Embedding Passports to Defeat Ambiguity Attacks Lixin Fan Kam Woh Ng Chee Seng Chan AAML 10 190 0 16 Sep 2019
Generating Accurate Pseudo-labels in Semi-Supervised Learning and Avoiding Overconfident Predictions via Hermite Polynomial Activations Vishnu Suresh Lokhande Songwong Tasneeyapant Abhay Venkatesh Sathya Ravi Vikas Singh 32 29 0 12 Sep 2019
Deep Metric Learning with Density Adaptivity Yehao Li Ting Yao Yingwei Pan Hongyang Chao Tao Mei 30 11 0 09 Sep 2019
Fixed-Horizon Temporal Difference Methods for Stable Reinforcement Learning Kristopher De Asis Alan Chan Silviu Pitis R. Sutton D. Graves 27 32 0 09 Sep 2019
Designing and Interpreting Probes with Control Tasks John Hewitt Percy Liang 32 527 0 08 Sep 2019
Deep Weakly-Supervised Learning Methods for Classification and Localization in Histology Images: A Survey Jérôme Rony Soufiane Belharbi Jose Dolz Ismail Ben Ayed Luke McCaffrey Eric Granger 34 70 0 08 Sep 2019
Learning with Noisy Labels for Sentence-level Sentiment Classification Hao Wang Bing-Quan Liu Chaozhuo Li Yan Yang Tianrui Li NoLa 31 26 0 31 Aug 2019
Image Captioning with Sparse Recurrent Neural Network J. Tan Chee Seng Chan Joon Huang Chuah VLM 31 6 0 28 Aug 2019
Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentation Nima Tajbakhsh Laura Jeyaseelan Q. Li J. Chiang Zhihao Wu Xiaowei Ding 38 755 0 27 Aug 2019
Transferability and Hardness of Supervised Classification Tasks Anh Tran Cuong V Nguyen Tal Hassner 137 164 0 21 Aug 2019
Symmetric Cross Entropy for Robust Learning with Noisy Labels Yisen Wang Xingjun Ma Zaiyi Chen Yuan Luo Jinfeng Yi James Bailey NoLa 39 881 0 16 Aug 2019
Needles in Haystacks: On Classifying Tiny Objects in Large Images Nick Pawlowski Suvrat Bhooshan Nicolas Ballas F. Ciompi Ben Glocker M. Drozdzal 27 22 0 16 Aug 2019
Regularizing CNN Transfer Learning with Randomised Regression Yang Zhong A. Maki 24 13 0 16 Aug 2019
The generalization error of random features regression: Precise asymptotics and double descent curve Song Mei Andrea Montanari 62 629 0 14 Aug 2019
Unsupervised Out-of-Distribution Detection by Maximum Classifier Discrepancy Qing Yu Kiyoharu Aizawa OODD 19 165 0 14 Aug 2019
Adaptive Ensemble of Classifiers with Regularization for Imbalanced Data Classification Chen Wang Qin Yu Kai Zhou D. Hui Xiaofeng Gong Ruisen Luo 29 22 0 09 Aug 2019
Convergence Rates of Variational Inference in Sparse Deep Learning Badr-Eddine Chérief-Abdellatif BDL 19 38 0 09 Aug 2019
Visualizing the PHATE of Neural Networks Scott A. Gigante Adam S. Charles Smita Krishnaswamy Gal Mishne 38 37 0 07 Aug 2019
How Does Learning Rate Decay Help Modern Neural Networks? Kaichao You Mingsheng Long Jianmin Wang Michael I. Jordan 34 4 0 05 Aug 2019
Nonparametric Regression on Low-Dimensional Manifolds using Deep ReLU Networks : Function Approximation and Statistical Recovery Minshuo Chen Haoming Jiang Wenjing Liao T. Zhao 6 90 0 05 Aug 2019
Sound source detection, localization and classification using consecutive ensemble of CRNN models Slawomir Kapka M. Lewandowski 16 66 0 02 Aug 2019
Self-training with progressive augmentation for unsupervised cross-domain person re-identification Xinyu Zhang Jiewei Cao Chunhua Shen Mingyu You LRM 36 223 0 31 Jul 2019
Pick-and-Learn: Automatic Quality Evaluation for Noisy-Labeled Image Segmentation Haidong Zhu Jialin Shi Ji Wu NoLa 24 65 0 27 Jul 2019
A Frobenius norm regularization method for convolutional kernels to avoid unstable gradient problem Pei-Chang Guo 38 5 0 25 Jul 2019