Exploring Generalization in Deep Learning

27 June 2017

Srinadh Bhojanapalli

Papers citing "Exploring Generalization in Deep Learning"

50 / 308 papers shown

Title
Reimagining Linear Probing: Kolmogorov-Arnold Networks in Transfer Learning Sheng Shen Rabih Younes 21 1 0 12 Sep 2024
WaterMAS: Sharpness-Aware Maximization for Neural Network Watermarking Carl De Sousa Trias Mihai P. Mitrea A. Fiandrotti Marco Cagnazzo Sumanta Chaudhuri Enzo Tartaglione AAML 38 1 0 05 Sep 2024
Universal Novelty Detection Through Adaptive Contrastive Learning Hossein Mirzaei Mojtaba Nafez Mohammad Jafari Mohammad Bagher Soltani Mohammad Azizmalayeri Jafar Habibi Mohammad Sabokrou M. Rohban 29 4 0 20 Aug 2024
RBLA: Rank-Based-LoRA-Aggregation for Fine-tuning Heterogeneous Models in FLaaS Shuaijun Chen Omid Tavallaie Niousha Nazemi Albert Y. Zomaya 39 3 0 16 Aug 2024
Quantum-secure multiparty deep learning Kfir Sulimany S. Vadlamani R. Hamerly Prahlad Iyengar Dirk Englund 22 5 0 10 Aug 2024
Do Sharpness-based Optimizers Improve Generalization in Medical Image Analysis? Mohamed Hassan Aleksandar Vakanski Min Xian AAML MedIm 41 1 0 07 Aug 2024
Mission Impossible: A Statistical Perspective on Jailbreaking LLMs Jingtong Su Mingyu Lee SangKeun Lee 40 8 0 02 Aug 2024
Quantum Supervised Learning A. Macaluso 43 3 0 24 Jul 2024
Requiem for a drone: a machine-learning based framework for stealthy attacks against unmanned autonomous vehicles K. Kim Denizhan Kara V. Paruchuri Sibin Mohan Greg Kimberly Jae Kim Josh D. Eckhardt 20 0 0 20 Jul 2024
Differentially Private Neural Network Training under Hidden State Assumption Ding Chen Chen Liu FedML 29 0 0 11 Jul 2024
How Neural Networks Learn the Support is an Implicit Regularization Effect of SGD Pierfrancesco Beneventano Andrea Pinto Tomaso A. Poggio MLT 32 1 0 17 Jun 2024
What Does Softmax Probability Tell Us about Classifiers Ranking Across Diverse Test Conditions? Weijie Tu Weijian Deng Liang Zheng Tom Gedeon 40 0 0 14 Jun 2024
Asymptotic Unbiased Sample Sampling to Speed Up Sharpness-Aware Minimization Jiaxin Deng Junbiao Pang Baochang Zhang 66 1 0 12 Jun 2024
Agnostic Sharpness-Aware Minimization Van-Anh Nguyen Quyen Tran Tuan Truong Thanh-Toan Do Dinh Q. Phung Trung Le 46 0 0 11 Jun 2024
A Universal Class of Sharpness-Aware Minimization Algorithms B. Tahmasebi Ashkan Soleymani Dara Bahri Stefanie Jegelka P. Jaillet AAML 52 2 0 06 Jun 2024
Generalization Bound and New Algorithm for Clean-Label Backdoor Attack Lijia Yu Shuang Liu Yibo Miao Xiao-Shan Gao Lijun Zhang AAML 34 5 0 02 Jun 2024
GenKubeSec: LLM-Based Kubernetes Misconfiguration Detection, Localization, Reasoning, and Remediation Ehud Malul Yair Meidan D. Mimran Yuval Elovici A. Shabtai 38 4 0 30 May 2024
MMPareto: Boosting Multimodal Learning with Innocent Unimodal Assistance Yake Wei Di Hu 34 13 0 28 May 2024
How many samples are needed to train a deep neural network? Pegah Golestaneh Mahsa Taheri Johannes Lederer 28 4 0 26 May 2024
Layer-Aware Analysis of Catastrophic Overfitting: Revealing the Pseudo-Robust Shortcut Dependency Runqi Lin Chaojian Yu Bo Han Hang Su Tongliang Liu AAML 32 3 0 25 May 2024
Deep linear networks for regression are implicitly regularized towards flat minima Pierre Marion Lénaic Chizat ODL 34 5 0 22 May 2024
Visualizing, Rethinking, and Mining the Loss Landscape of Deep Neural Networks Xin-Chun Li Lan Li De-Chuan Zhan 33 2 0 21 May 2024
Exploring and Exploiting the Asymmetric Valley of Deep Neural Networks Xin-Chun Li Jinli Tang Bo Zhang Lan Li De-Chuan Zhan 46 2 0 21 May 2024
Unlock the Power of Algorithm Features: A Generalization Analysis for Algorithm Selection Xingyu Wu Yan Zhong Jibin Wu Yuxiao Huang Sheng-hao Wu Kay Chen Tan 25 0 0 18 May 2024
Sharpness-Aware Minimization for Evolutionary Feature Construction in Regression Hengzhe Zhang Qi Chen Bing Xue Wolfgang Banzhaf Mengjie Zhang AAML 43 1 0 11 May 2024
PAC-Bayesian Generalization Bounds for Knowledge Graph Representation Learning Jaejun Lee Minsung Hwang J. Whang 39 1 0 10 May 2024
Full error analysis of the random deep splitting method for nonlinear parabolic PDEs and PIDEs Ariel Neufeld Philipp Schmocker Sizhou Wu 37 7 0 08 May 2024
General Place Recognition Survey: Towards Real-World Autonomy Peng Yin Jianhao Jiao Shiqi Zhao Lingyun Xu Guoquan Huang Howie Choset Sebastian A. Scherer Jianda Han 47 7 0 08 May 2024
Why is SAM Robust to Label Noise? Christina Baek Zico Kolter Aditi Raghunathan NoLa AAML 43 9 0 06 May 2024
Improved Generalization Bounds for Communication Efficient Federated Learning Peyman Gholami H. Seferoglu FedML AI4CE 23 6 0 17 Apr 2024
Information-Theoretic Generalization Bounds for Deep Neural Networks Haiyun He Christina Lee Yu 35 4 0 04 Apr 2024
Revisiting Confidence Estimation: Towards Reliable Failure Prediction Fei Zhu Xu-Yao Zhang Zhen Cheng Cheng-Lin Liu UQCV 49 10 0 05 Mar 2024
A PAC-Bayesian Link Between Generalisation and Flat Minima Maxime Haddouche Paul Viallard Umut Simsekli Benjamin Guedj 43 3 0 13 Feb 2024
Leveraging Gradients for Unsupervised Accuracy Estimation under Distribution Shift Renchunzi Xie Ambroise Odonnat Vasilii Feofanov I. Redko Jianfeng Zhang Bo An UQCV 77 1 0 17 Jan 2024
How Smooth Is Attention? Valérie Castin Pierre Ablin Gabriel Peyré AAML 40 9 0 22 Dec 2023
Doubly Perturbed Task Free Continual Learning Byung Hyun Lee Min-hwan Oh Se Young Chun 21 3 0 20 Dec 2023
Critical Influence of Overparameterization on Sharpness-aware Minimization Sungbin Shin Dongyeop Lee Maksym Andriushchenko Namhoon Lee AAML 44 1 0 29 Nov 2023
On the Over-Memorization During Natural, Robust and Catastrophic Overfitting Runqi Lin Chaojian Yu Bo Han Tongliang Liu 31 7 0 13 Oct 2023
Towards Demystifying the Generalization Behaviors When Neural Collapse Emerges Peifeng Gao Qianqian Xu Yibo Yang Peisong Wen Huiyang Shao Zhiyong Yang Guohao Li Qingming Huang AAML 25 3 0 12 Oct 2023
ROMO: Retrieval-enhanced Offline Model-based Optimization Mingcheng Chen Haoran Zhao Yuxiang Zhao Hulei Fan Hongqiao Gao Yong Yu Zheng Tian OffRL 18 1 0 11 Oct 2023
PAC-Bayesian Spectrally-Normalized Bounds for Adversarially Robust Generalization Jiancong Xiao Ruoyu Sun Zhimin Luo AAML 35 6 0 09 Oct 2023
Language Modeling Is Compression Grégoire Delétang Anian Ruoss Paul-Ambroise Duquenne Elliot Catt Tim Genewein ... Wenliang Kevin Li Matthew Aitchison Laurent Orseau Marcus Hutter J. Veness AI4CE 32 131 0 19 Sep 2023
Understanding Activation Patterns in Artificial Neural Networks by Exploring Stochastic Processes S. Lehmler Muhammad Saif-ur-Rehman Tobias Glasmachers Ioannis Iossifidis 24 0 0 01 Aug 2023
Lookbehind-SAM: k steps back, 1 step forward Gonçalo Mordido Pranshu Malviya A. Baratin Sarath Chandar AAML 45 1 0 31 Jul 2023
Sharpness Minimization Algorithms Do Not Only Minimize Sharpness To Achieve Better Generalization Kaiyue Wen Zhiyuan Li Tengyu Ma FAtt 38 26 0 20 Jul 2023
Sharpness-Aware Graph Collaborative Filtering Huiyuan Chen Chin-Chia Michael Yeh Yujie Fan Yan Zheng Junpeng Wang Vivian Lai Mahashweta Das Hao Yang 26 5 0 18 Jul 2023
Practical Sharpness-Aware Minimization Cannot Converge All the Way to Optima Dongkuk Si Chulhee Yun 28 15 0 16 Jun 2023
Gibbs-Based Information Criteria and the Over-Parameterized Regime Haobo Chen Yuheng Bu Greg Wornell 27 1 0 08 Jun 2023
Instance-dependent Noisy-label Learning with Graphical Model Based Noise-rate Estimation Arpit Garg Cuong C. Nguyen Rafael Felix Thanh-Toan Do G. Carneiro NoLa 33 1 0 31 May 2023
How to escape sharp minima with random perturbations Kwangjun Ahn Ali Jadbabaie S. Sra ODL 32 6 0 25 May 2023