Sharpness-Aware Minimization for Efficiently Improving Generalization

3 October 2020

Papers citing "Sharpness-Aware Minimization for Efficiently Improving Generalization"

50 / 867 papers shown

Title
Error Bounds of Supervised Classification from Information-Theoretic Perspective Binchuan Qi Wei Gong Li Li 21 0 0 07 Jun 2024
Polyp and Surgical Instrument Segmentation with Double Encoder-Decoder Networks Adrian Galdran MedIm 33 4 0 06 Jun 2024
A Universal Class of Sharpness-Aware Minimization Algorithms B. Tahmasebi Ashkan Soleymani Dara Bahri Stefanie Jegelka P. Jaillet AAML 49 2 0 06 Jun 2024
From Feature Visualization to Visual Circuits: Effect of Adversarial Model Manipulation Géraldin Nanfack Michael Eickenberg Eugene Belilovsky FAtt AAML GNN 32 0 0 03 Jun 2024
AI-Face: A Million-Scale Demographically Annotated AI-Generated Face Dataset and Fairness Benchmark Li Lin Santosh Xin Eric Wang Shu Hu Shu Hu EGVM 81 11 0 02 Jun 2024
Improving Generalization and Convergence by Enhancing Implicit Regularization Mingze Wang Haotian He Jinbo Wang Zilin Wang Guanhua Huang Feiyu Xiong Zhiyu Li E. Weinan Lei Wu 39 6 0 31 May 2024
Sharpness-Aware Minimization Enhances Feature Quality via Balanced Learning Jacob Mitchell Springer Vaishnavh Nagarajan Aditi Raghunathan 42 5 0 30 May 2024
Locally Estimated Global Perturbations are Better than Local Perturbations for Federated Sharpness-aware Minimization Ziqing Fan Shengchao Hu Jiangchao Yao Gang Niu Ya-Qin Zhang Masashi Sugiyama Yanfeng Wang FedML 44 11 0 29 May 2024
Domain-Inspired Sharpness-Aware Minimization Under Domain Shifts Ruipeng Zhang Ziqing Fan Jiangchao Yao Ya-Qin Zhang Yanfeng Wang 36 7 0 29 May 2024
A Margin-based Multiclass Generalization Bound via Geometric Complexity Michael Munn Benoit Dherin Javier Gonzalvo UQCV 40 2 0 28 May 2024
P4: Towards private, personalized, and Peer-to-Peer learning Mohammad Maheri S. Siby Sina Abdollahi Anastasia Borovykh Hamed Haddadi 26 0 0 27 May 2024
The Uncanny Valley: Exploring Adversarial Robustness from a Flatness Perspective Nils Philipp Walter Linara Adilova Jilles Vreeken Michael Kamp AAML 48 2 0 27 May 2024
AdaFisher: Adaptive Second Order Optimization via Fisher Information Damien Martins Gomes Yanlei Zhang Eugene Belilovsky Guy Wolf Mahdi S. Hosseini ODL 76 2 0 26 May 2024
Layer-Aware Analysis of Catastrophic Overfitting: Revealing the Pseudo-Robust Shortcut Dependency Runqi Lin Chaojian Yu Bo Han Hang Su Tongliang Liu AAML 32 3 0 25 May 2024
Enhancing Adversarial Transferability Through Neighborhood Conditional Sampling Chunlin Qiu Yiheng Duan Lingchen Zhao Qian Wang AAML 27 2 0 25 May 2024
Does SGD really happen in tiny subspaces? Minhak Song Kwangjun Ahn Chulhee Yun 66 4 1 25 May 2024
Predicting the Impact of Model Expansion through the Minima Manifold: A Loss Landscape Perspective Pranshu Malviya Jerry Huang Quentin Fournier Sarath Chandar 54 0 0 24 May 2024
Leakage-Resilient and Carbon-Neutral Aggregation Featuring the Federated AI-enabled Critical Infrastructure Zehang Deng Ruoxi Sun Minhui Xue Sheng Wen S. Çamtepe Surya Nepal Yang Xiang 35 1 0 24 May 2024
Repetita Iuvant: Data Repetition Allows SGD to Learn High-Dimensional Multi-Index Functions Luca Arnaboldi Yatin Dandi Florent Krzakala Luca Pesce Ludovic Stephan 66 12 0 24 May 2024
Unified Neural Backdoor Removal with Only Few Clean Samples through Unlearning and Relearning Nay Myat Min Long H. Pham Jun Sun MU AAML 32 0 0 23 May 2024
Smooth Pseudo-Labeling Nikolaos Karaliolios Hervé Le Borgne Florian Chabot 34 0 0 23 May 2024
Improving Generalization of Deep Neural Networks by Optimum Shifting Yuyan Zhou Ye Li Lei Feng Sheng-Jun Huang OOD ODL 38 0 0 23 May 2024
Adversarial Training of Two-Layer Polynomial and ReLU Activation Networks via Convex Optimization Daniel Kuelbs Sanjay Lall Mert Pilanci AAML 18 1 0 22 May 2024
A General Framework for Jersey Number Recognition in Sports Video Maria Koshkina James H. Elder 21 4 0 22 May 2024
SADDLe: Sharpness-Aware Decentralized Deep Learning with Heterogeneous Data Sakshi Choudhary Sai Aparna Aketi Kaushik Roy FedML 42 0 0 22 May 2024
Visualizing, Rethinking, and Mining the Loss Landscape of Deep Neural Networks Xin-Chun Li Lan Li De-Chuan Zhan 33 2 0 21 May 2024
Exploring and Exploiting the Asymmetric Valley of Deep Neural Networks Xin-Chun Li Jinli Tang Bo Zhang Lan Li De-Chuan Zhan 41 2 0 21 May 2024
Enhancing Fine-Grained Image Classifications via Cascaded Vision Language Models Canshi Wei VLM 30 0 0 18 May 2024
Sharpness-Aware Minimization in Genetic Programming I. Bakurov N. Haut Wolfgang Banzhaf 23 0 0 16 May 2024
Two-Phase Dynamics of Interactions Explains the Starting Point of a DNN Learning Over-Fitted Features Junpeng Zhang Qing Li Liang Lin Quanshi Zhang AI4CE 35 5 0 16 May 2024
MGSER-SAM: Memory-Guided Soft Experience Replay with Sharpness-Aware Optimization for Enhanced Continual Learning Xingyu Li Bo Tang VLM CLL 32 0 0 15 May 2024
Feature-based Federated Transfer Learning: Communication Efficiency, Robustness and Privacy Feng Wang M. C. Gursoy Senem Velipasalar 30 0 0 15 May 2024
Cross-Domain Feature Augmentation for Domain Generalization Yingnan Liu Yingtian Zou Rui Qiao Fusheng Liu M. Lee W. Hsu OOD 33 4 0 14 May 2024
Localizing Task Information for Improved Model Merging and Compression Ke Wang Nikolaos Dimitriadis Guillermo Ortiz-Jimenez Franccois Fleuret Pascal Frossard MoMe 33 46 0 13 May 2024
Sharpness-Aware Minimization for Evolutionary Feature Construction in Regression Hengzhe Zhang Qi Chen Bing Xue Wolfgang Banzhaf Mengjie Zhang AAML 35 1 0 11 May 2024
Why is SAM Robust to Label Noise? Christina Baek Zico Kolter Aditi Raghunathan NoLa AAML 41 9 0 06 May 2024
Better YOLO with Attention-Augmented Network and Enhanced Generalization Performance for Safety Helmet Detection Shuqi Shen Junjie Yang 36 2 0 04 May 2024
Position: Understanding LLMs Requires More Than Statistical Generalization Patrik Reizinger Szilvia Ujváry Anna Mészáros A. Kerekes Wieland Brendel Ferenc Huszár 36 12 0 03 May 2024
Practical Dataset Distillation Based on Deep Support Vectors Hyunho Lee Junhoo Lee Nojun Kwak 26 1 0 01 May 2024
Fairness Without Demographics in Human-Centered Federated Learning Shaily Roy Harshit Sharma Asif Salekin 48 2 0 30 Apr 2024
High dimensional analysis reveals conservative sharpening and a stochastic edge of stability Atish Agarwala Jeffrey Pennington 41 3 0 30 Apr 2024
From Optimization to Generalization: Fair Federated Learning against Quality Shift via Inter-Client Sharpness Matching Nannan Wu Zhuo Kuang Zengqiang Yan Li Yu FedML 34 4 0 27 Apr 2024
Pearls from Pebbles: Improved Confidence Functions for Auto-labeling Harit Vishwakarma Reid Chen Chen Sui Jiet Tay Satya Sai Srinath Namburi Frederic Sala Ramya Korlakai Vinayak 40 2 0 24 Apr 2024
The Over-Certainty Phenomenon in Modern UDA Algorithms Fin Amin Jung-Eun Kim 32 0 0 24 Apr 2024
Generalization Measures for Zero-Shot Cross-Lingual Transfer Saksham Bassi Duygu Ataman Kyunghyun Cho 29 0 0 24 Apr 2024
Reliable Model Watermarking: Defending Against Theft without Compromising on Evasion Markus Frey Sichu Liang Wentao Hu Matthias Nau Ju Jia Shilin Wang AAML 30 3 0 21 Apr 2024
A Hybrid Generative and Discriminative PointNet on Unordered Point Sets Yang Ye Shihao Ji PINN 3DPC 38 0 0 19 Apr 2024
Robust CLIP-Based Detector for Exposing Diffusion Model-Generated Images Santosh Li Lin Irene Amerini Xin Eric Wang Shu Hu 47 11 0 19 Apr 2024
One-Shot Sequential Federated Learning for Non-IID Data by Enhancing Local Model Diversity Naibo Wang Yuchen Deng Wenjie Feng Shichen Fan Jianwei Yin See-Kiong Ng FedML 29 5 0 18 Apr 2024
Dual-pronged deep learning preprocessing on heterogeneous platforms with CPU, GPU and CSD Jia Wei Xingjun Zhang Witold Pedrycz Longxiang Wang Jie Zhao 31 0 0 17 Apr 2024