Do We Need Zero Training Loss After Achieving Zero Training Error?

Do We Need Zero Training Loss After Achieving Zero Training Error?

20 February 2020

Masashi Sugiyama

Papers citing "Do We Need Zero Training Loss After Achieving Zero Training Error?"

19 / 19 papers shown

Title
Unleashing Mask: Explore the Intrinsic Out-of-Distribution Detection Capability Jianing Zhu Hengzhuang Li Jiangchao Yao Tongliang Liu Jianliang Xu Bo Han OODD 40 12 0 06 Jun 2023
Do Not Blindly Imitate the Teacher: Using Perturbed Loss for Knowledge Distillation Rongzhi Zhang Jiaming Shen Tianqi Liu Jia-Ling Liu Michael Bendersky Marc Najork Chao Zhang 45 18 0 08 May 2023
Exploring the Effect of Multi-step Ascent in Sharpness-Aware Minimization Hoki Kim Jinseong Park Yujin Choi Woojin Lee Jaewook Lee 15 9 0 27 Jan 2023
A Stability Analysis of Fine-Tuning a Pre-Trained Model Z. Fu Anthony Man-Cho So Nigel Collier 23 3 0 24 Jan 2023
Stability Analysis of Sharpness-Aware Minimization Hoki Kim Jinseong Park Yujin Choi Jaewook Lee 28 12 0 16 Jan 2023
One-Class Risk Estimation for One-Class Hyperspectral Image Classification Hengwei Zhao Yanfei Zhong Xinyu Wang H. Shu 21 8 0 27 Oct 2022
Pre-training General Trajectory Embeddings with Maximum Multi-view Entropy Coding Yan Lin Huaiyu Wan S. Guo Jilin Hu Christian S. Jensen Youfang Lin AI4TS 26 19 0 29 Jul 2022
Anti-Backdoor Learning: Training Clean Models on Poisoned Data Yige Li X. Lyu Nodens Koren Lingjuan Lyu Bo-wen Li Xingjun Ma OnRL 13 320 0 22 Oct 2021
On the Generalization of Models Trained with SGD: Information-Theoretic Bounds and Implications Ziqiao Wang Yongyi Mao FedML MLT 32 22 0 07 Oct 2021
Logit Attenuating Weight Normalization Aman Gupta R. Ramanath Jun Shi Anika Ramachandran Sirou Zhou Mingzhou Zhou S. Keerthi 32 1 0 12 Aug 2021
Jitter: Random Jittering Loss Function Zhicheng Cai Chenglei Peng S. Du 11 3 0 25 Jun 2021
RDA: Robust Domain Adaptation via Fourier Adversarial Attacking Jiaxing Huang Dayan Guan Aoran Xiao Shijian Lu AAML 35 76 0 05 Jun 2021
Accelerating BERT Inference for Sequence Labeling via Early-Exit Xiaonan Li Yunfan Shao Tianxiang Sun Hang Yan Xipeng Qiu Xuanjing Huang 19 40 0 28 May 2021
Regularizing Neural Networks via Adversarial Model Perturbation Yaowei Zheng Richong Zhang Yongyi Mao AAML 22 95 0 10 Oct 2020
Effective Regularization Through Loss-Function Metalearning Santiago Gonzalez Risto Miikkulainen 24 5 0 02 Oct 2020
Kernel Based Progressive Distillation for Adder Neural Networks Yixing Xu Chang Xu Xinghao Chen Wei Zhang Chunjing Xu Yunhe Wang 33 47 0 28 Sep 2020
When Does Preconditioning Help or Hurt Generalization? S. Amari Jimmy Ba Roger C. Grosse Xuechen Li Atsushi Nitanda Taiji Suzuki Denny Wu Ji Xu 34 32 0 18 Jun 2020
A Mean-field Analysis of Deep ResNet and Beyond: Towards Provable Optimization Via Overparameterization From Depth Yiping Lu Chao Ma Yulong Lu Jianfeng Lu Lexing Ying MLT 31 78 0 11 Mar 2020
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 281 2,888 0 15 Sep 2016