v1v2v3 (latest)

Decoupled Weight Decay Regularization

14 November 2017

I. Loshchilov

Katharina Eggensperger

OffRL

ArXiv (abs)PDF HTML Github (275★)

Papers citing "Decoupled Weight Decay Regularization"

50 / 1,216 papers shown

Title
Neural Proof NetsConference on Computational Natural Language Learning (CoNLL), 2020 Konstantinos Kogkalidis M. Moortgat R. Moot 125 12 0 26 Sep 2020
DSC IIT-ISM at SemEval-2020 Task 6: Boosting BERT with Dependencies for Definition ExtractionInternational Workshop on Semantic Evaluation (SemEval), 2020 Aadarsh Singh Priyanshu Kumar Aman Sinha 66 4 0 17 Sep 2020
Rethinking the Objectives of Extractive Question AnsweringWorkshop on Machine Reading for Question Answering (MRQA), 2020 Martin Fajcik Josef Jon Pavel Smrz 345 12 0 28 Aug 2020
Efficient hyperparameter optimization by way of PAC-Bayes bound minimization John J. Cherian Andrew G. Taube R. McGibbon Panagiotis Angelikopoulos Guy Blanc M. Snarski D. D. Richman J. L. Klepeis D. Shaw 119 5 0 14 Aug 2020
A community-powered search of machine learning strategy space to find NMR property prediction models Lars A. Bratholm W. Gerrard Brandon M. Anderson Shaojie Bai Sunghwan Choi ... A. Torrubia Devin Willmott C. Butts David R. Glowacki Kaggle participants 175 19 0 13 Aug 2020
A Large-Scale Chinese Short-Text Conversation DatasetNatural Language Processing and Chinese Computing (NLPCC), 2020 Yida Wang Pei Ke Yinhe Zheng Kaili Huang Yong Jiang Xiaoyan Zhu Shiyu Huang 268 140 0 10 Aug 2020
Meta-DRN: Meta-Learning for 1-Shot Image SegmentationIEEE India Conference (INDICON), 2020 Atmadeep Banerjee SSeg VLM 155 5 0 01 Aug 2020
newsSweeper at SemEval-2020 Task 11: Context-Aware Rich Feature Representations For Propaganda Classification Paramansh Singh Siraj Sandhu Subham Kumar Ashutosh Modi 73 9 0 21 Jul 2020
Video Representation Learning by Recognizing Temporal Transformations Simon Jenni Givi Meishvili Paolo Favaro 397 142 0 21 Jul 2020
Length-Controllable Image CaptioningEuropean Conference on Computer Vision (ECCV), 2020 Chaorui Deng Ning Ding Zhuliang Yu Qi Wu VLM 163 66 0 19 Jul 2020
UniTrans: Unifying Model Transfer and Data Transfer for Cross-Lingual Named Entity Recognition with Unlabeled DataInternational Joint Conference on Artificial Intelligence (IJCAI), 2020 Qianhui Wu Zijia Lin Börje F. Karlsson Biqing Huang Jian-Guang Lou 169 49 0 15 Jul 2020
Pose2RGBD. Generating Depth and RGB images from absolute positions Mihai Cristian Pîrvu 3DH 39 1 0 14 Jul 2020
Robust Learning with Frequency Domain Regularization Weiyu Guo Yidong Ouyang AAML 134 2 0 07 Jul 2020
Lipschitzness Is All You Need To Tame Off-policy Generative Adversarial Imitation Learning Lionel Blondé Pablo Strasser Alexandros Kalousis 367 24 0 28 Jun 2020
Ensemble Transfer Learning for Emergency Landing Field Identification on Moderate Resource Heterogeneous Kubernetes Cluster Andreas Klos Marius Rosenbaum W. Schiffmann 98 3 0 26 Jun 2020
A High-Quality Multilingual Dataset for Structured Documentation TranslationConference on Machine Translation (WMT), 2020 Kazuma Hashimoto Raffaella Buschiazzo James Bradbury Teresa Marshall R. Socher Caiming Xiong 131 23 0 24 Jun 2020
FrostNet: Towards Quantization-Aware Network Architecture Search Taehoon Kim Y. Yoo Jihoon Yang MQ 287 2 0 17 Jun 2020
ACMo: Angle-Calibrated Moment Methods for Stochastic OptimizationAAAI Conference on Artificial Intelligence (AAAI), 2020 Xunpeng Huang Runxin Xu Hao Zhou Zhe Wang Zhengyang Liu Lei Li ODL 91 2 0 12 Jun 2020
DeBERTa: Decoding-enhanced BERT with Disentangled Attention Pengcheng He Xiaodong Liu Jianfeng Gao Weizhu Chen AAML 611 3,379 0 05 Jun 2020
Boundary-assisted Region Proposal Networks for Nucleus Segmentation Shengcong Chen Changxing Ding Dacheng Tao 110 41 0 04 Jun 2020
Equivariant Flows: Exact Likelihood Generative Learning for Symmetric DensitiesInternational Conference on Machine Learning (ICML), 2020 Jonas Köhler Leon Klein Frank Noé DRL 312 311 0 03 Jun 2020
BPGC at SemEval-2020 Task 11: Propaganda Detection in News Articles with Multi-Granularity Knowledge Sharing and Linguistic Features based Ensemble LearningInternational Workshop on Semantic Evaluation (SemEval), 2020 Rajaswa Patil Somesh Singh Swati Agarwal 104 8 0 31 May 2020
Pseudo-Representation Labeling Semi-Supervised Learning Song-Bo Yang Tian-li Yu 147 3 0 31 May 2020
Local Motion Planner for Autonomous Navigation in Vineyards with a RGB-D Camera-Based Algorithm and Deep Learning Synergy Diego Aghi Vittorio Mazzia Marcello Chiaberge 114 60 0 26 May 2020
AVA: an Automatic eValuation Approach to Question Answering Systems Thuy Vu Alessandro Moschitti 140 15 0 02 May 2020
Identifying Necessary Elements for BERT's Multilinguality Philipp Dufter Hinrich Schütze 370 18 0 01 May 2020
Interpretable Entity Representations through Large-Scale TypingFindings (Findings), 2020 Yasumasa Onoe Greg Durrett 207 20 0 30 Apr 2020
Text Segmentation by Cross Segment AttentionConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Michal Lukasik Boris Dadachev Gonçalo Simões Kishore Papineni VLM 173 101 0 30 Apr 2020
Real-Time Apple Detection System Using Embedded Systems With Hardware Accelerators: An Edge AI ApplicationIEEE Access (IEEE Access), 2020 Vittorio Mazzia Francesco Salvetti Aleem Khaliq Marcello Chiaberge 153 166 0 28 Apr 2020
Single-/Multi-Source Cross-Lingual NER via Teacher-Student Learning on Unlabeled Data in Target LanguageAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Qianhui Wu Zijia Lin Börje F. Karlsson Jian-Guang Lou Biqing Huang 219 74 0 26 Apr 2020
How to track your dragon: A Multi-Attentional Framework for real-time RGB-D 6-DOF Object Pose Tracking Isidoros Marougkas Petros Koutras Nikos Kardaris Georgios Retsinas Georgia Chalvatzaki Petros Maragos VOT 189 7 0 21 Apr 2020
An Evaluation of DNN Architectures for Page Segmentation of Historical NewspapersInternational Conference on Pattern Recognition (ICPR), 2020 Bernhard Liebl M. Burghardt SSeg 115 12 0 15 Apr 2020
Generating Fact Checking ExplanationsAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Pepa Atanasova J. Simonsen Christina Lioma Isabelle Augenstein 172 225 0 13 Apr 2020
Inexpensive Domain Adaptation of Pretrained Language Models: Case Studies on Biomedical NER and Covid-19 QAFindings (Findings), 2020 Nina Poerner Ulli Waltinger Hinrich Schütze OOD 278 53 0 07 Apr 2020
DARE: Data Augmented Relation Extraction with GPT-2 Yannis Papanikolaou Andrea Pierleoni 138 81 0 06 Apr 2020
Steering Self-Supervised Feature Learning Beyond Local Pixel StatisticsComputer Vision and Pattern Recognition (CVPR), 2020 Simon Jenni Hailin Jin Paolo Favaro SSL 154 50 0 05 Apr 2020
FastBERT: a Self-distilling BERT with Adaptive Inference TimeAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Weijie Liu Peng Zhou Zhe Zhao Zhiruo Wang Haotang Deng Qi Ju 228 392 0 05 Apr 2020
A Corpus of Controlled Opinionated and Knowledgeable Movie Discussions for Training Neural Conversation ModelsInternational Conference on Language Resources and Evaluation (LREC), 2020 Fabian Galetzka Chukwuemeka Uchenna Eneh David Schlangen 124 14 0 30 Mar 2020
PointNetKL: Deep Inference for GICP Covariance Estimation in Bathymetric SLAMIEEE Robotics and Automation Letters (RA-L), 2020 Ignacio Torroba Christopher Iliffe Sprague Nils Bore John Folkesson 3DPC 108 21 0 24 Mar 2020
Semi-supervised Contrastive Learning Using Partial Label Information Colin B. Hansen V. Nath Diego A. Mesa Yuankai Huo Bennett A. Landman Thomas A. Lasko SSL 126 0 0 17 Mar 2020
Using a thousand optimization tasks to learn hyperparameter search strategies Luke Metz Niru Maheswaranathan Ruoxi Sun C. Freeman Ben Poole Jascha Narain Sohl-Dickstein 301 50 0 27 Feb 2020
Scheduled Restart Momentum for Accelerated Stochastic Gradient DescentSIAM Journal of Imaging Sciences (SIIMS), 2020 Bao Wang T. Nguyen Andrea L. Bertozzi Richard G. Baraniuk Stanley J. Osher ODL 165 54 0 24 Feb 2020
Learning from Positive and Unlabeled Data with Arbitrary Positive ShiftNeural Information Processing Systems (NeurIPS), 2020 Zayd Hammoudeh Daniel Lowd 423 42 0 24 Feb 2020
Training Question Answering Models From Synthetic DataConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Raul Puri Ryan Spring M. Patwary Mohammad Shoeybi Bryan Catanzaro ELM 183 168 0 22 Feb 2020
Guider láttention dans les modeles de sequence a sequence pour la prediction des actes de dialogue Pierre Colombo E. Chapuis Matteo Manica Emmanuel Vignon Giovanna Varni Chloé Clavel 3DV 164 2 0 21 Feb 2020
Guiding attention in Sequence-to-sequence models for Dialogue Act predictionAAAI Conference on Artificial Intelligence (AAAI), 2020 Pierre Colombo E. Chapuis Matteo Manica Emmanuel Vignon Giovanna Varni Chloé Clavel 3DV 320 68 0 20 Feb 2020
Keyphrase Extraction with Span-based Feature Representations Funan Mu Zhenting Yu Lifeng Wang Yequan Wang Qingyu Yin Yibo Sun Liqun Liu Teng Ma Jing Tang Xing Zhou 226 17 0 13 Feb 2020
SegVoxelNet: Exploring Semantic Context and Depth-aware Features for 3D Vehicle Detection from Point CloudIEEE International Conference on Robotics and Automation (ICRA), 2020 Hongwei Yi Shaoshuai Shi Mingyu Ding Jiankai Sun Kui Xu Hui Zhou Zhe Wang Sheng Li Guoping Wang 3DPC 225 61 0 13 Feb 2020
LaProp: Separating Momentum and Adaptivity in Adam Liu Ziyin Zhikang T.Wang Masahito Ueda ODL 216 20 0 12 Feb 2020
fastai: A Layered API for Deep Learning Jeremy Howard Sylvain Gugger AI4CE 353 955 0 11 Feb 2020