v1v2v3 (latest)

Decoupled Weight Decay Regularization

14 November 2017

I. Loshchilov

Katharina Eggensperger

OffRL

ArXiv (abs)PDF HTML Github (275★)

Papers citing "Decoupled Weight Decay Regularization"

50 / 1,216 papers shown

Cross-view Geo-localization with Evolving Transformer

146

02 Jul 2021

Non-isomorphic Inter-modality Graph Alignment and Synthesis for Holistic Brain MappingInformation Processing in Medical Imaging (IPMI), 2021

102

30 Jun 2021

OffRoadTranSeg: Semi-Supervised Segmentation using Transformers on OffRoad environments

Anukriti Singh

Kartikeya Singh

P. B. Sujit

ViT

100

26 Jun 2021

Knowledge-Grounded Self-Rationalization via Extractive and Natural Language ExplanationsInternational Conference on Machine Learning (ICML), 2021

Bodhisattwa Prasad Majumder

Oana-Maria Camburu

Thomas Lukasiewicz

Julian McAuley

365

25 Jun 2021

Stable, Fast and Accurate: Kernelized Attention with Relative Positional Encoding

Tianle Cai

204

23 Jun 2021

Adaptive Learning Rate and Momentum for Training Deep Neural Networks

109

22 Jun 2021

Iterative Network Pruning with Uncertainty Regularization for Lifelong Sentiment ClassificationAnnual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2021

Min Yang

Ruifeng Xu

122

21 Jun 2021

BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2021

Elad Ben-Zaken

Shauli Ravfogel

Yoav Goldberg

1.0K

1,540

18 Jun 2021

Label prompt for multi-label text classification

154

18 Jun 2021

PRGC: Potential Relation and Global Correspondence Based Joint Relational Triple ExtractionAnnual Meeting of the Association for Computational Linguistics (ACL), 2021

Ningyu Zhang

240

254

18 Jun 2021

Efficient Self-supervised Vision Transformers for Representation LearningInternational Conference on Learning Representations (ICLR), 2021

Jianwei Yang

Lu Yuan

302

222

17 Jun 2021

An Empirical Study on Hyperparameter Optimization for Fine-Tuning Pre-trained Language Models

Xueqing Liu

Chi Wang

101

17 Jun 2021

Delving Deep into the Generalization of Vision Transformers under Distribution ShiftsComputer Vision and Pattern Recognition (CVPR), 2021

Shanghang Zhang

Xianglong Liu

207

126

14 Jun 2021

Nested and Balanced Entity Recognition using Multi-Task Learning

Andreas Waldis

Luca Mazzola

142

11 Jun 2021

CAT: Cross Attention in Vision TransformerIEEE International Conference on Multimedia and Expo (ICME), 2021

Fan Yang

184

256

10 Jun 2021

Keeping Your Eye on the Ball: Trajectory Attention in Video TransformersNeural Information Processing Systems (NeurIPS), 2021

Ishan Misra Florian Metze

Christoph Feichtenhofer

Andrea Vedaldi

João F. Henriques

283

340

09 Jun 2021

MVT: Mask Vision Transformer for Facial Expression Recognition in the wild

211

08 Jun 2021

Reading StackOverflow Encourages Cheating: Adding Question Text Improves Extractive Code Generation

Gabriel Orlanski

Alex Gittens

108

08 Jun 2021

Let's be explicit about that: Distant supervision for implicit discourse relation classification via connective prediction

Murathan Kurfali

Robert Östling

125

06 Jun 2021

A Generalizable Approach to Learning Optimizers

277

02 Jun 2021

What Matters for Adversarial Imitation Learning?Neural Information Processing Systems (NeurIPS), 2021

Sertan Girgin

Olivier Bachem

Olivier Pietquin

Marcin Andrychowicz

229

01 Jun 2021

Reinforced Iterative Knowledge Distillation for Cross-Lingual Named Entity RecognitionKnowledge Discovery and Data Mining (KDD), 2021

207

01 Jun 2021

VidFace: A Full-Transformer Solver for Video FaceHallucination with Unaligned Tiny Snapshots

Yi Yang

182

31 May 2021

Defending Pre-trained Language Models from Adversarial Word Substitutions Without Performance SacrificeFindings (Findings), 2021

130

30 May 2021

Nested Hierarchical Transformer: Towards Accurate, Data-Efficient and Interpretable Visual UnderstandingAAAI Conference on Artificial Intelligence (AAAI), 2021

Tomas Pfister

357

206

26 May 2021

Read, Listen, and See: Leveraging Multimodal Information Helps Chinese Spell CheckingFindings (Findings), 2021

199

109

26 May 2021

Guiding the Growth: Difficulty-Controllable Question Generation through Step-by-Step RewritingAnnual Meeting of the Association for Computational Linguistics (ACL), 2021

Sujian Li

195

25 May 2021

Learning Better Visual Dialog Agents with Pretrained Visual-Linguistic RepresentationComputer Vision and Pattern Recognition (CVPR), 2021

Govind Thattai

182

24 May 2021

A Sequence-to-Set Network for Nested Named Entity RecognitionInternational Joint Conference on Artificial Intelligence (IJCAI), 2021

256

19 May 2021

On the Distributional Properties of Adaptive GradientsConference on Uncertainty in Artificial Intelligence (UAI), 2021

Z. Zhiyi

Liu Ziyin

140

15 May 2021

Towards an Online Empathetic Chatbot with Emotion CausesAnnual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2021

252

11 May 2021

Logic-Driven Context Extension and Data Augmentation for Logical Reasoning of TextFindings (Findings), 2021

316

08 May 2021

Apply Artificial Neural Network to Solving Manpower Scheduling Problem

Tianyu Liu

Lingyu Zhang

07 May 2021

SpeechNet: A Universal Modularized Model for Speech Processing Tasks

295

07 May 2021

Emerging Properties in Self-Supervised Vision TransformersIEEE International Conference on Computer Vision (ICCV), 2021

2.0K

7,910

29 Apr 2021

ConTNet: Why not use convolution and transformer at the same time?

274

27 Apr 2021

Prediction, Selection, and Generation: Exploration of Knowledge-Driven Conversation System

Dayiheng Liu

132

23 Apr 2021

Multiscale Vision TransformersIEEE International Conference on Computer Vision (ICCV), 2021

Christoph Feichtenhofer

ViT

481

1,513

22 Apr 2021

Vision Transformer Pruning

475

112

17 Apr 2021

How to Train BERT with an Academic BudgetConference on Empirical Methods in Natural Language Processing (EMNLP), 2021

Peter Izsak

Moshe Berchansky

Omer Levy

338

128

15 Apr 2021

Emotion Dynamics Modeling via BERTIEEE International Joint Conference on Neural Network (IJCNN), 2021

Haiqing Yang

Jianping Shen

207

15 Apr 2021

From Solving a Problem Boldly to Cutting the Gordian Knot: Idiomatic Text Generation

Jianing Zhou

Hongyu Gong

Srihari Venkat Nanniyur

S. Bhat

181

13 Apr 2021

Learning and Planning in Complex Action SpacesInternational Conference on Machine Learning (ICML), 2021

David Silver

224

13 Apr 2021

Online and Offline Reinforcement Learning by Planning with a Learned ModelNeural Information Processing Systems (NeurIPS), 2021

David Silver

223

131

13 Apr 2021

Fighting the COVID-19 Infodemic with a Holistic BERT Ensemble

Georgios Tziafas

Konstantinos Kogkalidis

Tommaso Caselli

130

12 Apr 2021

A Deep Learning Based Cost Model for Automatic Code OptimizationConference on Machine Learning and Systems (MLSys), 2021

Riyadh Baghdadi

Massinissa Merouani

Mohamed-Hicham Leghettas

168

11 Apr 2021

SiT: Self-supervised vIsion Transformer

379

155

08 Apr 2021

Modern Hopfield Networks for Few- and Zero-Shot Reaction Template Prediction

271

07 Apr 2021

Going deeper with Image TransformersIEEE International Conference on Computer Vision (ICCV), 2021

Hugo Touvron

Matthieu Cord

Alexandre Sablayrolles

Gabriel Synnaeve

Edouard Grave

ViT

575

1,188

31 Mar 2021

XRJL-HKUST at SemEval-2021 Task 4: WordNet-Enhanced Dual Multi-head Co-Attention for Reading Comprehension of Abstract MeaningInternational Workshop on Semantic Evaluation (SemEval), 2021

230

30 Mar 2021