Lookahead Optimizer: k steps forward, 1 step back

19 July 2019

Jimmy Ba

Papers citing "Lookahead Optimizer: k steps forward, 1 step back"

50 / 347 papers shown

Title
IWA: Integrated Gradient based White-box Attacks for Fooling Deep Neural Networks Yixiang Wang Jiqiang Liu Xiaolin Chang J. Misic Vojislav B. Mišić AAML 39 12 0 03 Feb 2021
Automated Deep Learning Analysis of Angiography Video Sequences for Coronary Artery Disease Chengyang Zhou Thao Vy Dinh Heyi Kong J. Yap K. Yeo H. Lee Kaicheng Liang 26 12 0 29 Jan 2021
Multilingual and cross-lingual document classification: A meta-learning approach Niels van der Heijden H. Yannakoudakis Pushkar Mishra Ekaterina Shutova VLM 8 23 0 27 Jan 2021
Knowledge Generation -- Variational Bayes on Knowledge Graphs Florian Wolf BDL 13 0 0 21 Jan 2021
Advances in Electron Microscopy with Deep Learning Jeffrey M. Ede 32 2 0 04 Jan 2021
Dynamic Traffic Modeling From Overhead Imagery Scott Workman Nathan Jacobs 29 17 0 18 Dec 2020
FedADC: Accelerated Federated Learning with Drift Control Emre Ozfatura Kerem Ozfatura Deniz Gunduz FedML 33 37 0 16 Dec 2020
Sparse encoding for more-interpretable feature-selecting representations in probabilistic matrix factorization Joshua C. Chang P. Fletcher Ju Han Ted L.Chang Shashaank Vattikuti Bart Desmet Ayah Zirikly Carson C. Chow 4 4 0 08 Dec 2020
Phonetic Posteriorgrams based Many-to-Many Singing Voice Conversion via Adversarial Training Haohan Guo Heng Lu Na Hu Chunlei Zhang Shan Yang Lei Xie Dan Su Dong Yu AAML 19 12 0 03 Dec 2020
Lookahead optimizer improves the performance of Convolutional Autoencoders for reconstruction of natural images Sayan Nag DRL 9 2 0 03 Dec 2020
MaX-DeepLab: End-to-End Panoptic Segmentation with Mask Transformers Huiyu Wang Yukun Zhu Hartwig Adam Alan Yuille Liang-Chieh Chen ViT 35 527 0 01 Dec 2020
Deep learning in magnetic resonance prostate segmentation: A review and a new perspective David Gillespie Connah Kendrick I. Boon C. Boon T. Rattay Moi Hoon Yap 8 12 0 16 Nov 2020
Conflicting Bundles: Adapting Architectures Towards the Improved Training of Deep Neural Networks David Peer Sebastian Stabinger A. Rodríguez-Sánchez 9 6 0 05 Nov 2020
Generalized Wasserstein Dice Score, Distributionally Robust Deep Learning, and Ranger for brain tumor segmentation: BraTS 2020 challenge Lucas Fidon Sebastien Ourselin Tom Kamiel Magda Vercauteren OOD MedIm 16 41 0 03 Nov 2020
Brain tumor segmentation with self-ensembled, deeply-supervised 3D U-net neural networks: a BraTS 2020 challenge solution T. Henry Alexandre Carré Marvin Lerousseau Théo Estienne C. Robert Nikos Paragios Eric Deutsch 17 75 0 30 Oct 2020
Genetic U-Net: Automatically Designed Deep Networks for Retinal Vessel Segmentation Using a Genetic Algorithm Jiahong Wei Zhun Fan 26 73 0 29 Oct 2020
Measuring and Harnessing Transference in Multi-Task Learning Christopher Fifty Ehsan Amid Zhe Zhao Tianhe Yu Rohan Anil Chelsea Finn 28 15 0 29 Oct 2020
Learning Transferrable Parameters for Long-tailed Sequential User Behavior Modeling Jianwen Yin Chenghao Liu Weiqing Wang Jianling Sun S. Hoi 16 28 0 22 Oct 2020
Learning Curves for Analysis of Deep Networks Derek Hoiem Tanmay Gupta Zhizhong Li Michal Shlapentokh-Rothman 8 24 0 21 Oct 2020
How much progress have we made in neural network training? A New Evaluation Protocol for Benchmarking Optimizers Yuanhao Xiong Xuanqing Liu Li-Cheng Lan Yang You Si Si Cho-Jui Hsieh OOD 15 1 0 19 Oct 2020
Training Stronger Baselines for Learning to Optimize Tianlong Chen Weiyi Zhang Jingyang Zhou Shiyu Chang Sijia Liu Lisa Amini Zhangyang Wang OffRL 22 51 0 18 Oct 2020
AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients Juntang Zhuang Tommy M. Tang Yifan Ding S. Tatikonda Nicha Dvornek X. Papademetris James S. Duncan ODL 11 499 0 15 Oct 2020
A method for escaping limit cycles in training GANs Li Keke Xinmin Yang 30 0 0 07 Oct 2020
BAMSProd: A Step towards Generalizing the Adaptive Optimization Methods to Deep Binary Model Junjie Liu Dongchao Wen Deyu Wang Wei Tao Tse-Wei Chen Kinya Osa Masami Kato MQ 19 1 0 29 Sep 2020
Towards General Purpose Geometry-Preserving Single-View Depth Estimation Mikhail Romanov Nikolay Patatkin Anna Vorontsova Sergey Nikolenko Anton Konushin Dmitry Senyushkin MDE 24 3 0 25 Sep 2020
Predicting galaxy spectra from images with hybrid convolutional neural networks John F. Wu J. E. G. Peek 11 9 0 25 Sep 2020
Multi-Modal Reasoning Graph for Scene-Text Based Fine-Grained Image Classification and Retrieval Andrés Mafla S. Dey Ali Furkan Biten Lluís Gómez Dimosthenis Karatzas 21 25 0 21 Sep 2020
Detecting Sound Events Using Convolutional Macaron Net With Pseudo Strong Labels T. K. Chan C. Chin 13 2 0 21 Sep 2020
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 31 79 0 17 Sep 2020
CRNNs for Urban Sound Tagging with spatiotemporal context Augustin Arnault Nicolas Riche 17 7 0 24 Aug 2020
Deep Volumetric Ambient Occlusion Dominik Engel Timo Ropinski 14 22 0 19 Aug 2020
Adaptive Hierarchical Hyper-gradient Descent Renlong Jie Junbin Gao A. Vasnev Minh-Ngoc Tran 19 5 0 17 Aug 2020
Obtaining Adjustable Regularization for Free via Iterate Averaging Jingfeng Wu Vladimir Braverman Lin F. Yang 30 2 0 15 Aug 2020
SynDistNet: Self-Supervised Monocular Fisheye Camera Distance Estimation Synergized with Semantic Segmentation for Autonomous Driving V. Kumar Marvin Klingner S. Yogamani Stefan Milz Tim Fingscheidt Patrick Mäder MDE 21 81 0 10 Aug 2020
Improving End-to-End Speech-to-Intent Classification with Reptile Yusheng Tian P. Gorinski VLM 15 24 0 05 Aug 2020
Two-Stage Deep Learning for Accelerated 3D Time-of-Flight MRA without Matched Training Data Hyungjin Chung Eunju Cha Leonard Sunwoo J. C. Ye MedIm 25 26 0 04 Aug 2020
Encoding in Style: a StyleGAN Encoder for Image-to-Image Translation Elad Richardson Yuval Alaluf Or Patashnik Yotam Nitzan Yaniv Azar Stav Shapiro Daniel Cohen-Or 53 1,098 0 03 Aug 2020
Bilevel Continual Learning Quang-Cuong Pham Doyen Sahoo Chenghao Liu S. Hoi CLL 23 10 0 30 Jul 2020
Single Image Cloud Detection via Multi-Image Fusion Scott Workman M. U. Rafique Hunter Blanton Connor Greenwell Nathan Jacobs 14 5 0 29 Jul 2020
Comparative study of deep learning methods for the automatic segmentation of lung, lesion and lesion type in CT scans of COVID-19 patients Sofie Tilborghs Ine Dirks Lucas Fidon S. Willems Tom Eelbode ... D. Robben D. Smeets F. Maes Jef Vandemeulebroucke P. Suetens OOD 32 28 0 29 Jul 2020
BUT-FIT at SemEval-2020 Task 5: Automatic detection of counterfactual statements with deep pre-trained language representation models Martin Fajcik Josef Jon Martin Docekal Pavel Smrz 12 11 0 28 Jul 2020
Neural networks with late-phase weights J. Oswald Seijin Kobayashi Alexander Meulemans Christian Henning Benjamin Grewe João Sacramento 27 34 0 25 Jul 2020
UnRectDepthNet: Self-Supervised Monocular Depth Estimation using a Generic Framework for Handling Common Camera Distortion Models V. Kumar S. Yogamani Markus Bach Christian Witt Stefan Milz Patrick Mäder MDE 13 52 0 13 Jul 2020
Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers Robin M. Schmidt Frank Schneider Philipp Hennig ODL 32 162 0 03 Jul 2020
On the Outsized Importance of Learning Rates in Local Update Methods Zachary B. Charles Jakub Konecný FedML 17 54 0 02 Jul 2020
Taming GANs with Lookahead-Minmax Tatjana Chavdarova Matteo Pagliardini Sebastian U. Stich F. Fleuret Martin Jaggi GAN 16 25 0 25 Jun 2020
MRI Image Reconstruction via Learning Optimization Using Neural ODEs Eric Z. Chen Terrence Chen Shanhui Sun 30 23 0 24 Jun 2020
MaxVA: Fast Adaptation of Step Sizes by Maximizing Observed Variance of Gradients Chenfei Zhu Yu Cheng Zhe Gan Furong Huang Jingjing Liu Tom Goldstein ODL 27 2 0 21 Jun 2020
Lookahead Adversarial Learning for Near Real-Time Semantic Segmentation Hadi Jamali Rad Attila Szabo SSeg 17 1 0 19 Jun 2020
AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights Byeongho Heo Sanghyuk Chun Seong Joon Oh Dongyoon Han Sangdoo Yun Gyuwan Kim Youngjung Uh Jung-Woo Ha ODL 280 27 0 15 Jun 2020