SGDR: Stochastic Gradient Descent with Warm Restarts

13 August 2016

Papers citing "SGDR: Stochastic Gradient Descent with Warm Restarts"

50 / 1,273 papers shown

Title
Geometric Back-projection Network for Point Cloud Classification S. Qiu Saeed Anwar Nick Barnes 3DPC 22 3 0 28 Nov 2019
Open Cross-Domain Visual Search William Thong Pascal Mettes Cees G. M. Snoek 11 13 0 19 Nov 2019
Rethinking deep active learning: Using unlabeled data at model training Oriane Siméoni Mateusz Budnik Yannis Avrithis G. Gravier HAI 14 79 0 19 Nov 2019
Neural Network Pruning with Residual-Connections and Limited-Data Jian-Hao Luo Jianxin Wu 11 112 0 19 Nov 2019
Graph Neural Ordinary Differential Equations Michael Poli Stefano Massaroli Junyoung Park Atsushi Yamashita Hajime Asama Jinkyoo Park AI4CE 37 154 0 18 Nov 2019
Preparing Lessons: Improve Knowledge Distillation with Better Supervision Tiancheng Wen Shenqi Lai Xueming Qian 23 67 0 18 Nov 2019
Segmenting Ships in Satellite Imagery With Squeeze and Excitation U-Net R. Venkatesh Anand Metha SSeg 11 4 0 27 Oct 2019
Reducing Domain Gap by Reducing Style Bias Hyeonseob Nam HyunJae Lee Jongchan Park Wonjun Yoon Donggeun Yoo 20 61 0 25 Oct 2019
Torchreid: A Library for Deep Learning Person Re-Identification in Pytorch Kaiyang Zhou Tao Xiang 16 116 0 22 Oct 2019
Self-Correction for Human Parsing Peike Li Yunqiu Xu Yunchao Wei Yezhou Yang 11 324 0 22 Oct 2019
Decoupling Representation and Classifier for Long-Tailed Recognition Bingyi Kang Saining Xie Marcus Rohrbach Zhicheng Yan Albert Gordo Jiashi Feng Yannis Kalantidis OODD 19 1,186 0 21 Oct 2019
Learning Generalisable Omni-Scale Representations for Person Re-Identification Kaiyang Zhou Yongxin Yang Andrea Cavallaro Tao Xiang 22 217 0 15 Oct 2019
Demon: Improved Neural Network Training with Momentum Decay John Chen Cameron R. Wolfe Zhaoqi Li Anastasios Kyrillidis ODL 8 15 0 11 Oct 2019
Deformable Kernels: Adapting Effective Receptive Fields for Object Deformation Hang Gao Xizhou Zhu Steve Lin Jifeng Dai 13 64 0 07 Oct 2019
SELF: Learning to Filter Noisy Labels with Self-Ensembling Philipp Kratzer Marc Toussaint Thi Phuong Nhung Ngo T. Nguyen Jim Mainprice Thomas Brox NoLa 22 308 0 04 Oct 2019
Spatio-Temporal FAST 3D Convolutions for Human Action Recognition Alexandros Stergiou R. Poppe 3DH 12 19 0 30 Sep 2019
Reducing Transformer Depth on Demand with Structured Dropout Angela Fan Edouard Grave Armand Joulin 19 584 0 25 Sep 2019
Balanced One-shot Neural Architecture Optimization Renqian Luo Tao Qin Enhong Chen BDL 22 14 0 24 Sep 2019
Empirical study towards understanding line search approximations for training neural networks Younghwan Chae D. Wilke 6 11 0 15 Sep 2019
Pixel-wise Segmentation of Right Ventricle of Heart Yaman Dang Deepak Anand A. Sethi 11 5 0 21 Aug 2019
How Does Learning Rate Decay Help Modern Neural Networks? Kaichao You Mingsheng Long Jianmin Wang Michael I. Jordan 17 4 0 05 Aug 2019
Attentive Normalization Xilai Li Wei Sun Tianfu Wu OOD ViT 20 31 0 04 Aug 2019
Adaptive Regularization via Residual Smoothing in Deep Learning Optimization Jung-Kyun Cho Junseok Kwon Byung-Woo Hong 21 1 0 23 Jul 2019
XferNAS: Transfer Neural Architecture Search Martin Wistuba 21 12 0 18 Jul 2019
A Unified Deep Framework for Joint 3D Pose Estimation and Action Recognition from a Single RGB Camera H. Pham H. Salmane L. Khoudour Alain Crouzil Pablo Zegers S. Velastín 18 46 0 16 Jul 2019
Learning Data Augmentation Strategies for Object Detection Barret Zoph E. D. Cubuk Golnaz Ghiasi Tsung-Yi Lin Jonathon Shlens Quoc V. Le 25 523 0 26 Jun 2019
Learning Deep Image Priors for Blind Image Denoising Xianxu Hou Hongming Luo Jingxin Liu Bolei Xu Ke Sun Yuanhao Gong Bozhi Liu Guoping Qiu 19 7 0 04 Jun 2019
Adaptive Stochastic Natural Gradient Method for One-Shot Neural Architecture Search Youhei Akimoto Shinichi Shirakawa Nozomu Yoshinari Kento Uchida Shota Saito K. Nishida 19 86 0 21 May 2019
Training CNNs with Selective Allocation of Channels Jongheon Jeong Jinwoo Shin CVBM 31 15 0 11 May 2019
Segmentation is All You Need Zehua Cheng Yuxiang Wu Zhenghua Xu Thomas Lukasiewicz Weiyan Wang 25 20 0 30 Apr 2019
Dynamic Mini-batch SGD for Elastic Distributed Training: Learning in the Limbo of Resources Haibin Lin Hang Zhang Yifei Ma Tong He Zhi-Li Zhang Sheng Zha Mu Li 17 23 0 26 Apr 2019
Attention Augmented Convolutional Networks Irwan Bello Barret Zoph Ashish Vaswani Jonathon Shlens Quoc V. Le 28 1,000 0 22 Apr 2019
EvalNorm: Estimating Batch Normalization Statistics for Evaluation Saurabh Singh Abhinav Shrivastava 18 51 0 12 Apr 2019
Semi-Supervised Segmentation of Salt Bodies in Seismic Images using an Ensemble of Convolutional Neural Networks Yauhen Babakhin A. Sanakoyeu Hirotoshi Kitamura 16 59 0 09 Apr 2019
sharpDARTS: Faster and More Accurate Differentiable Architecture Search Andrew Hundt Varun Jain Gregory Hager OOD 22 66 0 23 Mar 2019
Interpolation Consistency Training for Semi-Supervised Learning Vikas Verma Kenji Kawaguchi Alex Lamb Juho Kannala Arno Solin Yoshua Bengio David Lopez-Paz 11 756 0 09 Mar 2019
Modulated binary cliquenet Jinpeng Xia Jiasong Wu Youyong Kong Pinzheng Zhang L. Senhadji H. Shu MQ 8 0 0 27 Feb 2019
Deep Learning Based Video System for Accurate and Real-Time Parking Measurement B. Cai Ricardo Alvarez M. Sit Fábio Duarte C. Ratti HAI 16 53 0 20 Feb 2019
Artificial Intelligence for Prosthetics - challenge solutions L. Kidzinski Carmichael F. Ong Sharada Mohanty Jennifer Hicks Sean F. Carroll ... E. Tumer J. Watson M. Salathé Sergey Levine Scott L. Delp 13 40 0 07 Feb 2019
Using Pre-Training Can Improve Model Robustness and Uncertainty Dan Hendrycks Kimin Lee Mantas Mazeika NoLa 12 717 0 28 Jan 2019
EAT-NAS: Elastic Architecture Transfer for Accelerating Large-scale Neural Architecture Search Jiemin Fang Yukang Chen Xinbang Zhang Qian Zhang Chang Huang Gaofeng Meng Wenyu Liu Xinggang Wang 25 24 0 17 Jan 2019
Learning representations of molecules and materials with atomistic neural networks Kristof T. Schütt A. Tkatchenko K. Müller NAI 14 13 0 11 Dec 2018
Deep Anomaly Detection with Outlier Exposure Dan Hendrycks Mantas Mazeika Thomas G. Dietterich OODD 11 1,450 0 11 Dec 2018
ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Network Sachin Mehta Mohammad Rastegari Linda G. Shapiro Hannaneh Hajishirzi VLM 15 392 0 28 Nov 2018
Attention-Based Deep Neural Networks for Detection of Cancerous and Precancerous Esophagus Tissue on Histopathological Slides Naofumi Tomita B. Abdollahi Jason W. Wei Bing Ren A. Suriawinata Saeed Hassanpour MedIm 23 166 0 20 Nov 2018
NSGA-Net: Neural Architecture Search using Multi-Objective Genetic Algorithm Zhichao Lu Ian Whalen Vishnu Naresh Boddeti Yashesh D. Dhebar Kalyanmoy Deb E. Goodman W. Banzhaf 23 81 0 08 Oct 2018
Adaptive Input Representations for Neural Language Modeling Alexei Baevski Michael Auli 11 386 0 28 Sep 2018
Towards Understanding Regularization in Batch Normalization Ping Luo Xinjiang Wang Wenqi Shao Zhanglin Peng MLT AI4CE 8 179 0 04 Sep 2018
PFDet: 2nd Place Solution to Open Images Challenge 2018 Object Detection Track Takuya Akiba Tommi Kerola Yusuke Niitani Toru Ogawa Shotaro Sano Shuji Suzuki 14 20 0 04 Sep 2018
Don't Use Large Mini-Batches, Use Local SGD Tao R. Lin Sebastian U. Stich Kumar Kshitij Patel Martin Jaggi 22 429 0 22 Aug 2018