SGDR: Stochastic Gradient Descent with Warm Restarts

13 August 2016

Papers citing "SGDR: Stochastic Gradient Descent with Warm Restarts"

50 / 1,273 papers shown

Title
Non-trivial symmetries in quantum landscapes and their resilience to quantum noise Enrico Fontana M. Cerezo A. Arrasmith I. Rungger Patrick J. Coles 18 22 0 17 Nov 2020
EvoPose2D: Pushing the Boundaries of 2D Human Pose Estimation using Accelerated Neuroevolution with Weight Transfer William J. McNally Kanav Vats Alexander Wong J. McPhee 3DH 17 16 0 17 Nov 2020
Where to drive: free space detection with one fisheye camera Tobias Scheck Adarsh Mallandur C. Wiede G. Hirtz 6 7 0 11 Nov 2020
Towards Domain-Agnostic Contrastive Learning Vikas Verma Minh-Thang Luong Kenji Kawaguchi Hieu H. Pham Quoc V. Le SSL 15 115 0 09 Nov 2020
Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understanding Mike Roberts Jason Ramapuram Anurag Ranjan Atulit Kumar Miguel Angel Bautista Nathan Paczan Russ Webb Joshua M. Susskind 29 368 0 04 Nov 2020
Multi Projection Fusion for Real-time Semantic Segmentation of 3D LiDAR Point Clouds Yara Ali Alnaggar Mohamed Afifi K. Amer Mohamed ElHelw 3DPC 22 43 0 03 Nov 2020
Graph Attention Networks for Speaker Verification Jee-weon Jung Hee-Soo Heo Ha-Jin Yu Joon Son Chung 17 26 0 22 Oct 2020
Learning Loss for Test-Time Augmentation Ildoo Kim Younghoon Kim Sungwoong Kim OOD 18 90 0 22 Oct 2020
One Model to Reconstruct Them All: A Novel Way to Use the Stochastic Noise in StyleGAN Christian Bartz Joseph Bethge Haojin Yang Christoph Meinel 19 16 0 21 Oct 2020
Multi-hop Question Generation with Graph Convolutional Network Dan Su Yan Xu Wenliang Dai Ziwei Ji Tiezheng Yu Pascale Fung 21 39 0 19 Oct 2020
A New Distributional Ranking Loss With Uncertainty: Illustrated in Relative Depth Estimation Alican Mertan Y. Sahin D. Duff Gözde B. Ünal OOD UQCV 27 10 0 14 Oct 2020
Just Pick a Sign: Optimizing Deep Multitask Models with Gradient Sign Dropout Zhao Chen Jiquan Ngiam Yanping Huang Thang Luong Henrik Kretzschmar Yuning Chai Dragomir Anguelov 27 206 0 14 Oct 2020
Making Every Label Count: Handling Semantic Imprecision by Integrating Domain Knowledge C. Brust Björn Barz Joachim Denzler NoLa 8 5 0 13 Oct 2020
Energy-based Out-of-distribution Detection Weitang Liu Xiaoyun Wang John Douglas Owens Yixuan Li OODD 30 1,291 0 08 Oct 2020
Uncovering the Limits of Adversarial Training against Norm-Bounded Adversarial Examples Sven Gowal Chongli Qin J. Uesato Timothy A. Mann Pushmeet Kohli AAML 17 323 0 07 Oct 2020
Tasks, stability, architecture, and compute: Training more effective learned optimizers, and using them to train themselves Luke Metz Niru Maheswaranathan C. Freeman Ben Poole Jascha Narain Sohl-Dickstein 11 62 0 23 Sep 2020
Understanding Deformable Alignment in Video Super-Resolution Kelvin C. K. Chan Xintao Wang K. Yu Chao Dong Chen Change Loy 20 153 0 15 Sep 2020
Manifold attack K. Tran Fred-Maurice Ngole-Mboula Jean-Luc Starck AAML OOD 11 0 0 13 Sep 2020
Bias-Awareness for Zero-Shot Learning the Seen and Unseen William Thong Cees G. M. Snoek 14 5 0 25 Aug 2020
Training Sparse Neural Networks using Compressed Sensing Jonathan W. Siegel Jianhong Chen Pengchuan Zhang Jinchao Xu 24 5 0 21 Aug 2020
Data-driven Meta-set Based Fine-Grained Visual Classification Chuanyi Zhang Yazhou Yao Xiangbo Shu Zechao Li Zhenmin Tang Qi Wu NoLa 16 2 0 06 Aug 2020
Learning Long-term Visual Dynamics with Region Proposal Interaction Networks Haozhi Qi Xiaolong Wang Deepak Pathak Yi-An Ma Jitendra Malik 28 56 0 05 Aug 2020
1st Place Solutions of Waymo Open Dataset Challenge 2020 -- 2D Object Detection Track Zehao Huang Zehui Chen Qiaofei Li Hongkai Zhang Naiyan Wang 10 13 0 04 Aug 2020
Temporal Context Aggregation for Video Retrieval with Contrastive Learning Jie Shao Xin Wen Bingchen Zhao Xiangyang Xue AI4TS 30 4 0 04 Aug 2020
HAMLET: A Hierarchical Multimodal Attention-based Human Activity Recognition Algorithm Md. Mofijul Islam Tariq Iqbal 20 80 0 03 Aug 2020
Learning Video Representations from Textual Web Supervision Jonathan C. Stroud Zhichao Lu Chen Sun Jia Deng Rahul Sukthankar Cordelia Schmid David A. Ross SSL 24 48 0 29 Jul 2020
Stochastic Normalized Gradient Descent with Momentum for Large-Batch Training Shen-Yi Zhao Chang-Wei Shi Yin-Peng Xie Wu-Jun Li ODL 13 8 0 28 Jul 2020
Video Super Resolution Based on Deep Learning: A Comprehensive Survey Hongying Liu Zhubo Ruan Peng Zhao Chao Dong Fanhua Shang Yuanyuan Liu Linlin Yang Radu Timofte SupR 20 167 0 25 Jul 2020
KPRNet: Improving projection-based LiDAR semantic segmentation Deyvid Kochanov F. Karimi Nejadasl O. Booij 3DPC 9 73 0 24 Jul 2020
End-to-end Learning of Compressible Features Saurabh Singh Sami Abu-El-Haija Nick Johnston Johannes Ballé Abhinav Shrivastava G. Toderici SSL 89 71 0 23 Jul 2020
Balanced Meta-Softmax for Long-Tailed Visual Recognition Jiawei Ren Cunjun Yu Shunan Sheng Xiao Ma Haiyu Zhao Shuai Yi Hongsheng Li 159 549 0 21 Jul 2020
Regularizing Deep Networks with Semantic Data Augmentation Yulin Wang Gao Huang Shiji Song Xuran Pan Yitong Xia Cheng Wu 14 155 0 21 Jul 2020
MCUNet: Tiny Deep Learning on IoT Devices Ji Lin Wei-Ming Chen Yujun Lin J. Cohn Chuang Gan Song Han 38 471 0 20 Jul 2020
Learning with Privileged Information for Efficient Image Super-Resolution Wonkyung Lee Junghyup Lee Dohyung Kim Bumsub Ham 33 134 0 15 Jul 2020
Single-partition adaptive Q-learning J. Araújo Mário A. T. Figueiredo M. Botto OffRL 18 2 0 14 Jul 2020
Graph Structure of Neural Networks Jiaxuan You J. Leskovec Kaiming He Saining Xie GNN 19 136 0 13 Jul 2020
Towards Practical Lipreading with Distilled and Efficient Models Pingchuan Ma Brais Martínez Stavros Petridis M. Pantic 13 95 0 13 Jul 2020
Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networks Wei Fang Zhaofei Yu Yanqing Chen T. Masquelier Tiejun Huang Yonghong Tian 47 503 0 11 Jul 2020
Contrastive Training for Improved Out-of-Distribution Detection Jim Winkens Rudy Bunel Abhijit Guha Roy Robert Stanforth Vivek Natarajan ... Alan Karthikesalingam Simon A. A. Kohl taylan. cemgil S. M. Ali Eslami Olaf Ronneberger OODD 11 234 0 10 Jul 2020
Deep Multi-task Learning for Facial Expression Recognition and Synthesis Based on Selective Feature Sharing Rui Zhao Tianshan Liu Jun Xiao D. Lun K. Lam CVBM 20 18 0 09 Jul 2020
Diverse Ensembles Improve Calibration Asa Cooper Stickland Iain Murray UQCV FedML 16 26 0 08 Jul 2020
Self-Supervised MultiModal Versatile Networks Jean-Baptiste Alayrac Adrià Recasens R. Schneider Relja Arandjelović Jason Ramapuram J. Fauw Lucas Smaira Sander Dieleman Andrew Zisserman SSL 40 371 0 29 Jun 2020
GPT-GNN: Generative Pre-Training of Graph Neural Networks Ziniu Hu Yuxiao Dong Kuansan Wang Kai-Wei Chang Yizhou Sun SSL AI4CE 18 547 0 27 Jun 2020
Supermasks in Superposition Mitchell Wortsman Vivek Ramanujan Rosanne Liu Aniruddha Kembhavi Mohammad Rastegari J. Yosinski Ali Farhadi SSL CLL 17 279 0 26 Jun 2020
Cyclic Differentiable Architecture Search Hongyuan Yu Houwen Peng Yan Huang Jianlong Fu Hao Du Liang Wang Haibin Ling 3DPC 19 48 0 18 Jun 2020
Fine-Tuning DARTS for Image Classification M. Tanveer Muhammad Umar Karim Khan C. Kyung 23 49 0 16 Jun 2020
Ordering Dimensions with Nested Dropout Normalizing Flows Artur Bekasov Iain Murray DRL 17 5 0 15 Jun 2020
Multiscale Deep Equilibrium Models Shaojie Bai V. Koltun J. Zico Kolter BDL 33 211 0 15 Jun 2020
Neural Ensemble Search for Uncertainty Estimation and Dataset Shift Sheheryar Zaidi Arber Zela T. Elsken Chris Holmes Frank Hutter Yee Whye Teh OOD UQCV 13 71 0 15 Jun 2020
Optimal Lottery Tickets via SubsetSum: Logarithmic Over-Parameterization is Sufficient Ankit Pensia Shashank Rajput Alliot Nagle Harit Vishwakarma Dimitris Papailiopoulos 17 102 0 14 Jun 2020