Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Rates

23 August 2017

Papers citing "Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Rates"

50 / 127 papers shown

Title
CUE Vectors: Modular Training of Language Models Conditioned on Diverse Contextual Signals Scott Novotney Sreeparna Mukherjee Zeeshan Ahmed A. Stolcke 27 5 0 16 Mar 2022
DetFlowTrack: 3D Multi-object Tracking based on Simultaneous Optimization of Object Detection and Scene Flow Estimation Yueling Shen Guangming Wang Hesheng Wang VOT 3DPC 16 2 0 04 Mar 2022
Light Robust Monocular Depth Estimation For Outdoor Environment Via Monochrome And Color Camera Fusion Hyeonsoo Jang Yeongmin Ko Younkwan Lee M. Jeon MDE 25 1 0 24 Feb 2022
Cyclical Focal Loss L. Smith 35 14 0 16 Feb 2022
Word Segmentation and Morphological Parsing for Sanskrit Jingwen Li Leander Girrbach 27 6 0 30 Jan 2022
SASA: Semantics-Augmented Set Abstraction for Point-based 3D Object Detection Chen Chen Zhe Chen Jing Zhang Dacheng Tao 3DPC 33 119 0 06 Jan 2022
Sparse LiDAR Assisted Self-supervised Stereo Disparity Estimation Xiaoming Zhao Weihai Chen Xingming Wu Peter C. Y. Chen Zhengguo Li 3DV 25 1 0 31 Dec 2021
Improving COVID-19 CXR Detection with Synthetic Data Augmentation Daniel Schaudt C. Kloth Christian Spaete Andreas Hinteregger Meinrad Beer R. Schwerin MedIm 22 5 0 14 Dec 2021
Discovering Latent Representations of Relations for Interacting Systems Dohae Lee Young-Jin Oh In-Kwon Lee BDL 27 1 0 10 Nov 2021
STC speaker recognition systems for the NIST SRE 2021 Anastasia Avdeeva Aleksei Gusev Igor Korsunov Alexander Kozlov G. Lavrentyeva ... Andrey Shulipa Alisa Vinogradova V. Volokhov Evgeny Smirnov Vasily Galyuk 11 15 0 03 Nov 2021
Multi-Glimpse Network: A Robust and Efficient Classification Architecture based on Recurrent Downsampled Attention S. Tan Runpei Dong Kaisheng Ma 22 2 0 03 Nov 2021
LAE : Long-tailed Age Estimation Zenghao Bao Marc Rigter Paul Duckworth Jun Wan Xibo Ma Zhen Lei G. Guo CVBM 34 5 0 25 Oct 2021
Logical Activation Functions: Logit-space equivalents of Probabilistic Boolean Operators S. Lowe Robert C. Earle Jason dÉon Thomas Trappenberg Sageev Oore 23 1 0 22 Oct 2021
Towards efficient end-to-end speech recognition with biologically-inspired neural networks Thomas Bohnstingl Ayush Garg Stanislaw Wo'zniak G. Saon E. Eleftheriou A. Pantazi 29 5 0 04 Oct 2021
Stochastic Contrastive Learning Jason Ramapuram Dan Busbridge Xavier Suau Russ Webb BDL SSL 44 3 0 01 Oct 2021
Evaluating the fairness of fine-tuning strategies in self-supervised learning Jason Ramapuram Dan Busbridge Russ Webb 27 6 0 01 Oct 2021
Do Self-Supervised and Supervised Methods Learn Similar Visual Representations? Tom George Grigg Dan Busbridge Jason Ramapuram Russ Webb SSL DRL 27 27 0 01 Oct 2021
An Expert System for Redesigning Software for Cloud Applications Rahul Yedida R. Krishna A. Kalia Tim Menzies Jin Xiao M. Vukovic 16 4 0 29 Sep 2021
Weakly-Supervised Monocular Depth Estimationwith Resolution-Mismatched Data Jialei Xu Yuanchao Bai Xianming Liu Junjun Jiang Xiangyang Ji MDE 46 5 0 23 Sep 2021
Estimating and Exploiting the Aleatoric Uncertainty in Surface Normal Estimation Gwangbin Bae Ignas Budvytis R. Cipolla 32 113 0 20 Sep 2021
RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matching Lahav Lipson Zachary Teed Jia Deng MDE 56 391 0 15 Sep 2021
A Deep Learning Approach for Masking Fetal Gender in Ultrasound Images A. Borundiya Arshak Navruzyan Dennis Igoschev F. C. Oughali H. Pasupuleti Mike Fuller Vinay Kanigicherla T. Kashyap Rishabh Chaurasia Sonali Vinod Jain MedIm 27 0 0 14 Sep 2021
Automatic Portrait Video Matting via Context Motion Network Qiqi Hou Can Wang 21 1 0 10 Sep 2021
Weakly supervised semantic segmentation of tomographic images in the diagnosis of stroke A. Dobshik A. Tulupov V. Berikov 29 3 0 04 Sep 2021
A Protection Method of Trained CNN Model Using Feature Maps Transformed With Secret Key From Unauthorized Access Maungmaung Aprilpyone Hitoshi Kiya 16 5 0 01 Sep 2021
Integrating Dialog History into End-to-End Spoken Language Understanding Systems Jatin Ganhotra Samuel Thomas H. Kuo Sachindra Joshi G. Saon Zoltán Tüske Brian Kingsbury 30 10 0 18 Aug 2021
ERANNs: Efficient Residual Audio Neural Networks for Audio Pattern Recognition S. Verbitskiy Vladimir Berikov Viacheslav Vyshegorodtsev 24 73 0 03 Jun 2021
A Deep Learning Based Cost Model for Automatic Code Optimization Riyadh Baghdadi Massinissa Merouani Mohamed-Hicham Leghettas K. Abdous T. Arbaoui K. Benatchba Saman P. Amarasinghe 32 68 0 11 Apr 2021
PyNET-CA: Enhanced PyNET with Channel Attention for End-to-End Mobile Image Signal Processing Byung-Hoon Kim Joonyoung Song J. C. Ye JaeHyun Baek 18 26 0 07 Apr 2021
DCVNet: Dilated Cost Volume Networks for Fast Optical Flow Huaizu Jiang Erik Learned-Miller 3DPC 31 5 0 31 Mar 2021
Towards Understanding Adversarial Robustness of Optical Flow Networks Simon Schrodi Tonmoy Saikia Thomas Brox AAML 39 15 0 30 Mar 2021
Dynamic Efficient Adversarial Training Guided by Gradient Magnitude Fu Lee Wang Yanghao Zhang Yanbin Zheng Wenjie Ruan 31 1 0 04 Mar 2021
A Practical Framework for ROI Detection in Medical Images -- a case study for hip detection in anteroposterior pelvic radiographs Feng-yu Liu Chih-Chi Chen Shann-Ching Chen Chien-Hung Liao 19 1 0 02 Mar 2021
Provable Super-Convergence with a Large Cyclical Learning Rate Samet Oymak 35 12 0 22 Feb 2021
Bilateral Grid Learning for Stereo Matching Networks Binfeng Xu Yuhua Xu Xiaoli Yang Wei Jia Yulan Guo 49 79 0 01 Jan 2021
Exploration-Exploitation in Multi-Agent Learning: Catastrophe Theory Meets Game Theory Stefanos Leonardos Georgios Piliouras 31 40 0 05 Dec 2020
AdaBins: Depth Estimation using Adaptive Bins S. Bhat Ibraheem Alhashim Peter Wonka 3DV MDE ViT 66 838 0 28 Nov 2020
Relation3DMOT: Exploiting Deep Affinity for 3D Multi-Object Tracking from View Aggregation Can Chen L. Z. Fragonara Antonios Tsourdos 3DPC VOT 18 5 0 25 Nov 2020
Multi Projection Fusion for Real-time Semantic Segmentation of 3D LiDAR Point Clouds Yara Ali Alnaggar Mohamed Afifi K. Amer Mohamed ElHelw 3DPC 26 43 0 03 Nov 2020
Recent Developments on ESPnet Toolkit Boosted by Conformer Pengcheng Guo Florian Boyer Xuankai Chang Tomoki Hayashi Yosuke Higuchi ... Jing Shi Shinji Watanabe Kun Wei Wangyou Zhang Yuekai Zhang 45 262 0 26 Oct 2020
GraphMDN: Leveraging graph structure and deep learning to solve inverse problems Tuomas P. Oikarinen Daniel C. Hannah Sohrob Kazerounian BDL GNN 25 29 0 26 Oct 2020
Urban Sound Classification : striving towards a fair comparison Augustin Arnault Baptiste Hanssens Nicolas Riche 24 8 0 22 Oct 2020
Understanding Catastrophic Overfitting in Single-step Adversarial Training Hoki Kim Woojin Lee Jaewook Lee AAML 16 108 0 05 Oct 2020
Block-wise Image Transformation with Secret Key for Adversarially Robust Defense Maungmaung Aprilpyone Hitoshi Kiya 29 57 0 02 Oct 2020
Stock2Vec: A Hybrid Deep Learning Framework for Stock Market Prediction with Representation Learning and Temporal Convolutional Network Xing Wang Yijun Wang Bin Weng Aleksandr Vinel AIFin AI4TS 29 11 0 29 Sep 2020
Training DNN Model with Secret Key for Model Protection April Pyone Maung Maung Hitoshi Kiya 16 24 0 06 Aug 2020
FeatMatch: Feature-Based Augmentation for Semi-Supervised Learning Chia-Wen Kuo Chih-Yao Ma Jia-Bin Huang Z. Kira 37 118 0 16 Jul 2020
OrbNet: Deep Learning for Quantum Chemistry Using Symmetry-Adapted Atomic-Orbital Features Zhuoran Qiao Matthew Welborn Anima Anandkumar F. Manby Thomas F. Miller AI4CE 24 214 0 15 Jul 2020
Single-partition adaptive Q-learning J. Araújo Mário A. T. Figueiredo M. Botto OffRL 20 2 0 14 Jul 2020
CenterNet3D: An Anchor Free Object Detector for Point Cloud Guojun Wang Jian Wu Bin Wang Siyu Teng Long Chen Dongpu Cao 3DPC 19 27 0 13 Jul 2020