SGDR: Stochastic Gradient Descent with Warm Restarts

13 August 2016

Papers citing "SGDR: Stochastic Gradient Descent with Warm Restarts"

50 / 1,294 papers shown

Title
Visualizing Adapted Knowledge in Domain Transfer Yunzhong Hou Liang Zheng 111 54 0 20 Apr 2021
Lottery Jackpots Exist in Pre-trained Models Yu-xin Zhang Mingbao Lin Yan Wang Fei Chao Rongrong Ji 30 15 0 18 Apr 2021
Self-Supervised Graph Neural Networks for Improved Electroencephalographic Seizure Analysis Siyi Tang Jared A. Dunnmon Khaled Kamal Saab Xuan Zhang Qianying Huang Florian Dubost D. Rubin Christopher Lee-Messer 25 96 0 16 Apr 2021
Geometry-Free View Synthesis: Transformers and no 3D Priors Robin Rombach Patrick Esser Bjorn Ommer ViT 11 93 0 15 Apr 2021
RIANN -- A Robust Neural Network Outperforms Attitude Estimation Filters Daniel Weber C. Gühmann Thomas Seel 12 35 0 15 Apr 2021
Escaping the Big Data Paradigm with Compact Transformers Ali Hassani Steven Walton Nikhil Shah Abulikemu Abuduweili Jiachen Li Humphrey Shi 54 462 0 12 Apr 2021
CondenseNet V2: Sparse Feature Reactivation for Deep Networks Le Yang Haojun Jiang Ruojin Cai Yulin Wang Shiji Song Gao Huang Qi Tian DD 23 64 0 09 Apr 2021
Searching Efficient Model-guided Deep Network for Image Denoising Qiang Ning W. Dong Xin Li Jinjian Wu Leida Li Guangming Shi 27 7 0 06 Apr 2021
Multiview Pseudo-Labeling for Semi-supervised Learning from Video Bo Xiong Haoqi Fan Kristen Grauman Christoph Feichtenhofer SSL 22 49 0 01 Apr 2021
A Realistic Evaluation of Semi-Supervised Learning for Fine-Grained Classification Jong-Chyi Su Zezhou Cheng Subhransu Maji 23 57 0 01 Apr 2021
Explore Image Deblurring via Blur Kernel Space Phong Tran Anh Tran Quynh Phung Minh Hoai 19 70 0 01 Apr 2021
Training Multi-bit Quantized and Binarized Networks with A Learnable Symmetric Quantizer Phuoc Pham J. Abraham Jaeyong Chung MQ 33 11 0 01 Apr 2021
Rethinking Self-supervised Correspondence Learning: A Video Frame-level Similarity Perspective Jiarui Xu Xiaolong Wang VOS 30 92 0 31 Mar 2021
Broaden Your Views for Self-Supervised Video Learning Adrià Recasens Pauline Luc Jean-Baptiste Alayrac Luyu Wang Ross Hemsley ... Florent Altché M. Valko Jean-Bastien Grill Aaron van den Oord Andrew Zisserman SSL AI4TS 23 127 0 30 Mar 2021
Bayesian Deep Basis Fitting for Depth Completion with Uncertainty Chao Qu Wenxin Liu Camillo J. Taylor UQCV BDL 19 31 0 29 Mar 2021
Region Similarity Representation Learning Tete Xiao Colorado Reed Xiaolong Wang Kurt Keutzer Trevor Darrell VLM SSL 29 116 0 24 Mar 2021
Scaling Local Self-Attention for Parameter Efficient Visual Backbones Ashish Vaswani Prajit Ramachandran A. Srinivas Niki Parmar Blake A. Hechtman Jonathon Shlens 16 395 0 23 Mar 2021
Characterizing and Improving the Robustness of Self-Supervised Learning through Background Augmentations Chaitanya K. Ryali D. Schwab Ari S. Morcos SSL 29 9 0 23 Mar 2021
BossNAS: Exploring Hybrid CNN-transformers with Block-wisely Self-supervised Neural Architecture Search Changlin Li Tao Tang Guangrun Wang Jiefeng Peng Bing Wang Xiaodan Liang Xiaojun Chang ViT 46 105 0 23 Mar 2021
DeepViT: Towards Deeper Vision Transformer Daquan Zhou Bingyi Kang Xiaojie Jin Linjie Yang Xiaochen Lian Zihang Jiang Qibin Hou Jiashi Feng ViT 42 510 0 22 Mar 2021
TrivialAugment: Tuning-free Yet State-of-the-Art Data Augmentation Samuel G. Müller Frank Hutter ViT MQ 16 274 0 18 Mar 2021
Hierarchical Attention-based Age Estimation and Bias Estimation Shakediel Hiba Y. Keller CVBM 27 10 0 17 Mar 2021
Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detection Jiaming Li Hongtao Xie Jiahong Li Zhongyuan Wang Yongdong Zhang CVBM 29 237 0 16 Mar 2021
Revisiting ResNets: Improved Training and Scaling Strategies Irwan Bello W. Fedus Xianzhi Du E. D. Cubuk A. Srinivas Tsung-Yi Lin Jonathon Shlens Barret Zoph 27 297 0 13 Mar 2021
Searching by Generating: Flexible and Efficient One-Shot NAS with Architecture Generator Sian-Yao Huang W. Chu 14 25 0 12 Mar 2021
Learnable Companding Quantization for Accurate Low-bit Neural Networks Kohei Yamamoto MQ 24 63 0 12 Mar 2021
Knowledge Evolution in Neural Networks Ahmed Taha Abhinav Shrivastava L. Davis 45 21 0 09 Mar 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 42 2,287 0 04 Mar 2021
Adaptive Consistency Regularization for Semi-Supervised Transfer Learning Abulikemu Abuduweili Xingjian Li Humphrey Shi Chengzhong Xu Dejing Dou 35 77 0 03 Mar 2021
Touchless Palmprint Recognition based on 3D Gabor Template and Block Feature Refinement Zhaoqun Li Xu Liang Dandan Fan Jinxing Li Wei Jia David Zhang 25 16 0 03 Mar 2021
Fixing Data Augmentation to Improve Adversarial Robustness Sylvestre-Alvise Rebuffi Sven Gowal D. A. Calian Florian Stimberg Olivia Wiles Timothy A. Mann AAML 25 268 0 02 Mar 2021
A Multiclass Boosting Framework for Achieving Fast and Provable Adversarial Robustness Jacob D. Abernethy Pranjal Awasthi Satyen Kale AAML 13 6 0 01 Mar 2021
GRAD-MATCH: Gradient Matching based Data Subset Selection for Efficient Deep Model Training Krishnateja Killamsetty D. Sivasubramanian Ganesh Ramakrishnan A. De Rishabh K. Iyer OOD 88 188 0 27 Feb 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 103 27,632 0 26 Feb 2021
On the Validity of Modeling SGD with Stochastic Differential Equations (SDEs) Zhiyuan Li Sadhika Malladi Sanjeev Arora 33 78 0 24 Feb 2021
Provable Super-Convergence with a Large Cyclical Learning Rate Samet Oymak 30 12 0 22 Feb 2021
Learning Neural Network Subspaces Mitchell Wortsman Maxwell Horton Carlos Guestrin Ali Farhadi Mohammad Rastegari UQCV 19 85 0 20 Feb 2021
CReST: A Class-Rebalancing Self-Training Framework for Imbalanced Semi-Supervised Learning Chen Wei Kihyuk Sohn Clayton Mellina Alan Yuille Fan Yang CLL 26 256 0 18 Feb 2021
LambdaNetworks: Modeling Long-Range Interactions Without Attention Irwan Bello 269 179 0 17 Feb 2021
GradInit: Learning to Initialize Neural Networks for Stable and Efficient Training Chen Zhu Renkun Ni Zheng Xu Kezhi Kong W. R. Huang Tom Goldstein ODL 31 53 0 16 Feb 2021
Learning to Recognize Actions on Objects in Egocentric Video with Attention Dictionaries Swathikiran Sudhakaran Sergio Escalera O. Lanz EgoV 25 15 0 16 Feb 2021
VA-RED $^2$ : Video Adaptive Redundancy Reduction Bowen Pan Rameswar Panda Camilo Luciano Fosco Chung-Ching Lin A. Andonian Yue Meng Kate Saenko A. Oliva Rogerio Feris 15 19 0 15 Feb 2021
Understanding Negative Samples in Instance Discriminative Self-supervised Representation Learning Kento Nozawa Issei Sato SSL 18 43 0 13 Feb 2021
ReRankMatch: Semi-Supervised Learning with Semantics-Oriented Similarity Representation T. Tran Mingu Kang Daeyoung Kim 4 1 0 12 Feb 2021
High-Performance Large-Scale Image Recognition Without Normalization Andrew Brock Soham De Samuel L. Smith Karen Simonyan VLM 223 512 0 11 Feb 2021
Deep Residual Learning in Spiking Neural Networks Wei Fang Zhaofei Yu Yanqing Chen Tiejun Huang T. Masquelier Yonghong Tian 123 476 0 08 Feb 2021
Joint Denoising and Demosaicking with Green Channel Prior for Real-world Burst Images Shi Guo Zhetong Liang Lei Zhang 6 36 0 25 Jan 2021
GhostSR: Learning Ghost Features for Efficient Image Super-Resolution Ying Nie Kai Han Zhenhua Liu Chunjing Xu Yunhe Wang OOD 37 22 0 21 Jan 2021
Momentum^2 Teacher: Momentum Teacher with Momentum Statistics for Self-Supervised Learning Zeming Li Songtao Liu Jian-jun Sun 45 16 0 19 Jan 2021
Unlearnable Examples: Making Personal Data Unexploitable Hanxun Huang Xingjun Ma S. Erfani James Bailey Yisen Wang MIACV 136 190 0 13 Jan 2021