SGDR: Stochastic Gradient Descent with Warm Restarts

13 August 2016

Papers citing "SGDR: Stochastic Gradient Descent with Warm Restarts"

50 / 1,333 papers shown

Title
Ripple Attention for Visual Perception with Sub-quadratic Complexity Lin Zheng Huijie Pan Lingpeng Kong 23 3 0 06 Oct 2021
MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer Sachin Mehta Mohammad Rastegari ViT 209 1,212 0 05 Oct 2021
Decoding ECoG signal into 3D hand translation using deep learning Maciej Śliwowski Matthieu Martin Antoine Souloumiac P. Blanchart T. Aksenova 20 27 0 05 Oct 2021
De-rendering Stylized Texts Wataru Shimoda Daichi Haraguchi S. Uchida Kota Yamaguchi DiffM 25 25 0 05 Oct 2021
Spatial Ensemble: a Novel Model Smoothing Mechanism for Student-Teacher Framework Tengteng Huang Yifan Sun Xun Wang Haotian Yao Chi Zhang 20 3 0 04 Oct 2021
Perturbated Gradients Updating within Unit Space for Deep Learning Ching-Hsun Tseng Liu Cheng Shin-Jye Lee Xiaojun Zeng 38 5 0 01 Oct 2021
A Strong Baseline for the VIPriors Data-Efficient Image Classification Challenge Björn Barz Lorenzo Brigato Luca Iocchi Joachim Denzler VLM 22 2 0 28 Sep 2021
SAU: Smooth activation function using convolution with approximate identities Koushik Biswas Sandeep Kumar Shilpak Banerjee A. Pandey 11 6 0 27 Sep 2021
Using Soft Labels to Model Uncertainty in Medical Image Segmentation Joao Lourencco Silva Arlindo L. Oliveira UQCV 16 19 0 26 Sep 2021
$L$^{2}$NAS: Learning to Optimize Neural Architectures via Continuous-Action Reinforcement Learning$ L $^{2}$ NAS: Learning to Optimize Neural Architectures via Continuous-Action Reinforcement Learning Keith G. Mills Fred X. Han Mohammad Salameh Seyed Saeed Changiz Rezaei Linglong Kong Wei Lu Shuo Lian Shangling Jui Di Niu 19 10 0 25 Sep 2021
Rapid detection and recognition of whole brain activity in a freely behaving Caenorhabditis elegans Yuxiang Wu Shan Wu Xin Eric Wang Chengtian Lang Quanshi Zhang Quan Wen Tianqi Xu 13 8 0 22 Sep 2021
Search For Deep Graph Neural Networks Guosheng Feng Chunnan Wang Hongzhi Wang GNN 29 23 0 21 Sep 2021
Contrastive Learning of Subject-Invariant EEG Representations for Cross-Subject Emotion Recognition Xinke Shen Xianggen Liu Xin Hu Dan Zhang Sen Song 28 141 0 20 Sep 2021
Training Dynamic based data filtering may not work for NLP datasets Arka Talukdar Monika Dagar Prachi Gupta Varun G. Menon NoLa 35 3 0 19 Sep 2021
AutoInit: Analytic Signal-Preserving Weight Initialization for Neural Networks G. Bingham Risto Miikkulainen ODL 24 4 0 18 Sep 2021
Self-Supervised Neural Architecture Search for Imbalanced Datasets A. Timofeev Grigorios G. Chrysos V. Cevher OOD 25 5 0 17 Sep 2021
An End-to-End Transformer Model for 3D Object Detection Ishan Misra Rohit Girdhar Armand Joulin 3DPC ViT 39 470 0 16 Sep 2021
FaceGuard: Proactive Deepfake Detection Yuankun Yang Chenyue Liang Hongyu Hè Xiaoyu Cao Neil Zhenqiang Gong PICV WIGM 41 21 0 13 Sep 2021
No True State-of-the-Art? OOD Detection Methods are Inconsistent across Datasets Fahim Tajwar Ananya Kumar Sang Michael Xie Percy Liang OODD 22 21 0 12 Sep 2021
ErfAct and Pserf: Non-monotonic Smooth Trainable Activation Functions Koushik Biswas Sandeep Kumar Shilpak Banerjee A. Pandey 44 13 0 09 Sep 2021
Fine-grained Data Distribution Alignment for Post-Training Quantization Yunshan Zhong Mingbao Lin Mengzhao Chen Ke Li Yunhang Shen Fei Chao Yongjian Wu Rongrong Ji MQ 84 19 0 09 Sep 2021
TrAISformer -- A Transformer Network with Sparse Augmented Data Representation and Cross Entropy Loss for AIS-based Vessel Trajectory Prediction Duong Nguyen Ronan Fablet 19 24 0 08 Sep 2021
Robust fine-tuning of zero-shot models Mitchell Wortsman Gabriel Ilharco Jong Wook Kim Mike Li Simon Kornblith ... Raphael Gontijo-Lopes Hannaneh Hajishirzi Ali Farhadi Hongseok Namkoong Ludwig Schmidt VLM 26 688 0 04 Sep 2021
Access Control Using Spatially Invariant Permutation of Feature Maps for Semantic Segmentation Models Hiroki Ito Maungmaung Aprilpyone Hitoshi Kiya 18 5 0 03 Sep 2021
Dead Pixel Test Using Effective Receptive Field Bum Jun Kim Hyeyeon Choi Hyeonah Jang Dong Gu Lee Wonseok Jeong Sang Woo Kim 19 25 0 31 Aug 2021
Tune It or Don't Use It: Benchmarking Data-Efficient Image Classification Lorenzo Brigato Björn Barz Luca Iocchi Joachim Denzler 30 16 0 30 Aug 2021
LocTex: Learning Data-Efficient Visual Representations from Localized Textual Supervision Zhijian Liu Simon Stent Jie Li John Gideon Song Han VLM 22 10 0 26 Aug 2021
PocketNet: Extreme Lightweight Face Recognition Network using Neural Architecture Search and Multi-Step Knowledge Distillation Fadi Boutros Patrick Siebke Marcel Klemt Naser Damer Florian Kirchbuchner Arjan Kuijper CVBM 17 63 0 24 Aug 2021
Supervised Compression for Resource-Constrained Edge Computing Systems Yoshitomo Matsubara Ruihan Yang Marco Levorato Stephan Mandt 14 56 0 21 Aug 2021
SemiFed: Semi-supervised Federated Learning with Consistency and Pseudo-Labeling Haowen Lin Jian Lou Li Xiong Cyrus Shahabi FedML 21 56 0 21 Aug 2021
Online Continual Learning with Natural Distribution Shifts: An Empirical Study with Visual Data Zhipeng Cai Ozan Sener V. Koltun CLL 15 83 0 20 Aug 2021
Contrastive Language-Image Pre-training for the Italian Language Federico Bianchi Giuseppe Attanasio Raphael Pisoni Silvia Terragni Gabriele Sarti S. Lakshmi VLM CLIP 27 29 0 19 Aug 2021
Adaptive Graph Convolution for Point Cloud Analysis Hao Zhou Yidan Feng Mingsheng Fang Mingqiang Wei J. Qin Tong Lu 3DPC 39 134 0 18 Aug 2021
MOI-Mixer: Improving MLP-Mixer with Multi Order Interactions in Sequential Recommendation Hojoon Lee Dongyoon Hwang Sunghwan Hong Changyeon Kim Seungryong Kim Jaegul Choo 24 10 0 17 Aug 2021
Towards Efficient and Data Agnostic Image Classification Training Pipeline for Embedded Systems K. Prokofiev V. Sovrasov 3DH 19 2 0 16 Aug 2021
WikiChurches: A Fine-Grained Dataset of Architectural Styles with Real-World Challenges Björn Barz Joachim Denzler 36 7 0 16 Aug 2021
Logit Attenuating Weight Normalization Aman Gupta R. Ramanath Jun Shi Anika Ramachandran Sirou Zhou Mingzhou Zhou S. Keerthi 34 1 0 12 Aug 2021
Joint Multi-Object Detection and Tracking with Camera-LiDAR Fusion for Autonomous Driving Kemiao Huang Qi Hao 3DPC VOT 13 64 0 10 Aug 2021
Unsupervised Learning of Debiased Representations with Pseudo-Attributes Seonguk Seo Joon-Young Lee Bohyung Han FaML 68 48 0 06 Aug 2021
DPT: Deformable Patch-based Transformer for Visual Recognition Zhiyang Chen Yousong Zhu Chaoyang Zhao Guosheng Hu Wei Zeng Jinqiao Wang Ming Tang ViT 16 98 0 30 Jul 2021
StarEnhancer: Learning Real-Time and Style-Aware Image Enhancement Yuda Song Hui Qian Xin Du 10 47 0 27 Jul 2021
Clustering by Maximizing Mutual Information Across Views Kien Do T. Tran Svetha Venkatesh VLM SSL 11 37 0 24 Jul 2021
Clipped Hyperbolic Classifiers Are Super-Hyperbolic Classifiers Yunhui Guo Xudong Wang Yubei Chen Stella X. Yu 18 45 0 23 Jul 2021
A Deep Learning-based Quality Assessment and Segmentation System with a Large-scale Benchmark Dataset for Optical Coherence Tomographic Angiography Image Yu-Fang Wang Yiqing Shen Meng Yuan Jing Xu B. Yang Chicheng Liu Wenjia Cai Weijing Cheng Wei Wang 19 18 0 22 Jul 2021
ReSSL: Relational Self-Supervised Learning with Weak Augmentation Mingkai Zheng Shan You Fei-Yue Wang Chao Qian Changshui Zhang Xiaogang Wang Chang Xu 21 112 0 20 Jul 2021
Neural Architecture Search using Covariance Matrix Adaptation Evolution Strategy Nilotpal Sinha Kuan-Wen Chen 16 5 0 15 Jul 2021
Training Compact CNNs for Image Classification using Dynamic-coded Filter Fusion Mingbao Lin Bohong Chen Fei Chao Rongrong Ji VLM 25 23 0 14 Jul 2021
Synthesis in Style: Semantic Segmentation of Historical Documents using Synthetic Data Christian Bartz H. Rätz Joseph Bethge Christoph Meinel Haojin Yang 18 6 0 14 Jul 2021
KOALA: A Kalman Optimization Algorithm with Loss Adaptivity A. Davtyan Sepehr Sameni L. Cerkezi Givi Meishvili Adam Bielski Paolo Favaro ODL 51 2 0 07 Jul 2021
Reinforcement Learning for Abstractive Question Summarization with Question-aware Semantic Rewards S. Yadav D. Gupta Asma Ben Abacha Dina Demner-Fushman OffRL 14 34 0 01 Jul 2021