v1v2v3v4 (latest)

On the Variance of the Adaptive Learning Rate and Beyond

8 August 2019

Xiaodong Liu

ArXiv (abs)PDF HTML Github (2548★)

Papers citing "On the Variance of the Adaptive Learning Rate and Beyond"

50 / 864 papers shown

Title
Hierarchical Attention-based Age Estimation and Bias Estimation Shakediel Hiba Y. Keller CVBM 75 11 0 17 Mar 2021
Towards Indirect Top-Down Road Transport Emissions Estimation R. Mukherjee Derek M. Rollend Gordon A. Christie Armin Hadzic Sally Matson Anshu Saksena Marisa Hughes 27 7 0 16 Mar 2021
Learning spectro-temporal representations of complex sounds with parameterized neural networks Rachid Riad Julien Karadayi Anne-Catherine Bachoud-Lévi Emmanuel Dupoux 49 7 0 12 Mar 2021
Distributed Reinforcement Learning for Flexible and Efficient UAV Swarm Control Federico Venturini Federico Mason Francesco Pase Federico Chiariotti Alberto Testolin Andrea Zanella M. Zorzi 68 35 0 08 Mar 2021
Auto-tuning of Deep Neural Networks by Conflicting Layer Removal David Peer Sebastian Stabinger A. Rodríguez-Sánchez 35 4 0 07 Mar 2021
Enhanced 3D Human Pose Estimation from Videos by using Attention-Based Neural Network with Dilated Convolutions Ruixu Liu Ju Shen He Wang Chong Chen S. Cheung V. Asari 3DH 70 31 0 04 Mar 2021
RotoGrad: Gradient Homogenization in Multitask Learning Adrián Javaloy Isabel Valera 106 89 0 03 Mar 2021
LQResNet: A Deep Neural Network Architecture for Learning Dynamic Processes P. Goyal P. Benner AI4CE 33 11 0 03 Mar 2021
Reverb Conversion of Mixed Vocal Tracks Using an End-to-end Convolutional Deep Neural Network Junghyun Koo Seungryeol Paik Kyogu Lee 71 16 0 03 Mar 2021
When Attention Meets Fast Recurrence: Training Language Models with Reduced Compute Tao Lei RALM VLM 149 49 0 24 Feb 2021
Probabilistic Spatial Analysis in Quantitative Microscopy with Uncertainty-Aware Cell Detection using Deep Bayesian Regression of Density Maps Alvaro Gomariz Tiziano Portenier C. Nombela-Arrieta O. Goksel UQCV 60 7 0 23 Feb 2021
Improving Deep Learning Sound Events Classifiers using Gram Matrix Feature-wise Correlations Antonio Joia Neto André G. C. Pacheco D. Luvizon 35 4 0 23 Feb 2021
ISCL: Interdependent Self-Cooperative Learning for Unpaired Image Denoising Kanggeun Lee Won-Ki Jeong 56 36 0 19 Feb 2021
AI-SARAH: Adaptive and Implicit Stochastic Recursive Gradient Methods Zheng Shi Abdurakhmon Sadiev Nicolas Loizou Peter Richtárik Martin Takávc ODL 84 13 0 19 Feb 2021
Towards Solving the DeepFake Problem : An Analysis on Improving DeepFake Detection using Dynamic Face Augmentation Sowmen Das Selim S. Seferbekov Arup Datta Md. Saiful Islam Md Ruhul Amin CVBM 75 66 0 18 Feb 2021
GradInit: Learning to Initialize Neural Networks for Stable and Efficient Training Chen Zhu Renkun Ni Zheng Xu Kezhi Kong Wenjie Huang Tom Goldstein ODL 121 56 0 16 Feb 2021
A Sub-band Approach to Deep Denoising Wavelet Networks and a Frequency-adaptive Loss for Perceptual Quality Çağlar Aytekin S. Alenius D. Paliy Juuso Grén 20 3 0 16 Feb 2021
Hierarchical Transformer-based Large-Context End-to-end ASR with Large-Context Knowledge Distillation Ryo Masumura Naoki Makishima Mana Ihori Akihiko Takashima Tomohiro Tanaka Shota Orihashi 77 29 0 16 Feb 2021
PeriodNet: A non-autoregressive waveform generation model with a structure separating periodic and aperiodic components Yukiya Hono Shinji Takaki Kei Hashimoto Keiichiro Oura Yoshihiko Nankaku K. Tokuda 69 16 0 15 Feb 2021
Learning Intra-Batch Connections for Deep Metric Learning Jenny Seidenschwarz Ismail Elezi Laura Leal-Taixé FedML 81 54 0 15 Feb 2021
OmniDet: Surround View Cameras based Multi-task Visual Perception Network for Autonomous Driving Varun Ravi Kumar S. Yogamani Hazem Rashed Ganesh Sitsu Christian Witt Isabelle Leang Stefan Milz Patrick Mäder 106 92 0 15 Feb 2021
Estimating Nonplanar Flow from 2D Motion-blurred Widefield Microscopy Images via Deep Learning Adrian Shajkofci M. Liebling MedIm 37 0 0 14 Feb 2021
Improving Zero-shot Neural Machine Translation on Language-specific Encoders-Decoders Junwei Liao Yu Shi Ming Gong Linjun Shou Hong Qu Michael Zeng 58 11 0 12 Feb 2021
Onoma-to-wave: Environmental sound synthesis from onomatopoeic words Yuki Okamoto Keisuke Imoto Shinnosuke Takamichi Ryosuke Yamanishi Takahiro Fukumori Y. Yamashita 47 14 0 11 Feb 2021
An Adaptive Stochastic Sequential Quadratic Programming with Differentiable Exact Augmented Lagrangians Sen Na M. Anitescu Mladen Kolar 85 44 0 10 Feb 2021
Learning the exchange-correlation functional from nature with fully differentiable density functional theory M. F. Kasim S. Vinko 149 68 0 08 Feb 2021
Only a Matter of Style: Age Transformation Using a Style-Based Regression Model Yuval Alaluf Or Patashnik Daniel Cohen-Or 75 141 0 04 Feb 2021
Impact of Sound Duration and Inactive Frames on Sound Event Detection Performance Keisuke Imoto Sakiko Mishima Yumi Arai Reishi Kondo 50 20 0 03 Feb 2021
Gaze-based dual resolution deep imitation learning for high-precision dexterous robot manipulation Heecheol Kim Yoshiyuki Ohmura Yasuo Kuniyoshi 116 25 0 02 Feb 2021
Automated Deep Learning Analysis of Angiography Video Sequences for Coronary Artery Disease Chengyang Zhou Thao Vy Dinh Heyi Kong J. Yap K. Yeo H. Lee Kaicheng Liang 84 13 0 29 Jan 2021
Multilingual and cross-lingual document classification: A meta-learning approach Niels van der Heijden H. Yannakoudakis Pushkar Mishra Ekaterina Shutova VLM 70 24 0 27 Jan 2021
Multi-view Integration Learning for Irregularly-sampled Clinical Time Series Yurim Lee E. Jun Heung-Il Suk AI4TS 36 0 0 25 Jan 2021
Knowledge Generation -- Variational Bayes on Knowledge Graphs Florian Wolf BDL 27 0 0 21 Jan 2021
Improved parallel WaveGAN vocoder with perceptually weighted spectrogram loss Eunwoo Song Ryuichi Yamamoto Min-Jae Hwang Jin-Seob Kim Ohsung Kwon Jae-Min Kim 61 14 0 19 Jan 2021
Hyperspectral Image Classification-Traditional to Deep Models: A Survey for Future Prospects Muhammad Ahmad Sidrah Shabbir Swalpa Kumar Roy Danfeng Hong Xin Wu Jing Yao A. Khan Manuel Mazzara Salvatore Distefano Jocelyn Chanussot 170 260 0 15 Jan 2021
Density Compensated Unrolled Networks for Non-Cartesian MRI Reconstruction Zaccharie Ramzi Jean-Luc Starck P. Ciuciu 68 19 0 05 Jan 2021
Advances in Electron Microscopy with Deep Learning Jeffrey M. Ede 105 3 0 04 Jan 2021
Optimizing Deeper Transformers on Small Datasets Peng Xu Dhruv Kumar Wei Yang Wenjie Zi Keyi Tang Chenyang Huang Jackie C.K. Cheung S. Prince Yanshuai Cao AI4CE 113 69 0 30 Dec 2020
Variance Reduction on General Adaptive Stochastic Mirror Descent Wenjie Li Zhanyu Wang Yichen Zhang Guang Cheng 73 4 0 26 Dec 2020
Self-Supervised Multimodal Domino: in Search of Biomarkers for Alzheimer's Disease A. Fedorov Tristan Sylvain Eloy P. T. Geenjaar Margaux Luck Lei Wu T. DeRamus Alex Kirilin Dmitry Bleklov Vince D. Calhoun Sergey Plis SSL 68 13 0 25 Dec 2020
On self-supervised multi-modal representation learning: An application to Alzheimer's disease A. Fedorov Lei Wu Tristan Sylvain Margaux Luck T. DeRamus Dmitry Bleklov Sergey Plis Vince D. Calhoun SSL 30 16 0 25 Dec 2020
Time-Travel Rephotography Xuan Luo X. Zhang Paul D. Yoo Ricardo Martín Brualla Jason Lawrence S. M. Seitz 125 32 0 22 Dec 2020
Dynamic Traffic Modeling From Overhead Imagery Scott Workman Nathan Jacobs 63 17 0 18 Dec 2020
On Modality Bias in the TVQA Dataset T. Winterbottom S. Xiao A. McLean Noura Al Moubayed 87 35 0 18 Dec 2020
Intrinsic Temporal Regularization for High-resolution Human Video Synthesis Lingbo Yang Zhanning Gao Peiran Ren Siwei Ma Wen Gao 3DH 121 1 0 11 Dec 2020
GNN-XML: Graph Neural Networks for Extreme Multi-label Text Classification Daoming Zong Shiliang Sun 41 9 0 10 Dec 2020
Noise2Kernel: Adaptive Self-Supervised Blind Denoising using a Dilated Convolutional Kernel Architecture Kanggeun Lee Won-Ki Jeong 64 18 0 07 Dec 2020
AI-enabled Prediction of eSports Player Performance Using the Data from Heterogeneous Sensors Anton Smerdov Evgeny Burnaev A. Somov Anton Stepanov 56 1 0 07 Dec 2020
SAM: Self-supervised Learning of Pixel-wise Anatomical Embeddings in Radiological Images K. Yan Jinzheng Cai D. Jin S. Miao Dazhou Guo Adam P. Harrison Youbao Tang Jing Xiao Jingjing Lu Le Lu MedIm 103 86 0 04 Dec 2020
Make One-Shot Video Object Segmentation Efficient Again Tim Meinhardt Laura Leal-Taixe VOS 51 42 0 03 Dec 2020