An overview of gradient descent optimization algorithms

15 September 2016

Papers citing "An overview of gradient descent optimization algorithms"

50 / 1,022 papers shown

Title
EVHA: Explainable Vision System for Hardware Testing and Assurance -- An Overview Md. Mahfuz Al Hasan MD Tahsin Mostafiz Thomas An Le Jake Julia Nidish Vashistha S. Taheri Navid Asadizanjani 20 5 0 20 Jul 2022
Formal Algorithms for Transformers Mary Phuong Marcus Hutter 27 71 0 19 Jul 2022
A Survey of Decision Making in Adversarial Games Xiuxian Li Min Meng Yiguang Hong Jie-bin Chen AAML 41 14 0 16 Jul 2022
Automatic differentiation and the optimization of differential equation models in biology S. Frank 22 6 0 10 Jul 2022
StatMix: Data augmentation method that relies on image statistics in federated learning Dominik Lewy Jacek Mańdziuk M. Ganzha M. Paprzycki FedML 32 9 0 08 Jul 2022
Sociable and Ergonomic Human-Robot Collaboration through Action Recognition and Augmented Hierarchical Quadratic Programming Francesco Tassi Francesco Iodice Elena De Momi Arash Ajoudani 25 9 0 07 Jul 2022
A Solver + Gradient Descent Training Algorithm for Deep Neural Networks D. Ashok Vineel Nagisetty C. Srinivasa Vijay Ganesh 19 1 0 07 Jul 2022
Multi-Label Learning to Rank through Multi-Objective Optimization Debabrata Mahapatra Chaosheng Dong Yetian Chen Deqiang Meng Michinari Momma 26 13 0 07 Jul 2022
Automating the Design and Development of Gradient Descent Trained Expert System Networks Jeremy Straub 31 9 0 04 Jul 2022
$On bounds for norms of reparameterized ReLU artificial neural network parameters: sums of fractional powers of the Lipschitz norm control the network parameter vector$ On bounds for norms of reparameterized ReLU artificial neural network parameters: sums of fractional powers of the Lipschitz norm control the network parameter vector Arnulf Jentzen T. Kröger 30 0 0 27 Jun 2022
BeamsNet: A data-driven Approach Enhancing Doppler Velocity Log Measurements for Autonomous Underwater Vehicle Navigation Nadav Cohen Itzik Klein 19 38 0 27 Jun 2022
CTMQ: Cyclic Training of Convolutional Neural Networks with Multiple Quantization Steps Hyunjin Kim Jungwoon Shin Alberto A. Del Barrio MQ 21 1 0 26 Jun 2022
Data Leakage in Federated Averaging Dimitar I. Dimitrov Mislav Balunović Nikola Konstantinov Martin Vechev FedML 30 29 0 24 Jun 2022
Two-dimensional total absorption spectroscopy with conditional generative adversarial networks Cade Dembski M. Kuchera S. Liddick R. Ramanujan A. Spyrou GAN MedIm 16 0 0 23 Jun 2022
Open Set Classification of Untranscribed Handwritten Documents J. R. Prieto Juan José Flores Arellano Enrique Vidal Alejandro H. Toselli David Garrido Carlos Alonso 15 0 0 20 Jun 2022
ADBench: Anomaly Detection Benchmark Songqiao Han Xiyang Hu Hailiang Huang Mingqi Jiang Yue Zhao OOD 46 296 0 19 Jun 2022
0/1 Deep Neural Networks via Block Coordinate Descent Hui Zhang Shenglong Zhou Geoffrey Ye Li N. Xiu 43 7 0 19 Jun 2022
AI-based computer-aided diagnostic system of chest digital tomography synthesis: Demonstrating comparative advantage with X-ray-based AI systems Kyungsu Kim J. Lee S. Oh M. Chung 25 5 0 18 Jun 2022
Energy reconstruction for large liquid scintillator detectors with machine learning techniques: aggregated features approach Arsenii Gavrikov Y. Malyshkin F. Ratnikov 27 7 0 17 Jun 2022
Gradient-Based Adversarial and Out-of-Distribution Detection Jinsol Lee Mohit Prabhushankar Ghassan AlRegib UQCV 40 13 0 16 Jun 2022
Open-Set Recognition with Gradient-Based Representations Jinsol Lee Ghassan AlRegib VLM BDL 27 9 0 16 Jun 2022
MBGDT:Robust Mini-Batch Gradient Descent Hanming Wang Haozheng Luo Yue Wang 21 4 0 14 Jun 2022
A Stochastic Proximal Method for Nonsmooth Regularized Finite Sum Optimization Dounia Lakhmiri D. Orban Andrea Lodi 17 0 0 14 Jun 2022
Anchor Sampling for Federated Learning with Partial Client Participation Feijie Wu Song Guo Zhihao Qu Shiqi He Ziming Liu Jing Gao FedML 38 12 0 13 Jun 2022
Stochastic Gradient Descent without Full Data Shuffle Lijie Xu Shuang Qiu Binhang Yuan Jiawei Jiang Cédric Renggli ... Guoliang Li Ji Liu Wentao Wu Jieping Ye Ce Zhang 25 2 0 12 Jun 2022
Deep Leakage from Model in Federated Learning Zihao Zhao Mengen Luo Wenbo Ding FedML 32 14 0 10 Jun 2022
Binarizing Split Learning for Data Privacy Enhancement and Computation Reduction Ngoc Duy Pham A. Abuadbba Yansong Gao K. Phan Naveen Chilamkurti 24 35 0 10 Jun 2022
Towards Self-supervised and Weight-preserving Neural Architecture Search Zhuowei Li Yibo Gao Zhenzhou Zha Hu Zhiqiang Qing Xia Shaoting Zhang Dimitris N. Metaxas 27 4 0 08 Jun 2022
Hidden Markov Models with Momentum Andrew Miller Fabio Di Troia Mark Stamp 16 0 0 08 Jun 2022
Subject Membership Inference Attacks in Federated Learning Anshuman Suri Pallika H. Kanani Virendra J. Marathe Daniel W. Peterson 30 25 0 07 Jun 2022
Model-Informed Generative Adversarial Network (MI-GAN) for Learning Optimal Power Flow Yuxuan Li Chaoyue Zhao Chenang Liu 30 4 0 04 Jun 2022
The Phenomenon of Policy Churn Tom Schaul André Barreto John Quan Georg Ostrovski 44 26 0 01 Jun 2022
Linear Leaky-Integrate-and-Fire Neuron Model Based Spiking Neural Networks and Its Mapping Relationship to Deep Neural Networks Si-wei Lu Fengyi Xu 25 23 0 31 May 2022
Connecting adversarial attacks and optimal transport for domain adaptation Arip Asadulaev V. Shutov Alexander Korotin Alexander Panfilov Andrey Filchenkov OOD OT 23 0 0 30 May 2022
SemAffiNet: Semantic-Affine Transformation for Point Cloud Segmentation Ziyi Wang Yongming Rao Xumin Yu Jie Zhou Jiwen Lu 3DPC 38 15 0 26 May 2022
Neuro-Symbolic Learning of Answer Set Programs from Raw Data Daniel Cunnington Mark Law Jorge Lobo Alessandra Russo NAI 38 8 0 25 May 2022
Robust Quantity-Aware Aggregation for Federated Learning Jingwei Yi Fangzhao Wu Huishuai Zhang Bin Zhu Tao Qi Guangzhong Sun Xing Xie FedML 43 2 0 22 May 2022
A Comprehensive Study on Artificial Intelligence Algorithms to Implement Safety Using Communication Technologies Rafia Inam Alberto Hata Vlasjov Prifti Sara Abbaspour Asadollah 24 2 0 17 May 2022
Browser-based Hyperbolic Visualization of Graphs Jacob Miller Stephen Kobourov Vahan Huroyan 13 5 0 16 May 2022
Heavy-Tail Phenomenon in Decentralized SGD Mert Gurbuzbalaban Yuanhan Hu Umut Simsekli Kun Yuan Lingjiong Zhu 43 8 0 13 May 2022
GPN: A Joint Structural Learning Framework for Graph Neural Networks Qianggang Ding Deheng Ye Tingyang Xu P. Zhao 26 0 0 12 May 2022
Spatio-Temporal Transformer for Dynamic Facial Expression Recognition in the Wild Fuyan Ma Bin Sun Shutao Li ViT 19 31 0 10 May 2022
PI-NLF: A Proportional-Integral Approach for Non-negative Latent Factor Analysis Ye Yuan Xin Luo 16 0 0 05 May 2022
Byzantine Fault Tolerance in Distributed Machine Learning : a Survey Djamila Bouhata Hamouma Moumen Moumen Hamouma Ahcène Bounceur AI4CE 34 7 0 05 May 2022
Towards Real-time Traffic Sign and Traffic Light Detection on Embedded Systems Oshada Jayasinghe S. Hemachandra Damith Anhettigama Shenali Kariyawasam Tharindu Wickremasinghe Chalani Ekanayake Ranga Rodrigo P. Jayasekara 17 14 0 05 May 2022
Gradient Descent, Stochastic Optimization, and Other Tales Jun Lu 22 8 0 02 May 2022
Use All The Labels: A Hierarchical Multi-Label Contrastive Learning Framework Shu Zhen Zhang Ran Xu Caiming Xiong Chetan Ramaiah SSL 28 68 0 27 Apr 2022
Particle algorithms for maximum likelihood training of latent variable models Juan Kuntz Jen Ning Lim A. M. Johansen FedML 13 21 0 27 Apr 2022
Online Deep Learning from Doubly-Streaming Data H. Lian John Scovil Atwood Bo-Jian Hou Jian Wu Yi He 26 10 0 25 Apr 2022
Competitive Physics Informed Networks Qi Zeng Yash Kothari Spencer H. Bryngelson F. Schafer PINN 27 21 0 23 Apr 2022