Unbiased Online Recurrent Optimization

16 February 2017

Papers citing "Unbiased Online Recurrent Optimization"

28 / 28 papers shown

Title
On Unbiased Low-Rank Approximation with Minimum Distortion Leighton Barnes Stephen Cameron Benjamin Howard 19 0 0 12 May 2025
Small Clips, Big Gains: Learning Long-Range Refocused Temporal Information for Video Super-Resolution Xingyu Zhou Wei Long Jingbo Lu Shiyin Jiang Weiyi You Haifeng Wu Shuhang Gu 48 0 0 04 May 2025
Explanation-Driven Interventions for Artificial Intelligence Model Customization: Empowering End-Users to Tailor Black-Box AI in Rhinocytology Andrea Esposito Miriana Calvano Antonio Curci Francesco Greco Rosa Lanzilotti Antonio Piccinno 28 0 0 07 Apr 2025
Convergence Analysis of Real-time Recurrent Learning (RTRL) for a class of Recurrent Neural Networks Samuel Chun-Hei Lam Justin A. Sirignano K. Spiliopoulos 58 0 0 14 Jan 2025
Mind the truncation gap: challenges of learning on dynamic graphs with recurrent architectures Joao Bravo Jacopo Bono Pedro Saleiro Hugo Ferreira P. Bizarro 45 0 0 31 Dec 2024
Bio-Inspired Mamba: Temporal Locality and Bioplausible Learning in Selective State Space Models Jiahao Qin Mamba AI4CE 28 1 0 17 Sep 2024
Real-Time Recurrent Reinforcement Learning Julian Lemmel Radu Grosu 34 2 0 08 Nov 2023
Variance-Reduced Gradient Estimation via Noise-Reuse in Online Evolution Strategies Oscar Li James Harrison Jascha Narain Sohl-Dickstein Virginia Smith Luke Metz 54 5 0 21 Apr 2023
Online Training Through Time for Spiking Neural Networks Mingqing Xiao Qingyan Meng Zongpeng Zhang D.K. He Zhouchen Lin 45 60 0 09 Oct 2022
Amortized Proximal Optimization Juhan Bae Paul Vicol Jeff Z. HaoChen Roger C. Grosse ODL 29 14 0 28 Feb 2022
Tutorial on amortized optimization Brandon Amos OffRL 75 43 0 01 Feb 2022
Gradient Descent on Neurons and its Link to Approximate Second-Order Optimization Frederik Benzing ODL 43 23 0 28 Jan 2022
An Empirical Analysis of Recurrent Learning Algorithms In Neural Lossy Image Compression Systems A. Mali Alexander Ororbia Daniel Kifer L. Giles 19 4 0 27 Jan 2022
Unbiased Gradient Estimation in Unrolled Computation Graphs with Persistent Evolution Strategies Paul Vicol Luke Metz Jascha Narain Sohl-Dickstein 27 67 0 27 Dec 2021
Brain-Inspired Learning on Neuromorphic Substrates Friedemann Zenke Emre Neftci 38 89 0 22 Oct 2020
Incremental Training of a Recurrent Neural Network Exploiting a Multi-Scale Dynamic Memory Antonio Carta A. Sperduti D. Bacciu CLL 28 10 0 29 Jun 2020
Predictive Coding Approximates Backprop along Arbitrary Computation Graphs Beren Millidge Alexander Tschantz Christopher L. Buckley 30 118 0 07 Jun 2020
A Unified Framework of Online Learning Algorithms for Training Recurrent Neural Networks O. Marschall Kyunghyun Cho Cristina Savin FedML 36 72 0 05 Jul 2019
Adaptively Truncating Backpropagation Through Time to Control Gradient Bias Christopher Aicher N. Foti E. Fox MQ 30 32 0 17 May 2019
Optimal Kronecker-Sum Approximation of Real Time Recurrent Learning Frederik Benzing M. Gauy Asier Mujika A. Martinsson Angelika Steger 23 22 0 11 Feb 2019
Continual Learning of Recurrent Neural Networks by Locally Aligning Distributed Representations Alexander Ororbia A. Mali C. Lee Giles Daniel Kifer 21 63 0 17 Oct 2018
Approximating Real-Time Recurrent Learning with Random Kronecker Factors Asier Mujika Florian Meier Angelika Steger 19 60 0 28 May 2018
Low-pass Recurrent Neural Networks - A memory architecture for longer-term correlation discovery T. Stepleton Razvan Pascanu Will Dabney Siddhant M. Jayakumar Hubert Soyer Rémi Munos 16 4 0 13 May 2018
Sparse Attentive Backtracking: Long-Range Credit Assignment in Recurrent Networks Nan Rosemary Ke Anirudh Goyal O. Bilaniuk Jonathan Binas Laurent Charlin C. Pal Yoshua Bengio 30 15 0 07 Nov 2017
Unbiasing Truncated Backpropagation Through Time Corentin Tallec Yann Ollivier 25 75 0 23 May 2017
Online Natural Gradient as a Kalman Filter Yann Ollivier 34 67 0 01 Mar 2017
Decoupled Neural Interfaces using Synthetic Gradients Max Jaderberg Wojciech M. Czarnecki Simon Osindero Oriol Vinyals Alex Graves David Silver Koray Kavukcuoglu 44 353 0 18 Aug 2016
Equilibrium Propagation: Bridging the Gap Between Energy-Based Models and Backpropagation B. Scellier Yoshua Bengio 22 481 0 16 Feb 2016