KOALA: A Kalman Optimization Algorithm with Loss Adaptivity

7 July 2021

Papers citing "KOALA: A Kalman Optimization Algorithm with Loss Adaptivity"

5 / 5 papers shown

Title
LoKO: Low-Rank Kalman Optimizer for Online Fine-Tuning of Large Models Hossein Abdi Mingfei Sun Andi Zhang Samuel Kaski Wei Pan 18 0 0 15 Oct 2024
Signal Processing Meets SGD: From Momentum to Filter Zhipeng Yao Guisong Chang Jiaqi Zhang Qi Zhang Dazhou Li Yu Zhang ODL 16 0 0 06 Nov 2023
On the distance between two neural networks and the stability of learning Jeremy Bernstein Arash Vahdat Yisong Yue Ming-Yu Liu ODL 184 44 0 09 Feb 2020
diffGrad: An Optimization Method for Convolutional Neural Networks S. Dubey Soumendu Chakraborty S. K. Roy Snehasis Mukherjee S. Singh B. B. Chaudhuri ODL 38 160 0 12 Sep 2019
L4: Practical loss-based stepsize adaptation for deep learning Michal Rolínek Georg Martius ODL 29 63 0 14 Feb 2018