Learning compositional functions via multiplicative weight updates

v1v2 (latest)

Learning compositional functions via multiplicative weight updates

25 June 2020

Jeremy Bernstein

Anima Anandkumar

ArXiv (abs)PDF HTML

Papers citing "Learning compositional functions via multiplicative weight updates"

16 / 16 papers shown

Title
Understanding Gradient Orthogonalization for Deep Learning via Non-Euclidean Trust-Region Optimization Dmitry Kovalev 273 25 0 16 Mar 2025
Weight Clipping for Deep Continual and Reinforcement Learning Mohamed Elsayed Qingfeng Lan Clare Lyle A. Rupam Mahmood 231 16 0 01 Jul 2024
Analyzing and Improving the Training Dynamics of Diffusion ModelsComputer Vision and Pattern Recognition (CVPR), 2023 Tero Karras M. Aittala J. Lehtinen Janne Hellsten Timo Aila S. Laine 279 295 0 05 Dec 2023
Graph Matching via convex relaxation to the simplexFoundations of Data Science (FDS), 2023 Ernesto Araya Valdivia Hemant Tyagi 106 3 0 31 Oct 2023
A Spectral Condition for Feature Learning Greg Yang James B. Simon Jeremy Bernstein 237 53 0 26 Oct 2023
Non-negative isomorphic neural networks for photonic neuromorphic accelerators Manos Kirtas Nikolaos Passalis N. Pleros Anastasios Tefas 83 1 0 02 Oct 2023
Multiplicative update rules for accelerating deep learning training and increasing robustnessNeurocomputing (Neurocomputing), 2023 Manos Kirtas Nikolaos Passalis Anastasios Tefas AAML OOD 142 5 0 14 Jul 2023
The Lie-Group Bayesian Learning RuleInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2023 E. M. Kıral Thomas Möllenhoff Mohammad Emtiyaz Khan BDL 133 5 0 08 Mar 2023
Adaptive Gradient Methods with Local Guarantees Zhou Lu Wenhan Xia Sanjeev Arora Elad Hazan ODL 263 11 0 02 Mar 2022
Online-Learning Deep Neuro-Adaptive Dynamic Inversion Controller for Model Free Control Nathan Lutes K. Krishnamurthy Venkata Sriram Siddhardh Nadendla S. Balakrishnan 89 0 0 21 Jul 2021
An Embedding of ReLU Networks and an Analysis of their IdentifiabilityConstructive approximation (Constr. Approx.), 2021 Pierre Stock Rémi Gribonval 229 23 0 20 Jul 2021
$Boosting Certified $\ell_\infty$ Robustness with EMA Method and Ensemble Model$ Boosting Certified $\ell_\infty$ Robustness with EMA Method and Ensemble Model Binghui Li Shijie Xin Qizhe Zhang 42 0 0 01 Jul 2021
LNS-Madam: Low-Precision Training in Logarithmic Number System using Multiplicative Weight UpdateIEEE transactions on computers (IEEE Trans. Comput.), 2021 Jiawei Zhao Steve Dai Rangharajan Venkatesan Brian Zimmer Mustafa Ali Xuan Li Brucek Khailany B. Dally Anima Anandkumar MQ 111 18 0 26 Jun 2021
Multiplicative Reweighting for Robust Neural Network OptimizationSIAM Journal of Imaging Sciences (SIAM J. Imaging Sci.), 2021 Noga Bar Tomer Koren Raja Giryes OOD NoLa 399 9 0 24 Feb 2021
Learning by Turning: Neural Architecture Aware OptimisationInternational Conference on Machine Learning (ICML), 2021 Yang Liu Jeremy Bernstein M. Meister Yisong Yue ODL 217 28 0 14 Feb 2021
Probabilistic Trust Intervals for Out of Distribution Detection Gagandeep Singh Deepak Mishra UQCV AAML OOD 91 0 0 02 Feb 2021