Improving Optimization for Models With Continuous Symmetry Breaking

v1v2v3 (latest)

Improving Optimization for Models With Continuous Symmetry Breaking

8 March 2018

Kushagra Pandey

ArXiv (abs)PDF HTML

Papers citing "Improving Optimization for Models With Continuous Symmetry Breaking"

10 / 10 papers shown

Title
Symmetry in Neural Network Parameter Spaces Bo Zhao Robin Walters Rose Yu 305 6 0 16 Jun 2025
Level Set Teleportation: An Optimization Perspective Aaron Mishkin A. Bietti Robert Mansel Gower 262 1 0 05 Mar 2024
Investigation into the Training Dynamics of Learned OptimizersInternational Conference on Agents and Artificial Intelligence (ICAART), 2023 Jan Sobotka Petr Simánek Daniel Vasata 197 0 0 12 Dec 2023
Symmetries, flat minima, and the conserved quantities of gradient flowInternational Conference on Learning Representations (ICLR), 2022 Bo Zhao I. Ganev Robin Walters Rose Yu Nima Dehmamy 316 26 0 31 Oct 2022
Symmetry Teleportation for Accelerated OptimizationNeural Information Processing Systems (NeurIPS), 2022 B. Zhao Nima Dehmamy Robin Walters Rose Yu ODL 373 28 0 21 May 2022
Noether's Learning Dynamics: Role of Symmetry Breaking in Neural NetworksNeural Information Processing Systems (NeurIPS), 2021 Hidenori Tanaka D. Kunin 265 39 0 06 May 2021
Regularized linear autoencoders recover the principal components, eventuallyNeural Information Processing Systems (NeurIPS), 2020 Xuchan Bao James Lucas Sushant Sachdeva Roger C. Grosse 165 13 0 13 Jul 2020
Tightening Bounds for Variational Inference by Revisiting Perturbation TheoryJournal of Statistical Mechanics: Theory and Experiment (JSTAT), 2019 Kushagra Pandey Cheng Zhang Manfred Opper Stephan Mandt 168 3 0 30 Sep 2019
A Quantum Field Theory of Representation Learning Kushagra Pandey Stephan Mandt AI4CE 75 0 0 04 Jul 2019
Augmenting and Tuning Knowledge Graph EmbeddingsConference on Uncertainty in Artificial Intelligence (UAI), 2019 Kushagra Pandey Farnood Salehi Stephan Mandt 116 8 0 01 Jul 2019