Random initialisations performing above chance and how to find them

15 September 2022

Papers citing "Random initialisations performing above chance and how to find them"

7 / 7 papers shown

Title
Analyzing the Role of Permutation Invariance in Linear Mode Connectivity Keyao Zhan Puheng Li Lei Wu MoMe 79 0 0 13 Mar 2025
Training trajectories, mini-batch losses and the curious role of the learning rate Mark Sandler A. Zhmoginov Max Vladymyrov Nolan Miller ODL 13 10 0 05 Jan 2023
Wasserstein Barycenter-based Model Fusion and Linear Mode Connectivity of Neural Networks A. K. Akash Sixu Li Nicolas García Trillos 24 12 0 13 Oct 2022
Stochastic optimization on matrices and a graphon McKean-Vlasov limit Zaïd Harchaoui Sewoong Oh Soumik Pal Raghav Somani Raghavendra Tripathi 20 2 0 02 Oct 2022
Git Re-Basin: Merging Models modulo Permutation Symmetries Samuel K. Ainsworth J. Hayase S. Srinivasa MoMe 252 313 0 11 Sep 2022
Gradient Descent on Neurons and its Link to Approximate Second-Order Optimization Frederik Benzing ODL 37 23 0 28 Jan 2022
Optimizing Mode Connectivity via Neuron Alignment N. Joseph Tatro Pin-Yu Chen Payel Das Igor Melnyk P. Sattigeri Rongjie Lai MoMe 223 80 0 05 Sep 2020