DIMAT: Decentralized Iterative Merging-And-Training for Deep Learning
Models

DIMAT: Decentralized Iterative Merging-And-Training for Deep Learning Models

11 April 2024

Nastaran Saadati

Joshua R. Waite

Aditya Balu

Soumik Sarkar

Papers citing "DIMAT: Decentralized Iterative Merging-And-Training for Deep Learning Models"

4 / 4 papers shown

Title
Git Re-Basin: Merging Models modulo Permutation Symmetries Samuel K. Ainsworth J. Hayase S. Srinivasa MoMe 239 313 0 11 Sep 2022
Decentralized Deep Learning for Multi-Access Edge Computing: A Survey on Communication Efficiency and Trustworthiness Yuwei Sun H. Ochiai Hiroshi Esaki FedML 64 44 0 30 Jul 2021
DecentLaM: Decentralized Momentum SGD for Large-batch Deep Training Kun Yuan Yiming Chen Xinmeng Huang Yingya Zhang Pan Pan Yinghui Xu W. Yin MoE 46 60 0 24 Apr 2021
RepVGG: Making VGG-style ConvNets Great Again Xiaohan Ding X. Zhang Ningning Ma Jungong Han Guiguang Ding Jian-jun Sun 117 1,484 0 11 Jan 2021