Federated Training of Dual Encoding Models on Small Non-IID Client
Datasets

Federated Training of Dual Encoding Models on Small Non-IID Client Datasets

30 September 2022

Raviteja Vemulapalli

Warren Morningstar

Philip Mansfield

Arash Afkanpour

Papers citing "Federated Training of Dual Encoding Models on Small Non-IID Client Datasets"

9 / 9 papers shown

Title
Federated Self-supervised Learning for Heterogeneous Clients Disha Makhija Nhat Ho Joydeep Ghosh FedML 41 25 0 25 May 2022
Robust and Efficient Medical Imaging with Self-Supervision Shekoofeh Azizi Laura J. Culp Jan Freyberg Basil Mustafa Sebastien Baur ... Geoffrey E. Hinton N. Houlsby Alan Karthikesalingam Mohammad Norouzi Vivek Natarajan OOD 63 58 0 19 May 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 258 7,412 0 11 Nov 2021
SSFL: Tackling Label Deficiency in Federated Learning via Personalized Self-Supervision Chaoyang He Zhengyu Yang Erum Mushtaq Sunwoo Lee Mahdi Soltanolkotabi A. Avestimehr FedML 90 36 0 06 Oct 2021
A Field Guide to Federated Optimization Jianyu Wang Zachary B. Charles Zheng Xu Gauri Joshi H. B. McMahan ... Mi Zhang Tong Zhang Chunxiang Zheng Chen Zhu Wennan Zhu FedML 173 410 0 14 Jul 2021
Understanding self-supervised Learning Dynamics without Contrastive Pairs Yuandong Tian Xinlei Chen Surya Ganguli SSL 138 278 0 12 Feb 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 293 3,683 0 11 Feb 2021
BYOL works even without batch statistics Pierre Harvey Richemond Jean-Bastien Grill Florent Altché Corentin Tallec Florian Strub ... Samuel L. Smith Soham De Razvan Pascanu Bilal Piot Michal Valko SSL 242 114 0 20 Oct 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 238 3,359 0 09 Mar 2020