Understanding the Role of Layer Normalization in Label-Skewed Federated Learning

18 August 2023

Papers citing "Understanding the Role of Layer Normalization in Label-Skewed Federated Learning"

4 / 4 papers shown

Title
On the Expressivity Role of LayerNorm in Transformers' Attention Shaked Brody Shiyu Jin Xinghao Zhu MoE 61 30 0 04 May 2023
Rethinking Normalization Methods in Federated Learning Zhixu Du Jingwei Sun Ang Li Pin-Yu Chen Jianyi Zhang H. Li Yiran Chen FedML 29 28 0 07 Oct 2022
Towards Understanding and Mitigating Dimensional Collapse in Heterogeneous Federated Learning Yujun Shi Jian Liang Wenqing Zhang Vincent Y. F. Tan Song Bai FedML 69 55 0 01 Oct 2022
FedBN: Federated Learning on Non-IID Features via Local Batch Normalization Xiaoxiao Li Meirui Jiang Xiaofei Zhang Michael Kamp Qi Dou OOD FedML 168 786 0 15 Feb 2021