Neural Collapse in Deep Linear Networks: From Balanced to Imbalanced Data

1 January 2023

Papers citing "Neural Collapse in Deep Linear Networks: From Balanced to Imbalanced Data"

25 / 25 papers shown

Title
Neural Collapse Inspired Knowledge Distillation Shuoxi Zhang Zijian Song Kun He 67 1 0 16 Dec 2024
Understanding Representation of Deep Equilibrium Models from Neural Collapse Perspective Haixiang Sun Ye Shi 23 0 0 30 Oct 2024
The Persistence of Neural Collapse Despite Low-Rank Bias: An Analytic Perspective Through Unconstrained Features Connall Garrod Jonathan P. Keating 34 1 0 30 Oct 2024
The Fair Language Model Paradox Andrea Pinto Tomer Galanti Randall Balestriero 18 0 0 15 Oct 2024
Wide Neural Networks Trained with Weight Decay Provably Exhibit Neural Collapse Arthur Jacot Peter Súkeník Zihan Wang Marco Mondelli 28 1 0 07 Oct 2024
The Prevalence of Neural Collapse in Neural Multivariate Regression G. Andriopoulos Zixuan Dong Li Guo Zifan Zhao Keith Ross 33 2 0 06 Sep 2024
Beyond Unconstrained Features: Neural Collapse for Shallow Neural Networks with General Data Wanli Hong Shuyang Ling 27 3 0 03 Sep 2024
Linguistic Collapse: Neural Collapse in (Large) Language Models Robert Wu V. Papyan 33 11 0 28 May 2024
Pursuing Feature Separation based on Neural Collapse for Out-of-Distribution Detection Yingwen Wu Ruiji Yu Xinwen Cheng Zhengbao He Xiaolin Huang OODD 60 1 0 28 May 2024
Neural Collapse versus Low-rank Bias: Is Deep Neural Collapse Really Optimal? Peter Súkeník Marco Mondelli Christoph H. Lampert AI4CE 32 5 0 23 May 2024
Navigate Beyond Shortcuts: Debiased Learning through the Lens of Neural Collapse Yining Wang Junjie Sun Chenyue Wang Mi Zhang Min Yang 21 5 0 09 May 2024
Progressive Feedforward Collapse of ResNet Training Sicong Wang Kuo Gai Shihua Zhang AI4CE 25 4 0 02 May 2024
Unifying Low Dimensional Observations in Deep Learning Through the Deep Linear Unconstrained Feature Model Connall Garrod Jonathan P. Keating 22 8 0 09 Apr 2024
Average gradient outer product as a mechanism for deep neural collapse Daniel Beaglehole Peter Súkeník Marco Mondelli Misha Belkin AI4CE 25 12 0 21 Feb 2024
Cross Entropy versus Label Smoothing: A Neural Collapse Perspective Li Guo Keith Ross Zifan Zhao G. Andriopoulos Shuyang Ling Yufeng Xu Zixuan Dong UQCV NoLa 17 7 0 06 Feb 2024
FedLoGe: Joint Local and Generic Federated Learning under Long-tailed Data Zikai Xiao Zihan Chen Liyinglan Liu Yang Feng Jian Wu Wanlu Liu Joey Tianyi Zhou Howard H. Yang Zuo-Qiang Liu FedML 35 6 0 17 Jan 2024
Neural Collapse for Cross-entropy Class-Imbalanced Learning with Unconstrained ReLU Feature Model Hien Dang Tho Tran Tan Minh Nguyen Nhat Ho 10 11 0 04 Jan 2024
Neural Collapse in Multi-label Learning with Pick-all-label Loss Pengyu Li Xiao Li Yutong Wang Qing Qu 10 6 0 24 Oct 2023
Neural Collapse for Unconstrained Feature Model under Cross-entropy Loss with Imbalanced Data Wanli Hong Shuyang Ling 14 12 0 18 Sep 2023
SegDA: Maximum Separable Segment Mask with Pseudo Labels for Domain Adaptive Semantic Segmentation Anant Khandelwal 16 1 0 10 Aug 2023
Symmetric Neural-Collapse Representations with Supervised Contrastive Loss: The Impact of ReLU and Batching Ganesh Ramachandra Kini V. Vakilian Tina Behnia Jaidev Gill Christos Thrampoulidis 9 1 0 13 Jun 2023
Deep Neural Collapse Is Provably Optimal for the Deep Unconstrained Features Model Peter Súkeník Marco Mondelli Christoph H. Lampert 15 20 0 22 May 2023
MASIL: Towards Maximum Separable Class Representation for Few Shot Class Incremental Learning Anant Khandelwal CLL 14 0 0 08 Apr 2023
Principled and Efficient Transfer Learning of Deep Models via Neural Collapse Xiao Li Sheng Liu Jin-li Zhou Xin Lu C. Fernandez‐Granda Zhihui Zhu Q. Qu AAML 19 18 0 23 Dec 2022
Perturbation Analysis of Neural Collapse Tom Tirer Haoxiang Huang Jonathan Niles-Weed AAML 30 23 0 29 Oct 2022