Neural Collapse with Cross-Entropy Loss

15 December 2020

Papers citing "Neural Collapse with Cross-Entropy Loss"

46 / 46 papers shown

Title
Multiplicative Logit Adjustment Approximates Neural-Collapse-Aware Decision Boundary Adjustment Naoya Hasegawa Issei Sato 36 0 0 26 Sep 2024
Linguistic Collapse: Neural Collapse in (Large) Language Models Robert Wu V. Papyan 48 12 0 28 May 2024
Progressive Feedforward Collapse of ResNet Training Sicong Wang Kuo Gai Shihua Zhang AI4CE 33 4 0 02 May 2024
Hyperspherical Classification with Dynamic Label-to-Prototype Assignment Mohammad Saeed Ebrahimi Saadabadi Ali Dabouei Sahar Rahimi Malakshan Nasser M. Nasrabadi 29 3 0 25 Mar 2024
Supervised Contrastive Representation Learning: Landscape Analysis with Unconstrained Features Tina Behnia Christos Thrampoulidis SSL 33 0 0 29 Feb 2024
Deep Neural Network Models Trained With A Fixed Random Classifier Transfer Better Across Domains Hafiz Tiomoko Ali Umberto Michieli J. Moon Daehyun Kim Mete Ozay AAML 27 1 0 28 Feb 2024
Low-Rank Learning by Design: the Role of Network Architecture and Activation Linearity in Gradient Rank Collapse Bradley T. Baker Ba Pearlmutter Robyn L. Miller Vince D. Calhoun Sergey Plis AI4CE 11 2 0 09 Feb 2024
Pushing Boundaries: Mixup's Influence on Neural Collapse Quinn Fisher Haoming Meng V. Papyan AAML UQCV 38 5 0 09 Feb 2024
Neural Collapse for Cross-entropy Class-Imbalanced Learning with Unconstrained ReLU Feature Model Hien Dang Tho Tran Tan Minh Nguyen Nhat Ho 15 11 0 04 Jan 2024
DRAUC: An Instance-wise Distributionally Robust AUC Optimization Framework Siran Dai Qianqian Xu Zhiyong Yang Xiaochun Cao Qingming Huang 25 1 0 06 Nov 2023
Generalized Neural Collapse for a Large Number of Classes Jiachen Jiang Jinxin Zhou Peng Wang Qing Qu Dustin Mixon Chong You Zhihui Zhu AI4CE 32 23 0 09 Oct 2023
An Investigation of Representation and Allocation Harms in Contrastive Learning Subha Maity Mayank Agarwal Mikhail Yurochkin Yuekai Sun 29 2 0 02 Oct 2023
Neural Collapse in the Intermediate Hidden Layers of Classification Neural Networks Liam Parker Emre Onal Anton Stengel Jake Intrater 25 11 0 05 Aug 2023
Neural Collapse Terminus: A Unified Solution for Class Incremental Learning and Its Variants Yibo Yang Haobo Yuan Xiangtai Li Jianlong Wu Lefei Zhang Zhouchen Lin Philip H. S. Torr Dacheng Tao Bernard Ghanem CLL 31 8 0 03 Aug 2023
Mini-Batch Optimization of Contrastive Loss Jaewoong Cho Kartik K. Sreenivasan Keon Lee Kyunghoo Mun Soheun Yi Jeong-Gwan Lee Anna Lee Jy-yong Sohn Dimitris Papailiopoulos Kangwook Lee SSL 35 7 0 12 Jul 2023
Are Neurons Actually Collapsed? On the Fine-Grained Structure in Neural Representations Yongyi Yang Jacob Steinhardt Wei Hu 26 10 0 29 Jun 2023
Symmetric Neural-Collapse Representations with Supervised Contrastive Loss: The Impact of ReLU and Batching Ganesh Ramachandra Kini V. Vakilian Tina Behnia Jaidev Gill Christos Thrampoulidis 17 1 0 13 Jun 2023
Exploring Simple, High Quality Out-of-Distribution Detection with L2 Normalization J. Haas William Yolland B. Rabus OODD 19 0 0 07 Jun 2023
Quantifying the Variability Collapse of Neural Networks Jing-Xue Xu Haoxiong Liu 33 4 0 06 Jun 2023
Exploring Weight Balancing on Long-Tailed Recognition Problem Naoya Hasegawa Issei Sato 19 6 0 26 May 2023
Feature Collapse T. Laurent J. V. Brecht Xavier Bresson 25 3 0 25 May 2023
Neural Collapse Inspired Federated Learning with Non-iid Data Chenxi Huang Liang Xie Yibo Yang Wenxiao Wang Binbin Lin D. Cai FedML 24 3 0 27 Mar 2023
On the Implicit Geometry of Cross-Entropy Parameterizations for Label-Imbalanced Data Tina Behnia Ganesh Ramachandra Kini V. Vakilian Christos Thrampoulidis 33 17 0 14 Mar 2023
Neural Collapse Inspired Feature-Classifier Alignment for Few-Shot Class Incremental Learning Yibo Yang Haobo Yuan Xiangtai Li Zhouchen Lin Philip H. S. Torr Dacheng Tao CLL 32 96 0 06 Feb 2023
Understanding Imbalanced Semantic Segmentation Through Neural Collapse Zhisheng Zhong Jiequan Cui Yibo Yang Xiaoyang Wu Xiaojuan Qi X. Zhang Jiaya Jia 129 45 0 03 Jan 2023
Are All Losses Created Equal: A Neural Collapse Perspective Jinxin Zhou Chong You Xiao Li Kangning Liu Sheng Liu Qing Qu Zhihui Zhu 30 58 0 04 Oct 2022
Neural Collapse with Normalized Features: A Geometric Analysis over the Riemannian Manifold Can Yaras Peng Wang Zhihui Zhu Laura Balzano Qing Qu 15 41 0 19 Sep 2022
Linking Neural Collapse and L2 Normalization with Improved Out-of-Distribution Detection in Deep Neural Networks J. Haas William Yolland B. Rabus OODD 41 14 0 17 Sep 2022
Imbalance Trouble: Revisiting Neural-Collapse Geometry Christos Thrampoulidis Ganesh Ramachandra Kini V. Vakilian Tina Behnia 19 68 0 10 Aug 2022
Memorization-Dilation: Modeling Neural Collapse Under Label Noise Duc Anh Nguyen Ron Levie Julian Lienen Gitta Kutyniok Eyke Hüllermeier 16 1 0 11 Jun 2022
Neural Collapse: A Review on Modelling Principles and Generalization Vignesh Kothapalli 21 71 0 08 Jun 2022
Neural Collapse Inspired Attraction-Repulsion-Balanced Loss for Imbalanced Learning Liang Xie Yibo Yang Deng Cai Xiaofei He 16 44 0 19 Apr 2022
Perfectly Balanced: Improving Transfer and Robustness of Supervised Contrastive Learning Mayee F. Chen Daniel Y. Fu A. Narayan Michael Zhang Zhao-quan Song Kayvon Fatahalian Christopher Ré SSL 19 46 0 15 Apr 2022
Inducing Neural Collapse in Imbalanced Learning: Do We Really Need a Learnable Classifier at the End of Deep Neural Network? Yibo Yang Shixiang Chen Xiangtai Li Liangru Xie Zhouchen Lin Dacheng Tao 16 76 0 17 Mar 2022
On the Optimization Landscape of Neural Collapse under MSE Loss: Global Optimality with Unconstrained Features Jinxin Zhou Xiao Li Tian Ding Chong You Qing Qu Zhihui Zhu 22 97 0 02 Mar 2022
On the Implicit Bias Towards Minimal Depth of Deep Neural Networks Tomer Galanti Liane Galanti Ido Ben-Shaul 13 12 0 18 Feb 2022
Limitations of Neural Collapse for Understanding Generalization in Deep Learning Like Hui M. Belkin Preetum Nakkiran AI4CE 17 52 0 17 Feb 2022
Nearest Class-Center Simplification through Intermediate Layers Ido Ben-Shaul S. Dekel 38 26 0 21 Jan 2022
An Unconstrained Layer-Peeled Perspective on Neural Collapse Wenlong Ji Yiping Lu Yiliang Zhang Zhun Deng Weijie J. Su 127 83 0 06 Oct 2021
Neural Collapse Under MSE Loss: Proximity to and Dynamics on the Central Path X. Y. Han V. Papyan D. Donoho AAML 25 136 0 03 Jun 2021
A Geometric Analysis of Neural Collapse with Unconstrained Features Zhihui Zhu Tianyu Ding Jinxin Zhou Xiao Li Chong You Jeremias Sulam Qing Qu 19 195 0 06 May 2021
Label-Imbalanced and Group-Sensitive Classification under Overparameterization Ganesh Ramachandra Kini Orestis Paraskevas Samet Oymak Christos Thrampoulidis 27 93 0 02 Mar 2021
Exploring Deep Neural Networks via Layer-Peeled Model: Minority Collapse in Imbalanced Training Cong Fang Hangfeng He Qi Long Weijie J. Su FAtt 124 165 0 29 Jan 2021
On the emergence of simplex symmetry in the final and penultimate layers of neural network classifiers E. Weinan Stephan Wojtowytsch 28 42 0 10 Dec 2020
From Symmetry to Geometry: Tractable Nonconvex Problems Yuqian Zhang Qing Qu John N. Wright 26 43 0 14 Jul 2020
Efficient Estimation of Word Representations in Vector Space Tomáš Mikolov Kai Chen G. Corrado J. Dean 3DV 239 31,253 0 16 Jan 2013