Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2202.08087
Cited By
v1
v2
v3 (latest)
Extended Unconstrained Features Model for Exploring Deep Neural Collapse
International Conference on Machine Learning (ICML), 2022
16 February 2022
Tom Tirer
Joan Bruna
AAML
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Extended Unconstrained Features Model for Exploring Deep Neural Collapse"
50 / 81 papers shown
Diagonalizing the Softmax: Hadamard Initialization for Tractable Cross-Entropy Dynamics
Connall Garrod
Jonathan P. Keating
Christos Thrampoulidis
205
0
0
03 Dec 2025
From Coefficients to Directions: Rethinking Model Merging with Directional Alignment
Zhikang Chen
Sen Cui
Deheng Ye
Min Zhang
Gang Niu
Yu Zhang
Masashi Sugiyama
Tingting Zhu
MoMe
225
0
0
29 Nov 2025
3D-ANC: Adaptive Neural Collapse for Robust 3D Point Cloud Recognition
Yuanmin Huang
Wenxuan Li
Mi Zhang
Xiaohan Zhang
Xiaoyu You
Min Yang
3DPC
410
0
0
10 Nov 2025
Neural Collapse under Gradient Flow on Shallow ReLU Networks for Orthogonally Separable Data
Hancheng Min
Zhihui Zhu
Rene Vidal
188
1
0
24 Oct 2025
A mathematical theory for understanding when abstract representations emerge in neural networks
Bin Wang
W. Jeffrey Johnston
Stefano Fusi
MILM
195
1
0
10 Oct 2025
Geometric Properties of Neural Multivariate Regression
George Andriopoulos
Zixuan Dong
Bimarsha Adhikari
Keith Ross
181
1
0
01 Oct 2025
Explaining Grokking and Information Bottleneck through Neural Collapse Emergence
Keitaro Sakamoto
Issei Sato
249
0
0
25 Sep 2025
Sharper Convergence Rates for Nonconvex Optimisation via Reduction Mappings
Evan Markou
Thalaiyasingam Ajanthan
Stephen Gould
360
0
0
10 Jun 2025
Neural Collapse in Cumulative Link Models for Ordinal Regression: An Analysis with Unconstrained Feature Model
Chuang Ma
Tomoyuki Obuchi
Toshiyuki Tanaka
327
3
0
06 Jun 2025
Neural Collapse is Globally Optimal in Deep Regularized ResNets and Transformers
Peter Súkeník
Christoph H. Lampert
Marco Mondelli
295
4
0
21 May 2025
Neural Multivariate Regression: Qualitative Insights from the Unconstrained Feature Model
George Andriopoulos
Soyuj Jung Basnet
Juan Guevara
Li Guo
George Andriopoulos
342
0
0
14 May 2025
Geometry of Semantics in Next-Token Prediction: How Optimization Implicitly Organizes Linguistic Representations
Yize Zhao
Christos Thrampoulidis
320
0
0
13 May 2025
The Evolution of Embedding Table Optimization and Multi-Epoch Training in Pinterest Ads Conversion
Andrew Qiu
Shubham Barhate
Hin Wai Lui
Runze Su
Rafael Rios Müller
Kungang Li
Ling Leng
Han Sun
Shayan Ehsani
Zhifang Liu
266
2
0
08 May 2025
Enhancing Pre-Trained Model-Based Class-Incremental Learning through Neural Collapse
Kun He
Zijian Song
Shuoxi Zhang
John E. Hopcroft
CLL
342
0
0
25 Apr 2025
Balancing Two Classifiers via A Simplex ETF Structure for Model Calibration
Computer Vision and Pattern Recognition (CVPR), 2025
Jiani Ni
He Zhao
Jintong Gao
Dandan Guo
H. Zha
242
1
0
14 Apr 2025
Understanding Representation of Deep Equilibrium Models from Neural Collapse Perspective
Neural Information Processing Systems (NeurIPS), 2024
Haixiang Sun
Ye Shi
309
2
0
30 Oct 2024
The Persistence of Neural Collapse Despite Low-Rank Bias
Connall Garrod
Jonathan P. Keating
344
10
0
30 Oct 2024
Wide Neural Networks Trained with Weight Decay Provably Exhibit Neural Collapse
International Conference on Learning Representations (ICLR), 2024
Arthur Jacot
Peter Súkeník
Zihan Wang
Marco Mondelli
337
12
0
07 Oct 2024
Control-oriented Clustering of Visual Latent Representation
International Conference on Learning Representations (ICLR), 2024
Han Qi
Haocheng Yin
Heng Yang
SSL
586
7
0
07 Oct 2024
SGW-based Multi-Task Learning in Vision Tasks
Asian Conference on Computer Vision (ACCV), 2024
Ruiyuan Zhang
Yuyao Chen
Yuchi Huo
Jiaxiang Liu
Dianbing Xi
Jie Liu
Chao Wu
264
2
0
03 Oct 2024
The Prevalence of Neural Collapse in Neural Multivariate Regression
Neural Information Processing Systems (NeurIPS), 2024
George Andriopoulos
Zixuan Dong
Li Guo
Zifan Zhao
George Andriopoulos
399
14
0
06 Sep 2024
Beyond Unconstrained Features: Neural Collapse for Shallow Neural Networks with General Data
Wanli Hong
Shuyang Ling
351
8
0
03 Sep 2024
All-around Neural Collapse for Imbalanced Classification
IEEE Transactions on Knowledge and Data Engineering (TKDE), 2024
Enhao Zhang
Chaohua Li
Chuanxing Geng
Songcan Chen
AI4CE
371
2
0
14 Aug 2024
Federated Representation Learning in the Under-Parameterized Regime
International Conference on Machine Learning (ICML), 2024
Renpu Liu
Cong Shen
Jing Yang
396
12
0
07 Jun 2024
Linguistic Collapse: Neural Collapse in (Large) Language Models
Robert Wu
Vardan Papyan
395
30
0
28 May 2024
Neural Collapse versus Low-rank Bias: Is Deep Neural Collapse Really Optimal?
Peter Súkeník
Marco Mondelli
Christoph H. Lampert
AI4CE
306
15
0
23 May 2024
Improving Generalization of Deep Neural Networks by Optimum Shifting
AAAI Conference on Artificial Intelligence (AAAI), 2024
Yuyan Zhou
Ye Li
Lei Feng
Sheng-Jun Huang
OOD
ODL
188
0
0
23 May 2024
Progressive Feedforward Collapse of ResNet Training
Sicong Wang
Kuo Gai
Shihua Zhang
AI4CE
281
8
0
02 May 2024
Unifying Low Dimensional Observations in Deep Learning Through the Deep Linear Unconstrained Feature Model
Connall Garrod
Jonathan P. Keating
403
10
0
09 Apr 2024
Supervised Contrastive Representation Learning: Landscape Analysis with Unconstrained Features
Tina Behnia
Christos Thrampoulidis
SSL
282
2
0
29 Feb 2024
Average gradient outer product as a mechanism for deep neural collapse
Daniel Beaglehole
Peter Súkeník
Marco Mondelli
Misha Belkin
AI4CE
474
19
0
21 Feb 2024
Low-Rank Learning by Design: the Role of Network Architecture and Activation Linearity in Gradient Rank Collapse
Bradley T. Baker
Ba Pearlmutter
Robyn L. Miller
Vince D. Calhoun
Sergey Plis
AI4CE
313
4
0
09 Feb 2024
Pushing Boundaries: Mixup's Influence on Neural Collapse
Quinn Fisher
Haoming Meng
Vardan Papyan
AAML
UQCV
296
7
0
09 Feb 2024
Cross Entropy versus Label Smoothing: A Neural Collapse Perspective
Li Guo
George Andriopoulos
Zifan Zhao
George Andriopoulos
Shuyang Ling
Keith Ross
UQCV
NoLa
478
20
0
06 Feb 2024
FedLoGe: Joint Local and Generic Federated Learning under Long-tailed Data
International Conference on Learning Representations (ICLR), 2024
Zikai Xiao
Zihan Chen
Liyinglan Liu
Yang Feng
Jian Wu
Wanlu Liu
Qiufeng Wang
Howard H. Yang
Zuo-Qiang Liu
FedML
330
13
0
17 Jan 2024
Neural Collapse for Cross-entropy Class-Imbalanced Learning with Unconstrained ReLU Feature Model
International Conference on Machine Learning (ICML), 2024
Hien Dang
Tho Tran
Tan Minh Nguyen
Nhat Ho
434
18
0
04 Jan 2024
On the Robustness of Neural Collapse and the Neural Collapse of Robustness
Jingtong Su
Ya Shi Zhang
Nikolaos Tsilivis
Julia Kempe
AAML
252
9
0
13 Nov 2023
Neural Collapse in Multi-label Learning with Pick-all-label Loss
International Conference on Machine Learning (ICML), 2023
Pengyu Li
Xiao Li
Yutong Wang
Qing Qu
476
12
0
24 Oct 2023
It's an Alignment, Not a Trade-off: Revisiting Bias and Variance in Deep Models
Lin Chen
Michal Lukasik
Wittawat Jitkrittum
Chong You
Sanjiv Kumar
374
1
0
13 Oct 2023
Towards Demystifying the Generalization Behaviors When Neural Collapse Emerges
Peifeng Gao
Qianqian Xu
Jianlong Wu
Peisong Wen
Huiyang Shao
Zhiyong Yang
Guohao Li
Qingming Huang
AAML
343
5
0
12 Oct 2023
NECO: NEural Collapse Based Out-of-distribution detection
International Conference on Learning Representations (ICLR), 2023
Mouin Ben Ammar
Nacim Belkhir
Sebastian Popescu
Antoine Manzanera
Gianni Franchi
OODD
381
37
0
10 Oct 2023
Unleashing the power of Neural Collapse for Transferability Estimation
Yuhe Ding
Bo Jiang
Lijun Sheng
Aihua Zheng
Jian Liang
CVBM
260
1
0
09 Oct 2023
Generalized Neural Collapse for a Large Number of Classes
International Conference on Machine Learning (ICML), 2023
Jiachen Jiang
Jinxin Zhou
Peng Wang
Qing Qu
Dustin Mixon
Chong You
Zhihui Zhu
AI4CE
373
42
0
09 Oct 2023
On the Embedding Collapse when Scaling up Recommendation Models
International Conference on Machine Learning (ICML), 2023
Xingzhuo Guo
Kai Yan
Ximei Wang
Baixu Chen
Haohan Wang
Mingsheng Long
361
51
0
06 Oct 2023
Neural Collapse for Unconstrained Feature Model under Cross-entropy Loss with Imbalanced Data
Journal of machine learning research (JMLR), 2023
Wanli Hong
Shuyang Ling
269
37
0
18 Sep 2023
Towards Understanding Neural Collapse: The Effects of Batch Normalization and Weight Decay
Leyan Pan
Xinyuan Cao
409
7
0
09 Sep 2023
Neural Collapse in the Intermediate Hidden Layers of Classification Neural Networks
Liam Parker
Emre Onal
Anton Stengel
Jake Intrater
229
20
0
05 Aug 2023
Neural Collapse Terminus: A Unified Solution for Class Incremental Learning and Its Variants
Jianlong Wu
Haobo Yuan
Hefei Ling
Yue Yu
Lefei Zhang
Zhouchen Lin
Juil Sock
Dacheng Tao
Guohao Li
CLL
434
13
0
03 Aug 2023
A Neural Collapse Perspective on Feature Evolution in Graph Neural Networks
Neural Information Processing Systems (NeurIPS), 2023
Vignesh Kothapalli
Tom Tirer
Joan Bruna
310
18
0
04 Jul 2023
Are Neurons Actually Collapsed? On the Fine-Grained Structure in Neural Representations
International Conference on Machine Learning (ICML), 2023
Yongyi Yang
Jacob Steinhardt
Wei Hu
280
12
0
29 Jun 2023
1
2
Next
Page 1 of 2
