Matrix Information Theory for Self-Supervised Learning

Matrix Information Theory for Self-Supervised Learning

27 May 2023

Papers citing "Matrix Information Theory for Self-Supervised Learning"

19 / 19 papers shown

Title
Information-Theoretic Perspectives on Optimizers Zhiquan Tan Weiran Huang FAtt 49 0 0 28 Feb 2025
Uncovering RL Integration in SSL Loss: Objective-Specific Implications for Data-Efficient RL Ömer Veysel Çağatan Barış Akgün OffRL 29 0 0 22 Oct 2024
Exploring Information-Theoretic Metrics Associated with Neural Collapse in Supervised Training Kun Song Zhiquan Tan Bochao Zou Jiansheng Chen Huimin Ma Weiran Huang 26 0 0 25 Sep 2024
Teaching Tailored to Talent: Adverse Weather Restoration via Prompt Pool and Depth-Anything Constraint Sixiang Chen Tian-Chun Ye K. Zhang Zhaohu Xing Yunlong Lin Lei Zhu DiffM 25 0 0 24 Sep 2024
Exploiting Supervised Poison Vulnerability to Strengthen Self-Supervised Defense Jeremy A. Styborski Mingzhi Lyu Y. Huang Adams Kong 22 0 0 13 Sep 2024
Unveiling the Dynamics of Information Interplay in Supervised Learning Kun Song Zhiquan Tan Bochao Zou Huimin Ma Weiran Huang 25 1 0 06 Jun 2024
Provable Contrastive Continual Learning Yichen Wen Zhiquan Tan Kaipeng Zheng Chuanlong Xie Weiran Huang CLL 19 4 0 29 May 2024
The Information of Large Language Model Geometry Zhiquan Tan Chenghai Li Weiran Huang 8 1 0 01 Feb 2024
Large Language Model Evaluation via Matrix Entropy Lai Wei Zhiquan Tan Chenghai Li Jindong Wang Weiran Huang 15 9 0 30 Jan 2024
Understanding Grokking Through A Robustness Viewpoint Zhiquan Tan Weiran Huang AAML OOD 17 6 0 11 Nov 2023
OTMatch: Improving Semi-Supervised Learning with Optimal Transport Zhiquan Tan Kaipeng Zheng Weiran Huang OT 17 7 0 26 Oct 2023
FroSSL: Frobenius Norm Minimization for Efficient Multiview Self-Supervised Learning Oscar Skean A. Dhakal Nathan Jacobs Luis Gonzalo Sánchez Giraldo 24 0 0 04 Oct 2023
Information Flow in Self-Supervised Learning Zhiyuan Tan Jingqin Yang Weiran Huang Yang Yuan Yifan Zhang SSL 12 13 0 29 Sep 2023
Towards a Unified Theoretical Understanding of Non-contrastive Learning via Rank Differential Mechanism Zhijian Zhuo Yifei Wang Jinwen Ma Yisen Wang 25 24 0 04 Mar 2023
Improving Self-Supervised Learning by Characterizing Idealized Representations Yann Dubois Tatsunori Hashimoto Stefano Ermon Percy Liang SSL 41 40 0 13 Sep 2022
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 283 5,723 0 29 Apr 2021
Contrastive Learning Inverts the Data Generating Process Roland S. Zimmermann Yash Sharma Steffen Schneider Matthias Bethge Wieland Brendel SSL 227 206 0 17 Feb 2021
Understanding self-supervised Learning Dynamics without Contrastive Pairs Yuandong Tian Xinlei Chen Surya Ganguli SSL 127 258 0 12 Feb 2021
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 229 3,029 0 09 Mar 2020