Variance Covariance Regularization Enforces Pairwise Independence in
Self-Supervised Representations

Variance Covariance Regularization Enforces Pairwise Independence in Self-Supervised Representations

29 September 2022

Grégoire Mialon

Randall Balestriero

Papers citing "Variance Covariance Regularization Enforces Pairwise Independence in Self-Supervised Representations"

9 / 9 papers shown

Title
An Empirically Grounded Identifiability Theory Will Accelerate Self-Supervised Learning Research Patrik Reizinger Randall Balestriero David Klindt Wieland Brendel 38 0 0 17 Apr 2025
Graph Contrastive Invariant Learning from the Causal Perspective Yanhu Mo Xiao Wang Shaohua Fan Chuan Shi 24 14 0 23 Jan 2024
Self-Supervised Learning with Lie Symmetries for Partial Differential Equations Grégoire Mialon Q. Garrido Hannah Lawrence Danyal Rehman Yann LeCun B. Kiani SSL 14 24 0 11 Jul 2023
A Cookbook of Self-Supervised Learning Randall Balestriero Mark Ibrahim Vlad Sobal Ari S. Morcos Shashank Shekhar ... Pierre Fernandez Amir Bar Hamed Pirsiavash Yann LeCun Micah Goldblum SyDa FedML SSL 31 272 0 24 Apr 2023
More From Less: Self-Supervised Knowledge Distillation for Routine Histopathology Data Lucas Farndale R. Insall Ke Yuan 21 3 0 19 Mar 2023
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 258 7,412 0 11 Nov 2021
ResNet strikes back: An improved training procedure in timm Ross Wightman Hugo Touvron Hervé Jégou AI4TS 207 484 0 01 Oct 2021
On Feature Decorrelation in Self-Supervised Learning Tianyu Hua Wenxiao Wang Zihui Xue Sucheng Ren Yue Wang Hang Zhao SSL OOD 112 187 0 02 May 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 303 5,761 0 29 Apr 2021