VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning

11 May 2021

Papers citing "VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning"

50 / 613 papers shown

Title
FLSL: Feature-level Self-supervised Learning Qing Su Anton Netchaev Hai Helen Li Shihao Ji 22 4 0 09 Jun 2023
Image Clustering via the Principle of Rate Reduction in the Age of Pretrained Models Tianzhe Chu Shengbang Tong Tianjiao Ding Xili Dai B. Haeffele René Vidal Y. Ma SSL VLM 15 13 0 08 Jun 2023
Factorized Contrastive Learning: Going Beyond Multi-view Redundancy Paul Pu Liang Zihao Deng Martin Q. Ma James Y. Zou Louis-Philippe Morency Ruslan Salakhutdinov SSL 24 49 0 08 Jun 2023
Regularizing with Pseudo-Negatives for Continual Self-Supervised Learning Sungmin Cha Kyunghyun Cho Taesup Moon BDL CLL 23 2 0 08 Jun 2023
Understanding Masked Autoencoders via Hierarchical Latent Variable Models Lingjing Kong Martin Q. Ma Guan-Hong Chen Eric P. Xing Yuejie Chi Louis-Philippe Morency Kun Zhang 17 30 0 08 Jun 2023
Generative Text-Guided 3D Vision-Language Pretraining for Unified Medical Image Segmentation Yinda Chen Che Liu Wei Huang Sibo Cheng Rossella Arcucci Zhiwei Xiong VLM MedIm 24 48 0 07 Jun 2023
ScoreCL: Augmentation-Adaptive Contrastive Learning via Score-Matching Function Jinyoung Kim Soonwoo Kwon Hyojun Go Yunsung Lee Seungtaek Choi Hyun-Gyoon Kim 27 1 0 07 Jun 2023
Randomized Schur Complement Views for Graph Contrastive Learning Vignesh Kothapalli 12 1 0 06 Jun 2023
Unraveling Projection Heads in Contrastive Learning: Insights from Expansion and Shrinkage Yu Gui Cong Ma Yiqiao Zhong 22 6 0 06 Jun 2023
Exploring the Role of the Bottleneck in Slot-Based Models Through Covariance Regularization Andrew Stange Robert Lo Abishek Sridhar Kousik Rajesh 22 2 0 05 Jun 2023
Introduction to Latent Variable Energy-Based Models: A Path Towards Autonomous Machine Intelligence Anna Dawid Yann LeCun DRL 24 29 0 05 Jun 2023
On Feature Diversity in Energy-based Models Firas Laakom Jenni Raitoharju Alexandros Iosifidis M. Gabbouj 24 7 0 02 Jun 2023
Evaluating The Robustness of Self-Supervised Representations to Background/Foreground Removal Xavier F. Cadet Ranya Aloufi A. Miranville S. Ahmadi-Abhari Hamed Haddadi 16 0 0 02 Jun 2023
Scaling Up Semi-supervised Learning with Unconstrained Unlabelled Data Shuvendu Roy Ali Etemad SSL 29 4 0 02 Jun 2023
Understanding Augmentation-based Self-Supervised Representation Learning via RKHS Approximation and Regression Runtian Zhai Bing Liu Andrej Risteski Zico Kolter Pradeep Ravikumar SSL 28 9 0 01 Jun 2023
The Galerkin method beats Graph-Based Approaches for Spectral Algorithms Vivien A. Cabannes Francis R. Bach 27 3 0 01 Jun 2023
Feature Learning in Image Hierarchies using Functional Maximal Correlation Bo Hu Yuheng Bu José C. Príncipe 11 0 0 31 May 2023
Spectal Harmonics: Bridging Spectral Embedding and Matrix Completion in Self-Supervised Learning Marina Munkhoeva Ivan V. Oseledets SSL 23 2 0 31 May 2023
Augmentation-aware Self-supervised Learning with Conditioned Projector Marcin Przewike'zlikowski Mateusz Pyla Bartosz Zieliñski Bartlomiej Twardowski Jacek Tabor Marek Śmieja SSL 37 2 0 31 May 2023
Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priors Paul S. Scotti Atmadeep Banerjee J. Goode Stepan Shabalin A. Nguyen ... Nathalie Verlinde Elad Yundler David Weisberg K. A. Norman Tanishq Mathew Abraham DiffM 36 106 0 29 May 2023
Matrix Information Theory for Self-Supervised Learning Yifan Zhang Zhi-Hao Tan Jingqin Yang Weiran Huang Yang Yuan SSL 45 16 0 27 May 2023
Modulate Your Spectrum in Self-Supervised Learning Xi Weng Yu-Li Ni Tengwei Song Jie Luo Rao Muhammad Anwer Salman Khan F. Khan Lei Huang 32 5 0 26 May 2023
Efficient Document Embeddings via Self-Contrastive Bregman Divergence Learning Daniel Saggau Mina Rezaei Bernd Bischl Ilias Chalkidis SSL MedIm 22 2 0 25 May 2023
Reverse Engineering Self-Supervised Learning Ido Ben-Shaul Ravid Shwartz-Ziv Tomer Galanti S. Dekel Yann LeCun SSL 15 34 0 24 May 2023
Task-aware Distributed Source Coding under Dynamic Bandwidth Po-han Li S. Ankireddy Ruihan Zhao Hossein Nourkhiz Mahjoub Ehsan Moradi-Pari Ufuk Topcu Sandeep P. Chinchali Hyeji Kim 26 9 0 24 May 2023
Know Your Self-supervised Learning: A Survey on Image-based Generative and Discriminative Training Utku Ozbulak Hyun Jung Lee Beril Boga Esla Timothy Anzaku Ho-min Park Arnout Van Messem W. D. Neve J. Vankerschaver DiffM 26 36 0 23 May 2023
EnSiam: Self-Supervised Learning With Ensemble Representations Kai Han Minsik Lee SSL 24 0 0 22 May 2023
Not All Semantics are Created Equal: Contrastive Self-supervised Learning with Automatic Temperature Individualization Zimeng Qiu Quanqi Hu Zhuoning Yuan Denny Zhou Lijun Zhang Tianbao Yang 34 17 0 19 May 2023
S-JEA: Stacked Joint Embedding Architectures for Self-Supervised Visual Representation Learning Alvzbveta Manová A. Durrant Georgios Leontidis SSL 19 4 0 19 May 2023
HMSN: Hyperbolic Self-Supervised Learning by Clustering with Ideal Prototypes A. Durrant Georgios Leontidis SSL 25 4 0 18 May 2023
Tuned Contrastive Learning Chaitanya Animesh Manmohan Chandraker SSL 11 0 0 18 May 2023
Improved baselines for vision-language pre-training Enrico Fini Pietro Astolfi Adriana Romero Soriano Jakob Verbeek M. Drozdzal SSL CLIP VLM 45 22 0 15 May 2023
On the Effectiveness of Equivariant Regularization for Robust Online Continual Learning Lorenzo Bonicelli Matteo Boschini Emanuele Frascaroli Angelo Porrello M. Pennisi Giovanni Bellitto S. Palazzo C. Spampinato Simone Calderara CLL 24 3 0 05 May 2023
Multimodal Understanding Through Correlation Maximization and Minimization Yi Shi Marc Niethammer 33 0 0 04 May 2023
LD-GAN: Low-Dimensional Generative Adversarial Network for Spectral Image Generation with Variance Regularization Emmanuel Martinez Roman Jacome Alejandra Hernandez-Rojas Henry Arguello 19 5 0 29 Apr 2023
Maximizing Model Generalization for Machine Condition Monitoring with Self-Supervised Learning and Federated Learning Matthew Russell P. Wang FedML AI4CE 26 10 0 27 Apr 2023
Do SSL Models Have Déjà Vu? A Case of Unintended Memorization in Self-supervised Learning Casey Meehan Florian Bordes Pascal Vincent Kamalika Chaudhuri Chuan Guo 32 18 0 26 Apr 2023
Objectives Matter: Understanding the Impact of Self-Supervised Objectives on Vision Transformer Representations Shashank Shekhar Florian Bordes Pascal Vincent Ari S. Morcos 18 10 0 25 Apr 2023
A Cookbook of Self-Supervised Learning Randall Balestriero Mark Ibrahim Vlad Sobal Ari S. Morcos Shashank Shekhar ... Pierre Fernandez Amir Bar Hamed Pirsiavash Yann LeCun Micah Goldblum SyDa FedML SSL 44 273 0 24 Apr 2023
No Free Lunch in Self Supervised Representation Learning Ihab Bendidi Adrien Bardes E. Cohen Alexis Lamiable Guillaume Bollot Auguste Genovesio OOD 49 11 0 23 Apr 2023
Learning Symbolic Representations Through Joint GEnerative and DIscriminative Training Emanuele Sansone Robin Manhaeve BDL FedML GAN 23 5 0 22 Apr 2023
Contrastive Tuning: A Little Help to Make Masked Autoencoders Forget Johannes Lehner Benedikt Alkin Andreas Fürst Elisabeth Rumetshofer Lukas Miklautz Sepp Hochreiter 23 18 0 20 Apr 2023
To Compress or Not to Compress- Self-Supervised Learning and Information Theory: A Review Ravid Shwartz-Ziv Yann LeCun SSL 27 71 0 19 Apr 2023
Morph-SSL: Self-Supervision with Longitudinal Morphing to Predict AMD Progression from OCT A. Chakravarty T. Emre Oliver Leingang Sophie Riedl Julia Mai ... S. Sivaprasad Daniel Rueckert A. Lotery U. Schmidt-Erfurth Hrvoje Bogunović 28 1 0 17 Apr 2023
Self-Supervised Learning from Non-Object Centric Images with a Geometric Transformation Sensitive Architecture Taeho Kim Jong-Min Lee 26 0 0 17 Apr 2023
NEV-NCD: Negative Learning, Entropy, and Variance regularization based novel action categories discovery Zahid Hasan Masud Ahmed A. Faridee S. Purushotham H. Kwon Hyungtae Lee Nirmalya Roy 13 2 0 14 Apr 2023
A Comparative Study on Generative Models for High Resolution Solar Observation Imaging Mehdi Cherti Alexander Czernik Stefan Kesselheim F. Effenberger J. Jitsev DiffM 25 0 0 14 Apr 2023
Explaining, Analyzing, and Probing Representations of Self-Supervised Learning Models for Sensor-based Human Activity Recognition Bulat Khaertdinov S. Asteriadis 24 3 0 14 Apr 2023
Multi-Mode Online Knowledge Distillation for Self-Supervised Visual Representation Learning Kaiyou Song Jin Xie Shanyi Zhang Zimeng Luo 24 29 0 13 Apr 2023
EMP-SSL: Towards Self-Supervised Learning in One Training Epoch Shengbang Tong Yubei Chen Y. Ma Yann LeCun 18 24 0 08 Apr 2023