VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning

11 May 2021

Papers citing "VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning"

50 / 613 papers shown

Title
VNE: An Effective Method for Improving Deep Representation by Manipulating Eigenvalue Distribution Jaeill Kim Suhyun Kang Duhun Hwang Jungwook Shin Wonjong Rhee DRL 13 20 0 04 Apr 2023
Kaizen: Practical Self-supervised Continual Learning with Continual Fine-tuning Chi Ian Tang Lorena Qendro Dimitris Spathis F. Kawsar Cecilia Mascolo Akhil Mathur CLL 22 10 0 30 Mar 2023
Soft Neighbors are Positive Supporters in Contrastive Visual Representation Learning Chongjian Ge Jiangliu Wang Zhan Tong Shoufa Chen Yibing Song Ping Luo SSL 22 27 0 30 Mar 2023
Point2Vec for Self-Supervised Representation Learning on Point Clouds Karim Abou Zeid Jonas Schult Alexander Hermans Bastian Leibe 3DPC 20 27 0 29 Mar 2023
On the Stepwise Nature of Self-Supervised Learning James B. Simon Maksis Knutins Liu Ziyin Daniel Geisz Abraham J. Fetterman Joshua Albrecht SSL 32 29 0 27 Mar 2023
The Stable Signature: Rooting Watermarks in Latent Diffusion Models Pierre Fernandez Guillaume Couairon Hervé Jégou Matthijs Douze Teddy Furon WIGM 17 176 0 27 Mar 2023
Active Self-Supervised Learning: A Few Low-Cost Relationships Are All You Need Vivien A. Cabannes Léon Bottou Yann LeCun Randall Balestriero 40 13 0 27 Mar 2023
Temperature Schedules for Self-Supervised Contrastive Methods on Long-Tail Data Anna Kukleva Moritz Bohle Bernt Schiele Hilde Kuehne Christian Rupprecht 29 39 0 23 Mar 2023
MV-MR: multi-views and multi-representations for self-supervised learning and knowledge distillation Vitaliy Kinakh M. Drozdova S. Voloshynovskiy 40 1 0 21 Mar 2023
Dexterity from Touch: Self-Supervised Pre-Training of Tactile Representations with Robotic Play Irmak Güzey Ben Evans Soumith Chintala Lerrel Pinto 61 64 0 21 Mar 2023
ViC-MAE: Self-Supervised Representation Learning from Images and Video with Contrastive Masked Autoencoders J. Hernandez Ruben Villegas Vicente Ordonez SSL 33 2 0 21 Mar 2023
More From Less: Self-Supervised Knowledge Distillation for Routine Histopathology Data Lucas Farndale R. Insall Ke Yuan 21 3 0 19 Mar 2023
Feature propagation as self-supervision signals on graphs Oscar Pina Verónica Vilaplana SSL 12 1 0 15 Mar 2023
Non-Contrastive Unsupervised Learning of Physiological Signals from Video Jeremy Speth Nathan Vance Patrick Flynn A. Czajka AI4TS 48 42 0 14 Mar 2023
Sample-efficient Adversarial Imitation Learning Dahuin Jung Hyungyu Lee Sung-Hoon Yoon SSL 18 2 0 14 Mar 2023
Robust Contrastive Language-Image Pre-training against Data Poisoning and Backdoor Attacks Wenhan Yang Jingdong Gao Baharan Mirzasoleiman VLM 100 18 0 13 Mar 2023
Functional Knowledge Transfer with Self-supervised Representation Learning Prakash Chandra Chhipa Muskan Chopra G. Mengi Varun Gupta Richa Upadhyay Meenakshi Subhash Chippa Kanjar De Rajkumar Saini Seiichi Uchida Marcus Liwicki SSL 11 2 0 12 Mar 2023
Improving Masked Autoencoders by Learning Where to Mask Haijia Chen Wendong Zhang Yunbo Wang Xiaokang Yang SSL 15 20 0 12 Mar 2023
Towards domain-invariant Self-Supervised Learning with Batch Styles Standardization Marin Scalbert Maria Vakalopoulou Florent Couzinié-Devy 12 2 0 10 Mar 2023
An Evaluation of Non-Contrastive Self-Supervised Learning for Federated Medical Image Analysis Soumitri Chattopadhyay Soham Ganguly Sreejit Chaudhury Sayan Nag S. Chattopadhyay 19 0 0 09 Mar 2023
Distortion-Disentangled Contrastive Learning Jinfeng Wang Sifan Song Jionglong Su S. Kevin Zhou SSL 41 4 0 09 Mar 2023
Improving Self-Supervised Learning for Audio Representations by Feature Diversity and Decorrelation Bac Nguyen Stefan Uhlich Fabien Cardinaux SSL 42 3 0 07 Mar 2023
MAST: Masked Augmentation Subspace Training for Generalizable Self-Supervised Priors Chen Huang Hanlin Goh Jiatao Gu J. Susskind SSL OOD 42 6 0 07 Mar 2023
Learning Efficient Coding of Natural Images with Maximum Manifold Capacity Representations T. Yerxa Yilun Kuang Eero P. Simoncelli SueYeon Chung 11 0 0 06 Mar 2023
Exploring Self-Supervised Representation Learning For Low-Resource Medical Image Analysis Soumitri Chattopadhyay Soham Ganguly Sreejit Chaudhury Sayan Nag S. Chattopadhyay 28 1 0 03 Mar 2023
TRUSformer: Improving Prostate Cancer Detection from Micro-Ultrasound Using Attention and Self-Supervision Mahdi Gilany P. Wilson Andrea Perera-Ortega A. Jamzad Minh Nguyen Nhat To Fahimeh Fooladgar Brian Wodlinger Purang Abolmaesumi P. Mousavi ViT MedIm 22 10 0 03 Mar 2023
Towards Democratizing Joint-Embedding Self-Supervised Learning Florian Bordes Randall Balestriero Pascal Vincent 19 20 0 03 Mar 2023
Learning Common Rationale to Improve Self-Supervised Representation for Fine-Grained Visual Recognition Problems Yangyang Shu A. Hengel Lingqiao Liu SSL 28 14 0 03 Mar 2023
An Information-Theoretic Perspective on Variance-Invariance-Covariance Regularization Ravid Shwartz-Ziv Randall Balestriero Kenji Kawaguchi Tim G. J. Rudner Yann LeCun 30 23 0 01 Mar 2023
TimeMAE: Self-Supervised Representations of Time Series with Decoupled Masked Autoencoders Mingyue Cheng Qi Liu Zhiding Liu Haotong Zhang Rujiao Zhang Enhong Chen AI4TS 29 42 0 01 Mar 2023
Layer Grafted Pre-training: Bridging Contrastive Learning And Masked Image Modeling For Label-Efficient Representations Ziyu Jiang Yinpeng Chen Mengchen Liu Dongdong Chen Xiyang Dai Lu Yuan Zicheng Liu Zhangyang Wang SSL VLM CLIP 32 16 0 27 Feb 2023
Internet Explorer: Targeted Representation Learning on the Open Web Alexander C. Li Ellis L Brown Alexei A. Efros Deepak Pathak VLM 16 24 0 27 Feb 2023
Random Teachers are Good Teachers Felix Sarnthein Gregor Bachmann Sotiris Anagnostidis Thomas Hofmann 19 4 0 23 Feb 2023
Self-supervised network distillation: an effective approach to exploration in sparse reward environments Matej Pecháč M. Chovanec Igor Farkaš 19 3 0 22 Feb 2023
Self-supervised learning of Split Invariant Equivariant representations Q. Garrido Laurent Najman Yann LeCun SSL 24 32 0 14 Feb 2023
Policy-Induced Self-Supervision Improves Representation Finetuning in Visual RL Sébastien M. R. Arnold Fei Sha SSL 13 0 0 12 Feb 2023
Q-Match: Self-Supervised Learning by Matching Distributions Induced by a Queue Thomas Mulc Debidatta Dwibedi SSL 10 0 0 10 Feb 2023
The Edge of Orthogonality: A Simple View of What Makes BYOL Tick Pierre Harvey Richemond Allison C. Tam Yunhao Tang Florian Strub Bilal Piot Felix Hill SSL 26 9 0 09 Feb 2023
Self-Supervised Node Representation Learning via Node-to-Neighbourhood Alignment Wei Dong Dawei Yan Peifeng Wang SSL 9 2 0 09 Feb 2023
The SSL Interplay: Augmentations, Inductive Bias, and Generalization Vivien A. Cabannes B. Kiani Randall Balestriero Yann LeCun A. Bietti SSL 11 31 0 06 Feb 2023
CIPER: Combining Invariant and Equivariant Representations Using Contrastive and Predictive Learning Xia Xu Jochen Triesch SSL 15 2 0 05 Feb 2023
Self-supervised Multi-view Disentanglement for Expansion of Visual Collections Nihal Jain Praneetha Vaddamanu Paridhi Maheshwari Vishwa Vinay K. Kulkarni 17 3 0 04 Feb 2023
Rethinking Semi-Supervised Medical Image Segmentation: A Variance-Reduction Perspective Chenyu You Weicheng Dai Yifei Min Fenglin Liu David A. Clifton S. Kevin Zhou Lawrence H. Staib James S Duncan 20 69 0 03 Feb 2023
Blockwise Self-Supervised Learning at Scale Shoaib Ahmed Siddiqui David M. Krueger Yann LeCun Stéphane Deny SSL 25 15 0 03 Feb 2023
Style Feature Extraction Using Contrastive Conditioned Variational Autoencoders with Mutual Information Constraints S. Yasutomi Toshihisa Tanaka SSL DRL 17 0 0 03 Feb 2023
Energy-Inspired Self-Supervised Pretraining for Vision Models Ze Wang Jiang Wang Zicheng Liu Qiang Qiu 21 8 0 02 Feb 2023
Cross-Architectural Positive Pairs improve the effectiveness of Self-Supervised Learning P. Singh Jacopo Cirrone SSL 40 0 0 27 Jan 2023
Understanding Self-Supervised Pretraining with Part-Aware Representation Learning Jie Zhu Jiyang Qi Mingyu Ding Xiaokang Chen Ping Luo Xinggang Wang Wenyu Liu Leye Wang Jingdong Wang SSL 33 8 0 27 Jan 2023
Task-Agnostic Graph Neural Network Evaluation via Adversarial Collaboration Xiangyu Zhao Hannes Stärk Dominique Beaini Yiren Zhao Pietro Lio' 24 0 0 27 Jan 2023
Multilingual Multiaccented Multispeaker TTS with RADTTS Rohan Badlani Rafael Valle Kevin J. Shih J. F. Santos Siddharth Gururani Bryan Catanzaro 16 6 0 24 Jan 2023