VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning

11 May 2021

Papers citing "VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning"

50 / 613 papers shown

Title
Simple Emergent Action Representations from Multi-Task Policy Training Pu Hua Yubei Chen Huazhe Xu MLAU 17 6 0 18 Oct 2022
Non-Contrastive Learning Meets Language-Image Pre-Training Jinghao Zhou Li Dong Zhe Gan Lijuan Wang Furu Wei VLM CLIP 17 26 0 17 Oct 2022
Self-Supervised Learning Through Efference Copies Franz Scherr Qinghai Guo Timoleon Moraitis 19 10 0 17 Oct 2022
Self-Supervised 2D/3D Registration for X-Ray to CT Image Fusion Srikrishna Jaganathan Maximilian Kukla Jian Wang Karthik Shetty Andreas K. Maier 3DPC 29 10 0 14 Oct 2022
Disentanglement of Correlated Factors via Hausdorff Factorized Support Karsten Roth Mark Ibrahim Zeynep Akata Pascal Vincent Diane Bouchacourt CML OOD CoGe 30 33 0 13 Oct 2022
The Hidden Uniform Cluster Prior in Self-Supervised Learning Mahmoud Assran Randall Balestriero Quentin Duval Florian Bordes Ishan Misra Piotr Bojanowski Pascal Vincent Michael G. Rabbat Nicolas Ballas SSL 44 46 0 13 Oct 2022
Holo-Dex: Teaching Dexterity with Immersive Mixed Reality Sridhar Pandian Arunachalam Irmak Güzey Soumith Chintala Lerrel Pinto 32 67 0 12 Oct 2022
Motion Aware Self-Supervision for Generic Event Boundary Detection Ayush Rai Tarun Krishna J. Dietlmeier Kevin McGuinness A. Smeaton Noel E. O'Connor 21 2 0 11 Oct 2022
An Exploration of Hierarchical Attention Transformers for Efficient Long Document Classification Ilias Chalkidis Xiang Dai Manos Fergadiotis Prodromos Malakasiotis Desmond Elliott 32 33 0 11 Oct 2022
Self-supervised debiasing using low rank regularization Geon Yeong Park Chanyong Jung Sangmin Lee Jong Chul Ye Sang Wan Lee CML SSL 36 3 0 11 Oct 2022
VoLTA: Vision-Language Transformer with Weakly-Supervised Local-Feature Alignment Shraman Pramanick Li Jing Sayan Nag Jiachen Zhu Hardik Shah Yann LeCun Ramalingam Chellappa 24 21 0 09 Oct 2022
RankMe: Assessing the downstream performance of pretrained self-supervised representations by their rank Q. Garrido Randall Balestriero Laurent Najman Yann LeCun SSL 46 72 0 05 Oct 2022
Contrastive Learning Can Find An Optimal Basis For Approximately View-Invariant Functions Daniel D. Johnson Ayoub El Hanchi Chris J. Maddison SSL 21 22 0 04 Oct 2022
VICRegL: Self-Supervised Learning of Local Visual Features Adrien Bardes Jean Ponce Yann LeCun SSL 17 119 0 04 Oct 2022
Nuisances via Negativa: Adjusting for Spurious Correlations via Data Augmentation A. Puli Nitish Joshi Yoav Wald Hera Y. He Rajesh Ranganath 37 16 0 04 Oct 2022
Masked Supervised Learning for Semantic Segmentation H. Zunair A. Ben Hamza 22 6 0 03 Oct 2022
What shapes the loss landscape of self-supervised learning? Liu Ziyin Ekdeep Singh Lubana Masakuni Ueda Hidenori Tanaka 48 20 0 02 Oct 2022
Federated Representation Learning via Maximal Coding Rate Reduction J. Cerviño Navid Naderializadeh Alejandro Ribeiro FedML 36 0 0 01 Oct 2022
Towards Understanding and Mitigating Dimensional Collapse in Heterogeneous Federated Learning Yujun Shi Jian Liang Wenqing Zhang Vincent Y. F. Tan Song Bai FedML 79 55 0 01 Oct 2022
Federated Training of Dual Encoding Models on Small Non-IID Client Datasets Raviteja Vemulapalli Warren Morningstar Philip Mansfield Hubert Eichner K. Singhal Arash Afkanpour Bradley Green FedML 27 2 0 30 Sep 2022
Disentanglement with Biological Constraints: A Theory of Functional Cell Types James C. R. Whittington W. Dorrell Surya Ganguli Timothy Edward John Behrens 36 39 0 30 Sep 2022
Minimalistic Unsupervised Learning with the Sparse Manifold Transform Yubei Chen Zeyu Yun Y. Ma Bruno A. Olshausen Yann LeCun 45 8 0 30 Sep 2022
Mind Reader: Reconstructing complex images from brain activities Sikun Lin Thomas C. Sprague Ambuj K. Singh DiffM 124 86 0 30 Sep 2022
Understanding Collapse in Non-Contrastive Siamese Representation Learning Alexander C. Li Alexei A. Efros Deepak Pathak SSL 45 33 0 29 Sep 2022
Variance Covariance Regularization Enforces Pairwise Independence in Self-Supervised Representations Grégoire Mialon Randall Balestriero Yann LeCun 24 9 0 29 Sep 2022
Joint Embedding Self-Supervised Learning in the Kernel Regime B. Kiani Randall Balestriero Yubei Chen S. Lloyd Yann LeCun SSL 41 13 0 29 Sep 2022
Text-Adaptive Multiple Visual Prototype Matching for Video-Text Retrieval Che-Hsien Lin Ancong Wu Junwei Liang Jun Zhang Wenhang Ge Wei Zheng Chunhua Shen 87 21 0 27 Sep 2022
Multi-dataset Training of Transformers for Robust Action Recognition Junwei Liang Enwei Zhang Jun Zhang Chunhua Shen ViT 37 11 0 26 Sep 2022
Pretraining the Vision Transformer using self-supervised methods for vision based Deep Reinforcement Learning Manuel Goulão Arlindo L. Oliveira ViT 33 6 0 22 Sep 2022
Contrastive Learning for Time Series on Dynamic Graphs Yitian Zhang Florence Regol Antonios Valkanas Mark J. Coates AI4TS 14 0 0 21 Sep 2022
Interneurons accelerate learning dynamics in recurrent neural networks for statistical adaptation David Lipshutz C. Pehlevan D. Chklovskii 17 11 0 21 Sep 2022
The Geometry of Self-supervised Learning Models and its Impact on Transfer Learning Romain Cosentino Sarath Shekkizhar Mahdi Soltanolkotabi A. Avestimehr Antonio Ortega SSL 46 7 0 18 Sep 2022
Self-Supervised Learning with an Information Maximization Criterion Serdar Ozsoy Shadi S. Hamdan Sercan Ö. Arik Deniz Yuret A. Erdogan SSL 16 33 0 16 Sep 2022
Towards A Unified Policy Abstraction Theory and Representation Learning Approach in Markov Decision Processes M. Zhang Hongyao Tang Jianye Hao Yan Zheng OffRL 23 0 0 16 Sep 2022
Improving Self-Supervised Learning by Characterizing Idealized Representations Yann Dubois Tatsunori Hashimoto Stefano Ermon Percy Liang SSL 68 40 0 13 Sep 2022
HistoPerm: A Permutation-Based View Generation Approach for Improving Histopathologic Feature Representation Learning Joseph DiPalma Lorenzo Torresani Saeed Hassanpour AI4TS MedIm 22 2 0 13 Sep 2022
Graph Neural Networks for Molecules Yuyang Wang Zijie Li A. Farimani GNN AI4CE 45 20 0 12 Sep 2022
Self-Supervised Pyramid Representation Learning for Multi-Label Visual Analysis and Beyond Cheng-Yen Hsieh Chih-Jung Chang Fu-En Yang Yu-Chiang Frank Wang SSL 20 8 0 30 Aug 2022
Light-weight probing of unsupervised representations for Reinforcement Learning Wancong Zhang Anthony GX-Chen Vlad Sobal Yann LeCun Nicolas Carion SSL OffRL 33 13 0 25 Aug 2022
SCALE: Online Self-Supervised Lifelong Learning without Prior Knowledge Xiaofan Yu Yunhui Guo Sicun Gao Tajana Simunic CLL SSL 28 14 0 24 Aug 2022
Comparison of semi-supervised learning methods for High Content Screening quality control Umar Masud Ethan O. Cohen Ihab Bendidi Guillaume Bollot Auguste Genovesio 26 4 0 09 Aug 2022
Understanding Masked Image Modeling via Learning Occlusion Invariant Feature Xiangwen Kong Xiangyu Zhang SSL 24 53 0 08 Aug 2022
Analyzing Data-Centric Properties for Graph Contrastive Learning Puja Trivedi Ekdeep Singh Lubana Mark Heimann Danai Koutra Jayaraman J. Thiagarajan 26 11 0 04 Aug 2022
What can we Learn by Predicting Accuracy? Olivier Risser-Maroix Benjamin Chamand 22 4 0 02 Aug 2022
SampleMatch: Drum Sample Retrieval by Musical Context Stefan Lattner 22 7 0 01 Aug 2022
Self-supervised learning with rotation-invariant kernels Léon Zheng Gilles Puy E. Riccietti Patrick Pérez Rémi Gribonval SSL 9 2 0 28 Jul 2022
Contrastive Masked Autoencoders are Stronger Vision Learners Zhicheng Huang Xiaojie Jin Cheng Lu Qibin Hou Mingg-Ming Cheng Dongmei Fu Xiaohui Shen Jiashi Feng 31 147 0 27 Jul 2022
Time to augment self-supervised visual representation learning A. Aubret M. Ernst Céline Teulière Jochen Triesch 26 10 0 27 Jul 2022
Unsupervised Domain Adaptation for Video Transformers in Action Recognition Victor G. Turrisi da Costa Giacomo Zara Paolo Rota Thiago Oliveira-Santos N. Sebe Vittorio Murino Elisa Ricci 14 13 0 26 Jul 2022
Equivariance and Invariance Inductive Bias for Learning from Insufficient Data Tan Wang Qianru Sun Sugiri Pranata J. Karlekar Hanwang Zhang SSL 31 19 0 25 Jul 2022