VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning

11 May 2021

Papers citing "VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning"

50 / 613 papers shown

Title
Stochastic Vision Transformers with Wasserstein Distance-Aware Attention Franciskus Xaverius Erick Mina Rezaei Johanna P. Müller Bernhard Kainz 11 0 0 30 Nov 2023
Do text-free diffusion models learn discriminative visual representations? Soumik Mukhopadhyay M. Gwilliam Yosuke Yamaguchi Vatsal Agarwal Namitha Padmanabhan Archana Swaminathan Tianyi Zhou Abhinav Shrivastava DiffM 24 11 1 29 Nov 2023
Making Self-supervised Learning Robust to Spurious Correlation via Learning-speed Aware Sampling Weicheng Zhu Sheng Liu C. Fernandez‐Granda N. Razavian 41 1 0 27 Nov 2023
Understanding Self-Supervised Features for Learning Unsupervised Instance Segmentation Paul Engstler Luke Melas-Kyriazi Christian Rupprecht Iro Laina SSL 20 3 0 24 Nov 2023
Self-Distilled Representation Learning for Time Series Felix Pieper Konstantin Ditschuneit Martin Genzel Alexandra Lindt Johannes Otterbach AI4TS 21 1 0 19 Nov 2023
Deep Tensor Network Yifan Zhang 16 0 0 18 Nov 2023
From Pretext to Purpose: Batch-Adaptive Self-Supervised Learning Jiansong Zhang Linlin Shen Peizhong Liu SSL 24 0 0 16 Nov 2023
Self-Supervised Disentanglement by Leveraging Structure in Data Augmentations Cian Eastwood Julius von Kügelgen Linus Ericsson Diane Bouchacourt Pascal Vincent Bernhard Schölkopf Mark Ibrahim 34 10 0 15 Nov 2023
Transpose Attack: Stealing Datasets with Bidirectional Training Guy Amit Mosh Levy Yisroel Mirsky SILM AAML 39 0 0 13 Nov 2023
Contrastive Learning of View-Invariant Representations for Facial Expressions Recognition Shuvendu Roy Ali Etemad 33 2 0 12 Nov 2023
Proceedings of the 5th International Workshop on Reading Music Systems Jorge Calvo-Zaragoza Alexander Pacha Elona Shatri 19 0 0 07 Nov 2023
Random Field Augmentations for Self-Supervised Representation Learning Philip Mansfield Arash Afkanpour Warren Morningstar Karan Singhal OOD 12 2 0 07 Nov 2023
A Graph-Theoretic Framework for Understanding Open-World Semi-Supervised Learning Yiyou Sun Zhenmei Shi Yixuan Li OffRL 32 20 0 06 Nov 2023
Architecture Matters: Uncovering Implicit Mechanisms in Graph Contrastive Learning Xiaojun Guo Yifei Wang Zeming Wei Yisen Wang 26 11 0 05 Nov 2023
CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoders A. Fuller K. Millard James R. Green 15 60 0 01 Nov 2023
Rethinking Samples Selection for Contrastive Learning: Mining of Potential Samples Hengkui Dong Xianzhong Long Yun Li 30 2 0 01 Nov 2023
Battle of the Backbones: A Large-Scale Comparison of Pretrained Models across Computer Vision Tasks Micah Goldblum Hossein Souri Renkun Ni Manli Shu Viraj Prabhu ... Adrien Bardes Judy Hoffman Ramalingam Chellappa Andrew Gordon Wilson Tom Goldstein VLM 73 62 0 30 Oct 2023
Patch-Wise Self-Supervised Visual Representation Learning: A Fine-Grained Approach Ali Javidani Mohammad Amin Sadeghi Babak Nadjar Araabi 25 0 0 28 Oct 2023
Unveiling the Potential of Probabilistic Embeddings in Self-Supervised Learning Denis Janiak Jakub Binkowski Piotr Bielak Tomasz Kajdanowicz SSL UQCV 15 0 0 27 Oct 2023
Grid Jigsaw Representation with CLIP: A New Perspective on Image Clustering Zijie Song Zhenzhen Hu Richang Hong SSL 38 0 0 27 Oct 2023
Learning Repeatable Speech Embeddings Using An Intra-class Correlation Regularizer Jianwei Zhang Suren Jayasuriya Visar Berisha SSL 25 2 0 25 Oct 2023
Representation Learning via Consistent Assignment of Views over Random Partitions T. Silva Adín Ramirez Rivera SSL 11 2 0 19 Oct 2023
MTS-LOF: Medical Time-Series Representation Learning via Occlusion-Invariant Features Huayu Li Ana S. Carreon-Rascon Xiwen Chen Geng Yuan Ao Li AI4TS 11 5 0 19 Oct 2023
Splicing Up Your Predictions with RNA Contrastive Learning Phil Fradkin Ruian Shi Bo Wang Brendan Frey Leo J. Lee SSL 24 0 0 12 Oct 2023
Is ImageNet worth 1 video? Learning strong image encoders from 1 long unlabelled video Shashanka Venkataramanan Mamshad Nayeem Rizve João Carreira Yuki M. Asano Yannis Avrithis SSL 29 18 0 12 Oct 2023
SegLoc: Visual Self-supervised Learning Scheme for Dense Prediction Tasks of Security Inspection X-ray Images Shervin Halat Mohammad Rahmati Ehsan Nazerfard 33 0 0 12 Oct 2023
Survey on Imbalanced Data, Representation Learning and SEP Forecasting Josias Moukpe AI4TS 24 0 0 11 Oct 2023
Self-Supervised Dataset Distillation for Transfer Learning Dong Bok Lee Seanie Lee Joonho Ko Kenji Kawaguchi Juho Lee Sung Ju Hwang DD 41 3 0 10 Oct 2023
Adaptive Multi-head Contrastive Learning Lei Wang Piotr Koniusz Tom Gedeon Liang Zheng 28 4 0 09 Oct 2023
Robust Image Watermarking based on Cross-Attention and Invariant Domain Learning Agnibh Dasgupta Xin Zhong 31 0 0 09 Oct 2023
FroSSL: Frobenius Norm Minimization for Efficient Multiview Self-Supervised Learning Oscar Skean A. Dhakal Nathan Jacobs Luis Gonzalo Sánchez Giraldo 29 0 0 04 Oct 2023
Self-supervised Learning of Contextualized Local Visual Embeddings T. Silva Hélio Pedrini Adín Ramirez Rivera SSL 10 3 0 01 Oct 2023
Information Flow in Self-Supervised Learning Zhiyuan Tan Jingqin Yang Weiran Huang Yang Yuan Yifan Zhang SSL 25 13 0 29 Sep 2023
Understanding and Mitigating the Label Noise in Pre-training on Downstream Tasks Hao Chen Jindong Wang Ankit Shah Ran Tao Hongxin Wei Berfin cSimcsek Masashi Sugiyama Bhiksha Raj 24 26 0 29 Sep 2023
Symmetry Induces Structure and Constraint of Learning Liu Ziyin 26 10 0 29 Sep 2023
FLIP: Cross-domain Face Anti-spoofing with Language Guidance K. Srivatsan Muzammal Naseer Karthik Nandakumar CVBM 42 44 0 28 Sep 2023
Generalizable Heterogeneous Federated Cross-Correlation and Instance Similarity Learning Wenke Huang J. J. Valero-Mas Dasaem Jeong Bo Du FedML 30 44 0 28 Sep 2023
Feature Normalization Prevents Collapse of Non-contrastive Learning Dynamics Han Bao SSL MLT 24 1 0 28 Sep 2023
Learning from SAM: Harnessing a Foundation Model for Sim2Real Adaptation by Regularization Mayara Bonani Max Schwarz Sven Behnke 26 0 0 27 Sep 2023
STERLING: Self-Supervised Terrain Representation Learning from Unconstrained Robot Experience Haresh Karnan Elvin Yang Daniel Farkash Garrett A. Warnell Joydeep Biswas Peter Stone SSL 23 26 0 26 Sep 2023
Masked Image Residual Learning for Scaling Deeper Vision Transformers Guoxi Huang Hongtao Fu A. Bors 26 7 0 25 Sep 2023
Revisiting LARS for Large Batch Training Generalization of Neural Networks K. Do Duong Nguyen Hoa Nguyen Long Tran-Thanh Nguyen-Hoang Tran Viet Quoc Pham AI4CE ODL 8 0 0 25 Sep 2023
VIC-KD: Variance-Invariance-Covariance Knowledge Distillation to Make Keyword Spotting More Robust Against Adversarial Attacks Heitor R. Guimarães Arthur Pimentel Anderson R. Avila Tiago H. Falk AAML 20 0 0 22 Sep 2023
See to Touch: Learning Tactile Dexterity through Visual Incentives Irmak Güzey Yinlong Dai Ben Evans Soumith Chintala Lerrel Pinto 21 30 0 21 Sep 2023
DimCL: Dimensional Contrastive Learning For Improving Self-Supervised Learning Thanh Nguyen T. Pham Chaoning Zhang T. Luu Thang Vu Chang-Dong Yoo 23 9 0 21 Sep 2023
Weak Supervision for Label Efficient Visual Bug Detection F. Rahman 11 2 0 20 Sep 2023
Motif-Centric Representation Learning for Symbolic Music Yuxuan Wu Roger B. Dannenberg Gus Xia 16 0 0 19 Sep 2023
Regularized Contrastive Pre-training for Few-shot Bioacoustic Sound Detection Ilyass Moummad Romain Serizel Nicolas Farrugia 31 7 0 16 Sep 2023
Understanding the limitations of self-supervised learning for tabular anomaly detection Kimberly T. Mai Toby O. Davies Lewis D. Griffin SSL 24 0 0 15 Sep 2023
Plasticity-Optimized Complementary Networks for Unsupervised Continual Learning Alex Gomez-Villa Bartlomiej Twardowski Kai Wang Joost van de Weijer SSL CLL 28 8 0 12 Sep 2023