VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning

11 May 2021

Papers citing "VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning"

50 / 613 papers shown

Title
A Simple Recipe for Competitive Low-compute Self supervised Vision Models Quentin Duval Ishan Misra Nicolas Ballas 29 9 0 23 Jan 2023
Unifying Synergies between Self-supervised Learning and Dynamic Computation Tarun Krishna Ayush Rai Alexandru Drimbarean Eric Arazo Paul Albert A. Smeaton Kevin McGuinness Noel E. O'Connor 24 0 0 22 Jan 2023
Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture Mahmoud Assran Quentin Duval Ishan Misra Piotr Bojanowski Pascal Vincent Michael G. Rabbat Yann LeCun Nicolas Ballas SSL AI4TS MDE 27 318 0 19 Jan 2023
Vision Learners Meet Web Image-Text Pairs Bingchen Zhao Quan Cui Hao Wu Osamu Yoshie Cheng Yang Oisin Mac Aodha VLM 21 5 0 17 Jan 2023
A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trends Jie Gui Tuo Chen Jing Zhang Qiong Cao Zhe Sun Haoran Luo Dacheng Tao 29 122 0 13 Jan 2023
Self-Supervised Image-to-Point Distillation via Semantically Tolerant Contrastive Loss Anas Mahmoud Jordan S. K. Hu Tianshu Kuai Ali Harakeh Liam Paull Steven L. Waslander 3DPC SSL 30 29 0 12 Jan 2023
GraVIS: Grouping Augmented Views from Independent Sources for Dermatology Analysis Hong-Yu Zhou Chi-Ken Lu Liansheng Wang Yizhou Yu OOD 6 0 0 11 Jan 2023
Learning by Sorting: Self-supervised Learning with Group Ordering Constraints Nina Shvetsova Felix Petersen Anna Kukleva Bernt Schiele Hilde Kuehne SSL 44 11 0 05 Jan 2023
Unsupervised Manifold Linearizing and Clustering Tianjiao Ding Shengbang Tong Kwan Ho Ryan Chan Xili Dai Y. Ma B. Haeffele 16 11 0 04 Jan 2023
GEDI: GEnerative and DIscriminative Training for Self-Supervised Learning Emanuele Sansone Robin Manhaeve SSL 17 9 0 27 Dec 2022
Precise Location Matching Improves Dense Contrastive Learning in Digital Pathology Jingwei Zhang S. Kapse Ke Ma Prateek Prasanna Maria Vakalopoulou Joel H. Saltz Dimitris Samaras 24 9 0 23 Dec 2022
Contrastive Distillation Is a Sample-Efficient Self-Supervised Loss Policy for Transfer Learning Christopher T. Lengerich Gabriel Synnaeve Amy Zhang Hugh Leather Kurt Shuster Franccois Charton Charysse Redwood SSL OffRL 19 1 0 21 Dec 2022
Similarity Contrastive Estimation for Image and Video Soft Contrastive Self-Supervised Learning J. Denize Jaonary Rabarisoa Astrid Orcesi Romain Hérault SSL 14 6 0 21 Dec 2022
Masked Event Modeling: Self-Supervised Pretraining for Event Cameras Simone Klenk David Bonello Lukas Koestler Nikita Araslanov Daniel Cremers 21 22 0 20 Dec 2022
Semantics-Consistent Feature Search for Self-Supervised Visual Representation Learning Kaiyou Song Shanyi Zhang Zihao An Zimeng Luo Tongzhou Wang Jin Xie SSL 17 6 0 13 Dec 2022
TriNet: stabilizing self-supervised learning from complete or slow collapse on ASR Lixin Cao J. Wang Ben Yang Dan Su Dong Yu 18 4 0 12 Dec 2022
Implicit variance regularization in non-contrastive SSL Manu Srinath Halvagal Axel Laborieux Friedemann Zenke 34 8 0 09 Dec 2022
Linear Classification of Neural Manifolds with Correlated Variability Albert J. Wakhloo Tamara J. Sussman SueYeon Chung 16 10 0 27 Nov 2022
A Theoretical Study of Inductive Biases in Contrastive Learning Jeff Z. HaoChen Tengyu Ma UQCV SSL 30 31 0 27 Nov 2022
A Unified Framework for Contrastive Learning from a Perspective of Affinity Matrix Wenbin Li Meihao Kong Xuesong Yang Lei Wang Jing Huo Yang Gao Jiebo Luo 25 0 0 26 Nov 2022
Self-Supervised Learning based on Heat Equation Yinpeng Chen Xiyang Dai Dongdong Chen Mengchen Liu Lu Yuan Zicheng Liu Youzuo Lin 29 4 0 23 Nov 2022
Reason from Context with Self-supervised Learning Xinyu Liu Ankur Sikarwar Gabriel Kreiman Zenglin Shi Mengmi Zhang ReLM LRM 14 1 0 23 Nov 2022
A Generalized EigenGame with Extensions to Multiview Representation Learning James Chapman A. L. Aguila Lennie Wells 11 0 0 21 Nov 2022
Joint Embedding Predictive Architectures Focus on Slow Features Vlad Sobal V. JyothirS Siddhartha Jalagam Nicolas Carion Kyunghyun Cho Yann LeCun 11 8 0 20 Nov 2022
Weighted Ensemble Self-Supervised Learning Yangjun Ruan Saurabh Singh Warren Morningstar Alexander A. Alemi Sergey Ioffe Ian S. Fischer Joshua V. Dillon FedML 22 15 0 18 Nov 2022
Self-Supervised Visual Representation Learning via Residual Momentum T. Pham Axi Niu Zhang Kang Sultan Rizky Hikmawan Madjid Jiajing Hong Daehyeok Kim Joshua Tian Jin Tee Chang-Dong Yoo SSL 41 6 0 17 Nov 2022
Towards All-in-one Pre-training via Maximizing Multi-modal Mutual Information Weijie Su Xizhou Zhu Chenxin Tao Lewei Lu Bin Li Gao Huang Yu Qiao Xiaogang Wang Jie Zhou Jifeng Dai 34 41 0 17 Nov 2022
Robust Alzheimer's Progression Modeling using Cross-Domain Self-Supervised Deep Learning Saba Dadsetan Mohsen Hejrati Shandong Wu Somaye Hashemifar OOD 8 0 0 15 Nov 2022
LLEDA -- Lifelong Self-Supervised Domain Adaptation Mamatha Thota Dewei Yi Georgios Leontidis CLL 63 7 0 12 Nov 2022
Mitigating Forgetting in Online Continual Learning via Contrasting Semantically Distinct Augmentations Shenghao Yu Wei-Chen Chiu CLL 13 1 0 10 Nov 2022
Pushing the limits of self-supervised speaker verification using regularized distillation framework Yafeng Chen Siqi Zheng Haibo Wang Luyao Cheng Qian Chen 12 23 0 08 Nov 2022
On minimal variations for unsupervised representation learning Vivien A. Cabannes A. Bietti Randall Balestriero SSL DRL 25 8 0 07 Nov 2022
Distilling Representations from GAN Generator via Squeeze and Span Yu Yang Xiaotian Cheng Chang-rui Liu Hakan Bilen Xiang Ji GAN 29 0 0 06 Nov 2022
Local Manifold Augmentation for Multiview Semantic Consistency Yu Yang Wing Yin Cheung Chang-rui Liu Xiang Ji 29 1 0 05 Nov 2022
Unsupervised Visual Representation Learning via Mutual Information Regularized Assignment Dong Lee Sung-Ik Choi Hyunwoo J. Kim Sae-Young Chung SSL 21 7 0 04 Nov 2022
EquiMod: An Equivariance Module to Improve Self-Supervised Learning Alexandre Devillers Mathieu Lefort SSL 6 18 0 02 Nov 2022
Beyond Instance Discrimination: Relation-aware Contrastive Self-supervised Learning Yifei Zhang Chang-rui Liu Yu Zhou Weiping Wang QiXiang Ye Xiangyang Ji SSL ISeg BDL 19 6 0 02 Nov 2022
Self-Supervised Learning with Limited Labeled Data for Prostate Cancer Detection in High Frequency Ultrasound P. Wilson Mahdi Gilany A. Jamzad Fahimeh Fooladgar Minh Nguyen Nhat To Brian Wodlinger Purang Abolmaesumi P. Mousavi 40 12 0 01 Nov 2022
DyG2Vec: Efficient Representation Learning for Dynamic Graphs Mohammad Ali Alomrani Mahdi Biparva Yingxue Zhang Mark J. Coates AI4TS 34 3 0 30 Oct 2022
Unsupervised Learning of Structured Representations via Closed-Loop Transcription Shengbang Tong Xili Dai Yubei Chen Mingyang Li Zengyi Li Brent Yi Yann LeCun Y. Ma SSL DRL 21 7 0 30 Oct 2022
IDEAL: Improved DEnse locAL Contrastive Learning for Semi-Supervised Medical Image Segmentation Hritam Basak Soumitri Chattopadhyay Rohit Kundu Sayan Nag R. Mallipeddi SSL 14 8 0 26 Oct 2022
The Curious Case of Benign Memorization Sotiris Anagnostidis Gregor Bachmann Lorenzo Noci Thomas Hofmann AAML 41 8 0 25 Oct 2022
Robust Self-Supervised Learning with Lie Groups Mark Ibrahim Diane Bouchacourt Ari S. Morcos SSL OOD 33 6 0 24 Oct 2022
Neural Eigenfunctions Are Structured Representation Learners Zhijie Deng Jiaxin Shi Hao Zhang Peng Cui Cewu Lu Jun Zhu 45 14 0 23 Oct 2022
Anchored Speech Recognition with Neural Transducers Desh Raj J. Jia Jay Mahadeokar Chunyang Wu Niko Moritz Xiaohui Zhang Ozlem Kalinli 6 2 0 20 Oct 2022
VIBUS: Data-efficient 3D Scene Parsing with VIewpoint Bottleneck and Uncertainty-Spectrum Modeling Beiwen Tian Liyi Luo Hao Zhao Guyue Zhou 17 23 0 20 Oct 2022
Self-Supervised Learning via Maximum Entropy Coding Xin Liu Zhongdao Wang Yali Li Shengjin Wang SSL 15 39 0 20 Oct 2022
AugCSE: Contrastive Sentence Embedding with Diverse Augmentations Zilu Tang Muhammed Yusuf Kocyigit Derry Wijaya 32 8 0 20 Oct 2022
Rethinking Prototypical Contrastive Learning through Alignment, Uniformity and Correlation Shentong Mo Zhun Sun Chao Li 15 11 0 18 Oct 2022
Depth Contrast: Self-Supervised Pretraining on 3DPM Images for Mining Material Classification Prakash Chandra Chhipa Richa Upadhyay Rajkumar Saini Lars Lindqvist R. Nordenskjöld Seiichi Uchida Marcus Liwicki MDE 12 2 0 18 Oct 2022