VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning

11 May 2021

Papers citing "VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning"

50 / 613 papers shown

Title
seq-JEPA: Autoregressive Predictive Learning of Invariant-Equivariant World Models Hafez Ghaemi Eilif Muller Shahab Bakhtiari 46 0 0 06 May 2025
Contextures: Representations from Contexts Runtian Zhai Kai Yang Che-Ping Tsai Burak Varici Zico Kolter Pradeep Ravikumar 92 0 0 02 May 2025
Combatting Dimensional Collapse in LLM Pre-Training Data via Diversified File Selection Ziqing Fan Siyuan Du Shengchao Hu Pingjie Wang Li Shen Y. Zhang Dacheng Tao Y. Wang 41 1 0 29 Apr 2025
JEPA for RL: Investigating Joint-Embedding Predictive Architectures for Reinforcement Learning Tristan Kenneweg Philip Kenneweg Barbara Hammer AI4TS 30 0 0 23 Apr 2025
Representation Learning via Non-Contrastive Mutual Information Z. Guo Bernardo Avila-Pires Khimya Khetarpal Dale Schuurmans Bo Dai SSL 61 0 0 23 Apr 2025
The Efficacy of Semantics-Preserving Transformations in Self-Supervised Learning for Medical Ultrasound Blake Vanberlo Alexander Wong Jesse Hoey R. Arntfield 39 0 0 10 Apr 2025
Evolutionary algorithms meet self-supervised learning: a comprehensive survey Adriano Vinhas João Correia Penousal Machado SSL SyDa 59 0 0 09 Apr 2025
Measuring Déjà vu Memorization Efficiently Narine Kokhlikyan Bargav Jayaraman Florian Bordes Chuan Guo Kamalika Chaudhuri 25 1 0 08 Apr 2025
Variational Self-Supervised Learning Mehmet Can Yavuz Berrin Yanikoglu SSL 100 0 0 06 Apr 2025
Image Coding for Machines via Feature-Preserving Rate-Distortion Optimization Samuel Fernández-Menduiña Eduardo Pavez Antonio Ortega 28 0 0 03 Apr 2025
Masked Self-Supervised Pre-Training for Text Recognition Transformers on Large-Scale Datasets Martin Kiss Michal Hradiš 34 0 0 28 Mar 2025
RoCA: Robust Contrastive One-class Time Series Anomaly Detection with Contaminated Data Xudong Mou Rui Wang Bo Li Tianyu Wo Jie Sun H. Wang Xudong Liu AI4TS 45 0 0 24 Mar 2025
Text-Guided Image Invariant Feature Learning for Robust Image Watermarking Muhammad Ahtesham Xin Zhong 57 0 0 18 Mar 2025
Handling Domain Shifts for Anomalous Sound Detection: A Review of DCASE-Related Work Kevin Wilkinghoff Takuya Fujimura Keisuke Imoto Jonathan Le Roux Zheng-Hua Tan T. Toda 48 0 0 13 Mar 2025
Implicit Contrastive Representation Learning with Guided Stop-gradient Byeongchan Lee Sehyun Lee SSL 87 2 0 12 Mar 2025
Spatial Context-Driven Positive Pair Sampling for Enhanced Histopathology Image Classification Willmer Rafell Quinones Robles Sakonporn Noree Y. Ko Bryan Wong JongWoo Kim Mun Yi 47 0 0 07 Mar 2025
Projection Head is Secretly an Information Bottleneck Zhuo Ouyang Kaiwen Hu Qi Zhang Yifei Wang Yisen Wang 42 0 0 01 Mar 2025
BA-LoRA: Bias-Alleviating Low-Rank Adaptation to Mitigate Catastrophic Inheritance in Large Language Models Yupeng Chang Yi-Ju Chang Yuan Wu AI4CE ALM 87 0 0 24 Feb 2025
DUNIA: Pixel-Sized Embeddings via Cross-Modal Alignment for Earth Observation Applications Ibrahim Fayad Max Zimmer Martin Schwartz P. Ciais Fabian Gieseke Gabriel Belouze Sarah Brood A. D. Truchis Alexandre d’Aspremont AI4TS 40 0 0 24 Feb 2025
Graph Self-Supervised Learning with Learnable Structural and Positional Encodings Asiri Wijesinghe Hao Zhu Piotr Koniusz 40 0 0 22 Feb 2025
Simplifying DINO via Coding Rate Regularization Ziyang Wu Jingyuan Zhang Druv Pai X. Wang Chandan Singh Jianwei Yang Jianfeng Gao Yi-An Ma 143 1 0 17 Feb 2025
Neuron Platonic Intrinsic Representation From Dynamics Using Contrastive Learning Wei Yu Wu Can Liao Zizhen Deng Zhengrui Guo Jinzhuo Wang 36 0 0 06 Feb 2025
ConceptVAE: Self-Supervised Fine-Grained Concept Disentanglement from 2D Echocardiographies C. Ciușdel Alex Serban Tiziano Passerini CoGe 69 1 0 03 Feb 2025
Self-supervised Benchmark Lottery on ImageNet: Do Marginal Improvements Translate to Improvements on Similar Datasets? Utku Ozbulak Esla Timothy Anzaku Solha Kang W. D. Neve J. Vankerschaver 50 0 0 28 Jan 2025
BIOSCAN-5M: A Multimodal Dataset for Insect Biodiversity Zahra Gharaee Scott C. Lowe ZeMing Gong Pablo Millán Arias Nicholas Pellegrino ... Lila Kari Dirk Steinke Graham W. Taylor Paul Fieguth Angel X. Chang 44 7 0 28 Jan 2025
Color Flow Imaging Microscopy Improves Identification of Stress Sources of Protein Aggregates in Biopharmaceuticals Michaela Cohrs Shiwoo Koak Yejin Lee Yu Jin Sung W. D. Neve Hristo L. Svilenov Utku Ozbulak 38 0 0 28 Jan 2025
Memory Storyboard: Leveraging Temporal Segmentation for Streaming Self-Supervised Learning from Egocentric Videos Yanlai Yang Mengye Ren 145 0 0 21 Jan 2025
Perception Stitching: Zero-Shot Perception Encoder Transfer for Visuomotor Robot Policies Pingcheng Jian Easop Lee Zachary I. Bell Michael M. Zavlanos Boyuan Chen 65 1 0 03 Jan 2025
Mask Enhanced Deeply Supervised Prostate Cancer Detection on B-mode Micro-Ultrasound Lichun Zhang Steve Zhou Moon Hyung Choi Jeong Hoon Lee Shengtian Sang ... Wei Shao Ahmed N. El Kaffas Richard E. Fan G. Sonn M. Rusu MedIm 66 0 0 14 Dec 2024
Video Representation Learning with Joint-Embedding Predictive Architectures Katrina Drozdov Ravid Shwartz-Ziv Yann LeCun AI4TS 74 1 0 14 Dec 2024
Low-Data Classification of Historical Music Manuscripts: A Few-Shot Learning Approach Elona Shatri Daniel Raymond George Fazekas 70 0 0 25 Nov 2024
Design-o-meter: Towards Evaluating and Refining Graphic Designs Sahil Goyal Abhinav Mahajan Swasti Mishra Prateksha Udhayanan Tripti Shukla K. J. Joseph Balaji Vasan Srinivasan 70 1 0 22 Nov 2024
Infinite Width Limits of Self Supervised Neural Networks Maximilian Fleissner Gautham Govind Anil D. Ghoshdastidar SSL 139 0 0 17 Nov 2024
Understanding the Role of Equivariance in Self-supervised Learning Yifei Wang Kaiwen Hu Sharut Gupta Ziyu Ye Yisen Wang Stefanie Jegelka SSL 42 2 0 10 Nov 2024
Recurrent Joint Embedding Predictive Architecture with Recurrent Forward Propagation Learning O. M. Velarde Lucas Parra 69 0 0 10 Nov 2024
Seq-VCR: Preventing Collapse in Intermediate Transformer Representations for Enhanced Reasoning Md Rifat Arefin G. Subbaraj Nicolas Angelard-Gontier Yann LeCun Irina Rish Ravid Shwartz-Ziv C. Pal LRM 102 0 0 04 Nov 2024
Lightweight Frequency Masker for Cross-Domain Few-Shot Semantic Segmentation Jintao Tong Yixiong Zou Yuhua Li Ruixuan Li 30 4 0 29 Oct 2024
FreqMark: Invisible Image Watermarking via Frequency Based Optimization in Latent Space Yiyang Guo Ruizhe Li Mude Hui Hanzhong Guo Chen Zhang Chuangjian Cai Le Wan Shangfei Wang 19 0 0 28 Oct 2024
Connecting Joint-Embedding Predictive Architecture with Contrastive Self-supervised Learning Shentong Mo Shengbang Tong 32 1 0 25 Oct 2024
MACK: Mismodeling Addressed with Contrastive Knowledge Liam Rankin Sheldon D. Rankin Philip C. Harris 11 0 0 17 Oct 2024
Composing Novel Classes: A Concept-Driven Approach to Generalized Category Discovery Chuyu Zhang Peiyan Gu Xueyang Yu Xuming He 23 0 0 17 Oct 2024
Multiview Scene Graph Juexiao Zhang Gao Zhu Sihang Li Xinhao Liu Haorui Song Xinran Tang Chen Feng 3DV 18 1 0 15 Oct 2024
An Efficient Contrastive Unimodal Pretraining Method for EHR Time Series Data Ryan N. King Shivesh Kodali Conrad Krueger Tianbao Yang Bobak J. Mortazavi AI4TS 18 0 0 11 Oct 2024
Efficient Distribution Matching of Representations via Noise-Injected Deep InfoMax I. Butakov Alexander Sememenko Alexander Tolmachev Andrey Gladkov Marina Munkhoeva Alexey Frolov 32 0 0 09 Oct 2024
T-JEPA: Augmentation-Free Self-Supervised Learning for Tabular Data Hugo Thimonier José Lucas De Melo Costa Fabrice Popineau Arpad Rimmel Bich-Liên Doan 53 1 0 07 Oct 2024
Learning Cortico-Muscular Dependence through Orthonormal Decomposition of Density Ratios Shihan Ma Bo Hu Tianyu Jia A. Clarke Blanka Zicher Arnault H. Caillet D. Farina José C. Príncipe 18 0 0 04 Oct 2024
BiSSL: A Bilevel Optimization Framework for Enhancing the Alignment Between Self-Supervised Pre-Training and Downstream Fine-Tuning Gustav Wagner Zakarias Lars Kai Hansen Z. Tan 27 0 0 03 Oct 2024
PHI-S: Distribution Balancing for Label-Free Multi-Teacher Distillation Mike Ranzinger Jon Barker Greg Heinrich Pavlo Molchanov Bryan Catanzaro Andrew Tao 35 4 0 02 Oct 2024
Denoising with a Joint-Embedding Predictive Architecture Dengsheng Chen Jie Hu Xiaoming Wei Enhua Wu DiffM 50 2 0 02 Oct 2024
Localizing Memorization in SSL Vision Encoders Wenhao Wang Adam Dziedzic Michael Backes Franziska Boenisch 27 2 0 27 Sep 2024