Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methods

23 May 2022

Papers citing "Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methods"

33 / 33 papers shown

Title
Contextures: Representations from Contexts Runtian Zhai Kai Yang Che-Ping Tsai Burak Varici Zico Kolter Pradeep Ravikumar 110 0 0 02 May 2025
Riemannian Optimization on Relaxed Indicator Matrix Manifold Jinghui Yuan Fangyuan Xie Feiping Nie Xuelong Li 72 0 0 26 Mar 2025
Enhancing Graph Self-Supervised Learning with Graph Interplay Xinjian Zhao Wei Pang Xiangru Jian Yaoyao Xu Chaolong Ying Tianshu Yu 45 0 0 17 Jan 2025
Cross-Entropy Is All You Need To Invert the Data Generating Process Patrik Reizinger Alice Bizeul Attila Juhos Julia E. Vogt Randall Balestriero Wieland Brendel David Klindt SSL OOD BDL DRL 102 3 0 29 Oct 2024
InfoNCE: Identifying the Gap Between Theory and Practice E. Rusak Patrik Reizinger Attila Juhos Oliver Bringmann Roland S. Zimmermann Wieland Brendel 33 5 0 28 Jun 2024
Poly-View Contrastive Learning Amitis Shidani Devon Hjelm Jason Ramapuram Russ Webb Eeshan Gunesh Dhekane Dan Busbridge VLM SSL 34 4 0 08 Mar 2024
Unsupervised Multi-modal Feature Alignment for Time Series Representation Learning Cheng Liang Donghua Yang Zhiyu Liang Hongzhi Wang Zheng Liang Xiyang Zhang Jianfeng Huang AI4TS 143 1 0 09 Dec 2023
Unraveling Projection Heads in Contrastive Learning: Insights from Expansion and Shrinkage Yu Gui Cong Ma Yiqiao Zhong 22 6 0 06 Jun 2023
Spectal Harmonics: Bridging Spectral Embedding and Matrix Completion in Self-Supervised Learning Marina Munkhoeva Ivan V. Oseledets SSL 21 2 0 31 May 2023
Exploring the Utility of Self-Supervised Pretraining Strategies for the Detection of Absent Lung Sliding in M-Mode Lung Ultrasound Blake Vanberlo Brian Li Alexander Wong Jesse Hoey R. Arntfield 13 4 0 05 Apr 2023
On the Stepwise Nature of Self-Supervised Learning James B. Simon Maksis Knutins Liu Ziyin Daniel Geisz Abraham J. Fetterman Joshua Albrecht SSL 32 29 0 27 Mar 2023
Active Self-Supervised Learning: A Few Low-Cost Relationships Are All You Need Vivien A. Cabannes Léon Bottou Yann LeCun Randall Balestriero 40 13 0 27 Mar 2023
Towards Democratizing Joint-Embedding Self-Supervised Learning Florian Bordes Randall Balestriero Pascal Vincent 19 20 0 03 Mar 2023
Unsupervised Learning on a DIET: Datum IndEx as Target Free of Self-Supervision, Reconstruction, Projector Head Randall Balestriero 38 3 0 20 Feb 2023
The Edge of Orthogonality: A Simple View of What Makes BYOL Tick Pierre Harvey Richemond Allison C. Tam Yunhao Tang Florian Strub Bilal Piot Felix Hill SSL 26 9 0 09 Feb 2023
The SSL Interplay: Augmentations, Inductive Bias, and Generalization Vivien A. Cabannes B. Kiani Randall Balestriero Yann LeCun A. Bietti SSL 11 31 0 06 Feb 2023
GEDI: GEnerative and DIscriminative Training for Self-Supervised Learning Emanuele Sansone Robin Manhaeve SSL 20 9 0 27 Dec 2022
On minimal variations for unsupervised representation learning Vivien A. Cabannes A. Bietti Randall Balestriero SSL DRL 25 8 0 07 Nov 2022
Augmentation Invariant Manifold Learning Shulei Wang 33 1 0 01 Nov 2022
Self-Supervised Learning Through Efference Copies Franz Scherr Qinghai Guo Timoleon Moraitis 19 10 0 17 Oct 2022
RankMe: Assessing the downstream performance of pretrained self-supervised representations by their rank Q. Garrido Randall Balestriero Laurent Najman Yann LeCun SSL 46 72 0 05 Oct 2022
Minimalistic Unsupervised Learning with the Sparse Manifold Transform Yubei Chen Zeyu Yun Y. Ma Bruno A. Olshausen Yann LeCun 45 8 0 30 Sep 2022
Does Zero-Shot Reinforcement Learning Exist? Ahmed Touati Jérémy Rapin Yann Ollivier OffRL 28 38 0 29 Sep 2022
Variance Covariance Regularization Enforces Pairwise Independence in Self-Supervised Representations Grégoire Mialon Randall Balestriero Yann LeCun 26 9 0 29 Sep 2022
Joint Embedding Self-Supervised Learning in the Kernel Regime B. Kiani Randall Balestriero Yubei Chen S. Lloyd Yann LeCun SSL 41 13 0 29 Sep 2022
Graph Data Augmentation for Graph Machine Learning: A Survey Tong Zhao Wei Jin Yozen Liu Yingheng Wang Gang Liu Stephan Günnemann Neil Shah Meng-Long Jiang OOD 30 79 0 17 Feb 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 305 7,434 0 11 Nov 2021
On Feature Decorrelation in Self-Supervised Learning Tianyu Hua Wenxiao Wang Zihui Xue Sucheng Ren Yue Wang Hang Zhao SSL OOD 119 187 0 02 May 2021
With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations Debidatta Dwibedi Y. Aytar Jonathan Tompson P. Sermanet Andrew Zisserman SSL 188 452 0 29 Apr 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 314 5,775 0 29 Apr 2021
Understanding self-supervised Learning Dynamics without Contrastive Pairs Yuandong Tian Xinlei Chen Surya Ganguli SSL 138 279 0 12 Feb 2021
On the surprising similarities between supervised and self-supervised models Robert Geirhos Kantharaju Narayanappa Benjamin Mitzkus Matthias Bethge Felix Wichmann Wieland Brendel OOD SSL DRL 69 46 0 16 Oct 2020
Spectral Inference Networks: Unifying Deep and Spectral Learning David Pfau Stig Petersen Ashish Agarwal David Barrett Kimberly L. Stachenfeld 49 40 0 06 Jun 2018