Understanding and Improving the Role of Projection Head in
Self-Supervised Learning

Understanding and Improving the Role of Projection Head in Self-Supervised Learning

22 December 2022

Thalaiyasingam Ajanthan

Papers citing "Understanding and Improving the Role of Projection Head in Self-Supervised Learning"

11 / 11 papers shown

Title
Cross-Modal Consistency Learning for Sign Language Recognition Kepeng Wu Zecheng Li Weichao Zhao Hezhen Hu Wengang Zhou SLR 44 0 0 16 Mar 2025
RANGE: Retrieval Augmented Neural Fields for Multi-Resolution Geo-Embeddings A. Dhakal S. Sastry Subash Khanal Adeel Ahmad Eric Xing Nathan Jacobs 50 0 0 27 Feb 2025
Joint-Embedding Masked Autoencoder for Self-supervised Learning of Dynamic Functional Connectivity from the Human Brain Jungwon Choi Hyungi Lee Byung-Hoon Kim Juho Lee 72 0 0 11 Mar 2024
Efficient Semi-Supervised Federated Learning for Heterogeneous Participants Zhipeng Sun Yang Xu Hong-Ze Xu Liusheng Huang C. Qiao FedML 17 0 0 29 Jul 2023
S-JEA: Stacked Joint Embedding Architectures for Self-Supervised Visual Representation Learning Alvzbveta Manová A. Durrant Georgios Leontidis SSL 19 4 0 19 May 2023
Deciphering the Projection Head: Representation Evaluation Self-supervised Learning Jiajun Ma Tianyang Hu Wenjia Wang 17 8 0 28 Jan 2023
With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations Debidatta Dwibedi Y. Aytar Jonathan Tompson P. Sermanet Andrew Zisserman SSL 185 452 0 29 Apr 2021
Understanding self-supervised Learning Dynamics without Contrastive Pairs Yuandong Tian Xinlei Chen Surya Ganguli SSL 138 279 0 12 Feb 2021
BYOL works even without batch statistics Pierre Harvey Richemond Jean-Bastien Grill Florent Altché Corentin Tallec Florian Strub ... Samuel L. Smith Soham De Razvan Pascanu Bilal Piot Michal Valko SSL 247 114 0 20 Oct 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 264 3,369 0 09 Mar 2020
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 290 11,681 0 09 Mar 2017