On the Pros and Cons of Momentum Encoder in Self-Supervised Visual
Representation Learning

On the Pros and Cons of Momentum Encoder in Self-Supervised Visual Representation Learning

11 August 2022

Kang Zhang

Papers citing "On the Pros and Cons of Momentum Encoder in Self-Supervised Visual Representation Learning"

9 / 9 papers shown

Title
MDSGen: Fast and Efficient Masked Diffusion Temporal-Aware Transformers for Open-Domain Sound Generation T. Pham Tri Ton Chang D. Yoo 36 3 0 03 Oct 2024
Unsupervised Learning on a DIET: Datum IndEx as Target Free of Self-Supervision, Reconstruction, Projector Head Randall Balestriero 38 3 0 20 Feb 2023
Self-Supervised Visual Representation Learning via Residual Momentum T. Pham Axi Niu Zhang Kang Sultan Rizky Hikmawan Madjid Jiajing Hong Daehyeok Kim Joshua Tian Jin Tee Chang-Dong Yoo SSL 34 6 0 17 Nov 2022
Representational Continuity for Unsupervised Continual Learning Divyam Madaan Jaehong Yoon Yuanchun Li Yunxin Liu Sung Ju Hwang CLL SSL 62 111 0 13 Oct 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 300 5,761 0 29 Apr 2021
Contrastive Learning for Compact Single Image Dehazing Haiyan Wu Yanyun Qu Shaohui Lin J. Zhou Ruizhi Qiao Zhizhong Zhang Yuan Xie Lizhuang Ma 122 560 0 19 Apr 2021
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 238 3,359 0 09 Mar 2020
Quasi-hyperbolic momentum and Adam for deep learning Jerry Ma Denis Yarats ODL 73 126 0 16 Oct 2018
Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results Antti Tarvainen Harri Valpola OOD MoMe 244 1,276 0 06 Mar 2017