On the Importance of Asymmetry for Siamese Representation Learning

1 April 2022

Papers citing "On the Importance of Asymmetry for Siamese Representation Learning"

36 / 36 papers shown

Title
Implicit Contrastive Representation Learning with Guided Stop-gradient Byeongchan Lee Sehyun Lee SSL 89 2 0 12 Mar 2025
Extract More from Less: Efficient Fine-Grained Visual Recognition in Low-Data Regimes Dmitry Demidov Abduragim Shtanchaev M. Mihaylov Mohammad Almansoori 79 0 0 28 Jun 2024
Self-Distillation Learning Based on Temporal-Spatial Consistency for Spiking Neural Networks Lin Zuo Yongqi Ding Mengmeng Jing Kunshan Yang Yunqian Yu 46 3 0 12 Jun 2024
Augmentations vs Algorithms: What Works in Self-Supervised Learning Warren Morningstar Alex Bijamov Chris Duvarney Luke Friedman N. Kalibhat ... Philip Mansfield Renan A. Rojas-Gomez Karan Singhal Bradley Green Sushant Prakash SSL 23 10 0 08 Mar 2024
Cohere3D: Exploiting Temporal Coherence for Unsupervised Representation Learning of Vision-based Autonomous Driving Yichen Xie Hongge Chen Gregory P. Meyer Yong Jae Lee Eric M. Wolff Masayoshi Tomizuka Wei Zhan Yuning Chai Xin Huang 3DPC 35 1 0 23 Feb 2024
Exploring scalable medical image encoders beyond text supervision Fernando Pérez-García Harshita Sharma Sam Bond-Taylor Kenza Bouzid Valentina Salvatelli ... Maria T. A. Wetscherek Noel Codella Stephanie L. Hyland Javier Alvarez-Valle Ozan Oktay LM&MA MedIm 50 26 0 19 Jan 2024
Contrastive learning-based agent modeling for deep reinforcement learning Wenhao Ma Yu-Cheng Chang Jie Yang Yu-Kai Wang Chin-Teng Lin OffRL 20 0 0 30 Dec 2023
Low-rank constrained multichannel signal denoising considering channel-dependent sensitivity inspired by self-supervised learning for optical fiber sensing Noriyuki Tonami Wataru Kohno Sakiko Mishima Yumi Arai Reishi Kondo Tomoyuki Hino 15 1 0 14 Dec 2023
Asymmetric Masked Distillation for Pre-Training Small Foundation Models Zhiyu Zhao Bingkun Huang Sen Xing Gangshan Wu Yu Qiao Limin Wang 29 5 0 06 Nov 2023
Feature Normalization Prevents Collapse of Non-contrastive Learning Dynamics Han Bao SSL MLT 24 1 0 28 Sep 2023
The Triad of Failure Modes and a Possible Way Out Emanuele Sansone 16 2 0 27 Sep 2023
Masking Improves Contrastive Self-Supervised Learning for ConvNets, and Saliency Tells You Where Zhi-Yi Chin Chieh-Ming Jiang Ching-Chun Huang Pin-Yu Chen Wei-Chen Chiu SSL 29 0 0 22 Sep 2023
Opening the Vocabulary of Egocentric Actions Dibyadip Chatterjee Fadime Sener Shugao Ma Angela Yao VLM 33 16 0 22 Aug 2023
Point Contrastive Prediction with Semantic Clustering for Self-Supervised Learning on Point Cloud Videos Xiaoxiao Sheng Zhiqiang Shen Gang Xiao Longguang Wang Y. Guo Hehe Fan 3DPC SSL 33 7 0 18 Aug 2023
Pretrained deep models outperform GBDTs in Learning-To-Rank under label scarcity Charlie Hou K. K. Thekumparampil Michael Shavlovsky Giulia Fanti Yesh Dattatreya Sujay Sanghavi LMTD 13 1 0 31 Jul 2023
ScoreCL: Augmentation-Adaptive Contrastive Learning via Score-Matching Function Jinyoung Kim Soonwoo Kwon Hyojun Go Yunsung Lee Seungtaek Choi Hyun-Gyoon Kim 27 1 0 07 Jun 2023
Asymmetric Patch Sampling for Contrastive Learning Chen Shen Jianzhong Chen Shu Wang Hulin Kuang Jin Liu Jianxin Wang SSL 23 4 0 05 Jun 2023
PointCMP: Contrastive Mask Prediction for Self-supervised Learning on Point Cloud Videos Zhiqiang Shen Xiaoxiao Sheng Longguang Wang Y. Guo Qiong Liu Xiaoping Zhou 3DPC SSL 20 14 0 06 May 2023
A Cookbook of Self-Supervised Learning Randall Balestriero Mark Ibrahim Vlad Sobal Ari S. Morcos Shashank Shekhar ... Pierre Fernandez Amir Bar Hamed Pirsiavash Yann LeCun Micah Goldblum SyDa FedML SSL 41 273 0 24 Apr 2023
Towards a Unified Theoretical Understanding of Non-contrastive Learning via Rank Differential Mechanism Zhijian Zhuo Yifei Wang Jinwen Ma Yisen Wang 43 24 0 04 Mar 2023
A Survey of Mix-based Data Augmentation: Taxonomy, Methods, Applications, and Explainability Chengtai Cao Fan Zhou Yurou Dai Jianping Wang Kunpeng Zhang AAML 16 27 0 21 Dec 2022
Implicit variance regularization in non-contrastive SSL Manu Srinath Halvagal Axel Laborieux Friedemann Zenke 34 8 0 09 Dec 2022
Weighted Ensemble Self-Supervised Learning Yangjun Ruan Saurabh Singh Warren Morningstar Alexander A. Alemi Sergey Ioffe Ian S. Fischer Joshua V. Dillon FedML 22 15 0 18 Nov 2022
Masked Contrastive Representation Learning Yuan Yao Nandakishor Desai M. Palaniswami SSL 14 8 0 11 Nov 2022
On the Pros and Cons of Momentum Encoder in Self-Supervised Visual Representation Learning T. Pham Chaoning Zhang Axi Niu Kang Zhang Chang-Dong Yoo 36 11 0 11 Aug 2022
No Reason for No Supervision: Improved Generalization in Supervised Models Mert Bulent Sariyildiz Yannis Kalantidis Alahari Karteek Diane Larlus SSL OOD LRM 17 28 0 30 Jun 2022
Masked Siamese ConvNets L. Jing Jiachen Zhu Yann LeCun SSL 35 34 0 15 Jun 2022
CropMix: Sampling a Rich Input Distribution via Multi-Scale Cropping Junlin Han L. Petersson Hongdong Li Ian Reid 26 9 0 31 May 2022
Masked Image Modeling with Denoising Contrast Kun Yi Yixiao Ge Xiaotong Li Shusheng Yang Dian Li Jianping Wu Ying Shan Xiaohu Qie VLM 30 51 0 19 May 2022
Decoupled Contrastive Learning Chun-Hsiao Yeh Cheng-Yao Hong Yen-Chi Hsu Tyng-Luh Liu Yubei Chen Yann LeCun 178 182 0 13 Oct 2021
With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations Debidatta Dwibedi Y. Aytar Jonathan Tompson P. Sermanet Andrew Zisserman SSL 185 452 0 29 Apr 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 305 5,773 0 29 Apr 2021
Contrastive Learning with Stronger Augmentations Xiao Wang Guo-Jun Qi CLL 14 219 0 15 Apr 2021
Understanding self-supervised Learning Dynamics without Contrastive Pairs Yuandong Tian Xinlei Chen Surya Ganguli SSL 138 279 0 12 Feb 2021
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 252 3,369 0 09 Mar 2020
Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results Antti Tarvainen Harri Valpola OOD MoMe 246 1,275 0 06 Mar 2017