Self-Supervised Learning of Pretext-Invariant Representations

4 December 2019

Ishan Misra

L. V. D. van der Maaten

SSL

VLM

ArXiv PDF HTML

Papers citing "Self-Supervised Learning of Pretext-Invariant Representations"

50 / 319 papers shown

Title
Self-Relation Attention and Temporal Awareness for Emotion Recognition via Vocal Burst Dang-Linh Trinh Minh-Cong Vo Gueesang Lee 27 3 0 15 Sep 2022
Feature diversity in self-supervised learning Pranshu Malviya Arjun Vaithilingam Sudhakar SSL LRM 12 2 0 02 Sep 2022
Refine and Represent: Region-to-Object Representation Learning Akash Gokul Konstantinos Kallidromitis Shufang Li Yu Kato Kazuki Kozuka Trevor Darrell Colorado Reed SSeg 29 5 0 25 Aug 2022
Skeleton Prototype Contrastive Learning with Multi-Level Graph Relation Modeling for Unsupervised Person Re-Identification Haocong Rao Chun Miao 3DH 16 3 0 25 Aug 2022
Semi-Supervised and Unsupervised Deep Visual Learning: A Survey Yanbei Chen Massimiliano Mancini Xiatian Zhu Zeynep Akata 36 113 0 24 Aug 2022
Federated Self-Supervised Contrastive Learning and Masked Autoencoder for Dermatological Disease Diagnosis Yawen Wu Dewen Zeng Zhepeng Wang Yi Sheng Lei Yang A. James Yiyu Shi Jingtong Hu 18 7 0 24 Aug 2022
Self-Supervised Pretraining of Graph Neural Network for the Retrieval of Related Mathematical Expressions in Scientific Articles Lukas Pfahler K. Morik SSL 8 4 0 22 Aug 2022
Automatically Discovering Novel Visual Categories with Self-supervised Prototype Learning Lu Zhang Lu Qi Xu Yang Hong Qiao Ming Yang Zhiyong Liu SSL 28 3 0 01 Aug 2022
A Survey on Masked Autoencoder for Self-supervised Learning in Vision and Beyond Chaoning Zhang Chenshuang Zhang Junha Song John Seon Keun Yi Kang Zhang In So Kweon SSL 52 71 0 30 Jul 2022
Self-supervised learning with rotation-invariant kernels Léon Zheng Gilles Puy E. Riccietti Patrick Pérez Rémi Gribonval SSL 9 2 0 28 Jul 2022
Learning Hyper Label Model for Programmatic Weak Supervision Renzhi Wu Sheng Chen Jieyu Zhang Xu Chu 20 16 0 27 Jul 2022
Time to augment self-supervised visual representation learning A. Aubret M. Ernst Céline Teulière Jochen Triesch 26 10 0 27 Jul 2022
Hierarchical Semi-Supervised Contrastive Learning for Contamination-Resistant Anomaly Detection Gaoang Wang Yibing Zhan Xinchao Wang Min-Gyoo Song K. Nahrstedt 24 11 0 24 Jul 2022
Online Knowledge Distillation via Mutual Contrastive Learning for Visual Recognition Chuanguang Yang Zhulin An Helong Zhou Fuzhen Zhuang Yongjun Xu Qian Zhang 33 50 0 23 Jul 2022
Scale dependant layer for self-supervised nuclei encoding Peter Naylor Yao-Hung Hubert Tsai Marick Laé Makoto Yamada SSL 28 0 0 22 Jul 2022
A Closer Look at Invariances in Self-supervised Pre-training for 3D Vision Lanxiao Li M. Heizmann 3DPC 27 27 0 11 Jul 2022
Towards Proper Contrastive Self-supervised Learning Strategies For Music Audio Representation Jeong-Eun Choi Seongwon Jang Hyunsouk Cho Sehee Chung SSL 16 6 0 10 Jul 2022
Unsupervised Learning for Human Sensing Using Radio Signals Tianhong Li Lijie Fan Yuan. Yuan Dina Katabi SSL 39 34 0 06 Jul 2022
Dissecting Self-Supervised Learning Methods for Surgical Computer Vision Sanat Ramesh V. Srivastav Deepak Alapatt Tong Yu Aditya Murali ... Saurav Sharma A. Fleurentin Georgios Exarchakis Alexandros Karargyris N. Padoy 18 42 0 01 Jul 2022
Transfer Learning with Deep Tabular Models Roman Levin Valeriia Cherepanova Avi Schwarzschild Arpit Bansal C. B. Bruss Tom Goldstein A. Wilson Micah Goldblum OOD FedML LMTD 75 58 0 30 Jun 2022
Self-Supervised Learning for Videos: A Survey Madeline Chantry Schiappa Y. S. Rawat M. Shah SSL 34 131 0 18 Jun 2022
OmniMAE: Single Model Masked Pretraining on Images and Videos Rohit Girdhar Alaaeldin El-Nouby Mannat Singh Kalyan Vasudev Alwala Armand Joulin Ishan Misra ViT 35 97 0 16 Jun 2022
Beyond Supervised vs. Unsupervised: Representative Benchmarking and Analysis of Image Representation Learning M. Gwilliam Abhinav Shrivastava SSL 76 19 1 16 Jun 2022
Let Invariant Rationale Discovery Inspire Graph Contrastive Learning Sihang Li Xiang Wang An Zhang Y. Wu Xiangnan He Tat-Seng Chua 21 93 0 16 Jun 2022
Masked Siamese ConvNets L. Jing Jiachen Zhu Yann LeCun SSL 35 34 0 15 Jun 2022
From Labels to Priors in Capsule Endoscopy: A Prior Guided Approach for Improving Generalization with Few Labels Anuja Vats A. Mohammed Marius Pedersen OOD 11 7 0 10 Jun 2022
TriBYOL: Triplet BYOL for Self-Supervised Representation Learning Guang Li Ren Togo Takahiro Ogawa Miki Haseyama SSL 16 17 0 07 Jun 2022
MSR: Making Self-supervised learning Robust to Aggressive Augmentations Ying-Long Bai Erkun Yang Zhaoqing Wang Yuxuan Du Bo Han Cheng Deng Dadong Wang Tongliang Liu SSL 23 3 0 04 Jun 2022
Multi-Augmentation for Efficient Visual Representation Learning for Self-supervised Pre-training Van-Nhiem Tran Chi-En Huang Shenxiu Liu Kaicheng Yang Timothy Ko Yung-Hui Li SSL 25 0 0 24 May 2022
Object-Aware Self-supervised Multi-Label Learning Kaixin Xu Liu Liyang Ziyuan Zhao Zeng Zeng B. Veeravalli 29 3 0 14 May 2022
Embodied vision for learning object representations A. Aubret Céline Teulière Jochen Triesch OCL 25 1 0 12 May 2022
Contrastive Supervised Distillation for Continual Representation Learning Tommaso Barletti Niccoló Biondi F. Pernici Matteo Bruni A. Bimbo CLL 21 7 0 11 May 2022
A Closer Look at Few-shot Image Generation Yunqing Zhao Henghui Ding Houjing Huang Ngai-man Cheung 24 72 0 08 May 2022
Self-Supervised Learning for Invariant Representations from Multi-Spectral and SAR Images P. Jain Bianca Schoen-Phelan R. Ross 18 32 0 04 May 2022
On Negative Sampling for Audio-Visual Contrastive Learning from Movies Mahdi M. Kalayeh Shervin Ardeshir Lingyi Liu Nagendra Kamath Ashok Chandrashekar SSL 22 3 0 29 Apr 2022
Human-Centered Prior-Guided and Task-Dependent Multi-Task Representation Learning for Action Recognition Pre-Training Guanhong Wang Ke Lu Yang Zhou Zhanhao He Gaoang Wang SSL 19 3 0 27 Apr 2022
Context-Aware Sequence Alignment using 4D Skeletal Augmentation Taein Kwon Bugra Tekin Siyu Tang Marc Pollefeys 23 13 0 26 Apr 2022
Time-based Self-supervised Learning for Wireless Capsule Endoscopy Guillem Pascual Pablo Laiz A. García Hagen Wenzek Jordi Vitrià Santi Seguí 22 11 0 20 Apr 2022
Self-supervised Learning for Sonar Image Classification Alan Preciado-Grijalva Bilal Wehbe M. B. Firvida Matias Valdenegro-Toro SSL 38 16 0 20 Apr 2022
Empirical Evaluation and Theoretical Analysis for Representation Learning: A Survey Kento Nozawa Issei Sato AI4TS 19 4 0 18 Apr 2022
Masked Siamese Networks for Label-Efficient Learning Mahmoud Assran Mathilde Caron Ishan Misra Piotr Bojanowski Florian Bordes Pascal Vincent Armand Joulin Michael G. Rabbat Nicolas Ballas SSL 28 311 0 14 Apr 2022
Robust Cross-Modal Representation Learning with Progressive Self-Distillation A. Andonian Shixing Chen Raffay Hamid VLM 21 55 0 10 Apr 2022
Self-Labeling Refinement for Robust Representation Learning with Bootstrap Your Own Latent Siddhant Garg Dhruval Jain SSL 36 0 0 09 Apr 2022
The Effects of Regularization and Data Augmentation are Class Dependent Randall Balestriero Léon Bottou Yann LeCun 28 94 0 07 Apr 2022
On the Importance of Asymmetry for Siamese Representation Learning Xiao Wang Haoqi Fan Yuandong Tian Daisuke Kihara Xinlei Chen SSL 24 51 0 01 Apr 2022
Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Data Corentin Sautier Gilles Puy Spyros Gidaris Alexandre Boulch Andrei Bursuc Renaud Marlet 3DPC 15 117 0 30 Mar 2022
Large-scale Bilingual Language-Image Contrastive Learning ByungSoo Ko Geonmo Gu VLM 22 14 0 28 Mar 2022
Reinforcement-based frugal learning for satellite image change detection Sebastien Deschamps H. Sahbi 30 1 0 22 Mar 2022
Frugal Learning of Virtual Exemplars for Label-Efficient Satellite Image Change Detection H. Sahbi Sebastien Deschamps 30 0 0 22 Mar 2022
No Shifted Augmentations (NSA): compact distributions for robust self-supervised Anomaly Detection Mohamed Yousef Marcel R. Ackermann Unmesh Kurup Tom E. Bishop OODD OOD 28 3 0 19 Mar 2022