Self-Supervised Learning of Pretext-Invariant Representations

4 December 2019

Ishan Misra

L. V. D. van der Maaten

SSL

VLM

ArXiv PDF HTML

Papers citing "Self-Supervised Learning of Pretext-Invariant Representations"

50 / 319 papers shown

Title
S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration Zhiqiang Shen Zechun Liu Jie Qin Lei Huang Kwang-Ting Cheng Marios Savvides UQCV SSL MQ 248 22 0 17 Feb 2021
Self-Supervised Features Improve Open-World Learning A. Dhamija T. Ahmad Jonathan Schwan Mohsen Jafarzadeh Chunchun Li Terrance E. Boult SSL 19 13 0 15 Feb 2021
Understanding self-supervised Learning Dynamics without Contrastive Pairs Yuandong Tian Xinlei Chen Surya Ganguli SSL 138 279 0 12 Feb 2021
Self-supervised driven consistency training for annotation efficient histopathology image analysis C. Srinidhi Seung Wook Kim Fu-Der Chen Anne L. Martel SSL 19 109 0 07 Feb 2021
Exponential Moving Average Normalization for Self-supervised and Semi-supervised Learning Zhaowei Cai Avinash Ravichandran Subhransu Maji Charless C. Fowlkes Z. Tu Stefano Soatto 36 118 0 21 Jan 2021
Momentum^2 Teacher: Momentum Teacher with Momentum Statistics for Self-Supervised Learning Zeming Li Songtao Liu Jian-jun Sun 45 16 0 19 Jan 2021
Self-Supervised Pretraining of 3D Features on any Point-Cloud Zaiwei Zhang Rohit Girdhar Armand Joulin Ishan Misra 3DPC 124 268 0 07 Jan 2021
CLEAR: Contrastive Learning for Sentence Representation Zhuofeng Wu Sinong Wang Jiatao Gu Madian Khabsa Fei Sun Hao Ma SSL 27 319 0 31 Dec 2020
P4Contrast: Contrastive Learning with Pairs of Point-Pixel Pairs for RGB-D Scene Understanding Yunze Liu Li Yi Shanghang Zhang Qingnan Fan Thomas Funkhouser Hao Dong SSL 28 58 0 24 Dec 2020
Social NCE: Contrastive Learning of Socially-aware Motion Representations Yuejiang Liu Qi Yan Alexandre Alahi 24 101 0 21 Dec 2020
Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts Ji Hou Benjamin Graham Matthias Nießner Saining Xie 3DPC 42 263 0 16 Dec 2020
CASTing Your Model: Learning to Localize Improves Self-Supervised Representations Ramprasaath R. Selvaraju Karan Desai Justin Johnson Nikhil Naik SSL 27 79 0 08 Dec 2020
Seed the Views: Hierarchical Semantic Alignment for Contrastive Representation Learning Haohang Xu Xiaopeng Zhang Hao Li Lingxi Xie H. Xiong Qi Tian SSL 8 12 0 04 Dec 2020
Self supervised contrastive learning for digital histopathology Ozan Ciga Tony Xu Anne L. Martel SSL 108 306 0 27 Nov 2020
How Well Do Self-Supervised Models Transfer? Linus Ericsson H. Gouk Timothy M. Hospedales SSL 35 274 0 26 Nov 2020
Can Temporal Information Help with Contrastive Self-Supervised Learning? Yutong Bai Haoqi Fan Ishan Misra Ganesh Venkatesh Yongyi Lu Yuyin Zhou Qihang Yu Vikas Chandra Alan Yuille 16 40 0 25 Nov 2020
Boosting Contrastive Self-Supervised Learning with False Negative Cancellation T. Huynh Simon Kornblith Matthew R. Walter Michael Maire M. Khademi SSL 13 165 0 23 Nov 2020
Hierarchically Decoupled Spatial-Temporal Contrast for Self-supervised Video Representation Learning Zehua Zhang David J. Crandall AI4TS SSL 23 23 0 23 Nov 2020
CoMatch: Semi-supervised Learning with Contrastive Graph Regularization Junnan Li Caiming Xiong S. Hoi SSL 21 252 0 23 Nov 2020
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 16 3,949 0 20 Nov 2020
Geography-Aware Self-Supervised Learning Kumar Ayush Burak Uzkent Chenlin Meng Kumar Tanmay Marshall Burke David B. Lobell Stefano Ermon SSL 25 227 0 19 Nov 2020
Unsupervised Video Representation Learning by Bidirectional Feature Prediction Nadine Behrmann Juergen Gall M. Noroozi SSL MDE 22 29 0 11 Nov 2020
Towards Domain-Agnostic Contrastive Learning Vikas Verma Minh-Thang Luong Kenji Kawaguchi Hieu H. Pham Quoc V. Le SSL 15 115 0 09 Nov 2020
Intriguing Properties of Contrastive Losses Ting Chen Calvin Luo Lala Li 28 173 0 05 Nov 2020
Center-wise Local Image Mixture For Contrastive Representation Learning Hao Li Xiaopeng Zhang H. Xiong 10 8 0 05 Nov 2020
Learning Representations from Audio-Visual Spatial Alignment Pedro Morgado Yi Li Nuno Vasconcelos SSL 24 121 0 03 Nov 2020
Image Representations Learned With Unsupervised Pre-Training Contain Human-like Biases Ryan Steed Aylin Caliskan SSL 17 156 0 28 Oct 2020
Quantifying Learnability and Describability of Visual Concepts Emerging in Representation Learning Iro Laina Ruth C. Fong Andrea Vedaldi OCL 20 13 0 27 Oct 2020
Robust Pre-Training by Adversarial Contrastive Learning Ziyu Jiang Tianlong Chen Ting-Li Chen Zhangyang Wang 25 226 0 26 Oct 2020
For self-supervised learning, Rationality implies generalization, provably Yamini Bansal Gal Kaplun Boaz Barak OOD SSL 58 22 0 16 Oct 2020
Viewmaker Networks: Learning Views for Unsupervised Representation Learning Alex Tamkin Mike Wu Noah D. Goodman SSL 25 64 0 14 Oct 2020
Contrastive Learning with Hard Negative Samples Joshua Robinson Ching-Yao Chuang S. Sra Stefanie Jegelka SSL 54 759 0 09 Oct 2020
Representation Learning for Sequence Data with Deep Autoencoding Predictive Components Junwen Bai Weiran Wang Yingbo Zhou Caiming Xiong SSL AI4TS 18 12 0 07 Oct 2020
Contrastive Cross-Modal Pre-Training: A General Strategy for Small Sample Medical Imaging G. Liang Connor Greenwell Yu Zhang Xiaoqin Wang Ramakanth Kavuluru Nathan Jacobs 34 21 0 06 Oct 2020
CO2: Consistent Contrast for Unsupervised Visual Representation Learning Chen Wei Huiyu Wang Wei Shen Alan Yuille SSL 30 62 0 05 Oct 2020
Hard Negative Mixing for Contrastive Learning Yannis Kalantidis Mert Bulent Sariyildiz Noé Pion Philippe Weinzaepfel Diane Larlus SSL 29 628 0 02 Oct 2020
Understanding Self-supervised Learning with Dual Deep Networks Yuandong Tian Lantao Yu Xinlei Chen Surya Ganguli SSL 13 78 0 01 Oct 2020
CoKe: Localized Contrastive Learning for Robust Keypoint Detection Yutong Bai Angtian Wang Adam Kortylewski Alan Yuille 15 14 0 29 Sep 2020
Delving into Inter-Image Invariance for Unsupervised Visual Representations Jiahao Xie Xiaohang Zhan Ziwei Liu Yew-Soon Ong Chen Change Loy SSL VLM 18 58 0 26 Aug 2020
What Should Not Be Contrastive in Contrastive Learning Tete Xiao Xiaolong Wang Alexei A. Efros Trevor Darrell SSL DRL 21 298 0 13 Aug 2020
Self-Supervised Learning of Audio-Visual Objects from Video Triantafyllos Afouras Andrew Owens Joon Son Chung Andrew Zisserman SSL 17 250 0 10 Aug 2020
SeCo: Exploring Sequence Supervision for Unsupervised Representation Learning Ting Yao Yiheng Zhang Zhaofan Qiu Yingwei Pan Tao Mei DRL 13 108 0 03 Aug 2020
Demystifying Contrastive Self-Supervised Learning: Invariances, Augmentations and Dataset Biases Senthil Purushwalkam Abhinav Gupta SSL 31 213 0 28 Jul 2020
GraphCL: Contrastive Self-Supervised Learning of Graph Representations H. Hafidi Mounir Ghogho P. Ciblat A. Swami SSL 20 53 0 15 Jul 2020
Learning Speech Representations from Raw Audio by Joint Audiovisual Self-Supervision Abhinav Shukla Stavros Petridis M. Pantic SSL 13 16 0 08 Jul 2020
Parametric Instance Classification for Unsupervised Visual Feature Learning Yue Cao Zhenda Xie B. Liu Yutong Lin Zheng-Wei Zhang Han Hu VLM 26 60 0 25 Jun 2020
Automatic Data Augmentation for Generalization in Deep Reinforcement Learning Roberta Raileanu M. Goldstein Denis Yarats Ilya Kostrikov Rob Fergus OffRL 22 108 0 23 Jun 2020
Self-supervised Learning: Generative or Contrastive Xiao Liu Fanjin Zhang Zhenyu Hou Zhaoyu Wang Li Mian Jing Zhang Jie Tang SSL 33 1,586 0 15 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 72 6,643 0 13 Jun 2020
Knowledge Distillation Meets Self-Supervision Guodong Xu Ziwei Liu Xiaoxiao Li Chen Change Loy FedML 23 280 0 12 Jun 2020