Self-Supervised Learning of Pretext-Invariant Representations

4 December 2019

Ishan Misra

L. V. D. van der Maaten

SSL

VLM

ArXiv PDF HTML

Papers citing "Self-Supervised Learning of Pretext-Invariant Representations"

50 / 319 papers shown

Title
Non-isotropy Regularization for Proxy-based Deep Metric Learning Karsten Roth Oriol Vinyals Zeynep Akata 19 36 0 16 Mar 2022
Bamboo: Building Mega-Scale Vision Dataset Continually with Human-Machine Synergy Yuanhan Zhang Qi Sun Yichun Zhou Zexin He Zhen-fei Yin Kunze Wang Lu Sheng Yu Qiao Jing Shao Ziwei Liu ObjD VLM 19 19 0 15 Mar 2022
Magnification Prior: A Self-Supervised Method for Learning Representations on Breast Cancer Histopathological Images Prakash Chandra Chhipa Richa Upadhyay G. Pihlgren Rajkumar Saini Seiichi Uchida Marcus Liwicki SSL MedIm 24 19 0 15 Mar 2022
Transfer of Representations to Video Label Propagation: Implementation Factors Matter Daniel McKee Zitong Zhan Bing Shuai Davide Modolo Joseph Tighe Svetlana Lazebnik SSL 13 4 0 10 Mar 2022
An Unsupervised Domain Adaptive Approach for Multimodal 2D Object Detection in Adverse Weather Conditions George Eskandar Robert A. Marsden Pavithran Pandiyan Mario Döbler Karim Guirguis B. Yang 28 7 0 07 Mar 2022
Audio Self-supervised Learning: A Survey Shuo Liu Adria Mallol-Ragolta Emilia Parada-Cabeleiro Kun Qian Xingshuo Jing Alexander Kathan Bin Hu Bjoern W. Schuller SSL 35 106 0 02 Mar 2022
CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understanding Mohamed Afham Isuru Dissanayake Dinithi Dissanayake Amaya Dharmasiri Kanchana Thilakarathna Ranga Rodrigo 3DPC 16 249 0 01 Mar 2022
Vision Models Are More Robust And Fair When Pretrained On Uncurated Images Without Supervision Priya Goyal Quentin Duval Isaac Seessel Mathilde Caron Ishan Misra Levent Sagun Armand Joulin Piotr Bojanowski VLM SSL 26 110 0 16 Feb 2022
A Data-Augmentation Is Worth A Thousand Samples: Exact Quantification From Analytical Augmented Sample Moments Randall Balestriero Ishan Misra Yann LeCun 27 20 0 16 Feb 2022
Federated Contrastive Learning for Dermatological Disease Diagnosis via On-device Learning Yawen Wu Dewen Zeng Zhepeng Wang Yi Sheng Lei Yang A. James Yiyu Shi Jingtong Hu FedML 22 31 0 14 Feb 2022
SuperCon: Supervised Contrastive Learning for Imbalanced Skin Lesion Classification Keyu Chen Di Zhuang Jerome Chang SSL 20 5 0 11 Feb 2022
Bootstrapped Representation Learning for Skeleton-Based Action Recognition Olivier Moliner Sangxia Huang Kalle Åström SSL 27 13 0 04 Feb 2022
Ranking Info Noise Contrastive Estimation: Boosting Contrastive Learning via Ranked Positives David T. Hoffmann Nadine Behrmann Juergen Gall Thomas Brox M. Noroozi 27 43 0 27 Jan 2022
SimReg: Regression as a Simple Yet Effective Tool for Self-supervised Knowledge Distillation K. Navaneet Soroush Abbasi Koohpayegani Ajinkya Tejankar Hamed Pirsiavash 13 19 0 13 Jan 2022
Knowledge Tracing: A Survey Ghodai M. Abdelrahman Qing Wang B. Nunes AI4Ed 10 192 0 08 Jan 2022
Sound and Visual Representation Learning with Multiple Pretraining Tasks A. Vasudevan Dengxin Dai Luc Van Gool SSL 33 6 0 04 Jan 2022
Max-Margin Contrastive Learning Anshul B. Shah S. Sra Ramalingam Chellappa A. Cherian SSL 21 44 0 21 Dec 2021
High Fidelity Visualization of What Your Self-Supervised Representation Knows About Florian Bordes Randall Balestriero Pascal Vincent DiffM 25 61 0 16 Dec 2021
Improving Self-supervised Learning with Automated Unsupervised Outlier Arbitration Yu Wang Jingyang Lin Jingjing Zou Yingwei Pan Ting Yao Tao Mei OODD 24 12 0 15 Dec 2021
Tradeoffs Between Contrastive and Supervised Learning: An Empirical Study A. Karthik Mike Wu Noah D. Goodman Alex Tamkin SSL 32 5 0 10 Dec 2021
BT-Unet: A self-supervised learning framework for biomedical image segmentation using Barlow Twins with U-Net models Narinder Singh Punn Sonali Agarwal SSL 30 35 0 07 Dec 2021
Self-Supervised Material and Texture Representation Learning for Remote Sensing Tasks Peri Akiva Matthew Purri Matthew J. Leotta SSL 19 58 0 03 Dec 2021
BEVT: BERT Pretraining of Video Transformers Rui Wang Dongdong Chen Zuxuan Wu Yinpeng Chen Xiyang Dai Mengchen Liu Yu-Gang Jiang Luowei Zhou Lu Yuan ViT 36 203 0 02 Dec 2021
Self-supervised Video Transformer Kanchana Ranasinghe Muzammal Naseer Salman Khan F. Khan Michael S. Ryoo ViT 30 84 0 02 Dec 2021
Revisiting the Transferability of Supervised Pretraining: an MLP Perspective Yizhou Wang Shixiang Tang Feng Zhu Lei Bai Rui Zhao Donglian Qi Wanli Ouyang 21 51 0 01 Dec 2021
Semantic-Aware Generation for Self-Supervised Visual Representation Learning Yunjie Tian Lingxi Xie Xiaopeng Zhang Jiemin Fang Haohang Xu Wei Huang Jianbin Jiao Qi Tian QiXiang Ye SSL GAN 28 16 0 25 Nov 2021
RegionCL: Can Simple Region Swapping Contribute to Contrastive Learning? Yufei Xu Qiming Zhang Jing Zhang Dacheng Tao SSL 21 18 0 24 Nov 2021
Federated Learning with Domain Generalization Liling Zhang Xinyu Lei Yichun Shi Hongyu Huang Chao Chen FedML OOD 22 54 0 20 Nov 2021
Hybrid BYOL-ViT: Efficient approach to deal with small datasets Safwen Naimi Rien van Leeuwen W. Souidène S. B. Saoud SSL ViT 25 2 0 08 Nov 2021
PatchGame: Learning to Signal Mid-level Patches in Referential Games Kamal Gupta Gowthami Somepalli Anubhav Gupta Vinoj Jayasundara Matthias Zwicker Abhinav Shrivastava 20 3 0 02 Nov 2021
Self-Supervised Learning Disentangled Group Representation as Feature Tan Wang Zhongqi Yue Jianqiang Huang Qianru Sun Hanwang Zhang OOD 31 67 0 28 Oct 2021
Robust Contrastive Learning Using Negative Samples with Diminished Semantics Songwei Ge Shlok Kumar Mishra Haohan Wang Chun-Liang Li David Jacobs SSL 16 71 0 27 Oct 2021
Physically Explainable CNN for SAR Image Classification Zhongling Huang Xiwen Yao Ying Liu C. Dumitru Mihai Datcu Junwei Han PINN 14 60 0 27 Oct 2021
CLOOB: Modern Hopfield Networks with InfoLOOB Outperform CLIP Andreas Fürst Elisabeth Rumetshofer Johannes Lehner Viet-Hung Tran Fei Tang ... David P. Kreil Michael K Kopp G. Klambauer Angela Bitto-Nemling Sepp Hochreiter VLM CLIP 204 102 0 21 Oct 2021
Learning Rich Nearest Neighbor Representations from Self-supervised Ensembles Bram Wallace Devansh Arpit Huan Wang Caiming Xiong SSL OOD 22 0 0 19 Oct 2021
Understanding Dimensional Collapse in Contrastive Self-supervised Learning Li Jing Pascal Vincent Yann LeCun Yuandong Tian SSL 16 336 0 18 Oct 2021
Decoupled Contrastive Learning Chun-Hsiao Yeh Cheng-Yao Hong Yen-Chi Hsu Tyng-Luh Liu Yubei Chen Yann LeCun 178 182 0 13 Oct 2021
Revitalizing CNN Attentions via Transformers in Self-Supervised Visual Representation Learning Chongjian Ge Youwei Liang Yibing Song Jianbo Jiao Jue Wang Ping Luo ViT 18 36 0 11 Oct 2021
Weakly Supervised Contrastive Learning Mingkai Zheng Fei-Yue Wang Shan You Chao Qian Changshui Zhang Xiaogang Wang Chang Xu SSL 29 121 0 10 Oct 2021
Active learning for interactive satellite image change detection H. Sahbi Sebastien Deschamps Andrei Stoian 34 6 0 08 Oct 2021
Model Adaptation: Historical Contrastive Learning for Unsupervised Domain Adaptation without Source Data Jiaxing Huang Dayan Guan Aoran Xiao Shijian Lu 145 212 0 07 Oct 2021
The Power of Contrast for Feature Learning: A Theoretical Analysis Wenlong Ji Zhun Deng Ryumei Nakada James Y. Zou Linjun Zhang SSL 51 48 0 06 Oct 2021
Spatial Ensemble: a Novel Model Smoothing Mechanism for Student-Teacher Framework Tengteng Huang Yifan Sun Xun Wang Haotian Yao Chi Zhang 17 3 0 04 Oct 2021
Multi-view Contrastive Self-Supervised Learning of Accounting Data Representations for Downstream Audit Tasks Marco Schreyer Timur Sattarov Damian Borth MLAU 18 15 0 23 Sep 2021
Semi-Supervised Visual Representation Learning for Fashion Compatibility Ambareesh Revanur Vijay R. Kumar D. Sharma SSL 16 20 0 16 Sep 2021
Federated Contrastive Learning for Decentralized Unlabeled Medical Images Nanqing Dong Irina Voiculescu FedML 11 62 0 15 Sep 2021
Deep Bregman Divergence for Contrastive Learning of Visual Representations Mina Rezaei Farzin Soleymani B. Bischl Shekoofeh Azizi SSL 44 16 0 15 Sep 2021
Seeking an Optimal Approach for Computer-Aided Pulmonary Embolism Detection N. Islam S. Gehlot Zongwei Zhou Michael B. Gotway Jianming Liang OOD 77 11 0 15 Sep 2021
Knowledge Distillation Using Hierarchical Self-Supervision Augmented Distribution Chuanguang Yang Zhulin An Linhang Cai Yongjun Xu 22 15 0 07 Sep 2021
Fine-grained Hand Gesture Recognition in Multi-viewpoint Hand Hygiene Huy Q. Vo Tuong Khanh Long Do Vinson Pham Duy V.M. Nguyen An T. Duong Quang-Dieu Tran 17 3 0 07 Sep 2021