Efficient Visual Pretraining with Contrastive Detection

19 March 2021

Olivier J. Hénaff

Skanda Koppula

Jean-Baptiste Alayrac

Papers citing "Efficient Visual Pretraining with Contrastive Detection"

50 / 128 papers shown

Title
Bridging the Domain Gap: Self-Supervised 3D Scene Understanding with Foundation Models Zhimin Chen Longlong Jing Yingwei Li Bing Li 29 31 0 15 May 2023
Region-Aware Pretraining for Open-Vocabulary Object Detection with Vision Transformers Dahun Kim A. Angelova Weicheng Kuo ObjD ViT VLM 25 73 0 11 May 2023
Contrastive Mean Teacher for Domain Adaptive Object Detectors Shengcao Cao D. Joshi Liangyan Gui Yu-xiong Wang ObjD 29 55 0 04 May 2023
Boosting Video Object Segmentation via Space-time Correspondence Learning Yurong Zhang Liulei Li Wenguan Wang Rong Xie Li-Na Song Wenjun Zhang VOS 22 32 0 13 Apr 2023
Three Recipes for Better 3D Pseudo-GTs of 3D Human Mesh Estimation in the Wild Gyeongsik Moon Hongsuk Choi Sanghyuk Chun Jiyoung Lee Sangdoo Yun 22 7 0 10 Apr 2023
Multi-Level Contrastive Learning for Dense Prediction Task Qiushan Guo Yizhou Yu Yi-Xin Jiang Jiannan Wu Zehuan Yuan Ping Luo SSL 24 2 0 04 Apr 2023
Siamese DETR Ze-Sen Chen Gengshi Huang Wei Li Jianing Teng Kun Wang Jing Shao Chen Change Loy Lu Sheng ViT 16 8 0 31 Mar 2023
INoD: Injected Noise Discriminator for Self-Supervised Representation Learning in Agricultural Fields Julia Hindel Nikhil Gosala Kevin Bregler Abhinav Valada 22 6 0 31 Mar 2023
De-coupling and De-positioning Dense Self-supervised Learning Congpei Qiu Tong Zhang Wei Ke Mathieu Salzmann Sabine Süsstrunk 17 3 0 29 Mar 2023
Adaptive Similarity Bootstrapping for Self-Distillation based Representation Learning Tim Lebailly Thomas Stegmüller Behzad Bozorgtabar Jean-Philippe Thiran Tinne Tuytelaars SSL 14 2 0 23 Mar 2023
CrOC: Cross-View Online Clustering for Dense Visual Representation Learning Thomas Stegmüller Tim Lebailly Behzad Bozorgtabar Tinne Tuytelaars Jean-Philippe Thiran 29 15 0 23 Mar 2023
Correlational Image Modeling for Self-Supervised Visual Pre-Training Wei Li Jiahao Xie Chen Change Loy SSL 22 10 0 22 Mar 2023
SeqCo-DETR: Sequence Consistency Training for Self-Supervised Object Detection with Transformers Guoqiang Jin Fan Yang Mingshan Sun R. Zhao Yakun Liu Wei Li Tianpeng Bao Liwei Wu Xingyu Zeng Rui Zhao ViT 22 2 0 15 Mar 2023
Open-world Instance Segmentation: Top-down Learning with Bottom-up Supervision Tarun Kalluri Weiyao Wang Heng Wang Manmohan Chandraker Lorenzo Torresani Du Tran 25 6 0 09 Mar 2023
Rethinking Self-Supervised Visual Representation Learning in Pre-training for 3D Human Pose and Shape Estimation Hongsuk Choi Hyeongjin Nam T. Lee Gyeongsik Moon Kyoung Mu Lee 34 7 0 09 Mar 2023
Saliency Guided Contrastive Learning on Scene Images Meilin Chen Yizhou Wang Shixiang Tang Feng Zhu Haiyang Yang Lei Bai Rui Zhao Donglian Qi Wanli Ouyang SSL 19 1 0 22 Feb 2023
Self-Supervised Representation Learning from Temporal Ordering of Automated Driving Sequences Christopher Lang Alexander Braun Lars Schillingmann Karsten Haug Abhinav Valada SSL 17 10 0 17 Feb 2023
Vision Learners Meet Web Image-Text Pairs Bingchen Zhao Quan Cui Hao Wu Osamu Yoshie Cheng Yang Oisin Mac Aodha VLM 24 5 0 17 Jan 2023
A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trends Jie Gui Tuo Chen Jing Zhang Qiong Cao Zhe Sun Haoran Luo Dacheng Tao 29 122 0 13 Jan 2023
Self-Supervised Image-to-Point Distillation via Semantically Tolerant Contrastive Loss Anas Mahmoud Jordan S. K. Hu Tianshu Kuai Ali Harakeh Liam Paull Steven L. Waslander 3DPC SSL 30 29 0 12 Jan 2023
Foundation models in brief: A historical, socio-technical focus Johannes Schneider VLM 23 9 0 17 Dec 2022
Hyperbolic Contrastive Learning for Visual Representations beyond Objects Songwei Ge Shlok Kumar Mishra Simon Kornblith Chun-Liang Li David Jacobs OCL SSL 14 51 0 01 Dec 2022
Copy-Pasting Coherent Depth Regions Improves Contrastive Learning for Urban-Scene Segmentation Liang Zeng A. Lengyel Nergis Tomen J. C. V. Gemert AI4TS 19 0 0 25 Nov 2022
Ladder Siamese Network: a Method and Insights for Multi-level Self-Supervised Learning Ryota Yoshihashi Shuhei Nishimura Dai Yonebayashi Yuya Otsuka Tomohiro Tanaka Takashi Miyazaki SSL 24 2 0 25 Nov 2022
Label-Efficient Object Detection via Region Proposal Network Pre-Training Nanqing Dong Linus Ericsson Yongxin Yang A. Leonardis Steven G. McDonagh ObjD 42 5 0 16 Nov 2022
Pixel-Wise Contrastive Distillation Junqiang Huang Zichao Guo 37 4 0 01 Nov 2022
A simple, efficient and scalable contrastive masked autoencoder for learning visual representations Shlok Kumar Mishra Joshua Robinson Huiwen Chang David Jacobs Aaron Sarna Aaron Maschinot Dilip Krishnan DiffM 43 30 0 30 Oct 2022
Self-Supervised Pretraining on Satellite Imagery: a Case Study on Label-Efficient Vehicle Detection Jules Bourcier Thomas Floquet G. Dashyan Tugdual Ceillier Alahari Karteek Jocelyn Chanussot SSL 28 1 0 21 Oct 2022
Self-supervised Pre-training for Semantic Segmentation in an Indoor Scene Sulabh Shrestha Yimeng Li Jana Kosecka 3DPC SSL SSeg 33 2 0 04 Oct 2022
VICRegL: Self-Supervised Learning of Local Visual Features Adrien Bardes Jean Ponce Yann LeCun SSL 17 119 0 04 Oct 2022
Where Should I Spend My FLOPS? Efficiency Evaluations of Visual Pre-training Methods Skanda Koppula Yazhe Li Evan Shelhamer Andrew Jaegle Nikhil Parthasarathy Relja Arandjelović João Carreira Olivier J. Hénaff 30 9 0 30 Sep 2022
Self-Supervised Pyramid Representation Learning for Multi-Label Visual Analysis and Beyond Cheng-Yen Hsieh Chih-Jung Chang Fu-En Yang Yu-Chiang Frank Wang SSL 22 8 0 30 Aug 2022
Refine and Represent: Region-to-Object Representation Learning Akash Gokul Konstantinos Kallidromitis Shufang Li Yu Kato Kazuki Kozuka Trevor Darrell Colorado Reed SSeg 29 5 0 25 Aug 2022
Label-Free Synthetic Pretraining of Object Detectors Hei Law Jia Deng 25 4 0 08 Aug 2022
ConCL: Concept Contrastive Learning for Dense Prediction Pre-training in Pathology Images Jiawei Yang Hanbo Chen Yuan Liang Junzhou Huang Lei He Jianhua Yao 37 18 0 14 Jul 2022
Self-supervised Learning with Local Contrastive Loss for Detection and Semantic Segmentation Ashraful Islam Bengt Lundell H. Sawhney Sudipta N. Sinha Peter Morales Richard J. Radke SSL 28 9 0 10 Jul 2022
Look, Radiate, and Learn: Self-Supervised Localisation via Radio-Visual Correspondence Mohammed Alloulah Maximilian Arnold SSL 19 2 0 13 Jun 2022
SERE: Exploring Feature Self-relation for Self-supervised Transformer Zhong-Yu Li Shanghua Gao Ming-Ming Cheng ViT MDE 26 14 0 10 Jun 2022
Spatial Cross-Attention Improves Self-Supervised Visual Representation Learning M. Seyfi Amin Banitalebi-Dehkordi Yong Zhang SSL 11 0 0 07 Jun 2022
Self-Supervised Visual Representation Learning with Semantic Grouping Xin Wen Bingchen Zhao Anlin Zheng X. Zhang Xiaojuan Qi SSL 117 71 0 30 May 2022
Green Hierarchical Vision Transformer for Masked Image Modeling Lang Huang Shan You Mingkai Zheng Fei Wang Chao Qian T. Yamasaki 27 68 0 26 May 2022
Self-Supervised Learning of Object Parts for Semantic Segmentation A. Ziegler Yuki M. Asano SSL OCL 26 101 0 27 Apr 2022
Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Data Corentin Sautier Gilles Puy Spyros Gidaris Alexandre Boulch Andrei Bursuc Renaud Marlet 3DPC 15 117 0 30 Mar 2022
Learning Where to Learn in Cross-View Self-Supervised Learning Lang Huang Shan You Mingkai Zheng Fei Wang Chao Qian T. Yamasaki SSL 17 41 0 28 Mar 2022
Multi-scale and Cross-scale Contrastive Learning for Semantic Segmentation Theodoros Pissas Claudio S. Ravasio L. Cruz Christos Bergeles 15 15 0 25 Mar 2022
CP2: Copy-Paste Contrastive Pretraining for Semantic Segmentation Feng Wang Huiyu Wang Chen Wei Alan Yuille Wei Shen SSL VLM 19 35 0 22 Mar 2022
Drive&Segment: Unsupervised Semantic Segmentation of Urban Scenes via Cross-modal Distillation Antonín Vobecký David Hurych Oriane Siméoni Spyros Gidaris Andrei Bursuc Patrick Pérez Josef Sivic 3DPC 25 21 0 21 Mar 2022
Dense Siamese Network for Dense Unsupervised Learning Wenwei Zhang Jiangmiao Pang Kai-xiang Chen Chen Change Loy 23 12 0 21 Mar 2022
CYBORGS: Contrastively Bootstrapping Object Representations by Grounding in Segmentation Renhao Wang Hang Zhao Yang Gao SSL 18 1 0 17 Mar 2022
DATA: Domain-Aware and Task-Aware Self-supervised Learning Qing Chang Junran Peng Lingxi Xie Jiajun Sun Hao Yin Qi Tian Zhaoxiang Zhang 34 8 0 17 Mar 2022