ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1805.00932
  4. Cited By
Exploring the Limits of Weakly Supervised Pretraining

Exploring the Limits of Weakly Supervised Pretraining

2 May 2018
D. Mahajan
Ross B. Girshick
Vignesh Ramanathan
Kaiming He
Manohar Paluri
Shouqing Yang
Ashwin R. Bharambe
Laurens van der Maaten
    VLM
ArXiv (abs)PDFHTML

Papers citing "Exploring the Limits of Weakly Supervised Pretraining"

50 / 847 papers shown
Model soups: averaging weights of multiple fine-tuned models improves
  accuracy without increasing inference time
Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timeInternational Conference on Machine Learning (ICML), 2022
Mitchell Wortsman
Gabriel Ilharco
S. Gadre
Rebecca Roelofs
Raphael Gontijo-Lopes
...
Hongseok Namkoong
Ali Farhadi
Y. Carmon
Simon Kornblith
Ludwig Schmidt
MoMe
728
1,290
1
10 Mar 2022
Knowledge Distillation as Efficient Pre-training: Faster Convergence,
  Higher Data-efficiency, and Better Transferability
Knowledge Distillation as Efficient Pre-training: Faster Convergence, Higher Data-efficiency, and Better TransferabilityComputer Vision and Pattern Recognition (CVPR), 2022
Ruifei He
Shuyang Sun
Jihan Yang
Song Bai
Xiaojuan Qi
244
48
0
10 Mar 2022
Efficient Image Representation Learning with Federated Sampled Softmax
Efficient Image Representation Learning with Federated Sampled Softmax
Sagar M. Waghmare
Qi
Huizhong Chen
Mikhail Sirotenko
Tomer Meron
FedML
127
2
0
09 Mar 2022
ImageNet-Patch: A Dataset for Benchmarking Machine Learning Robustness against Adversarial Patches
ImageNet-Patch: A Dataset for Benchmarking Machine Learning Robustness against Adversarial PatchesPattern Recognition (Pattern Recogn.), 2022
Maura Pintor
Daniele Angioni
Angelo Sotgiu
Christian Scano
Ambra Demontis
Battista Biggio
Fabio Roli
AAML
350
57
0
07 Mar 2022
Aggregated Pyramid Vision Transformer: Split-transform-merge Strategy
  for Image Recognition without Convolutions
Aggregated Pyramid Vision Transformer: Split-transform-merge Strategy for Image Recognition without ConvolutionsIEEE International Conference on Consumer Electronics (ICCE), 2022
Ruikang Ju
Ting-Yu Lin
Jen-Shiun Chiang
Jia-Hao Jian
Yu-Shian Lin
Liu-Rui-Yi Huang
ViT
138
2
0
02 Mar 2022
WSLRec: Weakly Supervised Learning for Neural Sequential Recommendation
  Models
WSLRec: Weakly Supervised Learning for Neural Sequential Recommendation Models
Jingwei Zhuo
Binda Liu
Xiang Li
Ziru Xu
Xiaoqiang Zhu
72
0
0
28 Feb 2022
Synergistic Network Learning and Label Correction for Noise-robust Image
  Classification
Synergistic Network Learning and Label Correction for Noise-robust Image ClassificationIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2022
Chen Gong
K. Bin
E. Seibel
Xin Wang
Youbing Yin
Qi Song
NoLa
220
2
0
27 Feb 2022
Interpolation-based Contrastive Learning for Few-Label Semi-Supervised
  Learning
Interpolation-based Contrastive Learning for Few-Label Semi-Supervised LearningIEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2022
Xihong Yang
Xiaochang Hu
Sihang Zhou
Xinwang Liu
En Zhu
SSL
568
57
0
24 Feb 2022
Retrieval Augmented Classification for Long-Tail Visual Recognition
Retrieval Augmented Classification for Long-Tail Visual RecognitionComputer Vision and Pattern Recognition (CVPR), 2022
Alex Long
Wei Yin
Thalaiyasingam Ajanthan
Vu-Linh Nguyen
Pulak Purkait
Ravi Garg
Alan Blair
Chunhua Shen
Anton Van Den Hengel
165
118
0
22 Feb 2022
Tripartite: Tackle Noisy Labels by a More Precise Partition
Tripartite: Tackle Noisy Labels by a More Precise Partition
Xuefeng Liang
Longshan Yao
Xingyu Liu
Ying Zhou
NoLa
210
10
0
19 Feb 2022
Vision Models Are More Robust And Fair When Pretrained On Uncurated
  Images Without Supervision
Vision Models Are More Robust And Fair When Pretrained On Uncurated Images Without Supervision
Priya Goyal
Quentin Duval
Isaac Seessel
Mathilde Caron
Ishan Misra
Levent Sagun
Armand Joulin
Piotr Bojanowski
VLMSSL
410
122
0
16 Feb 2022
Fairness Indicators for Systematic Assessments of Visual Feature
  Extractors
Fairness Indicators for Systematic Assessments of Visual Feature ExtractorsConference on Fairness, Accountability and Transparency (FAccT), 2022
Priya Goyal
Adriana Romero Soriano
C. Hazirbas
Levent Sagun
Nicolas Usunier
EGVM
217
35
0
15 Feb 2022
CommerceMM: Large-Scale Commerce MultiModal Representation Learning with
  Omni Retrieval
CommerceMM: Large-Scale Commerce MultiModal Representation Learning with Omni RetrievalKnowledge Discovery and Data Mining (KDD), 2022
Licheng Yu
Jun Chen
Animesh Sinha
Mengjiao MJ Wang
Hugo Chen
Tamara L. Berg
Ning Zhang
VLM
257
44
0
15 Feb 2022
ASC me to Do Anything: Multi-task Training for Embodied AI
ASC me to Do Anything: Multi-task Training for Embodied AI
Jiasen Lu
Jordi Salvador
Roozbeh Mottaghi
Aniruddha Kembhavi
180
3
0
14 Feb 2022
Wukong: A 100 Million Large-scale Chinese Cross-modal Pre-training
  Benchmark
Wukong: A 100 Million Large-scale Chinese Cross-modal Pre-training BenchmarkNeural Information Processing Systems (NeurIPS), 2022
Jiaxi Gu
Xiaojun Meng
Guansong Lu
Lu Hou
Minzhe Niu
...
Runhu Huang
Wei Zhang
Xingda Jiang
Chunjing Xu
Hang Xu
VLM
396
137
0
14 Feb 2022
Learning Weakly-Supervised Contrastive Representations
Learning Weakly-Supervised Contrastive RepresentationsInternational Conference on Learning Representations (ICLR), 2022
Yifan Hao
Tianqi Li
Weixin Liu
Pei-Kai Liao
Ruslan Salakhutdinov
Louis-Philippe Morency
SSL
116
10
0
14 Feb 2022
Federated Contrastive Learning for Dermatological Disease Diagnosis via
  On-device Learning
Federated Contrastive Learning for Dermatological Disease Diagnosis via On-device Learning
Yawen Wu
Dewen Zeng
Zhepeng Wang
Yi Sheng
Lei Yang
A. James
Yiyu Shi
Jingtong Hu
FedML
157
33
0
14 Feb 2022
Dataset Condensation with Contrastive Signals
Dataset Condensation with Contrastive SignalsInternational Conference on Machine Learning (ICML), 2022
Saehyung Lee
Sanghyuk Chun
Sangwon Jung
Sangdoo Yun
Sung-Hoon Yoon
DD
314
128
0
07 Feb 2022
Catch Me if You Can: A Novel Task for Detection of Covert Geo-Locations
  (CGL)
Catch Me if You Can: A Novel Task for Detection of Covert Geo-Locations (CGL)
Binoy Saha
Sukhendu Das
134
1
0
05 Feb 2022
Auto-Transfer: Learning to Route Transferrable Representations
Auto-Transfer: Learning to Route Transferrable RepresentationsInternational Conference on Learning Representations (ICLR), 2022
K. Murugesan
Vijay Sadashivaiah
Ronny Luss
Karthikeyan Shanmugam
Pin-Yu Chen
Amit Dhurandhar
AAML
370
6
0
02 Feb 2022
AutoGeoLabel: Automated Label Generation for Geospatial Machine Learning
AutoGeoLabel: Automated Label Generation for Geospatial Machine Learning
C. Albrecht
F. Marianno
L. Klein
VLM
123
12
0
31 Jan 2022
Neural-PIM: Efficient Processing-In-Memory with Neural Approximation of
  Peripherals
Neural-PIM: Efficient Processing-In-Memory with Neural Approximation of PeripheralsIEEE transactions on computers (IEEE Trans. Comput.), 2022
Weidong Cao
Yilong Zhao
Adith Boloor
Yinhe Han
Xuan Zhang
Li Jiang
175
24
0
30 Jan 2022
Deep Learning Methods for Abstract Visual Reasoning: A Survey on Raven's
  Progressive Matrices
Deep Learning Methods for Abstract Visual Reasoning: A Survey on Raven's Progressive MatricesACM Computing Surveys (ACM CSUR), 2022
Mikolaj Malkiñski
Jacek Mańdziuk
491
54
0
28 Jan 2022
Revisiting Weakly Supervised Pre-Training of Visual Perception Models
Revisiting Weakly Supervised Pre-Training of Visual Perception ModelsComputer Vision and Pattern Recognition (CVPR), 2022
Mannat Singh
Laura Gustafson
Aaron B. Adcock
Vinicius de Freitas Reis
B. Gedik
Raj Prateek Kosaraju
D. Mahajan
Ross B. Girshick
Piotr Dollár
Laurens van der Maaten
VLM
285
146
0
20 Jan 2022
What can we learn from misclassified ImageNet images?
What can we learn from misclassified ImageNet images?
Shixian Wen
A. Rios
Kiran Lekkala
Laurent Itti
103
8
0
20 Jan 2022
The CLEAR Benchmark: Continual LEArning on Real-World Imagery
The CLEAR Benchmark: Continual LEArning on Real-World Imagery
Zhiqiu Lin
Jia Shi
Deepak Pathak
Deva Ramanan
CLLVLM
477
106
0
17 Jan 2022
Transferability in Deep Learning: A Survey
Transferability in Deep Learning: A Survey
Junguang Jiang
Yang Shu
Jianmin Wang
Mingsheng Long
OOD
193
131
0
15 Jan 2022
Offline-Online Associated Camera-Aware Proxies for Unsupervised Person
  Re-identification
Offline-Online Associated Camera-Aware Proxies for Unsupervised Person Re-identificationIEEE Transactions on Image Processing (IEEE TIP), 2022
Menglin Wang
Jiachen Li
Baisheng Lai
Xiaojin Gong
Xiansheng Hua
277
37
0
15 Jan 2022
Pedestrian Detection: Domain Generalization, CNNs, Transformers and
  Beyond
Pedestrian Detection: Domain Generalization, CNNs, Transformers and Beyond
Irtiza Hasan
Tianran Ouyang
Jinpeng Li
S. Akram
Ling Shao
ViT
287
26
0
10 Jan 2022
Learning with Less Labels in Digital Pathology via Scribble Supervision
  from Natural Images
Learning with Less Labels in Digital Pathology via Scribble Supervision from Natural ImagesIEEE International Symposium on Biomedical Imaging (ISBI), 2022
Eu Wern Teh
Graham W. Taylor
142
1
0
07 Jan 2022
AutoBalance: Optimized Loss Functions for Imbalanced Data
AutoBalance: Optimized Loss Functions for Imbalanced DataNeural Information Processing Systems (NeurIPS), 2022
Mingchen Li
Xuechen Zhang
Christos Thrampoulidis
Jiasi Chen
Samet Oymak
187
80
0
04 Jan 2022
Delving into Sample Loss Curve to Embrace Noisy and Imbalanced Data
Delving into Sample Loss Curve to Embrace Noisy and Imbalanced DataAAAI Conference on Artificial Intelligence (AAAI), 2021
Shenwang Jiang
Jianan Li
Ying Wang
Bo Huang
Zhang Zhang
Tingfa Xu
NoLa
135
41
0
30 Dec 2021
Cross Modal Retrieval with Querybank Normalisation
Cross Modal Retrieval with Querybank NormalisationComputer Vision and Pattern Recognition (CVPR), 2021
Simion-Vlad Bogolin
Ioana Croitoru
Hailin Jin
Yang Liu
Samuel Albanie
290
115
0
23 Dec 2021
Are Large-scale Datasets Necessary for Self-Supervised Pre-training?
Are Large-scale Datasets Necessary for Self-Supervised Pre-training?
Alaaeldin El-Nouby
Gautier Izacard
Hugo Touvron
Ivan Laptev
Edouard Grave
Edouard Grave
SSL
279
164
0
20 Dec 2021
On Efficient Transformer-Based Image Pre-training for Low-Level Vision
On Efficient Transformer-Based Image Pre-training for Low-Level VisionInternational Joint Conference on Artificial Intelligence (IJCAI), 2021
Wenbo Li
Xin Lu
Shengju Qian
Jiangbo Lu
Xinming Zhang
Jiaya Jia
ViT
246
124
0
19 Dec 2021
Data Efficient Language-supervised Zero-shot Recognition with Optimal
  Transport Distillation
Data Efficient Language-supervised Zero-shot Recognition with Optimal Transport Distillation
Bichen Wu
Rui Cheng
Peizhao Zhang
Tianren Gao
Peter Vajda
Joseph E. Gonzalez
VLM
309
54
0
17 Dec 2021
Audio Retrieval with Natural Language Queries: A Benchmark Study
Audio Retrieval with Natural Language Queries: A Benchmark Study
A. Sophia Koepke
Andreea-Maria Oncescu
João F. Henriques
Zeynep Akata
Samuel Albanie
201
118
0
17 Dec 2021
Rethinking Nearest Neighbors for Visual Classification
Rethinking Nearest Neighbors for Visual Classification
Menglin Jia
Bor-Chun Chen
Zuxuan Wu
Claire Cardie
Serge Belongie
Ser-Nam Lim
SSL
165
11
0
15 Dec 2021
Towards General and Efficient Active Learning
Towards General and Efficient Active Learning
Yichen Xie
Masayoshi Tomizuka
Wei Zhan
VLM
263
10
0
15 Dec 2021
Neural Belief Propagation for Scene Graph Generation
Neural Belief Propagation for Scene Graph Generation
Daqi Liu
M. Bober
J. Kittler
GNN
176
12
0
10 Dec 2021
Annotation-efficient cancer detection with report-guided lesion
  annotation for deep learning-based prostate cancer detection in bpMRI
Annotation-efficient cancer detection with report-guided lesion annotation for deep learning-based prostate cancer detection in bpMRI
Joeran S. Bosma
A. Saha
M. Hosseinzadeh
Ivan Slootweg
Maarten de Rooij
Henkjan Huisman
201
50
0
09 Dec 2021
A Transferable Approach for Partitioning Machine Learning Models on
  Multi-Chip-Modules
A Transferable Approach for Partitioning Machine Learning Models on Multi-Chip-Modules
Xinfeng Xie
Prakash Prabhu
Ulysse Beaugnon
P. Phothilimthana
Sudip Roy
Azalia Mirhoseini
E. Brevdo
James Laudon
Yanqi Zhou
123
7
0
07 Dec 2021
General Facial Representation Learning in a Visual-Linguistic Manner
General Facial Representation Learning in a Visual-Linguistic MannerComputer Vision and Pattern Recognition (CVPR), 2021
Yinglin Zheng
Hao Yang
Ting Zhang
Jianmin Bao
Dongdong Chen
Yangyu Huang
Lu Yuan
Dong Chen
Ming Zeng
Fang Wen
CVBM
461
230
0
06 Dec 2021
Lightweight Attentional Feature Fusion: A New Baseline for Text-to-Video
  Retrieval
Lightweight Attentional Feature Fusion: A New Baseline for Text-to-Video Retrieval
Fan Hu
Aozhu Chen
Ziyu Wang
Fangming Zhou
Jianfeng Dong
Xirong Li
211
44
0
03 Dec 2021
The Augmented Image Prior: Distilling 1000 Classes by Extrapolating from
  a Single Image
The Augmented Image Prior: Distilling 1000 Classes by Extrapolating from a Single Image
Yuki M. Asano
Aaqib Saeed
428
8
0
01 Dec 2021
The Majority Can Help The Minority: Context-rich Minority Oversampling
  for Long-tailed Classification
The Majority Can Help The Minority: Context-rich Minority Oversampling for Long-tailed Classification
Seulki Park
Youngkyu Hong
Byeongho Heo
Sangdoo Yun
J. Choi
353
204
0
01 Dec 2021
Task2Sim : Towards Effective Pre-training and Transfer from Synthetic
  Data
Task2Sim : Towards Effective Pre-training and Transfer from Synthetic Data
Samarth Mishra
Yikang Shen
Cheng Perng Phoo
Chun-Fu Chen
Leonid Karlinsky
Kate Saenko
Venkatesh Saligrama
Rogerio Feris
388
42
0
30 Nov 2021
A Simple Long-Tailed Recognition Baseline via Vision-Language Model
A Simple Long-Tailed Recognition Baseline via Vision-Language Model
Teli Ma
Shijie Geng
Mengmeng Wang
Jing Shao
Jiasen Lu
Jiaming Song
Shiyang Feng
Yu Qiao
VLM
234
62
0
29 Nov 2021
Weakly-guided Self-supervised Pretraining for Temporal Activity
  Detection
Weakly-guided Self-supervised Pretraining for Temporal Activity DetectionAAAI Conference on Artificial Intelligence (AAAI), 2021
Kumara Kahatapitiya
Zhou Ren
Haoxiang Li
Zhenyu Wu
Michael S. Ryoo
G. Hua
ViT
173
7
0
26 Nov 2021
VL-LTR: Learning Class-wise Visual-Linguistic Representation for
  Long-Tailed Visual Recognition
VL-LTR: Learning Class-wise Visual-Linguistic Representation for Long-Tailed Visual RecognitionEuropean Conference on Computer Vision (ECCV), 2021
Changyao Tian
Wenhai Wang
Xizhou Zhu
Jifeng Dai
Yu Qiao
VLM
356
94
0
26 Nov 2021
Previous
123...789...151617
Next