Exploring the Limits of Weakly Supervised Pretraining

2 May 2018

L. V. D. van der Maaten

VLM

ArXiv PDF HTML

Papers citing "Exploring the Limits of Weakly Supervised Pretraining"

50 / 825 papers shown

Title
Class-Balancing Diffusion Models Yiming Qin Huangjie Zheng Jiangchao Yao Mingyuan Zhou Ya-Qin Zhang DiffM 22 42 0 30 Apr 2023
The Emotions of the Crowd: Learning Image Sentiment from Tweets via Cross-modal Distillation Alessio Serra F. Carrara Maurizio Tesconi Fabrizio Falchi 43 3 0 28 Apr 2023
End-to-End Spatio-Temporal Action Localisation with Video Transformers A. Gritsenko Xuehan Xiong Josip Djolonga Mostafa Dehghani Chen Sun Mario Lucic Cordelia Schmid Anurag Arnab ViT 32 13 0 24 Apr 2023
Semantic-Aware Graph Matching Mechanism for Multi-Label Image Recognition Yanan Wu Songhe Feng Yang Wang 21 10 0 21 Apr 2023
Synthetic Data from Diffusion Models Improves ImageNet Classification Shekoofeh Azizi Simon Kornblith Chitwan Saharia Mohammad Norouzi David J. Fleet VLM DiffM 40 288 0 17 Apr 2023
DINOv2: Learning Robust Visual Features without Supervision Maxime Oquab Timothée Darcet Théo Moutakanni Huy Q. Vo Marc Szafraniec ... Hervé Jégou Julien Mairal Patrick Labatut Armand Joulin Piotr Bojanowski VLM CLIP SSL 89 3,017 0 14 Apr 2023
Unicom: Universal and Compact Representation Learning for Image Retrieval Xiang An Jiankang Deng Kaicheng Yang Jaiwei Li Ziyong Feng Jia Guo Jing Yang Tongliang Liu VLM SSL 32 26 0 12 Apr 2023
Reweighted Mixup for Subpopulation Shift Zongbo Han Zhipeng Liang Fan Yang Liu Liu Lanqing Li ... P. Zhao Qinghua Hu Bing Wu Changqing Zhang Jianhua Yao 29 3 0 09 Apr 2023
Long-Tailed Visual Recognition via Self-Heterogeneous Integration with Knowledge Excavation Yang Jin Mengke Li Yang Lu Y. Cheung Hanzi Wang 35 21 0 03 Apr 2023
Towards Understanding the Effect of Pretraining Label Granularity Guanzhe Hong Yin Cui Ariel Fuxman Stanley H. Chan Enming Luo 19 2 0 29 Mar 2023
VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking Limin Wang Bingkun Huang Zhiyu Zhao Zhan Tong Yinan He Yi Wang Yali Wang Yu Qiao VGen 54 325 0 29 Mar 2023
Towards Foundation Models and Few-Shot Parameter-Efficient Fine-Tuning for Volumetric Organ Segmentation Julio Silva-Rodríguez Jose Dolz Ismail Ben Ayed 66 12 0 29 Mar 2023
GeoNet: Benchmarking Unsupervised Adaptation across Geographies Tarun Kalluri Wangdong Xu Manmohan Chandraker OOD 18 15 0 27 Mar 2023
Mind the Backbone: Minimizing Backbone Distortion for Robust Object Detection Kuniaki Saito Donghyun Kim Piotr Teterwak Rogerio Feris Kate Saenko 36 1 0 26 Mar 2023
Joint fMRI Decoding and Encoding with Latent Embedding Alignment Xuelin Qian Yikai Wang Yanwei Fu Xinwei Sun Xiangyang Xue Jianfeng Feng 52 6 0 26 Mar 2023
Analyzing Effects of Mixed Sample Data Augmentation on Model Interpretability Soyoun Won Sung-Ho Bae Seong Tae Kim 43 2 0 26 Mar 2023
The effectiveness of MAE pre-pretraining for billion-scale pretraining Mannat Singh Quentin Duval Kalyan Vasudev Alwala Haoqi Fan Vaibhav Aggarwal ... Piotr Dollár Christoph Feichtenhofer Ross B. Girshick Rohit Girdhar Ishan Misra LRM 113 63 0 23 Mar 2023
Open-Vocabulary Object Detection using Pseudo Caption Labels Han-Cheol Cho Won Young Jhoo Woohyun Kang Byungseok Roh VLM ObjD 19 20 0 23 Mar 2023
Large AI Models in Health Informatics: Applications, Challenges, and the Future Jianing Qiu Lin Li Jiankai Sun Jiachuan Peng Peilun Shi ... Bo Xiao Wu Yuan Ningli Wang Dong Xu Benny P. L. Lo AI4MH LM&MA 40 127 0 21 Mar 2023
Computationally Budgeted Continual Learning: What Does Matter? Ameya Prabhu Hasan Hammoud P. Dokania Philip H. S. Torr Ser-Nam Lim Bernard Ghanem Adel Bibi CLL 28 61 0 20 Mar 2023
SeiT: Storage-Efficient Vision Training with Tokens Using 1% of Pixel Storage Song Park Sanghyuk Chun Byeongho Heo Wonjae Kim Sangdoo Yun VLM ViT 12 8 0 20 Mar 2023
VEIL: Vetting Extracted Image Labels from In-the-Wild Captions for Weakly-Supervised Object Detection Arushi Rai Adriana Kovashka 19 0 0 16 Mar 2023
Reinforce Data, Multiply Impact: Improved Model Accuracy and Robustness with Dataset Reinforcement Fartash Faghri Hadi Pouransari Sachin Mehta Mehrdad Farajtabar Ali Farhadi Mohammad Rastegari Oncel Tuzel 35 9 0 15 Mar 2023
Long-tailed Classification from a Bayesian-decision-theory Perspective Bolian Li Ruqi Zhang 30 1 0 10 Mar 2023
Adapting Contrastive Language-Image Pretrained (CLIP) Models for Out-of-Distribution Detection Nikolas Adaloglou Félix D. P. Michels Tim Kaiser M. Kollmann VLM 29 0 0 10 Mar 2023
Rethinking Self-Supervised Visual Representation Learning in Pre-training for 3D Human Pose and Shape Estimation Hongsuk Choi Hyeongjin Nam T. Lee Gyeongsik Moon Kyoung Mu Lee 28 7 0 09 Mar 2023
Your representations are in the network: composable and parallel adaptation for large scale models Yonatan Dukler Alessandro Achille Hao-Yu Yang Varsha Vivek L. Zancato Benjamin Bowman Avinash Ravichandran Charless C. Fowlkes A. Swaminathan Stefano Soatto 21 3 0 07 Mar 2023
Visual Atoms: Pre-training Vision Transformers with Sinusoidal Waves Sora Takashima Ryo Hayamizu Nakamasa Inoue Hirokatsu Kataoka Rio Yokota 60 18 0 02 Mar 2023
Internet Explorer: Targeted Representation Learning on the Open Web Alexander C. Li Ellis L Brown Alexei A. Efros Deepak Pathak VLM 16 24 0 27 Feb 2023
What Can We Learn From The Selective Prediction And Uncertainty Estimation Performance Of 523 Imagenet Classifiers Ido Galil Mohammed Dabbah Ran El-Yaniv UQCV 30 24 0 23 Feb 2023
Large-scale Multi-Modal Pre-trained Models: A Comprehensive Survey Xiao Wang Guangyao Chen Guangwu Qian Pengcheng Gao Xiaoyong Wei Yaowei Wang Yonghong Tian Wen Gao AI4CE VLM 28 200 0 20 Feb 2023
Mutual Exclusive Modulator for Long-Tailed Recognition Haixu Long Xiaolin Zhang Yanbin Liu Zongtai Luo Jianbo Liu 9 2 0 19 Feb 2023
Towards Efficient Visual Adaption via Structural Re-parameterization Gen Luo Minglang Huang Yiyi Zhou Xiaoshuai Sun Guannan Jiang Zhiyu Wang Rongrong Ji VLM VPVLM 8 78 0 16 Feb 2023
Generative Oversampling for Imbalanced Data via Majority-Guided VAE Qingzhong Ai Pengyun Wang Lirong He Liangjiang Wen Lujia Pan Zenglin Xu 19 7 0 14 Feb 2023
Multi-modal Machine Learning in Engineering Design: A Review and Future Directions Binyang Song Ruilin Zhou Faez Ahmed AI4CE 35 40 0 14 Feb 2023
Scaling Vision Transformers to 22 Billion Parameters Mostafa Dehghani Josip Djolonga Basil Mustafa Piotr Padlewski Jonathan Heek ... Mario Luvcić Xiaohua Zhai Daniel Keysers Jeremiah Harmsen N. Houlsby MLLM 61 569 0 10 Feb 2023
Beyond In-Domain Scenarios: Robust Density-Aware Calibration Christian Tomani Futa Waseda Yuesong Shen Daniel Cremers UQCV 16 4 0 10 Feb 2023
SimCon Loss with Multiple Views for Text Supervised Semantic Segmentation Yash J. Patel Yusheng Xie Yi Zhu Srikar Appalaraju R. Manmatha 27 4 0 07 Feb 2023
Diverse, Difficult, and Odd Instances (D2O): A New Test Set for Object Classification Ali Borji VLM 37 0 0 29 Jan 2023
Style-Aware Contrastive Learning for Multi-Style Image Captioning Yucheng Zhou Guodong Long 25 22 0 26 Jan 2023
Human-Timescale Adaptation in an Open-Ended Task Space Adaptive Agent Team Jakob Bauer Kate Baumli Satinder Baveja Feryal M. P. Behbahani ... Jakub Sygnowski K. Tuyls Sarah York Alexander Zacherl Lei Zhang LM&Ro OffRL AI4CE LRM 30 108 0 18 Jan 2023
Enhancing Self-Training Methods Aswathnarayan Radhakrishnan Jim Davis Zachary Rabin Benjamin Lewis Matthew Scherreik R. Ilin 19 1 0 18 Jan 2023
Towards Spatial Equilibrium Object Detection Zhaohui Zheng Yuming Chen Qibin Hou Xiang Li Ming-Ming Cheng ObjD 20 0 0 14 Jan 2023
Does progress on ImageNet transfer to real-world datasets? Alex Fang Simon Kornblith Ludwig Schmidt VLM 21 34 0 11 Jan 2023
Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training Filip Radenovic Abhimanyu Dubey Abhishek Kadian Todor Mihaylov Simon Vandenhende Yash J. Patel Y. Wen Vignesh Ramanathan D. Mahajan VLM 32 81 0 05 Jan 2023
On the Convergence of Stochastic Gradient Descent in Low-precision Number Formats M. Cacciola A. Frangioni M. Asgharian Alireza Ghaffari V. Nia 45 4 0 04 Jan 2023
Analyzing I/O Performance of a Hierarchical HPC Storage System for Distributed Deep Learning Takaaki Fukai Kento Sato Takahiro Hirofuchi 22 2 0 04 Jan 2023
Knowledge-Guided Data-Centric AI in Healthcare: Progress, Shortcomings, and Future Directions Edward Y. Chang MedIm 11 6 0 27 Dec 2022
Reversible Column Networks Yuxuan Cai Yi Zhou Qi Han Jianjian Sun Xiangwen Kong Jun Yu Li Xiangyu Zhang VLM 31 53 0 22 Dec 2022
Unleashing the Power of Visual Prompting At the Pixel Level Junyang Wu Xianhang Li Chen Wei Huiyu Wang Alan Yuille Yuyin Zhou Cihang Xie VPVLM VLM 19 31 0 20 Dec 2022