Big Transfer (BiT): General Visual Representation Learning

24 December 2019

Papers citing "Big Transfer (BiT): General Visual Representation Learning"

50 / 724 papers shown

Title
Identical Image Retrieval using Deep Learning Sayan Nath Nikhil Nayak VLM 32 1 0 10 May 2022
When does dough become a bagel? Analyzing the remaining mistakes on ImageNet Vijay Vasudevan Benjamin Caine Raphael Gontijo-Lopes Sara Fridovich-Keil Rebecca Roelofs VLM UQCV 35 57 0 09 May 2022
Beyond a Pre-Trained Object Detector: Cross-Modal Textual and Visual Context for Image Captioning Chia-Wen Kuo Z. Kira 19 52 0 09 May 2022
Large Scale Transfer Learning for Differentially Private Image Classification Harsh Mehta Abhradeep Thakurta Alexey Kurakin Ashok Cutkosky 9 39 0 06 May 2022
Lifelong Ensemble Learning based on Multiple Representations for Few-Shot Object Recognition H. Kasaei Songsong Xiong 16 12 0 04 May 2022
Cross-modal Representation Learning for Zero-shot Action Recognition Chung-Ching Lin Kevin Qinghong Lin Linjie Li Lijuan Wang Zicheng Liu ViT 16 29 0 03 May 2022
Better plain ViT baselines for ImageNet-1k Lucas Beyer Xiaohua Zhai Alexander Kolesnikov ViT VLM 33 111 0 03 May 2022
Continual Learning with Foundation Models: An Empirical Study of Latent Replay O. Ostapenko Timothée Lesort P. Rodríguez Md Rifat Arefin Arthur Douillard Irina Rish Laurent Charlin 29 50 0 30 Apr 2022
Unlocking High-Accuracy Differentially Private Image Classification through Scale Soham De Leonard Berrada Jamie Hayes Samuel L. Smith Borja Balle 28 217 0 28 Apr 2022
DearKD: Data-Efficient Early Knowledge Distillation for Vision Transformers Xianing Chen Qiong Cao Yujie Zhong Jing Zhang Shenghua Gao Dacheng Tao ViT 32 76 0 27 Apr 2022
Causal Transportability for Visual Recognition Chengzhi Mao K. Xia James Wang Hongya Wang Junfeng Yang Elias Bareinboim Carl Vondrick CML OOD BDL 19 35 0 26 Apr 2022
Adaptive Split-Fusion Transformer Zixuan Su Hao Zhang Jingjing Chen Lei Pang Chong-Wah Ngo Yu-Gang Jiang ViT 19 7 0 26 Apr 2022
Skill-based Meta-Reinforcement Learning Taewook Nam Shao-Hua Sun Karl Pertsch S. Hwang Joseph J. Lim OffRL 15 45 0 25 Apr 2022
K-LITE: Learning Transferable Visual Models with External Knowledge Sheng Shen Chunyuan Li Xiaowei Hu Jianwei Yang Yujia Xie ... Ce Liu Kurt Keutzer Trevor Darrell Anna Rohrbach Jianfeng Gao CLIP VLM 30 83 0 20 Apr 2022
Active Learning Helps Pretrained Models Learn the Intended Task Alex Tamkin Dat Nguyen Salil Deshpande Jesse Mu Noah D. Goodman 18 35 0 18 Apr 2022
Empirical Evaluation and Theoretical Analysis for Representation Learning: A Survey Kento Nozawa Issei Sato AI4TS 19 4 0 18 Apr 2022
DeiT III: Revenge of the ViT Hugo Touvron Matthieu Cord Hervé Jégou ViT 42 388 0 14 Apr 2022
From Modern CNNs to Vision Transformers: Assessing the Performance, Robustness, and Classification Strategies of Deep Learning Models in Histopathology Maximilian Springenberg A. Frommholz M. Wenzel Eva Weicken Jackie Ma Nils Strodthoff MedIm 25 42 0 11 Apr 2022
DualPrompt: Complementary Prompting for Rehearsal-free Continual Learning Zifeng Wang Zizhao Zhang Sayna Ebrahimi Ruoxi Sun Han Zhang ... Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VLM VPVLM 28 455 0 10 Apr 2022
Unified Contrastive Learning in Image-Text-Label Space Jianwei Yang Chunyuan Li Pengchuan Zhang Bin Xiao Ce Liu Lu Yuan Jianfeng Gao VLM SSL 34 219 0 07 Apr 2022
Last Layer Re-Training is Sufficient for Robustness to Spurious Correlations Polina Kirichenko Pavel Izmailov A. Wilson OOD 34 314 0 06 Apr 2022
MaxViT: Multi-Axis Vision Transformer Zhengzhong Tu Hossein Talebi Han Zhang Feng Yang P. Milanfar A. Bovik Yinxiao Li ViT 43 636 0 04 Apr 2022
Exploring Visual Prompts for Adapting Large-Scale Models Hyojin Bahng Ali Jahanian S. Sankaranarayanan Phillip Isola VLM VPVLM LRM 25 255 0 31 Mar 2022
Constrained Few-shot Class-incremental Learning Michael Hersche G. Karunaratne G. Cherubini Luca Benini A. Sebastian Abbas Rahimi CLL 24 141 0 30 Mar 2022
Understanding out-of-distribution accuracies through quantifying difficulty of test samples Berfin Simsek Melissa Hall Levent Sagun 23 5 0 28 Mar 2022
DepthFormer: Exploiting Long-Range Correlation and Local Information for Accurate Monocular Depth Estimation Zhenyu Li Zehui Chen Xianming Liu Junjun Jiang ViT MDE 36 183 1 27 Mar 2022
Domino: Discovering Systematic Errors with Cross-Modal Embeddings Sabri Eyuboglu M. Varma Khaled Kamal Saab Jean-Benoit Delbrouck Christopher Lee-Messer Jared A. Dunnmon James Y. Zou Christopher Ré 22 141 0 24 Mar 2022
Shoring Up the Foundations: Fusing Model Embeddings and Weak Supervision Mayee F. Chen Daniel Y. Fu Dyah Adila Michael Zhang Frederic Sala Kayvon Fatahalian Christopher Ré 27 20 0 24 Mar 2022
ViM: Out-Of-Distribution with Virtual-logit Matching Haoqi Wang Zhizhong Li Litong Feng Wayne Zhang OODD 20 309 0 21 Mar 2022
Are Vision Transformers Robust to Spurious Correlations? Soumya Suvra Ghosal Yifei Ming Yixuan Li ViT 25 28 0 17 Mar 2022
X-Learner: Learning Cross Sources and Tasks for Universal Visual Representation Yinan He Gengshi Huang Siyu Chen Jianing Teng Wang Kun Zhen-fei Yin Lu Sheng Ziwei Liu Yu Qiao Jing Shao VLM SSL ViT 37 7 0 16 Mar 2022
Bamboo: Building Mega-Scale Vision Dataset Continually with Human-Machine Synergy Yuanhan Zhang Qi Sun Yichun Zhou Zexin He Zhen-fei Yin Kunze Wang Lu Sheng Yu Qiao Jing Shao Ziwei Liu ObjD VLM 19 19 0 15 Mar 2022
Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time Mitchell Wortsman Gabriel Ilharco S. Gadre Rebecca Roelofs Raphael Gontijo-Lopes ... Hongseok Namkoong Ali Farhadi Y. Carmon Simon Kornblith Ludwig Schmidt MoMe 48 909 1 10 Mar 2022
Knowledge Distillation as Efficient Pre-training: Faster Convergence, Higher Data-efficiency, and Better Transferability Ruifei He Shuyang Sun Jihan Yang Song Bai Xiaojuan Qi 24 36 0 10 Mar 2022
Efficient Image Representation Learning with Federated Sampled Softmax Sagar M. Waghmare Qi Huizhong Chen Mikhail Sirotenko Tomer Meron FedML 11 2 0 09 Mar 2022
Flat minima generalize for low-rank matrix recovery Lijun Ding D. Drusvyatskiy Maryam Fazel Zaid Harchaoui 26 16 0 07 Mar 2022
Kubric: A scalable dataset generator Klaus Greff Francois Belletti Lucas Beyer Carl Doersch Yilun Du ... Ziyu Wang Tianhao Wu K. M. Yi Fangcheng Zhong Andrea Tagliasacchi 43 250 0 07 Mar 2022
Algorithmic Regularization in Model-free Overparametrized Asymmetric Matrix Factorization Liwei Jiang Yudong Chen Lijun Ding 33 26 0 06 Mar 2022
Aggregated Pyramid Vision Transformer: Split-transform-merge Strategy for Image Recognition without Convolutions Ruikang Ju Ting-Yu Lin Jen-Shiun Chiang Jia-Hao Jian Yu-Shian Lin Liu-Rui-Yi Huang ViT 16 1 0 02 Mar 2022
Enhance transferability of adversarial examples with model architecture Mingyuan Fan Wenzhong Guo Shengxing Yu Zuobin Ying Ximeng Liu SILM AAML 11 7 0 28 Feb 2022
SemSup: Semantic Supervision for Simple and Scalable Zero-shot Generalization Austin W. Hanjie A. Deshpande Karthik Narasimhan VLM 36 2 0 26 Feb 2022
Improving generalization with synthetic training data for deep learning based quality inspection Antoine Cordier Pierre Gutierrez Victoire Plessis 19 2 0 25 Feb 2022
ChimeraMix: Image Classification on Small Datasets via Masked Feature Mixing Christoph Reinders Frederik Schubert Bodo Rosenhahn 14 7 0 23 Feb 2022
Retrieval Augmented Classification for Long-Tail Visual Recognition Alex Long Wei Yin Thalaiyasingam Ajanthan Vu-Linh Nguyen Pulak Purkait Ravi Garg Alan Blair Chunhua Shen A. Hengel 15 107 0 22 Feb 2022
ViTAEv2: Vision Transformer Advanced by Exploring Inductive Bias for Image Recognition and Beyond Qiming Zhang Yufei Xu Jing Zhang Dacheng Tao ViT 24 229 0 21 Feb 2022
Vision Models Are More Robust And Fair When Pretrained On Uncurated Images Without Supervision Priya Goyal Quentin Duval Isaac Seessel Mathilde Caron Ishan Misra Levent Sagun Armand Joulin Piotr Bojanowski VLM SSL 26 110 0 16 Feb 2022
Fairness Indicators for Systematic Assessments of Visual Feature Extractors Priya Goyal Adriana Romero Soriano C. Hazirbas Levent Sagun Nicolas Usunier EGVM 22 31 0 15 Feb 2022
Simple Control Baselines for Evaluating Transfer Learning Andrei Atanov Shijian Xu Onur Beker Andrei Filatov Amir Zamir SSL 29 1 0 07 Feb 2022
Towards an Analytical Definition of Sufficient Data Adam Byerly T. Kalganova 22 4 0 07 Feb 2022
Data Scaling Laws in NMT: The Effect of Noise and Architecture Yamini Bansal Behrooz Ghorbani Ankush Garg Biao Zhang M. Krikun Colin Cherry Behnam Neyshabur Orhan Firat 37 47 0 04 Feb 2022