Big Transfer (BiT): General Visual Representation Learning

24 December 2019

Papers citing "Big Transfer (BiT): General Visual Representation Learning"

50 / 724 papers shown

Title
Confined Gradient Descent: Privacy-preserving Optimization for Federated Learning Yanjun Zhang Guangdong Bai Xue Li Surya Nepal R. Ko FedML 16 2 0 27 Apr 2021
If your data distribution shifts, use self-learning E. Rusak Steffen Schneider George Pachitariu L. Eck Peter V. Gehler Oliver Bringmann Wieland Brendel Matthias Bethge VLM OOD TTA 77 29 0 27 Apr 2021
ImageNet-21K Pretraining for the Masses T. Ridnik Emanuel Ben-Baruch Asaf Noy Lihi Zelnik-Manor SSeg VLM CLIP 168 686 0 22 Apr 2021
Dataset Inference: Ownership Resolution in Machine Learning Pratyush Maini Mohammad Yaghini Nicolas Papernot FedML 61 103 0 21 Apr 2021
Robust Learning Meets Generative Models: Can Proxy Distributions Improve Adversarial Robustness? Vikash Sehwag Saeed Mahloujifar Tinashe Handina Sihui Dai Chong Xiang M. Chiang Prateek Mittal OOD 39 126 0 19 Apr 2021
An Oracle for Guiding Large-Scale Model/Hybrid Parallel Training of Convolutional Neural Networks A. Kahira Truong Thao Nguyen L. Bautista-Gomez Ryousei Takano Rosa M. Badia M. Wahib 10 9 0 19 Apr 2021
Data-Efficient Language-Supervised Zero-Shot Learning with Self-Distillation Rui Cheng Bichen Wu Peizhao Zhang Peter Vajda Joseph E. Gonzalez CLIP VLM 18 31 0 18 Apr 2021
Filtering Empty Camera Trap Images in Embedded Systems Fagner Cunha E. M. Santos R. Barreto J. Colonna 21 14 0 18 Apr 2021
Does language help generalization in vision models? Benjamin Devillers Bhavin Choksi Romain Bielawski R. V. Rullen VLM 19 27 0 16 Apr 2021
Exploring Visual Engagement Signals for Representation Learning Menglin Jia Zuxuan Wu A. Reiter Claire Cardie Serge J. Belongie Ser-Nam Lim 19 13 0 15 Apr 2021
SI-Score: An image dataset for fine-grained analysis of robustness to object location, rotation and size Jessica Yung Rob Romijnders Alexander Kolesnikov Lucas Beyer Josip Djolonga N. Houlsby Sylvain Gelly Mario Lucic Xiaohua Zhai 19 8 0 09 Apr 2021
Does Your Dermatology Classifier Know What It Doesn't Know? Detecting the Long-Tail of Unseen Conditions Abhijit Guha Roy Jie Jessie Ren Shekoofeh Azizi Aaron Loh Vivek Natarajan ... Yun-hui Liu taylan. cemgil Alan Karthikesalingam Balaji Lakshminarayanan Jim Winkens 18 103 0 08 Apr 2021
Comparing Transfer and Meta Learning Approaches on a Unified Few-Shot Classification Benchmark Vincent Dumoulin N. Houlsby Utku Evci Xiaohua Zhai Ross Goroshin Sylvain Gelly Hugo Larochelle 19 26 0 06 Apr 2021
SpeechStew: Simply Mix All Available Speech Recognition Data to Train One Large Neural Network William Chan Daniel S. Park Chris A. Lee Yu Zhang Quoc V. Le Mohammad Norouzi AI4TS 32 135 0 05 Apr 2021
An Empirical Study of Training Self-Supervised Vision Transformers Xinlei Chen Saining Xie Kaiming He ViT 11 1,801 0 05 Apr 2021
Modular Adaptation for Cross-Domain Few-Shot Learning Xiaoyu Lin Meng Ye Yunye Gong G. Buracas Nikoletta Basiou Ajay Divakaran Yi Yao 13 4 0 01 Apr 2021
EfficientNetV2: Smaller Models and Faster Training Mingxing Tan Quoc V. Le EgoV 14 2,597 0 01 Apr 2021
On the Robustness of Vision Transformers to Adversarial Examples Kaleel Mahmood Rigel Mahmood Marten van Dijk ViT 20 217 0 31 Mar 2021
DAP: Detection-Aware Pre-training with Weak Supervision Yuanyi Zhong Jianfeng Wang Lijuan Wang Jian-wei Peng Yu-xiong Wang Lei Zhang 19 15 0 30 Mar 2021
Automatic Graph Partitioning for Very Large-scale Deep Learning Masahiro Tanaka Kenjiro Taura T. Hanawa Kentaro Torisawa GNN AI4CE 17 19 0 30 Mar 2021
Self-supervised Image-text Pre-training With Mixed Data In Chest X-rays Xiaosong Wang Ziyue Xu Leo K. Tam Dong Yang Daguang Xu ViT MedIm 17 23 0 30 Mar 2021
CvT: Introducing Convolutions to Vision Transformers Haiping Wu Bin Xiao Noel Codella Mengchen Liu Xiyang Dai Lu Yuan Lei Zhang ViT 28 1,874 0 29 Mar 2021
Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding Pengchuan Zhang Xiyang Dai Jianwei Yang Bin Xiao Lu Yuan Lei Zhang Jianfeng Gao ViT 23 328 0 29 Mar 2021
A Practical Survey on Faster and Lighter Transformers Quentin Fournier G. Caron Daniel Aloise 6 93 0 26 Mar 2021
Understanding Robustness of Transformers for Image Classification Srinadh Bhojanapalli Ayan Chakrabarti Daniel Glasner Daliang Li Thomas Unterthiner Andreas Veit ViT 14 377 0 26 Mar 2021
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Ze Liu Yutong Lin Yue Cao Han Hu Yixuan Wei Zheng-Wei Zhang Stephen Lin B. Guo ViT 107 20,660 0 25 Mar 2021
Contrast to Divide: Self-Supervised Pre-Training for Learning with Noisy Labels Evgenii Zheltonozhskii Chaim Baskin A. Mendelson A. Bronstein Or Litany SSL 17 92 0 25 Mar 2021
Vision Transformers for Dense Prediction René Ranftl Alexey Bochkovskiy V. Koltun ViT MDE 21 1,659 0 24 Mar 2021
Factors of Influence for Transfer Learning across Diverse Appearance Domains and Task Types Thomas Mensink J. Uijlings Alina Kuznetsova Michael Gygli V. Ferrari VLM 15 80 0 24 Mar 2021
Can Vision Transformers Learn without Natural Images? Kodai Nakashima Hirokatsu Kataoka Asato Matsumoto K. Iwata Nakamasa Inoue ViT 15 34 0 24 Mar 2021
Embracing the Disharmony in Medical Imaging: A Simple and Effective Framework for Domain Adaptation Rongguang Wang Pratik Chaudhari Christos Davatzikos OOD 29 49 0 23 Mar 2021
Scaling Local Self-Attention for Parameter Efficient Visual Backbones Ashish Vaswani Prajit Ramachandran A. Srinivas Niki Parmar Blake A. Hechtman Jonathon Shlens 16 395 0 23 Mar 2021
Self-Supervised Pretraining Improves Self-Supervised Pretraining Colorado Reed Xiangyu Yue Aniruddha Nrusimha Sayna Ebrahimi Vivek Vijaykumar ... Shanghang Zhang Devin Guillory Sean L. Metzger Kurt Keutzer Trevor Darrell 23 104 0 23 Mar 2021
Incorporating Convolution Designs into Visual Transformers Kun Yuan Shaopeng Guo Ziwei Liu Aojun Zhou F. Yu Wei Wu ViT 24 467 0 22 Mar 2021
UPANets: Learning from the Universal Pixel Attention Networks Ching-Hsun Tseng Shin-Jye Lee Jianxing Feng Shengzhong Mao Yuping Wu Jia-Yu Shang Mou-Chung Tseng Xiao-Jun Zeng 14 15 0 15 Mar 2021
Revisiting ResNets: Improved Training and Scaling Strategies Irwan Bello W. Fedus Xianzhi Du E. D. Cubuk A. Srinivas Tsung-Yi Lin Jonathon Shlens Barret Zoph 27 297 0 13 Mar 2021
Sequential Random Network for Fine-grained Image Classification Chaorong Li Malu Zhang Wei Huang Feng-qing Qin Anping Zeng Yuanyuan Huang 14 0 0 12 Mar 2021
VideoMoCo: Contrastive Video Representation Learning with Temporally Adversarial Examples Tian Pan Yibing Song Tianyu Yang Wenhao Jiang Wei Liu 17 222 0 10 Mar 2021
Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices Max Ryabinin Eduard A. Gorbunov Vsevolod Plokhotnyuk Gennady Pekhimenko 24 31 0 04 Mar 2021
Contrastive Learning Meets Transfer Learning: A Case Study In Medical Image Analysis Yuzhe Lu Aadarsh Jha Yuankai Huo MedIm 14 4 0 04 Mar 2021
Data Augmentation for Object Detection via Differentiable Neural Rendering G. Ning Guang Chen Chaowei Tan Si Luo Liefeng Bo Heng Huang 23 6 0 04 Mar 2021
Self-supervised Pretraining of Visual Features in the Wild Priya Goyal Mathilde Caron Benjamin Lefaudeux Min Xu Pengchao Wang ... Mannat Singh Vitaliy Liptchinsky Ishan Misra Armand Joulin Piotr Bojanowski VLM SSL 8 270 0 02 Mar 2021
OmniNet: Omnidirectional Representations from Transformers Yi Tay Mostafa Dehghani V. Aribandi Jai Gupta Philip Pham Zhen Qin Dara Bahri Da-Cheng Juan Donald Metzler 39 26 0 01 Mar 2021
Distilling Knowledge via Intermediate Classifiers Aryan Asadian Amirali Salehi-Abari 22 1 0 28 Feb 2021
Towards Causal Representation Learning Bernhard Schölkopf Francesco Locatello Stefan Bauer Nan Rosemary Ke Nal Kalchbrenner Anirudh Goyal Yoshua Bengio OOD CML AI4CE 29 316 0 22 Feb 2021
Inducing a hierarchy for multi-class classification problems Hayden S. Helm Weiwei Yang Sujeeth Bharadwaj Kate Lytvynets Oriana Riva Christopher M. White Ali Geisa Carey E. Priebe 11 7 0 20 Feb 2021
GradFreeBits: Gradient Free Bit Allocation for Dynamic Low Precision Neural Networks Ben Bodner G. B. Shalom Eran Treister MQ 19 2 0 18 Feb 2021
LambdaNetworks: Modeling Long-Range Interactions Without Attention Irwan Bello 260 179 0 17 Feb 2021
Momentum Residual Neural Networks Michael E. Sander Pierre Ablin Mathieu Blondel Gabriel Peyré 19 56 0 15 Feb 2021
Learning Deep Neural Networks under Agnostic Corrupted Supervision Boyang Liu Mengying Sun Ding Wang P. Tan Jiayu Zhou 18 5 0 12 Feb 2021