Big Transfer (BiT): General Visual Representation Learning

24 December 2019

Papers citing "Big Transfer (BiT): General Visual Representation Learning"

50 / 724 papers shown

Title
MSE Loss with Outlying Label for Imbalanced Classification S. Kato Kazuhiro Hotta 11 11 0 06 Jul 2021
A Systems Theory of Transfer Learning Tyler Cody Peter A. Beling 11 38 0 02 Jul 2021
Memory Efficient Meta-Learning with Large Images J. Bronskill Daniela Massiceti Massimiliano Patacchiola Katja Hofmann Sebastian Nowozin Richard E. Turner VLM 19 20 0 02 Jul 2021
UTNet: A Hybrid Transformer Architecture for Medical Image Segmentation Yunhe Gao Mu Zhou Dimitris N. Metaxas MedIm ViT 11 425 0 02 Jul 2021
CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows Xiaoyi Dong Jianmin Bao Dongdong Chen Weiming Zhang Nenghai Yu Lu Yuan Dong Chen B. Guo ViT 11 953 0 01 Jul 2021
JUWELS Booster -- A Supercomputer for Large-Scale AI Research Stefan Kesselheim A. Herten K. Krajsek J. Ebert J. Jitsev ... A. Strube Roshni Kamath Martin G. Schultz M. Riedel T. Lippert GNN 15 14 0 30 Jun 2021
The Evolution of Out-of-Distribution Robustness Throughout Fine-Tuning Anders Andreassen Yasaman Bahri Behnam Neyshabur Rebecca Roelofs OOD OODD 22 78 0 30 Jun 2021
Early Convolutions Help Transformers See Better Tete Xiao Mannat Singh Eric Mintun Trevor Darrell Piotr Dollár Ross B. Girshick 12 752 0 28 Jun 2021
R-Drop: Regularized Dropout for Neural Networks Xiaobo Liang Lijun Wu Juntao Li Yue Wang Qi Meng Tao Qin Wei Chen M. Zhang Tie-Yan Liu 31 424 0 28 Jun 2021
Memory Guided Road Detection Praveen Venkatesh Rwik Rana Varun Jain 18 0 0 27 Jun 2021
Advancing biological super-resolution microscopy through deep learning: a brief review Tianjie Yang Yaoru Luo Wei Ji Ge Yang SupR 14 17 0 24 Jun 2021
GAIA: A Transfer Learning System of Object Detection that Fits Your Needs Xingyuan Bu Junran Peng Junjie Yan T. Tan Zhaoxiang Zhang ObjD VLM 20 53 0 21 Jun 2021
Secure Distributed Training at Scale Eduard A. Gorbunov Alexander Borzunov Michael Diskin Max Ryabinin FedML 8 15 0 21 Jun 2021
ImageNet Pre-training also Transfers Non-Robustness Jiaming Zhang Jitao Sang Qiaomin Yi Yunfan Yang Huiwen Dong Jian Yu 45 1 0 21 Jun 2021
How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers Andreas Steiner Alexander Kolesnikov Xiaohua Zhai Ross Wightman Jakob Uszkoreit Lucas Beyer ViT 34 613 0 18 Jun 2021
Adversarial Training Helps Transfer Learning via Better Representations Zhun Deng Linjun Zhang Kailas Vodrahalli Kenji Kawaguchi James Y. Zou GAN 34 52 0 18 Jun 2021
Deep Learning Through the Lens of Example Difficulty R. Baldock Hartmut Maennel Behnam Neyshabur 17 155 0 17 Jun 2021
A Simple Fix to Mahalanobis Distance for Improving Near-OOD Detection Jie Jessie Ren Stanislav Fort J. Liu Abhijit Guha Roy Shreyas Padhy Balaji Lakshminarayanan UQCV 19 216 0 16 Jun 2021
Revisiting the Calibration of Modern Neural Networks Matthias Minderer Josip Djolonga Rob Romijnders F. Hubis Xiaohua Zhai N. Houlsby Dustin Tran Mario Lucic UQCV 17 356 0 15 Jun 2021
Delving Deep into the Generalization of Vision Transformers under Distribution Shifts Chongzhi Zhang Mingyuan Zhang Shanghang Zhang Daisheng Jin Qiang-feng Zhou Zhongang Cai Haiyu Zhao Xianglong Liu Ziwei Liu 13 102 0 14 Jun 2021
Partial success in closing the gap between human and machine vision Robert Geirhos Kantharaju Narayanappa Benjamin Mitzkus Tizian Thieringer Matthias Bethge Felix Wichmann Wieland Brendel VLM AAML 40 221 0 14 Jun 2021
Styleformer: Transformer based Generative Adversarial Networks with Style Vector Jeeseung Park Younggeun Kim ViT 21 48 0 13 Jun 2021
Neural Symbolic Regression that Scales Luca Biggio Tommaso Bendinelli Alexander Neitz Aurélien Lucchi Giambattista Parascandolo 34 167 0 11 Jun 2021
Learning to See by Looking at Noise Manel Baradad Jonas Wulff Tongzhou Wang Phillip Isola Antonio Torralba 13 89 0 10 Jun 2021
Scaling Vision with Sparse Mixture of Experts C. Riquelme J. Puigcerver Basil Mustafa Maxim Neumann Rodolphe Jenatton André Susano Pinto Daniel Keysers N. Houlsby MoE 12 574 0 10 Jun 2021
Tensor feature hallucination for few-shot learning Michalis Lazarou Tania Stathaki Yannis Avrithis 27 22 0 09 Jun 2021
Knowledge distillation: A good teacher is patient and consistent Lucas Beyer Xiaohua Zhai Amelie Royer L. Markeeva Rohan Anil Alexander Kolesnikov VLM 15 287 0 09 Jun 2021
It Takes Two to Tango: Mixup for Deep Metric Learning Shashanka Venkataramanan Bill Psomas Ewa Kijak Laurent Amsaleg Konstantinos Karantzalos Yannis Avrithis 12 25 0 09 Jun 2021
AdaMatch: A Unified Approach to Semi-Supervised Learning and Domain Adaptation David Berthelot Rebecca Roelofs Kihyuk Sohn Nicholas Carlini Alexey Kurakin 21 136 0 08 Jun 2021
Scaling Vision Transformers Xiaohua Zhai Alexander Kolesnikov N. Houlsby Lucas Beyer ViT 20 1,058 0 08 Jun 2021
Proxy-Normalizing Activations to Match Batch Normalization while Removing Batch Dependence A. Labatie Dominic Masters Zach Eaton-Rosen Carlo Luschi 17 21 0 07 Jun 2021
Reveal of Vision Transformers Robustness against Adversarial Attacks Ahmed Aldahdooh W. Hamidouche Olivier Déforges ViT 15 56 0 07 Jun 2021
Making EfficientNet More Efficient: Exploring Batch-Independent Normalization, Group Convolutions and Reduced Resolution Training Dominic Masters A. Labatie Zach Eaton-Rosen Carlo Luschi 14 11 0 07 Jun 2021
Securing Secure Aggregation: Mitigating Multi-Round Privacy Leakage in Federated Learning Jinhyun So Ramy E. Ali Başak Güler Jiantao Jiao Salman Avestimehr FedML 29 77 0 07 Jun 2021
A Near-Optimal Algorithm for Debiasing Trained Machine Learning Models Ibrahim M. Alabdulmohsin Mario Lucic 19 22 0 06 Jun 2021
Exploring the Limits of Out-of-Distribution Detection Stanislav Fort Jie Jessie Ren Balaji Lakshminarayanan 16 323 0 06 Jun 2021
Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning Jannik Kossen Neil Band Clare Lyle Aidan N. Gomez Tom Rainforth Y. Gal OOD 3DPC 22 137 0 04 Jun 2021
When Vision Transformers Outperform ResNets without Pre-training or Strong Data Augmentations Xiangning Chen Cho-Jui Hsieh Boqing Gong ViT 8 320 0 03 Jun 2021
You Only Look at One Sequence: Rethinking Transformer in Vision through Object Detection Yuxin Fang Bencheng Liao Xinggang Wang Jiemin Fang Jiyang Qi Rui Wu Jianwei Niu Wenyu Liu ViT 17 316 0 01 Jun 2021
Effect of Pre-Training Scale on Intra- and Inter-Domain Full and Few-Shot Transfer Learning for Natural and Medical X-Ray Chest Images Mehdi Cherti J. Jitsev LM&MA 22 23 0 31 May 2021
Correlated Input-Dependent Label Noise in Large-Scale Image Classification Mark Collier Basil Mustafa Efi Kokiopoulou Rodolphe Jenatton Jesse Berent NoLa 176 53 0 19 May 2021
Fast and Accurate Quantized Camera Scene Detection on Smartphones, Mobile AI 2021 Challenge: Report Andrey D. Ignatov Grigory Malivenko Radu Timofte Sheng Chen Xin Xia ... K. Lyda L. Khojoyan Abhishek Thanki Sayak Paul Shahid Siddiqui MQ 8 20 0 17 May 2021
Vision Transformers are Robust Learners Sayak Paul Pin-Yu Chen ViT 17 305 0 17 May 2021
Rethinking "Batch" in BatchNorm Yuxin Wu Justin Johnson BDL 27 66 0 17 May 2021
Are Convolutional Neural Networks or Transformers more like human vision? Shikhar Tuli Ishita Dasgupta Erin Grant Thomas L. Griffiths ViT FaML 11 181 0 15 May 2021
MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space Rui Huang Yixuan Li OODD 31 235 0 05 May 2021
MLP-Mixer: An all-MLP Architecture for Vision Ilya O. Tolstikhin N. Houlsby Alexander Kolesnikov Lucas Beyer Xiaohua Zhai ... Andreas Steiner Daniel Keysers Jakob Uszkoreit Mario Lucic Alexey Dosovitskiy 244 2,600 0 04 May 2021
Stealthy Backdoors as Compression Artifacts Yulong Tian Fnu Suya Fengyuan Xu David E. Evans 22 22 0 30 Apr 2021
MOOD: Multi-level Out-of-distribution Detection Ziqian Lin Sreya . Dutta Roy Yixuan Li OODD 18 114 0 30 Apr 2021
With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations Debidatta Dwibedi Y. Aytar Jonathan Tompson P. Sermanet Andrew Zisserman SSL 183 452 0 29 Apr 2021