Big Transfer (BiT): General Visual Representation Learning

24 December 2019

Papers citing "Big Transfer (BiT): General Visual Representation Learning"

50 / 724 papers shown

Title
Explaining Neural Scaling Laws Yasaman Bahri Ethan Dyer Jared Kaplan Jaehoon Lee Utkarsh Sharma 19 249 0 12 Feb 2021
ReRankMatch: Semi-Supervised Learning with Semantics-Oriented Similarity Representation T. Tran Mingu Kang Daeyoung Kim 4 1 0 12 Feb 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 293 3,693 0 11 Feb 2021
A linearized framework and a new benchmark for model selection for fine-tuning Aditya Deshpande Alessandro Achille Avinash Ravichandran Hao Li L. Zancato Charless C. Fowlkes Rahul Bhotika Stefano Soatto Pietro Perona ALM 107 46 0 29 Jan 2021
A Machine Learning Challenge for Prognostic Modelling in Head and Neck Cancer Using Multi-modal Data M. Kazmierski M. Welch Sejin Kim Chris McIntosh Princess Margaret Head ... M. Milosevic Fei-Fei Liu A. Hope S. Bratman B. Haibe-Kains 28 5 0 28 Jan 2021
An Empirical Study and Analysis on Open-Set Semi-Supervised Learning Huixiang Luo Hao Cheng Fanxu Meng Yuting Gao Ke Li Mengdan Zhang Xing Sun 17 8 0 19 Jan 2021
Supervised Transfer Learning at Scale for Medical Imaging Basil Mustafa Aaron Loh Jan Freyberg Patricia MacWilliams Megan Wilson ... Shruthi Prabhakara Umesh Telang Alan Karthikesalingam N. Houlsby Vivek Natarajan LM&MA 11 67 0 14 Jan 2021
Big Self-Supervised Models Advance Medical Image Classification Shekoofeh Azizi Basil Mustafa Fiona Ryan Zach Beaver Jan Freyberg ... Alan Karthikesalingam Simon Kornblith Ting-Li Chen Vivek Natarajan Mohammad Norouzi SSL 14 504 0 13 Jan 2021
Re-labeling ImageNet: from Single to Multi-Labels, from Global to Localized Labels Sangdoo Yun Seong Joon Oh Byeongho Heo Dongyoon Han Junsuk Choe Sanghyuk Chun 392 142 0 13 Jan 2021
A Convergence Theory Towards Practical Over-parameterized Deep Neural Networks Asaf Noy Yi Tian Xu Y. Aflalo Lihi Zelnik-Manor R. L. Jin 25 3 0 12 Jan 2021
Deeplite Neutrino: An End-to-End Framework for Constrained Deep Learning Model Optimization A. Sankaran Olivier Mastropietro Ehsan Saboori Yasser Idris Davis Sawyer Mohammadhossein Askarihemmat G. B. Hacene 16 4 0 11 Jan 2021
Self-Supervised Pretraining of 3D Features on any Point-Cloud Zaiwei Zhang Rohit Girdhar Armand Joulin Ishan Misra 3DPC 124 268 0 07 Jan 2021
Few-shot Image Classification: Just Use a Library of Pre-trained Feature Extractors and a Simple Classifier Arkabandhu Chowdhury Mingchao Jiang Swarat Chaudhuri C. Jermaine VLM 18 41 0 03 Jan 2021
Few-Shot Named Entity Recognition: A Comprehensive Study Jiaxin Huang Chunyuan Li K. Subudhi Damien Jose S. Balakrishnan Weizhu Chen Baolin Peng Jianfeng Gao Jiawei Han 16 79 0 29 Dec 2020
An Image Encryption Scheme Based on Chaotic Logarithmic Map and Key Generation using Deep CNN U. Erkan A. Toktas Serdar Enginoğlu Enver Karabacak D. N. Thanh 17 40 0 28 Dec 2020
Self-supervised Pre-training with Hard Examples Improves Visual Representations Chunyuan Li Xiujun Li Lei Zhang Baolin Peng Mingyuan Zhou Jianfeng Gao SSL 14 24 0 25 Dec 2020
A Survey on Visual Transformer Kai Han Yunhe Wang Hanting Chen Xinghao Chen Jianyuan Guo ... Chunjing Xu Yixing Xu Zhaohui Yang Yiman Zhang Dacheng Tao ViT 18 2,128 0 23 Dec 2020
Minimax Active Learning Sayna Ebrahimi William Gan Dian Chen Giscard Biamby Kamyar Salahi Michael Laielli Shizhan Zhu Trevor Darrell 19 26 0 18 Dec 2020
Toward Transformer-Based Object Detection Josh Beal Eric Kim Eric Tzeng Dong Huk Park Andrew Zhai Dmitry Kislyuk ViT 14 209 0 17 Dec 2020
A new semi-supervised self-training method for lung cancer prediction Kelvin Shak M. Al-Shabi Andre Liew B. Lan W. Chan K. Ng Maxine Tan 11 3 0 17 Dec 2020
Are Fewer Labels Possible for Few-shot Learning? Suichan Li Dongdong Chen Yinpeng Chen Lu Yuan L. Zhang Qi Chu Nenghai Yu SSL 19 3 0 10 Dec 2020
Pre-Trained Image Processing Transformer Hanting Chen Yunhe Wang Tianyu Guo Chang Xu Yiping Deng Zhenhua Liu Siwei Ma Chunjing Xu Chao Xu Wen Gao VLM ViT 37 1,632 0 01 Dec 2020
Explaining Deep Learning Models for Structured Data using Layer-Wise Relevance Propagation hsan Ullah André Ríos Vaibhav Gala Susan Mckeever FAtt 4 10 0 26 Nov 2020
Data-Efficient Classification of Radio Galaxies Ashwin Samudre L. George Mahak Bansal Y. Wadadekar GNN 18 11 0 26 Nov 2020
No Subclass Left Behind: Fine-Grained Robustness in Coarse-Grained Classification Problems N. Sohoni Jared A. Dunnmon Geoffrey Angus Albert Gu Christopher Ré 16 240 0 25 Nov 2020
Scaling Wide Residual Networks for Panoptic Segmentation Liang-Chieh Chen Huiyu Wang Siyuan Qiao SSeg 25 47 0 23 Nov 2020
Universal Activation Function For Machine Learning Brosnan Yuen Minh Tu Hoang Xiaodai Dong Tao Lu 13 40 0 07 Nov 2020
Underspecification Presents Challenges for Credibility in Modern Machine Learning Alexander DÁmour Katherine A. Heller D. Moldovan Ben Adlam B. Alipanahi ... Kellie Webster Steve Yadlowsky T. Yun Xiaohua Zhai D. Sculley OffRL 48 669 0 06 Nov 2020
Meta-learning Transferable Representations with a Single Target Domain Hong Liu Jeff Z. HaoChen Colin Wei Tengyu Ma AAML 32 5 0 03 Nov 2020
An Information-Geometric Distance on the Space of Tasks Yansong Gao Pratik Chaudhari 9 21 0 01 Nov 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 41 39,217 0 22 Oct 2020
A ReLU Dense Layer to Improve the Performance of Neural Networks Alireza M. Javid Sandipan Das Mikael Skoglund S. Chatterjee 18 31 0 22 Oct 2020
Edge Bias in Federated Learning and its Solution by Buffered Knowledge Distillation Sang-ho Lee Kiyoon Yoo Nojun Kwak FedML 24 2 0 20 Oct 2020
Self-training for Few-shot Transfer Across Extreme Task Differences Cheng Perng Phoo B. Hariharan SSL 11 106 0 15 Oct 2020
Deep Ensembles for Low-Data Transfer Learning Basil Mustafa C. Riquelme J. Puigcerver andAndré Susano Pinto Daniel Keysers N. Houlsby FedML OOD 17 22 0 14 Oct 2020
Sharpness-Aware Minimization for Efficiently Improving Generalization Pierre Foret Ariel Kleiner H. Mobahi Behnam Neyshabur AAML 16 1,276 0 03 Oct 2020
Group Whitening: Balancing Learning Efficiency and Representational Capacity Lei Huang Yi Zhou Li Liu Fan Zhu Ling Shao 12 20 0 28 Sep 2020
Scalable Transfer Learning with Expert Models J. Puigcerver C. Riquelme Basil Mustafa Cédric Renggli André Susano Pinto Sylvain Gelly Daniel Keysers N. Houlsby 21 62 0 28 Sep 2020
Deep Neural Networks with Short Circuits for Improved Gradient Learning Ming Yan Xueli Xiao Joey Tianyi Zhou Yi Pan 21 0 0 23 Sep 2020
A Principled Approach to Data Valuation for Federated Learning Tianhao Wang Johannes Rausch Ce Zhang R. Jia D. Song FedML TDI 9 189 0 14 Sep 2020
Estimating the Brittleness of AI: Safety Integrity Levels and the Need for Testing Out-Of-Distribution Performance A. Lohn 13 12 0 02 Sep 2020
What is being transferred in transfer learning? Behnam Neyshabur Hanie Sedghi Chiyuan Zhang 23 505 0 26 Aug 2020
Rethinking Recurrent Neural Networks and Other Improvements for Image Classification N. H. Phong B. Ribeiro VLM 16 8 0 30 Jul 2020
TinyTL: Reduce Activations, Not Trainable Parameters for Efficient On-Device Learning Han Cai Chuang Gan Ligeng Zhu Song Han 19 51 0 22 Jul 2020
Standing on the Shoulders of Giants: Hardware and Neural Architecture Co-Search with Hot Start Weiwen Jiang Lei Yang Sakyasingha Dasgupta J. Hu Yiyu Shi 14 59 0 17 Jul 2020
On Robustness and Transferability of Convolutional Neural Networks Josip Djolonga Jessica Yung Michael Tschannen Rob Romijnders Lucas Beyer ... D. Moldovan Sylvain Gelly N. Houlsby Xiaohua Zhai Mario Lucic OOD 8 153 0 16 Jul 2020
Do Adversarially Robust ImageNet Models Transfer Better? Hadi Salman Andrew Ilyas Logan Engstrom Ashish Kapoor A. Madry 32 416 0 16 Jul 2020
Monitoring and explainability of models in production Janis Klaise A. V. Looveren Clive Cox G. Vacanti Alexandru Coca 35 48 0 13 Jul 2020
SpinalNet: Deep Neural Network with Gradual Input H. M. D. Kabir Moloud Abdar S. M. Jalali Abbas Khosravi A. Atiya S. Nahavandi D. Srinivasan AI4CE 22 131 0 07 Jul 2020
A Survey on Self-supervised Pre-training for Sequential Transfer Learning in Neural Networks H. H. Mao BDL SSL 6 50 0 01 Jul 2020