Big Transfer (BiT): General Visual Representation Learning

24 December 2019

Papers citing "Big Transfer (BiT): General Visual Representation Learning"

50 / 724 papers shown

Title
New Insights for the Stability-Plasticity Dilemma in Online Continual Learning Dahuin Jung Dongjin Lee Sunwon Hong Hyemi Jang Ho Bae Sungroh Yoon CLL 26 14 0 17 Feb 2023
Efficiency 360: Efficient Vision Transformers Badri N. Patro Vijay Srinivas Agneeswaran 21 6 0 16 Feb 2023
A Comprehensive Study of Modern Architectures and Regularization Approaches on CheXpert5000 Sontje Ihler Felix Kuhnke Svenja Spindeldreier 17 1 0 13 Feb 2023
Autoselection of the Ensemble of Convolutional Neural Networks with Second-Order Cone Programming Buse Çisil Güldoğuş Abdullah Nazhat Abdullah Muhammad Ammar Ali Süreyya Özögür-Akyüz 19 0 0 12 Feb 2023
Scaling Vision Transformers to 22 Billion Parameters Mostafa Dehghani Josip Djolonga Basil Mustafa Piotr Padlewski Jonathan Heek ... Mario Luvcić Xiaohua Zhai Daniel Keysers Jeremiah Harmsen N. Houlsby MLLM 61 569 0 10 Feb 2023
Beyond In-Domain Scenarios: Robust Density-Aware Calibration Christian Tomani Futa Waseda Yuesong Shen Daniel Cremers UQCV 16 4 0 10 Feb 2023
The Devil is in the Wrongly-classified Samples: Towards Unified Open-set Recognition Jun Cen Di Luan Shiwei Zhang Yixuan Pei Yingya Zhang Deli Zhao Shaojie Shen Qifeng Chen 11 19 0 08 Feb 2023
Rethinking Out-of-distribution (OOD) Detection: Masked Image Modeling is All You Need Jingyao Li Pengguang Chen Shaozuo Yu Zexin He Shu Liu Jiaya Jia OODD 22 42 0 06 Feb 2023
Knowledge Distillation in Vision Transformers: A Critical Review Gousia Habib Tausifa Jan Saleem Brejesh Lall 21 15 0 04 Feb 2023
On the Efficacy of Differentially Private Few-shot Image Classification Marlon Tobaben Aliaksandra Shysheya J. Bronskill Andrew J. Paverd Shruti Tople Santiago Zanella Béguelin Richard E. Turner Antti Honkela 30 11 0 02 Feb 2023
Confidence and Dispersity Speak: Characterising Prediction Matrix for Unsupervised Accuracy Estimation Weijian Deng Yumin Suh Stephen Gould Liang Zheng UQCV 21 12 0 02 Feb 2023
Fourier Sensitivity and Regularization of Computer Vision Models K. Krishnamachari See-Kiong Ng Chuan-Sheng Foo OOD 20 2 0 31 Jan 2023
Adaptive Computation with Elastic Input Sequence Fuzhao Xue Valerii Likhosherstov Anurag Arnab N. Houlsby Mostafa Dehghani Yang You 29 18 0 30 Jan 2023
Benchmarking Robustness to Adversarial Image Obfuscations Florian Stimberg Ayan Chakrabarti Chun-Ta Lu Hussein Hazimeh Otilia Stretcu ... Merve Kaya Cyrus Rashtchian Ariel Fuxman Mehmet Tek Sven Gowal AAML 24 10 0 30 Jan 2023
Massively Scaling Heteroscedastic Classifiers Mark Collier Rodolphe Jenatton Basil Mustafa N. Houlsby Jesse Berent E. Kokiopoulou 26 8 0 30 Jan 2023
Improving the Accuracy-Robustness Trade-Off of Classifiers via Adaptive Smoothing Yatong Bai Brendon G. Anderson Aerin Kim Somayeh Sojoudi AAML 28 18 0 29 Jan 2023
A Closer Look at Few-shot Classification Again Xu Luo Hao Wu Ji Zhang Lianli Gao Jing Xu Jingkuan Song 24 48 0 28 Jan 2023
Learning Customized Visual Models with Retrieval-Augmented Knowledge Haotian Liu Kilho Son Jianwei Yang Ce Liu Jianfeng Gao Yong Jae Lee Chunyuan Li VLM 38 53 0 17 Jan 2023
Does progress on ImageNet transfer to real-world datasets? Alex Fang Simon Kornblith Ludwig Schmidt VLM 21 34 0 11 Jan 2023
Advances in Medical Image Analysis with Vision Transformers: A Comprehensive Review Reza Azad A. Kazerouni Moein Heidari Ehsan Khodapanah Aghdam Amir Molaei Yiwei Jia Abin Jose Rijo Roy Dorit Merhof MedIm ViT 30 161 0 09 Jan 2023
Robust Meta-Representation Learning via Global Label Inference and Classification Ruohan Wang Isak Falk Massimiliano Pontil C. Ciliberto 33 3 0 22 Dec 2022
Reversible Column Networks Yuxuan Cai Yi Zhou Qi Han Jianjian Sun Xiangwen Kong Jun Yu Li Xiangyu Zhang VLM 31 53 0 22 Dec 2022
3D Point Cloud Pre-training with Knowledge Distillation from 2D Images Yuan Yao Yuanhan Zhang Zhen-fei Yin Jiebo Luo Wanli Ouyang Xiaoshui Huang 3DPC 27 10 0 17 Dec 2022
Better May Not Be Fairer: A Study on Subgroup Discrepancy in Image Classification Ming-Chang Chiu Pin-Yu Chen Xuezhe Ma 21 6 0 16 Dec 2022
Reproducible scaling laws for contrastive language-image learning Mehdi Cherti Romain Beaumont Ross Wightman Mitchell Wortsman Gabriel Ilharco Cade Gordon Christoph Schuhmann Ludwig Schmidt J. Jitsev VLM CLIP 49 737 0 14 Dec 2022
SEPT: Towards Scalable and Efficient Visual Pre-Training Yiqi Lin Huabin Zheng Huaping Zhong Jinjing Zhu Weijia Li Conghui He Lin Wang 24 2 0 11 Dec 2022
A Whac-A-Mole Dilemma: Shortcuts Come in Multiples Where Mitigating One Amplifies Others Zhiheng Li Ivan Evtimov Albert Gordo C. Hazirbas Tal Hassner Cristian Canton Ferrer Chenliang Xu Mark Ibrahim 26 70 0 09 Dec 2022
Spurious Features Everywhere -- Large-Scale Detection of Harmful Spurious Features in ImageNet Yannic Neuhaus Maximilian Augustin Valentyn Boreiko Matthias Hein AAML 29 30 0 09 Dec 2022
MixBoost: Improving the Robustness of Deep Neural Networks by Boosting Data Augmentation Zhendong Liu Wenyu Jiang Min Guo Chongjun Wang AAML 21 1 0 08 Dec 2022
Capturing the Flow of Art History Chenxi Ji AI4CE 14 0 0 07 Dec 2022
Robust Speech Recognition via Large-Scale Weak Supervision Alec Radford Jong Wook Kim Tao Xu Greg Brockman C. McLeavey Ilya Sutskever OffRL 11 3,273 0 06 Dec 2022
A Trustworthy Framework for Medical Image Analysis with Deep Learning Kai Ma Siyuan He Pengcheng Xi Ashkan Ebadi Stéphane Tremblay Alexander Wong MedIm 14 1 0 06 Dec 2022
ResFormer: Scaling ViTs with Multi-Resolution Training Rui Tian Zuxuan Wu Qiuju Dai Hang-Rui Hu Yu Qiao Yu-Gang Jiang ViT 19 31 0 01 Dec 2022
Finetune like you pretrain: Improved finetuning of zero-shot vision models Sachin Goyal Ananya Kumar Sankalp Garg Zico Kolter Aditi Raghunathan CLIP VLM 27 136 0 01 Dec 2022
Procedural Image Programs for Representation Learning Manel Baradad Chun-Fu Jonas Wulff Tongzhou Wang Rogerio Feris Antonio Torralba Phillip Isola 13 18 0 29 Nov 2022
Better Generalized Few-Shot Learning Even Without Base Data Seongwoong Kim Dong-Wan Choi 19 7 0 29 Nov 2022
Game Theoretic Mixed Experts for Combinational Adversarial Machine Learning Ethan Rathbun Kaleel Mahmood Sohaib Ahmad Caiwen Ding Marten van Dijk AAML 19 4 0 26 Nov 2022
Delving into Out-of-Distribution Detection with Vision-Language Representations Yifei Ming Ziyan Cai Jiuxiang Gu Yiyou Sun W. Li Yixuan Li VLM OODD 37 157 0 24 Nov 2022
Differentially Private Image Classification from Features Harsh Mehta Walid Krichene Abhradeep Thakurta Alexey Kurakin Ashok Cutkosky 46 7 0 24 Nov 2022
Classification of Melanocytic Nevus Images using BigTransfer (BiT) Sanya Sinha Nilay Gupta 15 1 0 21 Nov 2022
Neural networks trained with SGD learn distributions of increasing complexity Maria Refinetti Alessandro Ingrosso Sebastian Goldt UQCV 30 41 0 21 Nov 2022
Efficient Generalization Improvement Guided by Random Weight Perturbation Tao Li Wei Yan Zehao Lei Yingwen Wu Kun Fang Ming Yang X. Huang AAML 35 6 0 21 Nov 2022
A Transformer Framework for Data Fusion and Multi-Task Learning in Smart Cities Alexander C. DeRieux Walid Saad W. Zuo R. Budiarto M. D. Koerniawan D. Novitasari 15 1 0 18 Nov 2022
How to Fine-Tune Vision Models with SGD Ananya Kumar Ruoqi Shen Sébastien Bubeck Suriya Gunasekar VLM 6 29 0 17 Nov 2022
InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutions Wenhai Wang Jifeng Dai Zhe Chen Zhenhang Huang Zhiqi Li ... Tong Lu Lewei Lu Hongsheng Li Xiaogang Wang Yu Qiao VLM 36 656 0 10 Nov 2022
Deep Learning based Computer Vision Methods for Complex Traffic Environments Perception: A Review Talha Azfar Jinlong Li Hongkai Yu R. Cheu Yisheng Lv Ruimin Ke 20 21 0 09 Nov 2022
Harmonizing the object recognition strategies of deep neural networks with humans Thomas Fel Ivan Felipe Drew Linsley Thomas Serre 30 71 0 08 Nov 2022
Could Giant Pretrained Image Models Extract Universal Representations? Yutong Lin Ze Liu Zheng-Wei Zhang Han Hu Nanning Zheng Stephen Lin Yue Cao VLM 46 9 0 03 Nov 2022
A picture of the space of typical learnable tasks Rahul Ramesh J. Mao Itay Griniasty Rubing Yang H. Teoh M. Transtrum J. Sethna Pratik Chaudhari SSL DRL 36 4 0 31 Oct 2022
A simple, efficient and scalable contrastive masked autoencoder for learning visual representations Shlok Kumar Mishra Joshua Robinson Huiwen Chang David Jacobs Aaron Sarna Aaron Maschinot Dilip Krishnan DiffM 43 30 0 30 Oct 2022