Big Transfer (BiT): General Visual Representation Learning

24 December 2019

Papers citing "Big Transfer (BiT): General Visual Representation Learning"

50 / 724 papers shown

Title
3D Face Alignment Through Fusion of Head Pose Information and Features Jae-Kyeong So Youngjoon Han 3DH CVBM 18 0 0 25 Aug 2023
Classification of the lunar surface pattern by AI architectures: Does AI see a rabbit in the Moon? D. Shoji CVBM 10 0 0 22 Aug 2023
Unlocking Accuracy and Fairness in Differentially Private Image Classification Leonard Berrada Soham De J. Shen Jamie Hayes Robert Stanforth David Stutz Pushmeet Kohli Samuel L. Smith Borja Balle 19 13 0 21 Aug 2023
Dataset Quantization Daquan Zhou Kaixin Wang Jianyang Gu Xiang Peng Dongze Lian Yifan Zhang Yang You Jiashi Feng DD 29 37 0 21 Aug 2023
Robust Mixture-of-Expert Training for Convolutional Neural Networks Yihua Zhang Ruisi Cai Tianlong Chen Guanhua Zhang Huan Zhang Pin-Yu Chen Shiyu Chang Zhangyang Wang Sijia Liu MoE AAML OOD 30 16 0 19 Aug 2023
Disposable Transfer Learning for Selective Source Task Unlearning Seunghee Koh Hyounguk Shon Janghyeon Lee H. Hong Junmo Kim 17 2 0 19 Aug 2023
Pelta: Shielding Transformers to Mitigate Evasion Attacks in Federated Learning Simon Queyrut Yérom-David Bromberg V. Schiavoni FedML AAML 9 1 0 08 Aug 2023
PUG: Photorealistic and Semantically Controllable Synthetic Data for Representation Learning Florian Bordes Shashank Shekhar Mark Ibrahim Diane Bouchacourt Pascal Vincent Ari S. Morcos 23 26 0 08 Aug 2023
Distributionally Robust Classification on a Data Budget Ben Feuer Ameya Joshi Minh Pham C. Hegde OOD 27 2 0 07 Aug 2023
An Adaptive Model Ensemble Adversarial Attack for Boosting Adversarial Transferability B. Chen Jia-Li Yin Shukai Chen Bo-Hao Chen Ximeng Liu AAML 14 39 0 05 Aug 2023
Improving Generalization of Adversarial Training via Robust Critical Fine-Tuning Kaijie Zhu Jindong Wang Xixu Hu Xingxu Xie G. Yang AAML 22 23 0 01 Aug 2023
Stylized Projected GAN: A Novel Architecture for Fast and Realistic Image Generation Md Nurul Muttakin Malik Shahid Sultan R. Hoehndorf H. Ombao GAN 28 0 0 30 Jul 2023
Validating polyp and instrument segmentation methods in colonoscopy through Medico 2020 and MedAI 2021 Challenges Debesh Jha Vanshali Sharma Debapriya Banik Debayan Bhattacharya K. Roy ... Sharib Ali Michael A. Riegler P. Halvorsen Thomas de Lange Ulas Bagci 30 1 0 30 Jul 2023
An Empirical Study of Large-Scale Data-Driven Full Waveform Inversion Peng Jin Yinan Feng Shihang Feng Hanchen Wang Yinpeng Chen B. Consolvo Zicheng Liu Youzuo Lin AI4CE 12 8 0 28 Jul 2023
On the unreasonable vulnerability of transformers for image restoration -- and an easy fix Shashank Agnihotri Kanchana Vaishnavi Gandikota Julia Grabinski Paramanand Chandramouli M. Keuper 30 9 0 25 Jul 2023
Do humans and Convolutional Neural Networks attend to similar areas during scene classification: Effects of task and image type Romy Müller Marcel Duerschmidt Julian Ullrich Carsten Knoll Sascha Weber Steffen Seitz HAI 13 6 0 25 Jul 2023
On the Connection between Pre-training Data Diversity and Fine-tuning Robustness Vivek Ramanujan Thao Nguyen Sewoong Oh Ludwig Schmidt Ali Farhadi OOD 14 21 0 24 Jul 2023
Towards A Unified Agent with Foundation Models Norman Di Palo Arunkumar Byravan Leonard Hasenclever Markus Wulfmeier N. Heess Martin Riedmiller LM&Ro LLMAG OffRL 30 58 0 18 Jul 2023
Is Imitation All You Need? Generalized Decision-Making with Dual-Phase Training Yao Wei Yanchao Sun Ruijie Zheng Sai H. Vemprala Rogerio Bonatti Shuhang Chen Ratnesh Madaan Zhongjie Ba Ashish Kapoor Shuang Ma OffRL 17 15 0 16 Jul 2023
No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models Jean Kaddour Oscar Key Piotr Nawrot Pasquale Minervini Matt J. Kusner 15 41 0 12 Jul 2023
Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution Mostafa Dehghani Basil Mustafa Josip Djolonga Jonathan Heek Matthias Minderer ... Avital Oliver Piotr Padlewski A. Gritsenko Mario Luvcić N. Houlsby ViT 18 102 0 12 Jul 2023
Evaluating AI systems under uncertain ground truth: a case study in dermatology David Stutz A. Cemgil Abhijit Guha Roy Tatiana Matejovicova Melih Barsbey ... Yossi Matias Pushmeet Kohli Yun-hui Liu Arnaud Doucet Alan Karthikesalingam 25 4 0 05 Jul 2023
CoPL: Contextual Prompt Learning for Vision-Language Understanding Koustava Goswami Srikrishna Karanam Prateksha Udhayanan J. JosephK. Balaji Vasan Srinivasan VLM 19 8 0 03 Jul 2023
Audio Embeddings as Teachers for Music Classification Yiwei Ding Alexander Lerch 25 5 0 30 Jun 2023
ParameterNet: Parameters Are All You Need Kai Han Yunhe Wang Jianyuan Guo Enhua Wu VLM AI4CE 22 25 0 26 Jun 2023
Large Sequence Models for Sequential Decision-Making: A Survey Muning Wen Runji Lin Hanjing Wang Yaodong Yang Ying Wen Luo Mai J. Wang Haifeng Zhang Weinan Zhang LM&Ro LRM 29 35 0 24 Jun 2023
Is Pre-training Truly Better Than Meta-Learning? Brando Miranda P. Yu Saumya Goyal Yu-xiong Wang Oluwasanmi Koyejo 39 5 0 24 Jun 2023
Comparing the Efficacy of Fine-Tuning and Meta-Learning for Few-Shot Policy Imitation Massimiliano Patacchiola Mingfei Sun Katja Hofmann Richard E. Turner OffRL 19 1 0 23 Jun 2023
Wildfire Detection Via Transfer Learning: A Survey Ziliang Hong Emadeldeen Hamdan Yifei Zhao Tianxiao Ye Hongyi Pan A. Enis Cetin 19 12 0 21 Jun 2023
LabelBench: A Comprehensive Framework for Benchmarking Adaptive Label-Efficient Learning Jifan Zhang Yifang Chen Gregory H. Canal Stephen Mussmann Arnav M. Das ... Yinglun Zhu Jeffrey Bilmes S. Du Kevin G. Jamieson Robert D. Nowak VLM 33 10 0 16 Jun 2023
One-for-All: Generalized LoRA for Parameter-Efficient Fine-tuning Arnav Chavan Zhuang Liu D. K. Gupta Eric P. Xing Zhiqiang Shen 25 87 0 13 Jun 2023
Image Captioners Are Scalable Vision Learners Too Michael Tschannen Manoj Kumar Andreas Steiner Xiaohua Zhai N. Houlsby Lucas Beyer VLM CLIP 21 53 0 13 Jun 2023
I See Dead People: Gray-Box Adversarial Attack on Image-To-Text Models Raz Lapid Moshe Sipper AAML 11 17 0 13 Jun 2023
Unlocking Feature Visualization for Deeper Networks with MAgnitude Constrained Optimization Thomas Fel Thibaut Boissin Victor Boutin Agustin Picard Paul Novello ... Drew Linsley Tom Rousseau Rémi Cadène Laurent Gardes Thomas Serre FAtt 10 18 0 11 Jun 2023
WSPAlign: Word Alignment Pre-training via Large-Scale Weakly Supervised Span Prediction Qiyu Wu Masaaki Nagata Yoshimasa Tsuruoka 19 5 0 09 Jun 2023
SNAP: Self-Supervised Neural Maps for Visual Positioning and Semantic Understanding Paul-Edouard Sarlin Eduard Trulls Marc Pollefeys J. Hosang Simon Lynen 3DPC SSL 22 25 0 08 Jun 2023
Quick-Tune: Quickly Learning Which Pretrained Model to Finetune and How Sebastian Pineda Arango Fabio Ferreira Arlind Kadra Frank Hutter Frank Hutter Josif Grabocka 29 15 0 06 Jun 2023
Performance-optimized deep neural networks are evolving into worse models of inferotemporal visual cortex Drew Linsley I. F. Rodriguez Thomas Fel Michael Arcaro Saloni Sharma Margaret Livingstone Thomas Serre 22 18 0 06 Jun 2023
A Functional Data Perspective and Baseline On Multi-Layer Out-of-Distribution Detection Eduardo Dadalto Camara Gomes Pierre Colombo Guillaume Staerman Nathan Noiry Pablo Piantanida OODD 33 2 0 06 Jun 2023
Adversarial alignment: Breaking the trade-off between the strength of an attack and its relevance to human perception Drew Linsley Pinyuan Feng Thibaut Boissin A. Ashok Thomas Fel Stephanie Olaiya Thomas Serre AAML 20 6 0 05 Jun 2023
Neuron Activation Coverage: Rethinking Out-of-distribution Detection and Generalization Y. Liu Chris Xing Tian Haoliang Li Lei Ma Shiqi Wang UQCV 24 19 0 05 Jun 2023
Joint Pre-training and Local Re-training: Transferable Representation Learning on Multi-source Knowledge Graphs Zequn Sun Jiacheng Huang Jing-Rong Lin Xiaozhou Xu Qijin Chen Wei Hu 34 2 0 05 Jun 2023
Aiming towards the minimizers: fast convergence of SGD for overparametrized problems Chaoyue Liu D. Drusvyatskiy M. Belkin Damek Davis Yi-An Ma ODL 15 16 0 05 Jun 2023
Towards In-context Scene Understanding Ivana Balazevic David Steiner Nikhil Parthasarathy Relja Arandjelović Olivier J. Hénaff 28 28 0 02 Jun 2023
In or Out? Fixing ImageNet Out-of-Distribution Detection Evaluation Julian Bitterwolf Maximilian Müller Matthias Hein OODD 19 83 0 01 Jun 2023
Diffused Redundancy in Pre-trained Representations Vedant Nanda Till Speicher John P. Dickerson S. Feizi Krishna P. Gummadi Adrian Weller SSL 21 2 0 31 May 2023
Efficient Storage of Fine-Tuned Models via Low-Rank Approximation of Weight Residuals Simo Ryu S. Seo Jaejun Yoo 16 4 0 28 May 2023
Three Towers: Flexible Contrastive Learning with Pretrained Image Models Jannik Kossen Mark Collier Basil Mustafa Xiao Wang Xiaohua Zhai Lucas Beyer Andreas Steiner Jesse Berent Rodolphe Jenatton Efi Kokiopoulou VLM 37 11 0 26 May 2023
HAAV: Hierarchical Aggregation of Augmented Views for Image Captioning Chia-Wen Kuo Z. Kira 25 21 0 25 May 2023
Getting ViT in Shape: Scaling Laws for Compute-Optimal Model Design Ibrahim M. Alabdulmohsin Xiaohua Zhai Alexander Kolesnikov Lucas Beyer VLM 27 57 0 22 May 2023