Do Better ImageNet Models Transfer Better?

23 May 2018

Papers citing "Do Better ImageNet Models Transfer Better?"

50 / 639 papers shown

Title
Project and Probe: Sample-Efficient Domain Adaptation by Interpolating Orthogonal Features Annie S. Chen Yoonho Lee Amrith Rajagopal Setlur Sergey Levine Chelsea Finn VLM 19 9 0 10 Feb 2023
Key Design Choices for Double-Transfer in Source-Free Unsupervised Domain Adaptation Andrea Maracani Raffaello Camoriano Elisa Maiettini Davide Talon Lorenzo Rosasco Lorenzo Natale 21 2 0 10 Feb 2023
SparseProp: Efficient Sparse Backpropagation for Faster Training of Neural Networks Mahdi Nikdan Tommaso Pegolotti Eugenia Iofinova Eldar Kurtic Dan Alistarh 10 11 0 09 Feb 2023
A Systematic Performance Analysis of Deep Perceptual Loss Networks: Breaking Transfer Learning Conventions G. Pihlgren Konstantina Nikolaidou Prakash Chandra Chhipa Nosheen Abid Rajkumar Saini Fredrik Sandin Marcus Liwicki 11 10 0 08 Feb 2023
Two Losses Are Better Than One: Faster Optimization Using a Cheaper Proxy Blake E. Woodworth Konstantin Mishchenko Francis R. Bach 26 6 0 07 Feb 2023
Interpretations of Domain Adaptations via Layer Variational Analysis H. Tseng Hsin-Yi Lin Kuo-Hsuan Hung Yu Tsao FAtt 13 3 0 03 Feb 2023
Contrastive Learning with Consistent Representations Zihu Wang Yu Wang Hanbin Hu Peng Li CLL 24 5 0 03 Feb 2023
Policy Expansion for Bridging Offline-to-Online Reinforcement Learning Haichao Zhang Weiwen Xu Haonan Yu CLL OffRL OnRL 30 62 0 02 Feb 2023
CLIPood: Generalizing CLIP to Out-of-Distributions Yang Shu Xingzhuo Guo Jialong Wu Ximei Wang Jianmin Wang Mingsheng Long OODD VLM 41 74 0 02 Feb 2023
A Closer Look at Few-shot Classification Again Xu Luo Hao Wu Ji Zhang Lianli Gao Jing Xu Jingkuan Song 24 48 0 28 Jan 2023
Learning Customized Visual Models with Retrieval-Augmented Knowledge Haotian Liu Kilho Son Jianwei Yang Ce Liu Jianfeng Gao Yong Jae Lee Chunyuan Li VLM 38 53 0 17 Jan 2023
Improving Reliability of Fine-tuning with Block-wise Optimisation Basel Barakat Qiang Huang 19 1 0 15 Jan 2023
Does progress on ImageNet transfer to real-world datasets? Alex Fang Simon Kornblith Ludwig Schmidt VLM 21 34 0 11 Jan 2023
COLT: Cyclic Overlapping Lottery Tickets for Faster Pruning of Convolutional Neural Networks Md. Ismail Hossain Mohammed Rakib M. M. L. Elahi Nabeel Mohammed Shafin Rahman 21 1 0 24 Dec 2022
Image Classification with Small Datasets: Overview and Benchmark Lorenzo Brigato Björn Barz Luca Iocchi Joachim Denzler VLM 12 17 0 23 Dec 2022
Principled and Efficient Transfer Learning of Deep Models via Neural Collapse Xiao Li Sheng Liu Jin-li Zhou Xin Lu C. Fernandez‐Granda Zhihui Zhu Q. Qu AAML 19 18 0 23 Dec 2022
Universal Object Detection with Large Vision Model Feng-Huei Lin Wenze Hu Yaowei Wang Yonghong Tian Guangming Lu Fanglin Chen Yong-mei Xu Xiaoyu Wang VLM ObjD 32 8 0 19 Dec 2022
Fine-Tuning Is All You Need to Mitigate Backdoor Attacks Zeyang Sha Xinlei He Pascal Berrang Mathias Humbert Yang Zhang AAML 13 33 0 18 Dec 2022
Fake it till you make it: Learning transferable representations from synthetic ImageNet clones Mert Bulent Sariyildiz Alahari Karteek Diane Larlus Yannis Kalantidis DiffM VLM 28 153 0 16 Dec 2022
Reproducible scaling laws for contrastive language-image learning Mehdi Cherti Romain Beaumont Ross Wightman Mitchell Wortsman Gabriel Ilharco Cade Gordon Christoph Schuhmann Ludwig Schmidt J. Jitsev VLM CLIP 49 737 0 14 Dec 2022
Benchmarking Self-Supervised Learning on Diverse Pathology Datasets Mingu Kang Heon Song Seonwook Park Donggeun Yoo Sérgio Pereira 11 128 0 09 Dec 2022
EPCL: Frozen CLIP Transformer is An Efficient Point Cloud Encoder Xiaoshui Huang Zhou Huang Shengjia Li Wentao Qu Tong He Yuenan Hou Yifan Zuo Wanli Ouyang 13 11 0 08 Dec 2022
Pre-trained Encoders in Self-Supervised Learning Improve Secure and Privacy-preserving Supervised Learning Hongbin Liu Wenjie Qu Jinyuan Jia Neil Zhenqiang Gong SSL 20 6 0 06 Dec 2022
Visual Query Tuning: Towards Effective Usage of Intermediate Representations for Parameter and Memory Efficient Transfer Learning Cheng-Hao Tu Zheda Mai Wei-Lun Chao 24 42 0 06 Dec 2022
MobileTL: On-device Transfer Learning with Inverted Residual Blocks HungYueh Chiang N. Frumkin Feng Liang Diana Marculescu MQ 19 12 0 05 Dec 2022
Finetune like you pretrain: Improved finetuning of zero-shot vision models Sachin Goyal Ananya Kumar Sankalp Garg Zico Kolter Aditi Raghunathan CLIP VLM 27 136 0 01 Dec 2022
Rethinking Two Consensuses of the Transferability in Deep Learning Yixiong Chen Jingxia Li C. Ding Li Liu 19 2 0 01 Dec 2022
Transferability Estimation Based On Principal Gradient Expectation Huiyan Qi Lechao Cheng Jingjing Chen Yue Yu Xue Song Zunlei Feng Yueping Jiang 14 2 0 29 Nov 2022
ModelDiff: A Framework for Comparing Learning Algorithms Harshay Shah Sung Min Park Andrew Ilyas A. Madry SyDa 46 26 0 22 Nov 2022
Frozen Overparameterization: A Double Descent Perspective on Transfer Learning of Deep Neural Networks Yehuda Dar Lorenzo Luzi Richard G. Baraniuk AI4CE 8 1 0 20 Nov 2022
How to Fine-Tune Vision Models with SGD Ananya Kumar Ruoqi Shen Sébastien Bubeck Suriya Gunasekar VLM 6 29 0 17 Nov 2022
ContextCLIP: Contextual Alignment of Image-Text pairs on CLIP visual representations Chanda Grover Indra Deep Mastan Debayan Gupta VLM CLIP 11 4 0 14 Nov 2022
Could Giant Pretrained Image Models Extract Universal Representations? Yutong Lin Ze Liu Zheng-Wei Zhang Han Hu Nanning Zheng Stephen Lin Yue Cao VLM 46 9 0 03 Nov 2022
LegoNet: A Fast and Exact Unlearning Architecture Sihao Yu Fei Sun J. Guo Ruqing Zhang Xueqi Cheng MU 37 7 0 28 Oct 2022
An Effective Approach for Multi-label Classification with Missing Labels Xin Zhang R. Abdelfattah Yuqi Song Xiaofeng Wang 17 4 0 24 Oct 2022
Deep Model Reassembly Xingyi Yang Zhou Daquan Songhua Liu Jingwen Ye Xinchao Wang MoMe 20 120 0 24 Oct 2022
Surgical Fine-Tuning Improves Adaptation to Distribution Shifts Yoonho Lee Annie S. Chen Fahim Tajwar Ananya Kumar Huaxiu Yao Percy Liang Chelsea Finn OOD 47 197 0 20 Oct 2022
lo-fi: distributed fine-tuning without communication Mitchell Wortsman Suchin Gururangan Shen Li Ali Farhadi Ludwig Schmidt Michael G. Rabbat Ari S. Morcos 19 24 0 19 Oct 2022
Perceptual Grouping in Contrastive Vision-Language Models Kanchana Ranasinghe Brandon McKinzie S. S. Ravi Yinfei Yang Alexander Toshev Jonathon Shlens VLM 22 51 0 18 Oct 2022
Towards Efficient and Effective Self-Supervised Learning of Visual Representations Sravanti Addepalli Kaushal Bhogale Priyam Dey R. Venkatesh Babu SSL 10 8 0 18 Oct 2022
Simple Emergent Action Representations from Multi-Task Policy Training Pu Hua Yubei Chen Huazhe Xu MLAU 17 6 0 18 Oct 2022
LAION-5B: An open large-scale dataset for training next generation image-text models Christoph Schuhmann Romain Beaumont Richard Vencu Cade Gordon Ross Wightman ... Srivatsa Kundurthy Katherine Crowson Ludwig Schmidt R. Kaczmarczyk J. Jitsev VLM MLLM CLIP 43 3,247 0 16 Oct 2022
A Closer Look at the Calibration of Differentially Private Learners Hanlin Zhang Xuechen Li Prithviraj Sen Salim Roukos Tatsunori Hashimoto 8 3 0 15 Oct 2022
Data-Limited Tissue Segmentation using Inpainting-Based Self-Supervised Learning J. Dominic Nandita Bhaskhar Arjun D Desai Andrew M Schmidt E. Rubin ... G. Gold B. Hargreaves L. Lenchik R. Boutin Akshay S. Chaudhari 8 0 0 14 Oct 2022
Predicting Fine-Tuning Performance with Probing Zining Zhu Soroosh Shahtalebi Frank Rudzicz 26 9 0 13 Oct 2022
Visual Classification via Description from Large Language Models Sachit Menon Carl Vondrick VLM 11 287 0 13 Oct 2022
Towards Understanding and Boosting Adversarial Transferability from a Distribution Perspective Yao Zhu YueFeng Chen Xiaodan Li Kejiang Chen Yuan He Xiang Tian Bo Zheng Yao-wu Chen Qingming Huang AAML 14 57 0 09 Oct 2022
Content-Based Search for Deep Generative Models Daohan Lu Sheng-Yu Wang Nupur Kumari Rohan Agarwal Mia Tang David Bau Jun-Yan Zhu DiffM SyDa 30 5 0 06 Oct 2022
Differentially Private Bias-Term Fine-tuning of Foundation Models Zhiqi Bu Yu-Xiang Wang Sheng Zha George Karypis 21 46 0 30 Sep 2022
Transfer Learning with Pretrained Remote Sensing Transformers A. Fuller K. Millard J.R. Green 25 11 0 28 Sep 2022