On the test-time zero-shot generalization of vision-language models: Do we really need prompt learning?

3 May 2024

Maxime Zanella

Papers citing "On the test-time zero-shot generalization of vision-language models: Do we really need prompt learning?"

26 / 26 papers shown

Title
Can Language Models Understand Social Behavior in Clinical Conversations? Manas Satish Bedmutha Feng Chen Andrea Hartzler Trevor Cohen Nadir Weibel LM&MA AI4MH 35 0 0 07 May 2025
R-TPT: Improving Adversarial Robustness of Vision-Language Models through Test-Time Prompt Tuning Lijun Sheng Jian Liang Z. Wang Ran He AAML VLM 31 0 0 15 Apr 2025
Test-Time Visual In-Context Tuning Jiahao Xie A. Tonioni N. Rauschmayr F. Tombari Bernt Schiele OOD VLM 47 0 0 27 Mar 2025
VTD-CLIP: Video-to-Text Discretization via Prompting CLIP Wencheng Zhu Yuexin Wang Hongxuan Li Pengfei Zhu Q. Hu CLIP 48 0 0 24 Mar 2025
Enhancing Zero-Shot Image Recognition in Vision-Language Models through Human-like Concept Guidance Hui Liu Wenya Wang Kecheng Chen Jie Liu Yibing Liu Tiexin Qin Peisong He Xinghao Jiang Haoliang Li BDL VLM 64 0 0 20 Mar 2025
SCAP: Transductive Test-Time Adaptation via Supportive Clique-based Attribute Prompting Chenyu Zhang Kunlun Xu Zichen Liu Yuxin Peng Jiahuan Zhou VLM 47 1 0 17 Mar 2025
Point-Cache: Test-time Dynamic and Hierarchical Cache for Robust and Generalizable Point Cloud Analysis Hongyu Sun Qiuhong Ke Ming Cheng Y. Wang Deying Li Chenhui Gou Jianfei Cai 3DPC 84 0 0 15 Mar 2025
Rethinking Few-Shot Adaptation of Vision-Language Models in Two Stages Matteo Farina Massimiliano Mancini Giovanni Iacca Elisa Ricci VLM 46 0 0 14 Mar 2025
Bayesian Test-Time Adaptation for Vision-Language Models Lihua Zhou Mao Ye Shuaifeng Li Nianxin Li Xiatian Zhu Lei Deng Hongbin Liu Zhen Lei BDL VLM TTA 91 0 0 12 Mar 2025
Space Rotation with Basis Transformation for Training-free Test-Time Adaptation Chenhao Ding Xinyuan Gao Songlin Dong Yuhang He Qiang Wang Xiang Song Alex C. Kot Yihong Gong TTA VLM 92 0 0 27 Feb 2025
Conformal Predictions for Human Action Recognition with Vision-Language Models Bary Tim Fuchs Clément Macq Benoît VLM 38 0 0 10 Feb 2025
Enhancing Remote Sensing Vision-Language Models for Zero-Shot Scene Classification K. E. Khoury Maxime Zanella Benoît Gérin Tiffanie Godelaine Benoît Macq Saïd Mahmoudi Christophe De Vleeschouwer Ismail Ben Ayed VLM 55 0 0 08 Jan 2025
Dual Prototype Evolving for Test-Time Generalization of Vision-Language Models Ce Zhang Simon Stepputtis Katia P. Sycara Yaqi Xie VLM 28 5 0 16 Oct 2024
Is Less More? Exploring Token Condensation as Training-free Test-time Adaptation Zixin Wang Dong Gong Sen Wang Zi Huang Yadan Luo VLM 22 0 0 16 Oct 2024
On the Element-Wise Representation and Reasoning in Zero-Shot Image Recognition: A Systematic Survey Jingcai Guo Zhijie Rao Zhi Chen Song Guo Jingren Zhou Dacheng Tao 23 3 0 09 Aug 2024
Boosting Vision-Language Models with Transduction Maxime Zanella Benoît Gérin Ismail Ben Ayed VLM 27 5 0 03 Jun 2024
Low-Rank Few-Shot Adaptation of Vision-Language Models Maxime Zanella Ismail Ben Ayed OffRL VLM 33 22 0 28 May 2024
Frustratingly Easy Test-Time Adaptation of Vision-Language Models Matteo Farina Gianni Franchi Giovanni Iacca Massimiliano Mancini Elisa Ricci VLM 24 0 0 28 May 2024
Visual-Language Prompt Tuning with Knowledge-guided Context Optimization Hantao Yao Rui Zhang Changsheng Xu VLM VPVLM 122 193 0 23 Mar 2023
CALIP: Zero-Shot Enhancement of CLIP with Parameter-free Attention Ziyu Guo Renrui Zhang Longtian Qiu Xianzheng Ma Xupeng Miao Xuming He Bin Cui VLM AAML 52 108 0 28 Sep 2022
Test-Time Prompt Tuning for Zero-Shot Generalization in Vision-Language Models Manli Shu Weili Nie De-An Huang Zhiding Yu Tom Goldstein Anima Anandkumar Chaowei Xiao VLM VPVLM 152 278 0 15 Sep 2022
What does a platypus look like? Generating customized prompts for zero-shot image classification Sarah M Pratt Ian Covert Rosanne Liu Ali Farhadi VLM 116 211 0 07 Sep 2022
Prompt-aligned Gradient for Prompt Tuning Beier Zhu Yulei Niu Yucheng Han Yuehua Wu Hanwang Zhang VLM 167 263 0 30 May 2022
Learning to Prompt for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VPVLM CLIP VLM 319 2,108 0 02 Sep 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 275 3,784 0 18 Apr 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 293 2,875 0 11 Feb 2021