ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2309.05950
  4. Cited By
Language Models as Black-Box Optimizers for Vision-Language Models
v1v2v3v4v5 (latest)

Language Models as Black-Box Optimizers for Vision-Language Models

Computer Vision and Pattern Recognition (CVPR), 2023
12 September 2023
Shihong Liu
Zhiqiu Lin
Samuel Yu
Ryan Lee
Tiffany Ling
Deepak Pathak
Deva Ramanan
    VLM
ArXiv (abs)PDFHTMLHuggingFace (4 upvotes)

Papers citing "Language Models as Black-Box Optimizers for Vision-Language Models"

28 / 28 papers shown
ViPER: Empowering the Self-Evolution of Visual Perception Abilities in Vision-Language Model
ViPER: Empowering the Self-Evolution of Visual Perception Abilities in Vision-Language Model
J. Zhang
Song Jin
Chuanqi Cheng
Yuhan Liu
Yankai Lin
...
Yufei Zhang
F. Jiang
G. Yin
Wei Lin
Rui Yan
VLM
213
4
0
28 Oct 2025
BiomedXPro: Prompt Optimization for Explainable Diagnosis with Biomedical Vision Language Models
BiomedXPro: Prompt Optimization for Explainable Diagnosis with Biomedical Vision Language Models
Kaushitha Silva
Mansitha Eashwara
Sanduni Ubayasiri
Ruwan Tennakoon
Damayanthi Herath
LM&MA
170
0
0
17 Oct 2025
A geometrical approach to solve the proximity of a point to an axisymmetric quadric in space
A geometrical approach to solve the proximity of a point to an axisymmetric quadric in space
Bibekananda Patra
Aditya Mahesh Kolte
Sandipan Bandyopadhyay
119
11
0
10 Oct 2025
GRPOformer: Advancing Hyperparameter Optimization via Group Relative Policy Optimization
GRPOformer: Advancing Hyperparameter Optimization via Group Relative Policy Optimization
Haoxin Guo
Jiawen Pan
Weixin Zhai
92
0
0
21 Sep 2025
Maestro: Self-Improving Text-to-Image Generation via Agent Orchestration
Maestro: Self-Improving Text-to-Image Generation via Agent Orchestration
Xingchen Wan
Han Zhou
Ruoxi Sun
Hootan Nakhost
Ke Jiang
Rajarishi Sinha
Sercan Ö. Arık
246
4
0
12 Sep 2025
Discrete Prompt Tuning via Recursive Utilization of Black-box Multimodal Large Language Model for Personalized Visual Emotion Recognition
Discrete Prompt Tuning via Recursive Utilization of Black-box Multimodal Large Language Model for Personalized Visual Emotion Recognition
Ryo Takahashi
Naoki Saito
Keisuke Maeda
Takahiro Ogawa
Miki Haseyama
VLM
78
0
0
30 Aug 2025
Towards Understanding Camera Motions in Any Video
Towards Understanding Camera Motions in Any Video
Zhiqiu Lin
Siyuan Cen
Daniel Jiang
Jay Karhade
Hewei Wang
...
Rushikesh Zawar
Xue Bai
Yilun Du
Chuang Gan
Deva Ramanan
VGen
382
25
0
21 Apr 2025
SCRAMBLe : Enhancing Multimodal LLM Compositionality with Synthetic Preference Data
SCRAMBLe : Enhancing Multimodal LLM Compositionality with Synthetic Preference Data
Samarth Mishra
Kate Saenko
Venkatesh Saligrama
CoGeLRM
313
0
0
07 Apr 2025
ProAPO: Progressively Automatic Prompt Optimization for Visual Classification
ProAPO: Progressively Automatic Prompt Optimization for Visual ClassificationComputer Vision and Pattern Recognition (CVPR), 2025
Xiangyan Qu
Gaopeng Gou
Jiamin Zhuang
Jing Yu
Kun Song
Qihao Wang
Yili Li
Gang Xiong
VLM
687
11
0
13 Mar 2025
On the Effectiveness of Large Language Models in Automating Categorization of Scientific Texts
On the Effectiveness of Large Language Models in Automating Categorization of Scientific TextsInternational Conference on Enterprise Information Systems (ICEIS), 2025
Gautam Kishore Shahi
Oliver Hummel
225
3
0
08 Feb 2025
Deep Insights into Automated Optimization with Large Language Models and
  Evolutionary Algorithms
Deep Insights into Automated Optimization with Large Language Models and Evolutionary Algorithms
He Yu
Qingbin Liu
184
13
0
28 Oct 2024
IPO: Interpretable Prompt Optimization for Vision-Language Models
IPO: Interpretable Prompt Optimization for Vision-Language ModelsNeural Information Processing Systems (NeurIPS), 2024
Yingjun Du
Wenfang Sun
Cees G. M. Snoek
VLM
257
6
0
20 Oct 2024
GLOV: Guided Large Language Models as Implicit Optimizers for Vision Language Models
GLOV: Guided Large Language Models as Implicit Optimizers for Vision Language Models
Muhammad Jehanzeb Mirza
Mengjie Zhao
Zhuoyuan Mao
Sivan Doveh
Wei Lin
...
Yuki Mitsufuji
Horst Possegger
Rogerio Feris
Leonid Karlinsky
James Glass
VLM
667
3
0
08 Oct 2024
LLM-wrapper: Black-Box Semantic-Aware Adaptation of Vision-Language Models for Referring Expression Comprehension
LLM-wrapper: Black-Box Semantic-Aware Adaptation of Vision-Language Models for Referring Expression ComprehensionInternational Conference on Learning Representations (ICLR), 2024
Amaia Cardiel
Éloi Zablocki
Oriane Siméoni
Elias Ramzi
Matthieu Cord
VLM
299
0
0
18 Sep 2024
Robust Adaptation of Foundation Models with Black-Box Visual Prompting
Robust Adaptation of Foundation Models with Black-Box Visual Prompting
Changdae Oh
Gyeongdeok Seo
Geunyoung Jung
Zhi-Qi Cheng
Hosik Choi
Jiyoung Jung
Kyungwoo Song
VLM
354
2
0
04 Jul 2024
GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual
  Generation
GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generation
Baiqi Li
Zhiqiu Lin
Deepak Pathak
Jiayao Li
Yixin Fei
...
Tiffany Ling
Xide Xia
Pengchuan Zhang
Graham Neubig
Deva Ramanan
EGVM
362
70
0
19 Jun 2024
Test-Time Multimodal Backdoor Detection by Contrastive Prompting
Test-Time Multimodal Backdoor Detection by Contrastive Prompting
Yuwei Niu
Shuo He
Qinglai Wei
Z. Wu
Feng Liu
Bingquan Shen
AAML
406
4
0
24 May 2024
Large Language Models for Tuning Evolution Strategies
Large Language Models for Tuning Evolution Strategies
Oliver Kramer
162
4
0
16 May 2024
When Large Language Model Meets Optimization
When Large Language Model Meets OptimizationSwarm and Evolutionary Computation (Swarm Evol. Comput.), 2024
Sen Huang
Kaixiang Yang
Sheng Qi
Rui Wang
298
44
0
16 May 2024
Iteratively Prompting Multimodal LLMs to Reproduce Natural and
  AI-Generated Images
Iteratively Prompting Multimodal LLMs to Reproduce Natural and AI-Generated Images
Ali Naseh
Katherine Thai
Mohit Iyyer
Amir Houmansadr
260
12
0
21 Apr 2024
Evolving Interpretable Visual Classifiers with Large Language Models
Evolving Interpretable Visual Classifiers with Large Language Models
Mia Chiquier
Utkarsh Mall
Carl Vondrick
VLM
254
20
0
15 Apr 2024
Evaluating Text-to-Visual Generation with Image-to-Text Generation
Evaluating Text-to-Visual Generation with Image-to-Text Generation
Zhiqiu Lin
Deepak Pathak
Baiqi Li
Jiayao Li
Xide Xia
Graham Neubig
Pengchuan Zhang
Deva Ramanan
EGVM
450
342
0
01 Apr 2024
Automated Black-box Prompt Engineering for Personalized Text-to-Image Generation
Automated Black-box Prompt Engineering for Personalized Text-to-Image Generation
Yutong He
Avi Schwarzschild
Naoki Murata
Yiding Jiang
J. Williams
George Pappas
Hamed Hassani
Yuki Mitsufuji
Ruslan Salakhutdinov
J. Zico Kolter
DiffM
343
8
0
28 Mar 2024
Just Shift It: Test-Time Prototype Shifting for Zero-Shot Generalization
  with Vision-Language Models
Just Shift It: Test-Time Prototype Shifting for Zero-Shot Generalization with Vision-Language Models
Elaine Sui
Xiaohan Wang
Serena Yeung-Levy
VLM
272
21
0
19 Mar 2024
Large Language Model-Based Evolutionary Optimizer: Reasoning with
  elitism
Large Language Model-Based Evolutionary Optimizer: Reasoning with elitism
Shuvayan Brahmachary
Subodh M. Joshi
Aniruddha Panda
K. Koneripalli
A. Sagotra
Harshil Patel
Ankush Sharma
Ameya Dilip Jagtap
Kaushic Kalyanaraman
LRM
303
45
0
04 Mar 2024
On Catastrophic Inheritance of Large Foundation Models
On Catastrophic Inheritance of Large Foundation Models
Hao Chen
Bhiksha Raj
Xing Xie
Yongfeng Zhang
AI4CE
296
14
0
02 Feb 2024
The Neglected Tails in Vision-Language Models
The Neglected Tails in Vision-Language ModelsComputer Vision and Pattern Recognition (CVPR), 2024
Shubham Parashar
Zhiqiu Lin
Tian Liu
Xiangjue Dong
Yanan Li
Deva Ramanan
James Caverlee
Shu Kong
VLM
480
60
0
23 Jan 2024
Efficient Federated Prompt Tuning for Black-box Large Pre-trained Models
Efficient Federated Prompt Tuning for Black-box Large Pre-trained Models
Zihao Lin
Yan Sun
Yifan Shi
Xueqian Wang
Lifu Huang
Li Shen
Dacheng Tao
249
15
0
04 Oct 2023
1