Black-Box Tuning for Language-Model-as-a-Service

10 January 2022

Tianxiang Sun

Yunfan Shao

Hong Qian

Xuanjing Huang

Xipeng Qiu

VLM

ArXiv PDF HTML

Papers citing "Black-Box Tuning for Language-Model-as-a-Service"

50 / 204 papers shown

Title
Large Language Models as Surrogate Models in Evolutionary Algorithms: A Preliminary Study Hao Hao Xiaoqun Zhang Aimin Zhou ELM 29 9 0 15 Jun 2024
Multi-Prompting Decoder Helps Better Language Understanding Zifeng Cheng Zhaoling Chen Zhiwei Jiang Yafeng Yin Shiping Ge Yuliang Liu Qing Gu AI4CE 34 0 0 10 Jun 2024
FunBO: Discovering Acquisition Functions for Bayesian Optimization with FunSearch Virginia Aglietti Ira Ktena Jessica Schrouff Eleni Sgouritsa Francisco J. R. Ruiz Alan Malek Alexis Bellot Silvia Chiappa 19 2 0 07 Jun 2024
Enabling Efficient Batch Serving for LMaaS via Generation Length Prediction Ke Cheng Wen Hu Zhi Wang Peng Du Jianguo Li Sheng Zhang 24 10 0 07 Jun 2024
HYDRA: Model Factorization Framework for Black-Box LLM Personalization Yuchen Zhuang Haotian Sun Yue Yu Rushi Qiang Qifan Wang Chao Zhang Bo Dai AAML 31 14 0 05 Jun 2024
Conditional Language Learning with Context X. Zhang Miao Li Ji Wu 36 1 0 04 Jun 2024
Why Larger Language Models Do In-context Learning Differently? Zhenmei Shi Junyi Wei Zhuoyan Xu Yingyu Liang 29 18 0 30 May 2024
Prompt Optimization with Human Feedback Xiaoqiang Lin Zhongxiang Dai Arun Verma See-Kiong Ng P. Jaillet K. H. Low AAML 23 8 0 27 May 2024
A First Look at Kolmogorov-Arnold Networks in Surrogate-assisted Evolutionary Algorithms Hao Hao Xiaoqun Zhang Bingdong Li Aimin Zhou 30 4 0 26 May 2024
Blackbox Adaptation for Medical Image Segmentation Jay N. Paranjape S. Sikder S. Vedula Vishal M. Patel VLM MedIm 33 0 0 17 May 2024
When Large Language Model Meets Optimization Sen Huang Kaixiang Yang Sheng Qi Rui Wang 31 8 0 16 May 2024
Reinforcement Retrieval Leveraging Fine-grained Feedback for Fact Checking News Claims with Black-Box LLM Xuan Zhang Wei Gao LRM KELM 19 8 0 26 Apr 2024
Consistency and Uncertainty: Identifying Unreliable Responses From Black-Box Vision-Language Models for Selective Visual Question Answering Zaid Khan Yun Fu AAML 16 8 0 16 Apr 2024
Variance-reduced Zeroth-Order Methods for Fine-Tuning Language Models Tanmay Gautam Youngsuk Park Hao Zhou Parameswaran Raman Wooseok Ha 35 11 0 11 Apr 2024
Test-Time Model Adaptation with Only Forward Passes Shuaicheng Niu Chunyan Miao Guohao Chen Pengcheng Wu Peilin Zhao TTA 26 18 0 02 Apr 2024
BLADE: Enhancing Black-box Large Language Models with Small Domain-Specific Models Haitao Li Qingyao Ai Jia Chen Qian Dong Zhijing Wu Yiqun Liu Chong Chen Qi Tian AILaw 37 13 0 27 Mar 2024
Editing Knowledge Representation of Language Model via Rephrased Prefix Prompts Yuchen Cai Ding Cao Rongxi Guo Yaqin Wen Guiquan Liu Enhong Chen KELM 21 3 0 21 Mar 2024
Genetic Auto-prompt Learning for Pre-trained Code Intelligence Language Models Chengzhe Feng Yanan Sun Ke Li Pan Zhou Jiancheng Lv Aojun Lu 43 1 0 20 Mar 2024
CrossTune: Black-Box Few-Shot Classification with Label Enhancement Danqing Luo Chen Zhang Yan Zhang Haizhou Li 19 2 0 19 Mar 2024
Personalized LoRA for Human-Centered Text Understanding Youjia Zhang Jin Wang Liang-Chih Yu Dan Xu Xuejie Zhang 24 8 0 10 Mar 2024
Privacy-preserving Fine-tuning of Large Language Models through Flatness Tiejin Chen Longchao Da Huixue Zhou Pingzhi Li Kaixiong Zhou Tianlong Chen Hua Wei 26 3 0 07 Mar 2024
Localized Zeroth-Order Prompt Optimization Wenyang Hu Yao Shu Zongmin Yu Zhaoxuan Wu Xiangqiang Lin Zhongxiang Dai See-Kiong Ng Bryan Kian Hsiang Low 27 6 0 05 Mar 2024
RIFF: Learning to Rephrase Inputs for Few-shot Fine-tuning of Language Models Saeed Najafi Alona Fyshe 25 1 0 04 Mar 2024
Derivative-Free Optimization for Low-Rank Adaptation in Large Language Models Feihu Jin Yin Liu Ying Tan 27 3 0 04 Mar 2024
Learning Intrinsic Dimension via Information Bottleneck for Explainable Aspect-based Sentiment Analysis Zhenxiao Cheng Jie Zhou Wen Wu Qin Chen Liang He 33 0 0 28 Feb 2024
LSTP: Language-guided Spatial-Temporal Prompt Learning for Long-form Video-Text Understanding Yuxuan Wang Yueqian Wang Pengfei Wu Jianxin Liang Dongyan Zhao Zilong Zheng VLM 21 3 0 25 Feb 2024
Sparse MeZO: Less Parameters for Better Performance in Zeroth-Order LLM Fine-Tuning Yong Liu Zirui Zhu Chaoyu Gong Minhao Cheng Cho-Jui Hsieh Yang You MoE 25 16 0 24 Feb 2024
BSPA: Exploring Black-box Stealthy Prompt Attacks against Image Generators Yu Tian Xiao Yang Yinpeng Dong Heming Yang Hang Su Jun Zhu AAML 23 1 0 23 Feb 2024
Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark Yihua Zhang Pingzhi Li Junyuan Hong Jiaxiang Li Yimeng Zhang ... Wotao Yin Mingyi Hong Zhangyang Wang Sijia Liu Tianlong Chen 12 12 0 18 Feb 2024
PhaseEvo: Towards Unified In-Context Prompt Optimization for Large Language Models Wendi Cui Jiaxin Zhang Zhuohang Li Hao Sun Damien Lopez Kamalika Das Bradley Malin Kumar Sricharan 11 6 0 17 Feb 2024
Privacy-Preserving Language Model Inference with Instance Obfuscation Yixiang Yao Fei Wang Srivatsan Ravi Muhao Chen 11 6 0 13 Feb 2024
BBox-Adapter: Lightweight Adapting for Black-Box Large Language Models Haotian Sun Yuchen Zhuang Wei Wei Chao Zhang Bo Dai 15 3 0 13 Feb 2024
Integration of cognitive tasks into artificial general intelligence test for large models Youzhi Qu Chen Wei Penghui Du Wenxin Che Chi Zhang ... Bin Hu Kai Du Haiyan Wu Jia Liu Quanying Liu ELM 26 5 0 04 Feb 2024
Data Poisoning for In-context Learning Pengfei He Han Xu Yue Xing Hui Liu Makoto Yamada Jiliang Tang AAML SILM 14 10 0 03 Feb 2024
cmaes : A Simple yet Practical Python Library for CMA-ES Masahiro Nomura Masashi Shibata 37 19 0 02 Feb 2024
Computational Experiments Meet Large Language Model Based Agents: A Survey and Perspective Qun Ma Xiao Xue Deyu Zhou Xiangning Yu Donghua Liu ... Yifan Shen Peilin Ji Juanjuan Li Gang Wang Wanpeng Ma AI4CE LM&Ro LLMAG 8 6 0 01 Feb 2024
When Large Language Models Meet Evolutionary Algorithms: Potential Enhancements and Challenges Wang Chao Jiaxuan Zhao Licheng Jiao Lingling Li Fang Liu Shuyuan Yang 45 13 0 19 Jan 2024
Evolutionary Computation in the Era of Large Language Model: Survey and Roadmap Xingyu Wu Sheng-hao Wu Jibin Wu Liang Feng Kay Chen Tan ELM 34 57 0 18 Jan 2024
Black-Box Tuning of Vision-Language Models with Effective Gradient Approximation Zixian Guo Yuxiang Wei Ming-Yu Liu Zhilong Ji Jinfeng Bai Yiwen Guo Wangmeng Zuo VLM 19 8 0 26 Dec 2023
Do LLMs Work on Charts? Designing Few-Shot Prompts for Chart Question Answering and Summarization Do Xuan Long Mohammad Hassanpour Ahmed Masry P. Kavehzadeh Enamul Hoque Shafiq R. Joty LRM 20 9 0 17 Dec 2023
Maatphor: Automated Variant Analysis for Prompt Injection Attacks Ahmed Salem Andrew J. Paverd Boris Köpf 11 8 0 12 Dec 2023
A Bayesian approach for prompt optimization in pre-trained language models Antonio Sabbatella Andrea Ponti Antonio Candelieri I. Giordani F. Archetti 8 1 0 01 Dec 2023
Grounding Foundation Models through Federated Transfer Learning: A General Framework Yan Kang Tao Fan Hanlin Gu Xiaojin Zhang Lixin Fan Qiang Yang AI4CE 59 19 0 29 Nov 2023
Low-Rank Adaptation for Multilingual Summarization: An Empirical Study Chenxi Whitehouse Fantine Huot Jasmijn Bastings Mostafa Dehghani Chu-Cheng Lin Mirella Lapata 11 5 0 14 Nov 2023
Plum: Prompt Learning using Metaheuristic Rui Pan Shuo Xing Shizhe Diao Wenhe Sun Xiang Liu Kashun Shum Renjie Pi Jipeng Zhang Tong Zhang VLM OffRL LRM 29 1 0 14 Nov 2023
Instruct Me More! Random Prompting for Visual In-Context Learning Jiahao Zhang Bowen Wang Liangzhi Li Yuta Nakashima Hajime Nagahara VLM 20 9 0 07 Nov 2023
Improving Prompt Tuning with Learned Prompting Layers Wei Zhu Ming Tan VLM 15 1 0 31 Oct 2023
When Do Prompting and Prefix-Tuning Work? A Theory of Capabilities and Limitations Aleksandar Petrov Philip H. S. Torr Adel Bibi VPVLM 17 21 0 30 Oct 2023
LLMaAA: Making Large Language Models as Active Annotators Ruoyu Zhang Yanzeng Li Yongliang Ma Ming Zhou Lei Zou 24 68 0 30 Oct 2023
CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language Model Kaiyan Zhang Ning Ding Biqing Qi Xuekai Zhu Xinwei Long Bowen Zhou 38 3 0 24 Oct 2023