Black-Box Tuning for Language-Model-as-a-Service

10 January 2022

Tianxiang Sun

Yunfan Shao

Hong Qian

Xuanjing Huang

Xipeng Qiu

VLM

ArXiv PDF HTML

Papers citing "Black-Box Tuning for Language-Model-as-a-Service"

50 / 204 papers shown

Title
When Gradient Descent Meets Derivative-Free Optimization: A Match Made in Black-Box Scenario Chengcheng Han Liqing Cui Renyu Zhu J. Wang Nuo Chen Qiushi Sun Xiang Li Ming Gao 18 7 0 17 May 2023
Prompt-Tuning Decision Transformer with Preference Ranking Shengchao Hu Li Shen Ya-Qin Zhang Dacheng Tao OffRL 18 14 0 16 May 2023
Make Prompt-based Black-Box Tuning Colorful: Boosting Model Generalization from Three Orthogonal Perspectives Qiushi Sun Chengcheng Han Nuo Chen Renyu Zhu Jing Gong Xiang Li Ming Gao VLM 17 5 0 14 May 2023
How Good are Commercial Large Language Models on African Languages? Jessica Ojo Kelechi Ogueji 16 5 0 11 May 2023
CodeIE: Large Code Generation Models are Better Few-Shot Information Extractors Peng Li Tianxiang Sun Qiong Tang Hang Yan Yuanbin Wu Xuanjing Huang Technology SyDa 6 67 0 09 May 2023
Adapt and Align to Improve Zero-Shot Sketch-Based Image Retrieval Shiyin Dong Mingrui Zhu N. Wang Xinbo Gao VLM 14 3 0 09 May 2023
HiFi: High-Information Attention Heads Hold for Parameter-Efficient Model Adaptation Anchun Gui Han Xiao 14 4 0 08 May 2023
Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models Lei Wang Wanyu Xu Yihuai Lan Zhiqiang Hu Yunshi Lan Roy Ka-Wei Lee Ee-Peng Lim ReLM LRM 15 308 0 06 May 2023
Black-box Prompt Tuning with Subspace Learning Yuanhang Zheng Zhixing Tan Peng Li Yang Liu VLM 43 9 0 04 May 2023
How to Unleash the Power of Large Language Models for Few-shot Relation Extraction? Xin Xu Yuqi Zhu Xiaohan Wang Ningyu Zhang KELM LRM 43 45 0 02 May 2023
Reliable Gradient-free and Likelihood-free Prompt Tuning Maohao Shen S. Ghosh P. Sattigeri Subhro Das Yuheng Bu G. Wornell VLM 44 10 0 30 Apr 2023
OpenBox: A Python Toolkit for Generalized Black-box Optimization Huaijun Jiang Yu Shen Yang Li Beicheng Xu Sixian Du Wentao Zhang Ce Zhang Bin Cui 13 4 0 26 Apr 2023
The Dark Side of ChatGPT: Legal and Ethical Challenges from Stochastic Parrots and Hallucination Z. Li AILaw SILM 39 34 0 21 Apr 2023
Gradient-Free Textual Inversion Zhengcong Fei Mingyuan Fan Junshi Huang DiffM 13 31 0 12 Apr 2023
BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning Changdae Oh Hyeji Hwang Hee-young Lee Yongtaek Lim Geunyoung Jung Jiyoung Jung Hosik Choi Kyungwoo Song VLM VPVLM 72 54 0 26 Mar 2023
The Life Cycle of Knowledge in Big Language Models: A Survey Boxi Cao Hongyu Lin Xianpei Han Le Sun KELM 26 22 0 14 Mar 2023
Bootstrap The Original Latent: Learning a Private Model from a Black-box Model Shuai Wang Daoan Zhang Jiang Zhang Weiwei Zhang Ruizhen Li FedML 15 0 0 07 Mar 2023
Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Data Kashun Shum Shizhe Diao Tong Zhang ReLM LRM 19 128 0 24 Feb 2023
Guiding Large Language Models via Directional Stimulus Prompting Zekun Li Baolin Peng Pengcheng He Michel Galley Jianfeng Gao Xi Yan LLMAG LRM LM&Ro 21 91 0 22 Feb 2023
Explanation Selection Using Unlabeled Data for Chain-of-Thought Prompting Xi Ye Greg Durrett LRM ReLM 10 10 0 09 Feb 2023
A Survey on In-context Learning Qingxiu Dong Lei Li Damai Dai Ce Zheng Jingyuan Ma ... Zhiyong Wu Baobao Chang Xu Sun Lei Li Zhifang Sui ReLM AIMat 20 443 0 31 Dec 2022
Language Modeling with Latent Situations Belinda Z. Li Maxwell Nye Jacob Andreas LRM 6 7 0 20 Dec 2022
PromptBoosting: Black-Box Text Classification with Ten Forward Passes Bairu Hou J. O'Connor Jacob Andreas Shiyu Chang Yang Zhang VLM 19 43 0 19 Dec 2022
Decoder Tuning: Efficient Language Understanding as Decoding Ganqu Cui Wentao Li Ning Ding Longtao Huang Zhiyuan Liu Maosong Sun 19 6 0 16 Dec 2022
Technical Report -- Competition Solution for Prompt Tuning using Pretrained Language Model Jiang-Long Song Wuhe Zou Feng Li Xiaolei Qin Weidong Zhang 16 0 0 13 Dec 2022
PyPop7: A Pure-Python Library for Population-Based Black-Box Optimization Qiqi Duan Guochen Zhou Chang Shao Zhuowei Wang Mingyang Feng Yuwei Huang Yajing Tan Yijun Yang Qi Zhao Yuhui Shi 21 5 0 12 Dec 2022
DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models Zhengfu He Tianxiang Sun Kuan-Chieh Jackson Wang Xuanjing Huang Xipeng Qiu DiffM VLM 6 112 0 28 Nov 2022
TEMPERA: Test-Time Prompting via Reinforcement Learning Tianjun Zhang Xuezhi Wang Denny Zhou Dale Schuurmans Joseph E. Gonzalez VLM 12 35 0 21 Nov 2022
GPS: Genetic Prompt Search for Efficient Few-shot Learning Hanwei Xu Yujun Chen Yulun Du Nan Shao Yanggang Wang Haiyu Li Zhilin Yang VLM 14 22 0 31 Oct 2022
Clip-Tuning: Towards Derivative-free Prompt Learning with a Mixture of Rewards Yekun Chai Shuohuan Wang Yu Sun Hao Tian Hua-Hong Wu Haifeng Wang VLM 11 17 0 21 Oct 2022
Late Prompt Tuning: A Late Prompt Could Be Better Than Many Prompts Xiangyang Liu Tianxiang Sun Xuanjing Huang Xipeng Qiu VLM 15 27 0 20 Oct 2022
Multitask Pre-training of Modular Prompt for Chinese Few-Shot Learning Tianxiang Sun Zhengfu He Qinen Zhu Xipeng Qiu Xuanjing Huang VLM VPVLM 4 20 0 14 Oct 2022
DyLoRA: Parameter Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank Adaptation Mojtaba Valipour Mehdi Rezagholizadeh I. Kobyzev A. Ghodsi 12 156 0 14 Oct 2022
Transformers generalize differently from information stored in context vs in weights Stephanie C. Y. Chan Ishita Dasgupta Junkyung Kim D. Kumaran Andrew Kyle Lampinen Felix Hill 95 45 0 11 Oct 2022
Prompt Tuning for Generative Multimodal Pretrained Models Han Yang Junyang Lin An Yang Peng Wang Chang Zhou Hongxia Yang VLM LRM VPVLM 27 30 0 04 Aug 2022
Probing Semantic Grounding in Language Models of Code with Representational Similarity Analysis Shounak Naik Rajaswa Patil Swati Agarwal V. Baths 17 3 0 15 Jul 2022
RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learning Mingkai Deng Jianyu Wang Cheng-Ping Hsieh Yihan Wang Han Guo Tianmin Shu Meng Song Eric P. Xing Zhiting Hu 8 315 0 25 May 2022
BBTv2: Towards a Gradient-Free Future with Large Language Models Tianxiang Sun Zhengfu He Hong Qian Yunhua Zhou Xuanjing Huang Xipeng Qiu 94 53 0 23 May 2022
Parameter-Efficient Tuning by Manipulating Hidden States of Pretrained Language Models For Classification Tasks Haoran Yang Piji Li Wai Lam 15 2 0 10 Apr 2022
GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models Archiki Prasad Peter Hase Xiang Zhou Mohit Bansal 10 117 0 14 Mar 2022
Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Models Ning Ding Yujia Qin Guang Yang Fu Wei Zonghan Yang ... Jianfei Chen Yang Liu Jie Tang Juan Li Maosong Sun 8 196 0 14 Mar 2022
Input-Tuning: Adapting Unfamiliar Inputs to Frozen Pretrained Models Shengnan An Yifei Li Zeqi Lin Qian Liu Bei Chen Qiang Fu Weizhu Chen Nanning Zheng Jian-Guang Lou VLM AAML 26 39 0 07 Mar 2022
$$\mathcal{Y}$-Tuning: An Efficient Tuning Paradigm for Large-Scale Pre-Trained Models via Label Representation Learning$ $\mathcal{Y}$ -Tuning: An Efficient Tuning Paradigm for Large-Scale Pre-Trained Models via Label Representation Learning Yitao Liu Chen An Xipeng Qiu 19 13 0 20 Feb 2022
Black-box Prompt Learning for Pre-trained Language Models Shizhe Diao Zhichao Huang Ruijia Xu Xuechun Li Yong Lin Xiao Zhou Tong Zhang VLM AAML 22 68 0 21 Jan 2022
P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks Xiao Liu Kaixuan Ji Yicheng Fu Weng Lam Tam Zhengxiao Du Zhilin Yang Jie Tang VLM 236 780 0 14 Oct 2021
CLIP-Adapter: Better Vision-Language Models with Feature Adapters Peng Gao Shijie Geng Renrui Zhang Teli Ma Rongyao Fang Yongfeng Zhang Hongsheng Li Yu Qiao VLM CLIP 18 963 0 09 Oct 2021
Paradigm Shift in Natural Language Processing Tianxiang Sun Xiangyang Liu Xipeng Qiu Xuanjing Huang 109 71 0 26 Sep 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 278 3,784 0 18 Apr 2021
WARP: Word-level Adversarial ReProgramming Karen Hambardzumyan Hrant Khachatrian Jonathan May AAML 248 340 0 01 Jan 2021
Making Pre-trained Language Models Better Few-shot Learners Tianyu Gao Adam Fisch Danqi Chen 241 1,898 0 31 Dec 2020