Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,921 papers shown

Title
Is a Question Decomposition Unit All We Need? Pruthvi H. Patel Swaroop Mishra Mihir Parmar Chitta Baral ReLM 300 55 0 25 May 2022
Conditional set generation using Seq2seq models Aman Madaan Dheeraj Rajagopal Niket Tandon Yiming Yang Antoine Bosselut 108 10 0 25 May 2022
Learning a Better Initialization for Soft Prompts via Meta-Learning Yukun Huang Kun Qian Zhou Yu VLM 159 12 0 25 May 2022
Toxicity Detection with Generative Prompt-based Inference Yau-Shian Wang Y. Chang 194 39 0 24 May 2022
Evaluating the Impact of Model Scale for Compositional Generalization in Semantic Parsing Linlu Qiu Peter Shaw Panupong Pasupat Tianze Shi Jonathan Herzig Emily Pitler Fei Sha Kristina Toutanova AI4CE LRM 207 56 0 24 May 2022
Large Language Models are Zero-Shot Reasoners Takeshi Kojima S. Gu Machel Reid Yutaka Matsuo Yusuke Iwasawa ReLM LRM 1.0K 5,294 0 24 May 2022
Formulating Few-shot Fine-tuning Towards Language Model Pre-training: A Pilot Study on Named Entity Recognition Zihan Wang Kewen Zhao Zilong Wang Jingbo Shang 110 7 0 24 May 2022
On Measuring Social Biases in Prompt-Based Multi-Task Learning Afra Feyza Akyürek Sejin Paik Muhammed Yusuf Kocyigit S. Akbiyik cSerife Leman Runyun Derry Wijaya ALM 105 14 0 23 May 2022
Many-Class Text Classification with Matching Yi-Fan Song Yuxian Gu Minlie Huang VLM 61 1 0 23 May 2022
Looking for a Handsome Carpenter! Debiasing GPT-3 Job Advertisements Conrad Borchers Dalia Sara Gala Ben Gilburt Eduard Oravkin Wilfried Bounsi Yuki M. Asano Hannah Rose Kirk AI4CE 102 34 0 23 May 2022
BBTv2: Towards a Gradient-Free Future with Large Language Models Tianxiang Sun Zhengfu He Hong Qian Yunhua Zhou Xuanjing Huang Xipeng Qiu 209 64 0 23 May 2022
PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models Yuan Yao Qi-An Chen Ao Zhang Wei Ji Zhiyuan Liu Tat-Seng Chua Maosong Sun VLM MLLM 125 39 0 23 May 2022
Prompt Tuning for Discriminative Pre-trained Language Models Yuan Yao Bowen Dong Ao Zhang Zhengyan Zhang Ruobing Xie Zhiyuan Liu Leyu Lin Maosong Sun Jianyong Wang VLM 91 35 0 23 May 2022
Vector-Quantized Input-Contextualized Soft Prompts for Natural Language Understanding Rishabh Bhardwaj Amrita Saha Guosheng Lin Soujanya Poria VLM VPVLM 103 8 0 23 May 2022
Instruction Induction: From Few Examples to Natural Language Task Descriptions Or Honovich Uri Shaham Samuel R. Bowman Omer Levy ELM LRM 344 165 0 22 May 2022
How sensitive are translation systems to extra contexts? Mitigating gender bias in Neural Machine Translation models through relevant contexts Shanya Sharma Manan Dey Koustuv Sinha 91 12 0 22 May 2022
Self-Supervised Speech Representation Learning: A Review Abdel-rahman Mohamed Hung-yi Lee Lasse Borgholt Jakob Drachmann Havtorn Joakim Edin ... Shang-Wen Li Karen Livescu Lars Maaløe Tara N. Sainath Shinji Watanabe SSL AI4TS 410 405 0 21 May 2022
Few-Shot Natural Language Inference Generation with PDD: Prompt and Dynamic Demonstration Kaijian Li Shansan Gong Kenny Q. Zhu 71 0 0 21 May 2022
Evaluating and Inducing Personality in Pre-trained Language Models Guangyuan Jiang Manjie Xu Song-Chun Zhu Wenjuan Han Fangqiu Yi Yixin Zhu 188 105 0 20 May 2022
Can Foundation Models Wrangle Your Data? A. Narayan Ines Chami Laurel J. Orr Simran Arora Christopher Ré LMTD AI4CE 314 263 0 20 May 2022
Are Prompt-based Models Clueless? Pride Kavumba Ryo Takahashi Yusuke Oda VLM 265 13 0 19 May 2022
PromptDA: Label-guided Data Augmentation for Prompt-based Few-shot Learners Canyu Chen Kai Shu VLM 162 11 0 18 May 2022
Automatic Rule Induction for Interpretable Semi-Supervised Learning Reid Pryzant Ziyi Yang Yichong Xu Chenguang Zhu Michael Zeng 169 10 0 18 May 2022
Leveraging Pseudo-labeled Data to Improve Direct Speech-to-Speech Translation Qianqian Dong Fengpeng Yue Tom Ko Mingxuan Wang Qibing Bai Yu Zhang 146 17 0 18 May 2022
What GPT Knows About Who is Who Xiaohan Yang Eduardo Peynetti Vasco Meerman Christy Tanner 234 14 0 16 May 2022
SeqZero: Few-shot Compositional Semantic Parsing with Sequential Prompts and Zero-shot Models Jingfeng Yang Haoming Jiang Qingyu Yin Danqing Zhang Bing Yin Diyi Yang 91 49 0 15 May 2022
Adaptive Prompt Learning-based Few-Shot Sentiment Analysis Pengfei Zhang Tingting Chai Yongdong Xu VLM 100 15 0 15 May 2022
Clinical Prompt Learning with Frozen Language Models Niall Taylor Yi Zhang Dan W Joyce A. Nevado-Holgado Andrey Kormilitzin VLM LM&MA 91 36 0 11 May 2022
Making Pretrained Language Models Good Long-tailed Learners Chen Zhang Lei Ren Jingang Wang Wei Wu Dawei Song RALM VLM 120 9 0 11 May 2022
Towards Unified Prompt Tuning for Few-shot Text Classification Jiadong Wang Chengyu Wang Fuli Luo Chuanqi Tan Minghui Qiu Fei Yang Qiuhui Shi Songfang Huang Ming Gao VLM 88 32 0 11 May 2022
Beyond Bounding Box: Multimodal Knowledge Learning for Object Detection Wei Feng Xingyuan Bu Chenchen Zhang Xubin Li VLM 61 4 0 09 May 2022
ProQA: Structural Prompt-based Pre-training for Unified Question Answering Wanjun Zhong Yifan Gao Ning Ding Yujia Qin Zhiyuan Liu Ming Zhou Jiahai Wang Jian Yin Nan Duan 115 37 0 09 May 2022
Declaration-based Prompt Tuning for Visual Question Answering Yuhang Liu Wei Wei Daowan Peng Feida Zhu MLLM VLM 86 19 0 05 May 2022
Language Models in the Loop: Incorporating Prompting into Weak Supervision Ryan Smith Jason Alan Fries Braden Hancock Stephen H. Bach 134 58 0 04 May 2022
Lexical Knowledge Internalization for Neural Dialog Generation Zhiyong Wu Wei Bi Xiang Li Lingpeng Kong B. Kao 91 2 0 04 May 2022
P^3 Ranker: Mitigating the Gaps between Pre-training and Ranking Fine-tuning with Prompt-based Learning and Pre-finetuning Xiaomeng Hu S. Yu Chenyan Xiong Zhenghao Liu Zhiyuan Liu Geoffrey X. Yu 70 12 0 04 May 2022
All You May Need for VQA are Image Captions Soravit Changpinyo Doron Kukliansky Idan Szpektor Xi Chen Nan Ding Radu Soricut 143 81 0 04 May 2022
Textual Entailment for Event Argument Extraction: Zero- and Few-Shot with Multi-Source Learning Oscar Sainz Itziar Gonzalez-Dios Oier López de Lacalle Bonan Min Eneko Agirre 116 51 0 03 May 2022
CUP: Curriculum Learning based Prompt Tuning for Implicit Event Argument Extraction Jiaju Lin Qin Chen Jie Zhou Jian Jin Liangye He 117 24 0 01 May 2022
EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing Chengyu Wang Minghui Qiu Chen Shi Taolin Zhang Tingting Liu Lei Li Jiadong Wang Ming Wang Jun Huang W. Lin 97 21 0 30 Apr 2022
Prompt Consistency for Zero-Shot Task Generalization Chunting Zhou Junxian He Xuezhe Ma Taylor Berg-Kirkpatrick Graham Neubig VLM 197 83 0 29 Apr 2022
Polyglot Prompt: Multilingual Multitask PrompTraining Jinlan Fu See-Kiong Ng Pengfei Liu 78 9 0 29 Apr 2022
QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware Relevance Xiaoqiang Wang Bang Liu Siliang Tang Lingfei Wu 128 11 0 29 Apr 2022
Tailor: A Prompt-Based Approach to Attribute-Based Controlled Text Generation Kexin Yang Dayiheng Liu Wenqiang Lei Baosong Yang Mingfeng Xue Boxing Chen Jun Xie 97 29 0 28 Apr 2022
NLU++: A Multi-Label, Slot-Rich, Generalisable Dataset for Natural Language Understanding in Task-Oriented Dialogue I. Casanueva Ivan Vulić Georgios P. Spithourakis Paweł Budzianowski 133 12 0 27 Apr 2022
Probing Simile Knowledge from Pre-trained Language Models Weijie Chen Yongzhu Chang Rongsheng Zhang Jiashu Pu Guandan Chen Le Zhang Yadong Xi Yijiang Chen Chang Su 86 11 0 27 Apr 2022
On the Limitations of Dataset Balancing: The Lost Battle Against Spurious Correlations Roy Schwartz Gabriel Stanovsky 136 28 0 27 Apr 2022
ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation Yufei Xu Jing Zhang Qiming Zhang Dacheng Tao ViT 183 642 0 26 Apr 2022
Natural Language to Code Translation with Execution Freda Shi Daniel Fried Marjan Ghazvininejad Luke Zettlemoyer Sida I. Wang 184 140 0 25 Apr 2022
Decorate the Examples: A Simple Method of Prompt Design for Biomedical Relation Extraction Hui-Syuan Yeh Thomas Lavergne Pierre Zweigenbaum 105 14 0 21 Apr 2022