Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,918 papers shown

Title
OMG: Observe Multiple Granularities for Natural Language-Based Vehicle Retrieval Yunhao Du Binyu Zhang Xiang Ruan Fei Su Zhicheng Zhao Hong Chen 76 7 0 18 Apr 2022
Multi-Modal Few-Shot Object Detection with Meta-Learning-Based Cross-Modal Prompting G. Han Long Chen Jiawei Ma Shiyuan Huang Ramalingam Chellappa Shih-Fu Chang VLM 178 23 0 16 Apr 2022
A Contrastive Cross-Channel Data Augmentation Framework for Aspect-based Sentiment Analysis Bing Wang Liang Ding Qihuang Zhong Ximing Li Dacheng Tao 132 35 0 16 Apr 2022
UniGDD: A Unified Generative Framework for Goal-Oriented Document-Grounded Dialogue Chang Gao Wenxuan Zhang W. Lam 185 13 0 16 Apr 2022
In-BoXBART: Get Instructions into Biomedical Multi-Task Learning Mihir Parmar Swaroop Mishra Mirali Purohit Man Luo M. H. Murad Chitta Baral 113 23 0 15 Apr 2022
mGPT: Few-Shot Learners Go Multilingual Oleh Shliazhko Alena Fenogenova Maria Tikhonova Vladislav Mikhailov Anastasia Kozlova Tatiana Shavrina 216 168 0 15 Apr 2022
Image Captioning In the Transformer Age Yangliu Xu Li Li Haiyang Xu Songfang Huang Fei Huang Jianfei Cai ViT 98 6 0 15 Apr 2022
Rows from Many Sources: Enriching row completions from Wikidata with a pre-trained Language Model Carina Negreanu Alperen Karaoglu Jack Williams Shuang Chen Daniel Fabian Andrew D. Gordon Chin-Yew Lin RALM AIMat LMTD 71 2 0 14 Apr 2022
A Unified Multi-task Learning Framework for Multi-goal Conversational Recommender Systems Yang Deng Wenxuan Zhang Weiwen Xu Wenqiang Lei Tat-Seng Chua W. Lam LRM 155 71 0 14 Apr 2022
Impossible Triangle: What's Next for Pre-trained Language Models? Chenguang Zhu Michael Zeng 122 1 0 13 Apr 2022
A Review on Language Models as Knowledge Bases Badr AlKhamissi Millicent Li Asli Celikyilmaz Mona T. Diab Marjan Ghazvininejad KELM 171 199 0 12 Apr 2022
Exploring the Universal Vulnerability of Prompt-based Learning Paradigm Lei Xu Yangyi Chen Ganqu Cui Hongcheng Gao Zhiyuan Liu SILM VPVLM 145 78 0 11 Apr 2022
Entities, Dates, and Languages: Zero-Shot on Historical Texts with T0 F. Toni Christopher Akiki Javier de la Rosa Clémentine Fourrier Enrique Manjavacas Stefan Schweter Daniel Alexander van Strien 85 11 0 11 Apr 2022
Generative Biomedical Entity Linking via Knowledge Base-Guided Pre-training and Synonyms-Aware Fine-tuning Hongyi Yuan Zheng Yuan Sheng Yu MedIm 131 46 0 11 Apr 2022
DualPrompt: Complementary Prompting for Rehearsal-free Continual Learning Zifeng Wang Zizhao Zhang Sayna Ebrahimi Ruoxi Sun Han Zhang ... Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VLM VPVLM 219 595 0 10 Apr 2022
Parameter-Efficient Tuning by Manipulating Hidden States of Pretrained Language Models For Classification Tasks Haoran Yang Piji Li Wai Lam 109 4 0 10 Apr 2022
Contrastive Demonstration Tuning for Pre-trained Language Models Xiaozhuan Liang Ningyu Zhang Shuyang Cheng Zhenru Zhang Chuanqi Tan Huajun Chen VLM ALM VPVLM 156 10 0 09 Apr 2022
Match-Prompt: Improving Multi-task Generalization Ability for Neural Text Matching via Prompt Learning Shicheng Xu Liang Pang Huawei Shen Xueqi Cheng VLM 103 18 0 06 Apr 2022
Can language models learn from explanations in context? Andrew Kyle Lampinen Ishita Dasgupta Stephanie C. Y. Chan Kory Matthewson Michael Henry Tessler Antonia Creswell James L. McClelland Jane X. Wang Felix Hill LRM ReLM 316 332 0 05 Apr 2022
Improved and Efficient Conversational Slot Labeling through Question Answering Gabor Fuisz Ivan Vulić Samuel Gibbons I. Casanueva Paweł Budzianowski 110 12 0 05 Apr 2022
Nowruz at SemEval-2022 Task 7: Tackling Cloze Tests with Transformers and Ordinal Regression Mohammadmahdi Nouriborji Omid Rohanian David Clifton 82 1 0 01 Apr 2022
Making Pre-trained Language Models End-to-end Few-shot Learners with Contrastive Prompt Tuning Ziyun Xu Chengyu Wang Minghui Qiu Fuli Luo Runxin Xu Songfang Huang Jun Huang VLM 137 37 0 01 Apr 2022
Exploring Visual Prompts for Adapting Large-Scale Models Hyojin Bahng Ali Jahanian S. Sankaranarayanan Phillip Isola VLM VPVLM LRM 203 307 0 31 Mar 2022
SpeechPrompt: An Exploration of Prompt Tuning on Generative Spoken Language Model for Speech Processing Tasks Kai-Wei Chang Wei-Cheng Tseng Shang-Wen Li Hung-yi Lee 136 23 0 31 Mar 2022
Towards Few-shot Entity Recognition in Document Images: A Label-aware Sequence-to-Sequence Framework Zilong Wang Jingbo Shang 86 13 0 30 Mar 2022
Position-based Prompting for Health Outcome Generation Micheal Abaho Danushka Bollegala P. Williamson S. Dodd 84 11 0 30 Mar 2022
Enhanced compound-protein binding affinity prediction by representing protein multimodal information via a coevolutionary strategy Binjie Guo Hanyu Zheng Haohan Jiang Xiaodan Li Nai-Yang Guan Yanming Zuo Yicheng Zhang Hengfu Yang Xuhua Wang 68 4 0 30 Mar 2022
Evaluating Prompts Across Multiple Choice Tasks In a Zero-Shot Setting Gabriel Orlanski LRM 91 2 0 29 Mar 2022
Bridge-Prompt: Towards Ordinal Action Understanding in Instructional Videos Muheng Li Lei Chen Yueqi Duan Zhilan Hu Jianjiang Feng Jie Zhou Jiwen Lu 120 84 0 26 Mar 2022
Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5) Shijie Geng Shuchang Liu Zuohui Fu Yingqiang Ge Zelong Li VLM AI4TS 369 582 0 24 Mar 2022
Can Unsupervised Knowledge Transfer from Social Discussions Help Argument Mining? Subhabrata Dutta Jeevesh Juneja Dipankar Das Tanmoy Chakraborty 98 18 0 24 Mar 2022
A Survey on Cross-Lingual Summarization Jiaan Wang Fandong Meng Duo Zheng Yunlong Liang Zhixu Li Jianfeng Qu Jie Zhou AILaw 109 68 0 23 Mar 2022
Prompt-based System for Personality and Interpersonal Reactivity Prediction Bin Li Yixuan Weng 138 9 0 23 Mar 2022
Can Prompt Probe Pretrained Language Models? Understanding the Invisible Risks from a Causal View Boxi Cao Hongyu Lin Xianpei Han Fangchao Liu Le Sun ELM AAML 67 45 0 23 Mar 2022
Visual Prompt Tuning Menglin Jia Luming Tang Bor-Chun Chen Claire Cardie Serge Belongie Bharath Hariharan Ser-Nam Lim VLM VPVLM 365 1,969 0 23 Mar 2022
A Prompt Array Keeps the Bias Away: Debiasing Vision-Language Models with Adversarial Learning Hugo Elias Berg Elizaveta Semenova Yash Bhalgat Wonsuk Yang Hannah Rose Kirk Aleksandar Shtedritski Max Bain VLM 170 118 0 22 Mar 2022
How well does CLIP understand texture? Chenyun Wu Subhransu Maji 104 8 0 22 Mar 2022
A Prompting-based Approach for Adversarial Example Generation and Robustness Enhancement Yuting Yang Pei Huang Juan Cao Jintao Li Yun Lin Jin Song Dong Feifei Ma Jian Zhang AAML SILM 143 15 0 21 Mar 2022
On Robust Prefix-Tuning for Text Classification Zonghan Yang Yang Liu VLM 103 21 0 19 Mar 2022
PRBoost: Prompt-Based Rule Discovery and Boosting for Interactive Weakly-Supervised Learning Rongzhi Zhang Yue Yu Pranav Shetty Le Song Chao Zhang 187 27 0 18 Mar 2022
ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detection Thomas Hartvigsen Saadia Gabriel Hamid Palangi Maarten Sap Dipankar Ray Ece Kamar 211 452 0 17 Mar 2022
How Many Data Samples is an Additional Instruction Worth? Ravsehaj Singh Puri Swaroop Mishra Mihir Parmar Chitta Baral 151 20 0 17 Mar 2022
RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extraction Yew Ken Chia Lidong Bing Soujanya Poria Luo Si 120 123 0 17 Mar 2022
Speaker Information Can Guide Models to Better Inductive Biases: A Case Study On Predicting Code-Switching Alissa Ostapenko S. Wintner Melinda Fricke Yulia Tsvetkov 120 5 0 16 Mar 2022
ConTinTin: Continual Learning from Task Instructions Wenpeng Yin Jia Li Caiming Xiong CLL 136 32 0 16 Mar 2022
Continuous Detection, Rapidly React: Unseen Rumors Detection based on Continual Prompt-Tuning Yuhui Zuo Wei Zhu Guoyong Cai CLL VLM 144 14 0 16 Mar 2022
Iteratively Prompt Pre-trained Language Models for Chain of Thought Boshi Wang Xiang Deng Huan Sun KELM ReLM LRM 215 114 0 16 Mar 2022
Multilingual Generative Language Models for Zero-Shot Cross-Lingual Event Argument Extraction Kuan-Hao Huang I-Hung Hsu Premkumar Natarajan Kai-Wei Chang Nanyun Peng 101 71 0 15 Mar 2022
Things not Written in Text: Exploring Spatial Commonsense from Visual Signals Xiao Liu Da Yin Yansong Feng Dongyan Zhao LRM 99 54 0 15 Mar 2022
Modular and Parameter-Efficient Multimodal Fusion with Prompting Sheng Liang Mengjie Zhao Hinrich Schütze 114 47 0 15 Mar 2022