Do Prompt-Based Models Really Understand the Meaning of their Prompts?

2 September 2021

Papers citing "Do Prompt-Based Models Really Understand the Meaning of their Prompts?"

50 / 254 papers shown

Title
Active Learning Principles for In-Context Learning with Large Language Models Katerina Margatina Timo Schick Nikolaos Aletras Jane Dwivedi-Yu 20 39 0 23 May 2023
In-Context Probing: Toward Building Robust Classifiers via Probing Large Language Models Afra Amini Massimiliano Ciaramita ReLM 17 1 0 23 May 2023
Towards Legally Enforceable Hate Speech Detection for Public Forums Chunyan Luo R. Bhambhoria Xiao-Dan Zhu Samuel Dahan AILaw 28 5 0 23 May 2023
Measuring Inductive Biases of In-Context Learning with Underspecified Demonstrations Chenglei Si Dan Friedman Nitish Joshi Shi Feng Danqi Chen He He 8 42 0 22 May 2023
Prompting is not a substitute for probability measurements in large language models Jennifer Hu R. Levy 22 36 0 22 May 2023
Automated Few-shot Classification with Instruction-Finetuned Language Models Rami Aly Xingjian Shi Kaixiang Lin Aston Zhang A. Wilson 19 9 0 21 May 2023
Solving NLP Problems through Human-System Collaboration: A Discussion-based Approach Masahiro Kaneko Graham Neubig Naoaki Okazaki 22 6 0 19 May 2023
Do Models Really Learn to Follow Instructions? An Empirical Study of Instruction Tuning Po-Nien Kung Nanyun Peng 12 46 0 19 May 2023
Symbol tuning improves in-context learning in language models Jerry W. Wei Le Hou Andrew Kyle Lampinen Xiangning Chen Da Huang ... Xinyun Chen Yifeng Lu Denny Zhou Tengyu Ma Quoc V. Le LRM 22 71 0 15 May 2023
Multilingual LLMs are Better Cross-lingual In-context Learners with Alignment Eshaan Tanwar Subhabrata Dutta Manish Borthakur Tanmoy Chakraborty 8 52 0 10 May 2023
Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Prompting Miles Turpin Julian Michael Ethan Perez Sam Bowman ReLM LRM 16 376 0 07 May 2023
In-context Learning as Maintaining Coherency: A Study of On-the-fly Machine Translation Using Large Language Models Suzanna Sia Kevin Duh LRM 18 17 0 05 May 2023
MLCopilot: Unleashing the Power of Large Language Models in Solving Machine Learning Tasks Lei Zhang Yuge Zhang Kan Ren Dongsheng Li Yuqing Yang LLMAG 17 35 0 28 Apr 2023
Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond Jingfeng Yang Hongye Jin Ruixiang Tang Xiaotian Han Qizhang Feng Haoming Jiang Bing Yin Xia Hu LM&MA 123 593 0 26 Apr 2023
Graph-ToolFormer: To Empower LLMs with Graph Reasoning Ability via Prompt Augmented by ChatGPT Jiawei Zhang LRM 18 76 0 10 Apr 2023
Eight Things to Know about Large Language Models Sam Bowman ALM 15 108 0 02 Apr 2023
Large Language Model Instruction Following: A Survey of Progresses and Challenges Renze Lou Kai Zhang Wenpeng Yin ALM LRM 21 19 0 18 Mar 2023
The Learnability of In-Context Learning Noam Wies Yoav Levine Amnon Shashua 114 89 0 14 Mar 2023
ChatGPT Participates in a Computer Science Exam Sebastian Bordt U. V. Luxburg ELM 13 40 0 08 Mar 2023
Larger language models do in-context learning differently Jerry W. Wei Jason W. Wei Yi Tay Dustin Tran Albert Webson ... Xinyun Chen Hanxiao Liu Da Huang Denny Zhou Tengyu Ma ReLM LRM 15 349 0 07 Mar 2023
Spelling convention sensitivity in neural language models Elizabeth Nielsen Christo Kirov Brian Roark 17 1 0 06 Mar 2023
Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following Seonghyeon Ye Hyeonbin Hwang Sohee Yang Hyeongu Yun Yireun Kim Minjoon Seo LRM 22 34 0 28 Feb 2023
Modular Deep Learning Jonas Pfeiffer Sebastian Ruder Ivan Vulić E. Ponti MoMe OOD 19 73 0 22 Feb 2023
Few-shot Multimodal Multitask Multilingual Learning Aman Chadha Vinija Jain 31 0 0 19 Feb 2023
Stabilized In-Context Learning with Pre-trained Language Models for Few Shot Dialogue State Tracking Derek Chen Kun Qian Zhou Yu 15 5 0 12 Feb 2023
Position Matters! Empirical Study of Order Effect in Knowledge-grounded Dialogue Hsuan Su Shachi H. Kumar Sahisnu Mazumder Wenda Chen R. Manuvinakurike Eda Okur Saurav Sahay L. Nachman Shang-Tse Chen Hung-yi Lee 18 3 0 12 Feb 2023
Evaluating the Robustness of Discrete Prompts Yoichi Ishibashi Danushka Bollegala Katsuhito Sudoh Satoshi Nakamura 13 18 0 11 Feb 2023
Is ChatGPT a General-Purpose Natural Language Processing Task Solver? Chengwei Qin Aston Zhang Zhuosheng Zhang Jiaao Chen Michihiro Yasunaga Diyi Yang LM&MA AI4MH LRM ELM 32 659 0 08 Feb 2023
Controlling Personality Style in Dialogue with Zero-Shot Prompt-Based Learning Angela Ramirez Mamon Alsalihy Kartik Aggarwal Cecilia Li Liren Wu M. Walker 12 13 0 08 Feb 2023
Language Quantized AutoEncoders: Towards Unsupervised Text-Image Alignment Hao Liu Wilson Yan Pieter Abbeel 26 24 0 02 Feb 2023
Large Language Models Can Be Easily Distracted by Irrelevant Context Freda Shi Xinyun Chen Kanishka Misra Nathan Scales David Dohan Ed H. Chi Nathanael Scharli Denny Zhou ReLM RALM LRM 28 522 0 31 Jan 2023
Are Language Models Worse than Humans at Following Prompts? It's Complicated Albert Webson A. Loo Qinan Yu Ellie Pavlick LRM 11 16 0 17 Jan 2023
SPT: Semi-Parametric Prompt Tuning for Multitask Prompted Learning M Saiful Bari Aston Zhang Shuai Zheng Xingjian Shi Yi Zhu Shafiq R. Joty Mu Li RALM VLM VPVLM LRM 27 5 0 21 Dec 2022
MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning Zhiyang Xu Ying Shen Lifu Huang MLLM 16 110 0 21 Dec 2022
Toward Human Readable Prompt Tuning: Kubrick's The Shining is a good movie, and a good prompt too? Weijia Shi Xiaochuang Han Hila Gonen Ari Holtzman Yulia Tsvetkov Luke Zettlemoyer 24 41 0 20 Dec 2022
Task Ambiguity in Humans and Language Models Alex Tamkin Kunal Handa Ava Shrestha Noah D. Goodman UQLM 21 22 0 20 Dec 2022
Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matters Boshi Wang Sewon Min Xiang Deng Jiaming Shen You Wu Luke Zettlemoyer Huan Sun LRM ReLM 32 219 0 20 Dec 2022
Cross-Lingual Retrieval Augmented Prompt for Low-Resource Languages Ercong Nie Sheng Liang Helmut Schmid Hinrich Schütze VLM RALM LRM 12 22 0 19 Dec 2022
Reasoning with Language Model Prompting: A Survey Shuofei Qiao Yixin Ou Ningyu Zhang Xiang Chen Yunzhi Yao Shumin Deng Chuanqi Tan Fei Huang Huajun Chen ReLM ELM LRM 44 307 0 19 Dec 2022
Language model acceptability judgements are not always robust to context Koustuv Sinha Jon Gauthier Aaron Mueller Kanishka Misra Keren Fuentes R. Levy Adina Williams 6 17 0 18 Dec 2022
CREPE: Can Vision-Language Foundation Models Reason Compositionally? Zixian Ma Jerry Hong Mustafa Omer Gul Mona Gandhi Irena Gao Ranjay Krishna CoGe 18 124 0 13 Dec 2022
Do Text-to-Text Multi-Task Learners Suffer from Task Conflict? David Mueller Nicholas Andrews Mark Dredze 31 6 0 13 Dec 2022
Despite "super-human" performance, current LLMs are unsuited for decisions about ethics and safety Joshua Albrecht Ellie Kitanidis Abraham J. Fetterman ELM ReLM ALM LRM 11 17 0 13 Dec 2022
Robustness of Learning from Task Instructions Jiasheng Gu Hongyu Zhao Hanzi Xu Liang Nie Hongyuan Mei Wenpeng Yin OOD 4 31 0 07 Dec 2022
Designing Ecosystems of Intelligence from First Principles Karl J. Friston M. Ramstead Alex B. Kiefer Alexander Tschantz Christopher L. Buckley ... K. Fung Jason G. Fox Steven Swanson D. Mapes Gabriel René 8 30 0 02 Dec 2022
Legal Prompting: Teaching a Language Model to Think Like a Lawyer Fang Yu Lee Quartey Frank Schilder ELM LRM 10 62 0 02 Dec 2022
TCBERT: A Technical Report for Chinese Topic Classification BERT Ting Han Kunhao Pan Xinyu Chen Dingjie Song Yuchen Fan Xinyu Gao Ruyi Gan Jiaxing Zhang VLM 17 1 0 21 Nov 2022
CCPrefix: Counterfactual Contrastive Prefix-Tuning for Many-Class Classification Y. Li Canran Xu Guodong Long Tao Shen Chongyang Tao Jing Jiang 28 1 0 11 Nov 2022
Measuring Reliability of Large Language Models through Semantic Consistency Harsh Raj Domenic Rosati S. Majumdar HILM 14 30 0 10 Nov 2022
Creative Writing with an AI-Powered Writing Assistant: Perspectives from Professional Writers Daphne Ippolito Ann Yuan Andy Coenen Sehmon Burnam 18 86 0 09 Nov 2022