v1v2 (latest)

Do Prompt-Based Models Really Understand the Meaning of their Prompts?

2 September 2021

Papers citing "Do Prompt-Based Models Really Understand the Meaning of their Prompts?"

50 / 276 papers shown

Title
Larger language models do in-context learning differently Jerry W. Wei Jason W. Wei Yi Tay Dustin Tran Albert Webson ... Xinyun Chen Hanxiao Liu Da Huang Denny Zhou Tengyu Ma ReLM LRM 315 425 0 07 Mar 2023
Spelling convention sensitivity in neural language modelsFindings (Findings), 2023 Elizabeth Nielsen Christo Kirov Brian Roark 95 1 0 06 Mar 2023
Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction FollowingAAAI Conference on Artificial Intelligence (AAAI), 2023 Seonghyeon Ye Hyeonbin Hwang Sohee Yang Hyeongu Yun Yireun Kim Minjoon Seo LRM 206 46 0 28 Feb 2023
Modular Deep Learning Jonas Pfeiffer Sebastian Ruder Ivan Vulić Edoardo Ponti MoMe OOD 377 101 0 22 Feb 2023
Few-shot Multimodal Multitask Multilingual Learning Vasu Sharma Vinija Jain 187 0 0 19 Feb 2023
Stabilized In-Context Learning with Pre-trained Language Models for Few Shot Dialogue State TrackingFindings (Findings), 2023 Derek Chen Kun Qian Zhou Yu 158 11 0 12 Feb 2023
Position Matters! Empirical Study of Order Effect in Knowledge-grounded DialogueWorkshop on Document-grounded Dialogue and Conversational Question Answering (DialDoc), 2023 Hsuan Su Shachi H. Kumar Sahisnu Mazumder Wenda Chen R. Manuvinakurike Eda Okur Saurav Sahay L. Nachman Shang-Tse Chen Hung-yi Lee 100 4 0 12 Feb 2023
Evaluating the Robustness of Discrete PromptsConference of the European Chapter of the Association for Computational Linguistics (EACL), 2023 Yoichi Ishibashi Danushka Bollegala Katsuhito Sudoh Satoshi Nakamura 139 20 0 11 Feb 2023
Is ChatGPT a General-Purpose Natural Language Processing Task Solver?Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Chengwei Qin Aston Zhang Zhuosheng Zhang Jiaao Chen Michihiro Yasunaga Diyi Yang LM&MA AI4MH LRM ELM 315 781 0 08 Feb 2023
Controlling Personality Style in Dialogue with Zero-Shot Prompt-Based Learning Angela Ramirez Mamon Alsalihy Kartik Aggarwal Cecilia Li Liren Wu M. Walker 150 19 0 08 Feb 2023
Language Quantized AutoEncoders: Towards Unsupervised Text-Image AlignmentNeural Information Processing Systems (NeurIPS), 2023 Hao Liu Wilson Yan Pieter Abbeel 213 34 0 02 Feb 2023
Large Language Models Can Be Easily Distracted by Irrelevant ContextInternational Conference on Machine Learning (ICML), 2023 Freda Shi Xinyun Chen Kanishka Misra Nathan Scales David Dohan Ed H. Chi Nathanael Scharli Denny Zhou ReLM RALM LRM 548 782 0 31 Jan 2023
Are Language Models Worse than Humans at Following Prompts? It's ComplicatedConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Albert Webson A. Loo Qinan Yu Ellie Pavlick LRM 230 18 0 17 Jan 2023
SPT: Semi-Parametric Prompt Tuning for Multitask Prompted Learning M Saiful Bari Aston Zhang Shuai Zheng Xingjian Shi Yi Zhu Shafiq Joty Mu Li RALM VLM VPVLM LRM 175 5 0 21 Dec 2022
MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction TuningAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Zhiyang Xu Ying Shen Lifu Huang MLLM 270 132 0 21 Dec 2022
Toward Human Readable Prompt Tuning: Kubrick's The Shining is a good movie, and a good prompt too?Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Weijia Shi Xiaochuang Han Hila Gonen Ari Holtzman Yulia Tsvetkov Luke Zettlemoyer 169 56 0 20 Dec 2022
Task Ambiguity in Humans and Language Models Alex Tamkin Kunal Handa Ava Shrestha Noah D. Goodman UQLM 243 24 0 20 Dec 2022
Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What MattersAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Boshi Wang Sewon Min Xiang Deng Jiaming Shen You Wu Luke Zettlemoyer Huan Sun LRM ReLM 390 314 0 20 Dec 2022
Cross-Lingual Retrieval Augmented Prompt for Low-Resource LanguagesAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Ercong Nie Sheng Liang Helmut Schmid Hinrich Schütze VLM RALM LRM 351 25 0 19 Dec 2022
Reasoning with Language Model Prompting: A SurveyAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Shuofei Qiao Yixin Ou Ningyu Zhang Xiang Chen Yunzhi Yao Shumin Deng Chuanqi Tan Fei Huang Huajun Chen ReLM ELM LRM 587 382 0 19 Dec 2022
Language model acceptability judgements are not always robust to contextAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Koustuv Sinha Jon Gauthier Aaron Mueller Kanishka Misra Keren Fuentes R. Levy Adina Williams 193 19 0 18 Dec 2022
CREPE: Can Vision-Language Foundation Models Reason Compositionally?Computer Vision and Pattern Recognition (CVPR), 2022 Zixian Ma Jerry Hong Mustafa Omer Gul Mona Gandhi Irena Gao Ranjay Krishna CoGe 335 176 0 13 Dec 2022
Do Text-to-Text Multi-Task Learners Suffer from Task Conflict?Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022 David Mueller Nicholas Andrews Mark Dredze 206 8 0 13 Dec 2022
Despite "super-human" performance, current LLMs are unsuited for decisions about ethics and safety Joshua Albrecht Ellie Kitanidis Abraham J. Fetterman ELM ReLM ALM LRM 139 23 0 13 Dec 2022
Robustness of Learning from Task InstructionsAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Jiasheng Gu Hongyu Zhao Hanzi Xu Liang Nie Hongyuan Mei Wenpeng Yin OOD 328 41 0 07 Dec 2022
Designing Ecosystems of Intelligence from First PrinciplesCollective Intelligence (CI), 2022 Karl J. Friston M. Ramstead Alex B. Kiefer Alexander Tschantz Christopher L. Buckley ... K. Fung Jason G. Fox Steven Swanson D. Mapes Gabriel René 226 46 0 02 Dec 2022
Legal Prompting: Teaching a Language Model to Think Like a Lawyer Fang Yu Lee Quartey Frank Schilder ELM LRM 170 82 0 02 Dec 2022
TCBERT: A Technical Report for Chinese Topic Classification BERT Ting Han Kunhao Pan Xinyu Chen Dingjie Song Yuchen Fan Xinyu Gao Ruyi Gan Jiaxing Zhang VLM 105 1 0 21 Nov 2022
CCPrefix: Counterfactual Contrastive Prefix-Tuning for Many-Class ClassificationConference of the European Chapter of the Association for Computational Linguistics (EACL), 2022 Yongbin Li Canran Xu Guodong Long Tao Shen Chongyang Tao Jing Jiang 216 2 0 11 Nov 2022
Measuring Reliability of Large Language Models through Semantic Consistency Harsh Raj Domenic Rosati Subhabrata Majumdar HILM 194 37 0 10 Nov 2022
Creative Writing with an AI-Powered Writing Assistant: Perspectives from Professional Writers Daphne Ippolito Ann Yuan Andy Coenen Sehmon Burnam 189 118 0 09 Nov 2022
Large Language Models Are Human-Level Prompt EngineersInternational Conference on Learning Representations (ICLR), 2022 Yongchao Zhou Andrei Ioan Muresanu Ziwen Han Keiran Paster Silviu Pitis Harris Chan Jimmy Ba ALM LLMAG 393 1,134 0 03 Nov 2022
GPS: Genetic Prompt Search for Efficient Few-shot LearningConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Hanwei Xu Yujun Chen Yulun Du Nan Shao Yanggang Wang Haiyu Li Zhilin Yang VLM 131 46 0 31 Oct 2022
STPrompt: Semantic-guided and Task-driven prompts for Effective Few-shot Classification Jinta Weng Yue Hu Jing Qiu Heyan Huan VLM 115 0 0 29 Oct 2022
Can language models handle recursively nested grammatical structures? A case study on comparing models and humansComputational Linguistics (CL), 2022 Andrew Kyle Lampinen ReLM ELM 318 44 0 27 Oct 2022
MemoNet: Memorizing All Cross Features' Representations Efficiently via Multi-Hash Codebook Network for CTR PredictionInternational Conference on Information and Knowledge Management (CIKM), 2022 P. Zhang Junlin Zhang 135 5 0 25 Oct 2022
Communication breakdown: On the low mutual intelligibility between human and neural captioningConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Roberto Dessì Eleonora Gualdoni Francesca Franzon Gemma Boleda Marco Baroni VLM 278 5 0 20 Oct 2022
TabLLM: Few-shot Classification of Tabular Data with Large Language ModelsInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2022 S. Hegselmann Alejandro Buendia Hunter Lang Monica Agrawal Xiaoyi Jiang David Sontag LMTD 280 318 0 19 Oct 2022
Robustness of Demonstration-based Learning Under Limited Data ScenarioConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Hongxin Zhang Yanzhe Zhang Ruiyi Zhang Diyi Yang 215 15 0 19 Oct 2022
Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve ThemAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Mirac Suzgun Nathan Scales Nathanael Scharli Sebastian Gehrmann Yi Tay ... Aakanksha Chowdhery Quoc V. Le Ed H. Chi Denny Zhou Jason W. Wei ALM ELM LRM ReLM 482 1,497 0 17 Oct 2022
Language Models Are Poor Learners of Directional InferenceConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Tianyi Li Mohammad Javad Hosseini Sabine Weber Mark Steedman 241 11 0 10 Oct 2022
Automatic Chain of Thought Prompting in Large Language ModelsInternational Conference on Learning Representations (ICLR), 2022 Zhuosheng Zhang Aston Zhang Mu Li Alexander J. Smola ReLM LRM 416 826 0 07 Oct 2022
Achieving and Understanding Out-of-Distribution Generalization in Systematic Reasoning in Small-Scale Transformers A. Nam Mustafa Abdool Trevor C. Maxfield James L. McClelland NAI LRM AI4CE 151 3 0 07 Oct 2022
Efficiently Enhancing Zero-Shot Performance of Instruction Following Model via Retrieval of Soft PromptConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Seonghyeon Ye Joel Jang Doyoung Kim Yongrae Jo Minjoon Seo VLM 216 3 0 06 Oct 2022
Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot LearnersInternational Conference on Learning Representations (ICLR), 2022 Seonghyeon Ye Doyoung Kim Joel Jang Joongbo Shin Minjoon Seo FedML VLM UQCV LRM 371 25 0 06 Oct 2022
Explaining Patterns in Data with Language Models via Interpretable Autoprompting Chandan Singh John X. Morris J. Aneja Alexander M. Rush Jianfeng Gao LRM 143 0 0 04 Oct 2022
ThinkSum: Probabilistic reasoning over sets using large language modelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Batu Mehmet Ozturkler Nikolay Malkin Zhen Wang Nebojsa Jojic ReLM LRM 195 24 0 04 Oct 2022
Can Large Language Models Truly Understand Prompts? A Case Study with Negated Prompts Joel Jang Seonghyeon Ye Minjoon Seo ELM LRM 231 77 0 26 Sep 2022
Selecting Better Samples from Pre-trained LLMs: A Case Study on Question GenerationAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Xingdi Yuan Tong Wang Yen-Hsiang Wang Emery Fine Rania Abdelghani Pauline Lucas Hélene Sauzéon Pierre-Yves Oudeyer 236 34 0 22 Sep 2022
Shortcut Learning of Large Language Models in Natural Language UnderstandingCommunications of the ACM (CACM), 2022 Mengnan Du Fengxiang He Na Zou Dacheng Tao Helen Zhou KELM OffRL 342 108 0 25 Aug 2022

All Papers

Do Prompt-Based Models Really Understand the Meaning of their Prompts?

Papers citing "Do Prompt-Based Models Really Understand the Meaning of their Prompts?"