Demystifying Prompts in Language Models via Perplexity Estimation

8 December 2022

Luke Zettlemoyer

Papers citing "Demystifying Prompts in Language Models via Perplexity Estimation"

50 / 141 papers shown

Title
E-ICL: Enhancing Fine-Grained Emotion Recognition through the Lens of Prototype Theory Zhou Yang Zhou Yang Chenglong Ye Yufeng Wang Haizhou Sun Chao Chen Xiaofei Zhu Yunbing Wu Xiangwen Liao 47 0 0 04 Jun 2024
Exploring Vulnerabilities and Protections in Large Language Models: A Survey Frank Weizhen Liu Chenhui Hu AAML 25 7 0 01 Jun 2024
RAGSys: Item-Cold-Start Recommender as RAG System Emile Contal Garrin McGoldrick RALM 17 5 0 27 May 2024
On the Noise Robustness of In-Context Learning for Text Generation Hongfu Gao Feipeng Zhang Wenyu Jiang Jun Shu Feng Zheng Hongxin Wei 48 3 0 27 May 2024
Language Models can Exploit Cross-Task In-context Learning for Data-Scarce Novel Tasks Anwoy Chatterjee Eshaan Tanwar Subhabrata Dutta Tanmoy Chakraborty LRM 24 6 0 17 May 2024
General Purpose Verification for Chain of Thought Prompting Robert Vacareanu Anurag Pratik Evangelia Spiliopoulou Zheng Qi Giovanni Paolini Neha Ann John Jie Ma Yassine Benajiba Miguel Ballesteros LRM 19 6 0 30 Apr 2024
Exploring the Capability of LLMs in Performing Low-Level Visual Analytic Tasks on SVG Data Visualizations Zhongzhen Xu Emily Wall 25 9 0 29 Apr 2024
Talking Nonsense: Probing Large Language Models' Understanding of Adversarial Gibberish Inputs Valeriia Cherepanova James Zou AAML 28 4 0 26 Apr 2024
Sample Design Engineering: An Empirical Study of What Makes Good Downstream Fine-Tuning Samples for LLMs Biyang Guo He Wang Wenyilin Xiao Hong Chen Zhuxin Lee Songqiao Han Hailiang Huang 25 2 0 19 Apr 2024
Pack of LLMs: Model Fusion at Test-Time via Perplexity Optimization Costas Mavromatis Petros Karypis George Karypis MoMe 21 23 0 17 Apr 2024
Paraphrase and Solve: Exploring and Exploiting the Impact of Surface Form on Mathematical Reasoning in Large Language Models Yue Zhou Yada Zhu Diego Antognini Yoon Kim Yang Zhang ReLM LRM 16 3 0 17 Apr 2024
Compression Represents Intelligence Linearly Yuzhen Huang Jinghan Zhang Zifei Shan Junxian He 39 24 0 15 Apr 2024
Min-K%++: Improved Baseline for Detecting Pre-Training Data from Large Language Models Jingyang Zhang Jingwei Sun Eric C. Yeats Ouyang Yang Martin Kuo Jianyi Zhang Hao Frank Yang Hai Li 29 41 0 03 Apr 2024
Dissecting Paraphrases: The Impact of Prompt Syntax and supplementary Information on Knowledge Retrieval from Pretrained Language Models Stephan Linzbach Dimitar Dimitrov Laura Kallmeyer Kilian Evang Hajira Jabeen Stefan Dietze KELM 23 0 0 02 Apr 2024
IsoBench: Benchmarking Multimodal Foundation Models on Isomorphic Representations Deqing Fu Ghazal Khalighinejad Ollie Liu Bhuwan Dhingra Dani Yogatama Robin Jia W. Neiswanger 23 14 0 01 Apr 2024
Learning From Correctness Without Prompting Makes LLM Efficient Reasoner Yuxuan Yao Han Wu Zhijiang Guo Biyan Zhou Jiahui Gao Sichun Luo Hanxu Hou Xiaojin Fu Linqi Song LLMAG LRM 40 9 0 28 Mar 2024
A Survey on Large Language Models from Concept to Implementation Chen Wang Jin Zhao Jiaqi Gong LLMAG LM&MA 22 3 0 27 Mar 2024
Monotonic Paraphrasing Improves Generalization of Language Model Prompting Qin Liu Fei Wang Nan Xu Tianyi Yan Tao Meng Muhao Chen LRM 25 7 0 24 Mar 2024
Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttention Bin Gao Zhuomin He Puru Sharma Qingxuan Kang Djordje Jevdjic Junbo Deng Xingkun Yang Zhou Yu Pengfei Zuo 61 42 0 23 Mar 2024
Classist Tools: Social Class Correlates with Performance in NLP A. C. Curry Giuseppe Attanasio Zeerak Talat Dirk Hovy 25 3 0 07 Mar 2024
Causal Prompting: Debiasing Large Language Model Prompting based on Front-Door Adjustment Congzhi Zhang Linhai Zhang Jialong Wu Deyu Zhou Guoqiang Xu CML AI4CE LRM 44 15 0 05 Mar 2024
Formulation Comparison for Timeline Construction using LLMs Kimihiro Hasegawa Nikhil Kandukuri Susan Holm Yukari Yamakawa Teruko Mitamura 28 0 0 01 Mar 2024
Benchmarking zero-shot stance detection with FlanT5-XXL: Insights from training data, prompting, and decoding strategies into its near-SoTA performance Rachith Aiyappa Shruthi Senthilmani Jisun An Haewoon Kwak Yong-Yeol Ahn 19 3 0 01 Mar 2024
Crafting Knowledge: Exploring the Creative Mechanisms of Chat-Based Search Engines Lijia Ma Xingchen Xu Yong-Ming Tan 25 7 0 29 Feb 2024
Towards Unified Task Embeddings Across Multiple Models: Bridging the Gap for Prompt-Based Large Language Models and Beyond Xinyu Wang Hainiu Xu Lin Gui Yulan He MoMe AIFin 28 1 0 22 Feb 2024
The Impact of Demonstrations on Multilingual In-Context Learning: A Multidimensional Analysis Miaoran Zhang Vagrant Gautam Mingyang Wang Jesujoba Oluwadara Alabi Xiaoyu Shen Dietrich Klakow Marius Mosbach 36 8 0 20 Feb 2024
I Learn Better If You Speak My Language: Understanding the Superior Performance of Fine-Tuning Large Language Models with LLM-Generated Responses Xuan Ren Biao Wu Lingqiao Liu 25 5 0 17 Feb 2024
PoisonedRAG: Knowledge Poisoning Attacks to Retrieval-Augmented Generation of Large Language Models Wei Zou Runpeng Geng Binghui Wang Jinyuan Jia SILM 15 45 1 12 Feb 2024
Whispers in the Machine: Confidentiality in LLM-integrated Systems Jonathan Evertz Merlin Chlosta Lea Schonherr Thorsten Eisenhofer 69 15 0 10 Feb 2024
NICE: To Optimize In-Context Examples or Not? Pragya Srivastava Satvik Golechha Amit Deshpande Amit Sharma 22 4 0 09 Feb 2024
How do Large Language Models Learn In-Context? Query and Key Matrices of In-Context Heads are Two Towers for Metric Learning Zeping Yu Sophia Ananiadou 45 6 0 05 Feb 2024
Knowledge Generation for Zero-shot Knowledge-based VQA Rui Cao Jing Jiang 13 2 0 04 Feb 2024
GLaPE: Gold Label-agnostic Prompt Evaluation and Optimization for Large Language Model Xuanchang Zhang Zhuosheng Zhang Hai Zhao LRM ALM 19 2 0 04 Feb 2024
Large Language Model Evaluation via Matrix Entropy Lai Wei Zhiquan Tan Chenghai Li Jindong Wang Weiran Huang 20 5 0 30 Jan 2024
Security and Privacy Challenges of Large Language Models: A Survey B. Das M. H. Amini Yanzhao Wu PILM ELM 17 98 0 30 Jan 2024
Revisiting Demonstration Selection Strategies in In-Context Learning Keqin Peng Liang Ding Yancheng Yuan Xuebo Liu Min Zhang Y. Ouyang Dacheng Tao 19 20 0 22 Jan 2024
In-context Learning with Retrieved Demonstrations for Language Models: A Survey an Luo Xin Xu Yue Liu Panupong Pasupat Mehran Kazemi RALM 24 54 0 21 Jan 2024
AboutMe: Using Self-Descriptions in Webpages to Document the Effects of English Pretraining Data Filters L. Lucy Suchin Gururangan Luca Soldaini Emma Strubell David Bamman Lauren Klein Jesse Dodge 18 14 0 12 Jan 2024
State of What Art? A Call for Multi-Prompt LLM Evaluation Moran Mizrahi Guy Kaplan Daniel Malkin Rotem Dror Dafna Shahaf Gabriel Stanovsky ELM 10 123 0 31 Dec 2023
Lever LM: Configuring In-Context Sequence to Lever Large Vision Language Models Xu Yang Yingzhe Peng Haoxuan Ma Shuo Xu Chi Zhang Yucheng Han Hanwang Zhang 30 5 0 15 Dec 2023
Prompt Optimization via Adversarial In-Context Learning Do Xuan Long Yiran Zhao Hannah Brown Yuxi Xie James Xu Zhao Nancy F. Chen Kenji Kawaguchi Michael Qizhe Xie Junxian He 23 11 0 05 Dec 2023
How to Configure Good In-Context Sequence for Visual Question Answering Li Li Jiawei Peng Huiyi Chen Chongyang Gao Xu Yang MLLM 13 8 0 04 Dec 2023
MM-Narrator: Narrating Long-form Videos with Multimodal In-Context Learning Chaoyi Zhang K. Lin Zhengyuan Yang Jianfeng Wang Linjie Li Chung-Ching Lin Zicheng Liu Lijuan Wang VGen 16 28 0 29 Nov 2023
PEARL: Personalizing Large Language Model Writing Assistants with Generation-Calibrated Retrievers Sheshera Mysore Zhuoran Lu Mengting Wan Longqi Yang Steve Menezes Tina Baghaee Emmanuel Barajas Gonzalez Jennifer Neville Tara Safavi RALM 9 34 0 15 Nov 2023
Data Similarity is Not Enough to Explain Language Model Performance Gregory Yauney Emily Reif David M. Mimno 35 6 0 15 Nov 2023
Leveraging Multiple Teachers for Test-Time Adaptation of Language-Guided Classifiers Kangda Wei Sayan Ghosh Rakesh R Menon Shashank Srivastava 17 2 0 13 Nov 2023
How are Prompts Different in Terms of Sensitivity? Sheng Lu Hendrik Schuff Iryna Gurevych 29 17 0 13 Nov 2023
Instruct Me More! Random Prompting for Visual In-Context Learning Jiahao Zhang Bowen Wang Liangzhi Li Yuta Nakashima Hajime Nagahara VLM 20 15 0 07 Nov 2023
In-Context Exemplars as Clues to Retrieving from Large Associative Memory Jiachen Zhao 6 7 0 06 Nov 2023
The language of prompting: What linguistic properties make a prompt successful? Alina Leidinger R. Rooij Ekaterina Shutova 17 41 0 03 Nov 2023