Demystifying Prompts in Language Models via Perplexity Estimation

8 December 2022

Luke Zettlemoyer

Papers citing "Demystifying Prompts in Language Models via Perplexity Estimation"

50 / 141 papers shown

Title
Incomplete In-context Learning Wenqiang Wang Yangshijie Zhang 19 0 0 12 May 2025
Token-Efficient Prompt Injection Attack: Provoking Cessation in LLM Reasoning via Adaptive Token Compression Yu Cui Yujun Cai Y. Wang SILM AAML LRM 32 0 0 29 Apr 2025
E-InMeMo: Enhanced Prompting for Visual In-Context Learning Jiahao Zhang Bowen Wang Hong Liu Liangzhi Li Yuta Nakashima Hajime Nagahara VLM 99 0 0 25 Apr 2025
MDIT: A Model-free Data Interpolation Method for Diverse Instruction Tuning Yangning Li Zihua Lan Lv Qingsong Yinghui Li Hai-Tao Zheng 25 0 0 09 Apr 2025
Accelerating Particle-based Energetic Variational Inference Xuelian Bao Lulu Kang Chun Liu Yiwei Wang BDL 54 0 0 04 Apr 2025
Practical Poisoning Attacks against Retrieval-Augmented Generation Baolei Zhang Y. Chen Minghong Fang Zhuqing Liu Lihai Nie Tong Li Zheli Liu SILM AAML 52 0 0 04 Apr 2025
YaleNLP @ PerAnsSumm 2025: Multi-Perspective Integration via Mixture-of-Agents for Enhanced Healthcare QA Summarization Dongsuk Jang Alan Li Arman Cohan 27 0 0 04 Apr 2025
reWordBench: Benchmarking and Improving the Robustness of Reward Models with Transformed Inputs Zhaofeng Wu Michihiro Yasunaga Andrew Cohen Yoon Kim Asli Celikyilmaz Marjan Ghazvininejad 29 1 0 14 Mar 2025
DOVE: A Large-Scale Multi-Dimensional Predictions Dataset Towards Meaningful LLM Evaluation Eliya Habba Ofir Arviv Itay Itzhak Yotam Perlitz Elron Bandel Leshem Choshen Michal Shmueli-Scheuer Gabriel Stanovsky 59 1 0 03 Mar 2025
Same Question, Different Words: A Latent Adversarial Framework for Prompt Robustness Tingchen Fu Fazl Barez AAML 53 0 0 03 Mar 2025
Problem-Solving Logic Guided Curriculum In-Context Learning for LLMs Complex Reasoning Xuetao Ma Wenbin Jiang Hua Huang LRM 60 1 0 24 Feb 2025
PICASO: Permutation-Invariant Context Composition with State Space Models Tian Yu Liu Alessandro Achille Matthew Trager Aditya Golatkar L. Zancato Stefano Soatto LRM 55 0 0 24 Feb 2025
SimPER: A Minimalist Approach to Preference Alignment without Hyperparameters Teng Xiao Yige Yuan Z. Chen Mingxiao Li Shangsong Liang Z. Ren V. Honavar 90 5 0 21 Feb 2025
CER: Confidence Enhanced Reasoning in LLMs Ali Razghandi Seyed Mohsen Hosseini Mahdieh Soleymani Baghshah LRM 90 1 0 21 Feb 2025
D.Va: Validate Your Demonstration First Before You Use It Qi Zhang Zhiqing Xiao Ruixuan Xiao Lirong Gao Junbo Zhao 44 0 0 20 Feb 2025
Logical forms complement probability in understanding language model (and human) performance Yixuan Wang Freda Shi ReLM LRM 71 2 0 13 Feb 2025
Soup-of-Experts: Pretraining Specialist Models via Parameters Averaging Pierre Ablin Angelos Katharopoulos Skyler Seto David Grangier MoMe 45 0 0 03 Feb 2025
Topic-FlipRAG: Topic-Orientated Adversarial Opinion Manipulation Attacks to Retrieval-Augmented Generation Models Y. Gong Zhuo Chen Miaokun Chen Fengchang Yu Wei-Tsung Lu XiaoFeng Wang Xiaozhong Liu J. Liu AAML SILM 56 0 0 03 Feb 2025
ChatBug: A Common Vulnerability of Aligned LLMs Induced by Chat Templates Fengqing Jiang Zhangchen Xu Luyao Niu Bill Yuchen Lin Radha Poovendran SILM 61 5 0 08 Jan 2025
Citations and Trust in LLM Generated Responses Yifan Ding Matthew Facciani Amrit Poudel Ellen Joyce Salvador Aguiñaga Balaji Veeramani Sanmitra Bhattacharya Tim Weninger HILM 36 3 0 03 Jan 2025
A Reality Check on Context Utilisation for Retrieval-Augmented Generation Lovisa Hagström Sara Vera Marjanović Haeun Yu Arnav Arora Christina Lioma Maria Maistro Pepa Atanasova Isabelle Augenstein 70 0 0 22 Dec 2024
Smoothie: Label Free Language Model Routing Neel Guha Mayee F. Chen Trevor Chow Ishan S. Khare Christopher Ré 71 3 0 06 Dec 2024
Aligning Generalisation Between Humans and Machines Filip Ilievski Barbara Hammer F. V. Harmelen Benjamin Paassen S. Saralajew ... Vered Shwartz Gabriella Skitalinskaya Clemens Stachl Gido M. van de Ven T. Villmann 66 0 0 23 Nov 2024
Engagement-Driven Content Generation with Large Language Models Erica Coppolillo Federico Cinus Marco Minici Francesco Bonchi Giuseppe Manco 62 0 0 20 Nov 2024
Shortcut Learning in In-Context Learning: A Survey Rui Song Yingji Li Fausto Giunchiglia Fausto Giunchiglia Hao Xu 33 1 0 04 Nov 2024
Label Set Optimization via Activation Distribution Kurtosis for Zero-shot Classification with Generative Models Yue Li Zhixue Zhao Carolina Scarton 22 0 0 24 Oct 2024
Do LLMs "know" internally when they follow instructions? Juyeon Heo Christina Heinze-Deml Oussama Elachqar Shirley Ren Udhay Nallasamy Andy Miller Kwan Ho Ryan Chan Jaya Narain 44 3 0 18 Oct 2024
3DS: Decomposed Difficulty Data Selection's Case Study on LLM Medical Domain Adaptation Hongxin Ding Yue Fang Runchuan Zhu Xinke Jiang Jinyang Zhang Yongxin Xu Xu Chu Junfeng Zhao Yasha Wang 23 0 0 13 Oct 2024
Wrong-of-Thought: An Integrated Reasoning Framework with Multi-Perspective Verification and Wrong Information Yongheng Zhang Qiguang Chen Jingxuan Zhou Peng Wang Jiasheng Si Jin Wang Wenpeng Lu Libo Qin LRM 36 3 0 06 Oct 2024
GraphIC: A Graph-Based In-Context Example Retrieval Model for Multi-Step Reasoning Jiale Fu Yaqing Wang Simeng Han Jiaming Fan Chen Si 21 1 0 03 Oct 2024
What Is Wrong with My Model? Identifying Systematic Problems with Semantic Data Slicing Chenyang Yang Yining Hong Grace A. Lewis Tongshuang Wu Christian Kastner 36 1 0 14 Sep 2024
Enhancing Document-level Argument Extraction with Definition-augmented Heuristic-driven Prompting for LLMs Tongyue Sun Jiayi Xiao 25 0 0 30 Aug 2024
In-Context Learning with Reinforcement Learning for Incomplete Utterance Rewriting Haowei Du Dongyan Zhao RALM 22 0 0 23 Aug 2024
QPO: Query-dependent Prompt Optimization via Multi-Loop Offline Reinforcement Learning Yilun Kong Hangyu Mao Qi Zhao Bin Zhang Jingqing Ruan Li Shen Yongzhe Chang Xueqian Wang Rui Zhao Dacheng Tao OffRL 23 1 0 20 Aug 2024
When Raw Data Prevails: Are Large Language Model Embeddings Effective in Numerical Data Representation for Medical Machine Learning Applications? Yanjun Gao Skatje Myers Shan Chen Dmitriy Dligach Timothy A Miller Danielle S. Bitterman M. Churpek Majid Afshar 29 7 0 15 Aug 2024
Does Liking Yellow Imply Driving a School Bus? Semantic Leakage in Language Models Hila Gonen Terra Blevins Alisa Liu Luke Zettlemoyer Noah A. Smith 18 5 0 12 Aug 2024
Evaluating Language Model Math Reasoning via Grounding in Educational Curricula L. Lucy Tal August Rose E. Wang Luca Soldaini Courtney Allison Kyle Lo ReLM LRM 21 1 0 08 Aug 2024
Effective Demonstration Annotation for In-Context Learning via Language Model-Based Determinantal Point Process Peng Wang Xiaobin Wang Chao Lou Shengyu Mao Pengjun Xie Yong-jia Jiang 39 0 0 04 Aug 2024
Inductive or Deductive? Rethinking the Fundamental Reasoning Abilities of LLMs Kewei Cheng Jingfeng Yang Haoming Jiang Zhengyang Wang Binxuan Huang ... Zheng Li Yifan Gao Xian Li Bing Yin Yizhou Sun ELM LRM 22 1 0 31 Jul 2024
Improving Minimum Bayes Risk Decoding with Multi-Prompt David Heineman Yao Dou Wei-ping Xu 21 6 0 22 Jul 2024
Systematic Task Exploration with LLMs: A Study in Citation Text Generation Furkan Şahinuç Ilia Kuznetsov Yufang Hou Iryna Gurevych 19 3 0 04 Jul 2024
SADL: An Effective In-Context Learning Method for Compositional Visual QA Long Hoang Dang T. Le Vuong Le Tu Minh Phuong Truyen Tran ReLM CoGe 33 2 0 02 Jul 2024
Dynamic Few-Shot Learning for Knowledge Graph Question Answering Jacopo DÁbramo Andrea Zugarini Paolo Torroni 33 2 0 01 Jul 2024
On the Transformations across Reward Model, Parameter Update, and In-Context Prompt Deng Cai Huayang Li Tingchen Fu Siheng Li Weiwen Xu ... Leyang Cui Yan Wang Lemao Liu Taro Watanabe Shuming Shi KELM 26 2 0 24 Jun 2024
Token-based Decision Criteria Are Suboptimal in In-context Learning Hakaze Cho Yoshihiro Sakai Mariko Kato Kenshiro Tanaka Akira Ishii Naoya Inoue 27 2 0 24 Jun 2024
FamiCom: Further Demystifying Prompts for Language Models with Task-Agnostic Performance Estimation Bangzheng Li Ben Zhou Xingyu Fu Fei Wang Dan Roth Muhao Chen 16 0 0 17 Jun 2024
Deep Bayesian Active Learning for Preference Modeling in Large Language Models L. Melo P. Tigas Alessandro Abate Yarin Gal 29 8 0 14 Jun 2024
ConMe: Rethinking Evaluation of Compositional Reasoning for Modern VLMs Irene Huang Wei Lin M. Jehanzeb Mirza Jacob A. Hansen Sivan Doveh ... Trevor Darrel Chuang Gan Aude Oliva Rogerio Feris Leonid Karlinsky CoGe LRM 30 1 0 12 Jun 2024
On the Worst Prompt Performance of Large Language Models Bowen Cao Deng Cai Zhisong Zhang Yuexian Zou Wai Lam ALM LRM 17 5 0 08 Jun 2024
BERTs are Generative In-Context Learners David Samuel 19 5 0 07 Jun 2024