(Why) Is My Prompt Getting Worse? Rethinking Regression Testing for
Evolving LLM APIs

(Why) Is My Prompt Getting Worse? Rethinking Regression Testing for Evolving LLM APIs

18 November 2023

Chenyang Yang

Christian Kastner

Papers citing "(Why) Is My Prompt Getting Worse? Rethinking Regression Testing for Evolving LLM APIs"

4 / 4 papers shown

Title
From Cool Demos to Production-Ready FMware: Core Challenges and a Technology Roadmap Gopi Krishnan Rajbahadur G. Oliva Dayi Lin Ahmed E. Hassan 39 0 0 28 Jan 2025
Prompts Are Programs Too! Understanding How Developers Build Software Containing Prompts Jenny T Liang Melissa Lin Nikitha Rao Brad A. Myers 66 5 0 19 Sep 2024
Toxicity Detection with Generative Prompt-based Inference Yau-Shian Wang Y. Chang 69 34 0 24 May 2022
Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity Yao Lu Max Bartolo Alastair Moore Sebastian Riedel Pontus Stenetorp AILaw LRM 274 882 0 18 Apr 2021