Papers citing 'How to Build User Simulators to Train RL-based Dialog Systems'

Title
SAGE: A Top-Down Bottom-Up Knowledge-Grounded User Simulator for Multi-turn AGent Evaluation Ryan Shea Yunan Lu Liang Qiu Zhou Yu LLMAG ELM 68 0 0 13 Oct 2025
Incorporating Expert Knowledge into Bayesian Causal Discovery of Mixtures of Directed Acyclic Graphs Zachris Björkman Jorge Loría S. Wharrie Samuel Kaski CML 102 1 0 08 Oct 2025
Fashion-AlterEval: A Dataset for Improved Evaluation of Conversational Recommendation Systems with Alternative Relevant ItemsACM Conference on Recommender Systems (RecSys), 2025 Maria Vlachou 116 2 0 24 Jul 2025
Know You First and Be You Better: Modeling Human-Like User Simulators via Implicit ProfilesAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Kuang Wang Xianrui Li Steve Yang Li Zhou Feng Jiang Haoyang Li 304 6 0 26 Feb 2025
Simulating User Agents for Embodied Conversational-AI Daniel Philipov Vardhan Dongre Gokhan Tur Dilek Hakkani-Tür LM&Ro 127 3 0 31 Oct 2024
Multi-trait User Simulation with Adaptive Decoding for Conversational Task AssistantsConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Rafael Ferreira David Semedo João Magalhães 150 4 0 16 Oct 2024
Strength Lies in Differences! Towards Effective Non-collaborative Dialogues via Tailored Strategy PlanningConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Tong Zhang Chen Huang Yang Deng Hongru Liang Jia-Wei Liu Zujie Wen Wenqiang Lei Tat-Seng Chua LLMAG 87 2 0 11 Mar 2024
Reliable LLM-based User Simulator for Task-Oriented Dialogue Systems Ivan Sekulić Silvia Terragni Victor Guimaraes Nghia Khau Bruna Guedes Modestas Filipavicius A. Manso Roland Mathis 117 13 0 20 Feb 2024
A Review of Reinforcement Learning for Natural Language Processing, and Applications in Healthcare Ying Liu Haozhu Wang Huixue Zhou Mingchen Li Yu Hou Sicheng Zhou Fang Wang Rama Hoetzlein Rui Zhang OffRL LM&MA 152 3 0 23 Oct 2023
It HAS to be Subjective: Human Annotator Simulation via Zero-shot Density Estimation Wen Wu Jiajun He Chuxu Zhang P. Woodland 149 1 0 30 Sep 2023
User Simulation with Large Language Models for Evaluating Task-Oriented Dialogue Sam Davidson Salvatore Romeo Raphael Shu James Gung Arshit Gupta Saab Mansour Yi Zhang ALM LLMAG 222 3 0 23 Sep 2023
Investigating Reinforcement Learning for Communication Strategies in a Task-Initiative Setting Baber Khalid Matthew Stone 142 1 0 03 Aug 2023
Prompt-Based Monte-Carlo Tree Search for Goal-Oriented Dialogue Policy PlanningConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Xiao Yu Maximillian Chen Zhou Yu LLMAG LM&Ro 277 59 0 23 May 2023
Human Choice Prediction in Language-based Persuasion Games: Simulation-based Off-Policy EvaluationTransactions of the Association for Computational Linguistics (TACL), 2023 Eilam Shapira Reut Apel Moshe Tennenholtz Roi Reichart Roi Reichart 335 3 0 17 May 2023
Learning to Simulate Natural Language Feedback for Interactive Semantic ParsingAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Hao Yan Saurabh Srivastava Yintao Tai Sida I. Wang Anuj Kumar Ziyu Yao 222 21 0 14 May 2023
Development of a Trust-Aware User Simulator for Statistical Proactive Dialog Modeling in Human-AI TeamsUser Modeling, Adaptation, and Personalization (UMAP), 2023 Matthias Kraus Ron Riekenbrauck Wolfgang Minker 122 4 0 24 Apr 2023
Reinforced Approximate Exploratory Data AnalysisAAAI Conference on Artificial Intelligence (AAAI), 2022 Shaddy Garg Subrata Mitra Tong Yu Yash Gadhia A. Kashettiwar 109 6 0 12 Dec 2022
ConvLab-3: A Flexible Dialogue System Toolkit Based on a Unified Data FormatConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Qi Zhu Christian Geishauser Hsien-Chin Lin Carel van Niekerk Baolin Peng ... Dazhen Wan Xiaochen Zhu Jianfeng Gao Milica Gavsić Shiyu Huang 213 30 0 30 Nov 2022
KRLS: Improving End-to-End Response Generation in Task Oriented Dialog with Reinforced Keywords LearningConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Xiao Yu Qingyang Wu Kun Qian Zhou Yu OffRL 182 12 0 30 Nov 2022
BotSIM: An End-to-End Bot Simulation Toolkit for Commercial Task-Oriented Dialog Systems Guangsen Wang Shafiq Joty Junnan Li Steven C. H. Hoi 103 1 0 29 Nov 2022
BotSIM: An End-to-End Bot Simulation Framework for Commercial Task-Oriented Dialog SystemsConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Guangsen Wang Samson Tan Shafiq Joty Ganglu Wu Jimmy Au Steven C. H. Hoi 207 3 0 22 Nov 2022
Is MultiWOZ a Solved Task? An Interactive TOD Evaluation Framework with User SimulatorConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Qinyuan Cheng Linyang Li Guofeng Quan Feng Gao Xiaofeng Mou Xipeng Qiu 150 18 0 26 Oct 2022
A Generative User Simulator with GPT-based Architecture and Goal State Tracking for Reinforced Multi-Domain Dialog Systems Hong Liu Yucheng Cai Zhijian Ou Yi Huang Junlan Feng ELM 131 5 0 17 Oct 2022
Jointly Reinforced User Simulator and Task-oriented Dialog System with Simplified Generative Architecture Abhishek Sethi Zhijian Ou Yi Huang Junlan Feng RALM 104 1 0 13 Oct 2022
Social Influence Dialogue Systems: A Survey of Datasets and Models For Social Influence TasksConference of the European Chapter of the Association for Computational Linguistics (EACL), 2022 Kushal Chawla Weiyan Shi Jingwen Zhang Gale M. Lucas Zhou Yu Jonathan Gratch 261 22 0 11 Oct 2022
LAD: Language Models as Data for Zero-Shot DialogSIGDIAL Conferences (SIGDIAL), 2022 Shikib Mehri Yasemin Altun M. Eskénazi 150 27 0 28 Jul 2022
A Challenge on Semi-Supervised and Reinforced Task-Oriented Dialog Systems Zhijian Ou Junlan Feng Juan-Zi Li Yakun Li Hong Liu Hao Peng Yi Huang Jiangjiang Zhao OffRL 143 10 0 06 Jul 2022
Learning as Conversation: Dialogue Systems Reinforced for Information AcquisitionNorth American Chapter of the Association for Computational Linguistics (NAACL), 2022 Pengshan Cai H. Wan Fei Liu Mo Yu Hong-ye Yu Sachindra Joshi 158 6 0 29 May 2022
Metaphorical User Simulators for Evaluating Task-oriented Dialogue Systems Weiwei Sun Shuyu Guo Shuo Zhang Sudipta Singha Roy Zhumin Chen Maarten de Rijke Zhaochun Ren ELM 201 7 0 02 Apr 2022
A Review of Dialogue Systems: From Trained Monkeys to Stochastic Parrots Atharv Singh Patlan Shiven Tripathi S. Korde OffRL 106 4 0 02 Nov 2021
Teaching Models new APIs: Domain-Agnostic Simulators for Task Oriented Dialogue Moya Chen Paul A. Crook Stephen Roller ALM 108 8 0 13 Oct 2021
Every time I fire a conversational designer, the performance of the dialog system goes downInternational Conference on Language Resources and Evaluation (LREC), 2021 Giancarlo A. Xompero Michele Mastromattei Samir Salman Cristina Giannone Andrea Favalli Raniero Romagnoli Fabio Massimo Zanzotto 96 0 0 27 Sep 2021
Two Approaches to Building Collaborative, Task-Oriented Dialog Agents through Self-Play Arkady Arkhangorodsky Scot Fang Victoria F. Knight Ajay Nagesh Maria Ryskina Kevin Knight LLMAG 96 0 0 20 Sep 2021
How to Evaluate Your Dialogue Models: A Review of Approaches Xinmeng Li Wansen Wu Long Qin Quanjun Yin ELM 95 10 0 03 Aug 2021
Domain-independent User Simulation with Transformers for Task-oriented Dialogue Systems Hsien-Chin Lin Nurul Lubis Songbo Hu Carel van Niekerk Christian Geishauser Michael Heck Shutong Feng Milica Gavsić 182 32 0 16 Jun 2021
High-Quality Diversification for Task-Oriented Dialogue SystemsFindings (Findings), 2021 Zhiwen Tang Hrishikesh Kulkarni Grace Hui Yang 179 11 0 02 Jun 2021
Designing an Automatic Agent for Repeated Language based Persuasion GamesTransactions of the Association for Computational Linguistics (TACL), 2021 Maya Raifer Guy Rotman Reut Apel Moshe Tennenholtz Roi Reichart 143 10 0 11 May 2021
Refine and Imitate: Reducing Repetition and Inconsistency in Persuasion Dialogues via Reinforcement Learning and Human DemonstrationConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Weiyan Shi Yu Li Saurav Sahay Zhou Yu OffRL 313 33 0 31 Dec 2020
Data-Efficient Methods for Dialogue Systems Igor Shalyminov 152 1 0 05 Dec 2020
Towards Emotion-Aware User Simulator for Task-Oriented Dialogue Rui Zhang Kai-Li Yin Li-Wei Li 242 2 0 19 Nov 2020
Conversational Semantic Parsing for Dialog State TrackingConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Jianpeng Cheng Devang Agrawal Héctor Martínez Alonso Shruti Bhargava Joris Driesen ... Dhivya Piraviperumal Jason D. Williams Hong-ye Yu Diarmuid Ó Séaghdha Anders Johannsen 328 65 0 24 Oct 2020
Multi-Agent Task-Oriented Dialog Policy Learning with Role-Aware Reward DecompositionAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Ryuichi Takanobu Runze Liang Shiyu Huang LLMAG 187 55 0 08 Apr 2020
Recent Advances and Challenges in Task-oriented Dialog SystemScience China Technological Sciences (Sci China Technol Sci), 2020 Zheng Zhang Ryuichi Takanobu Qi Zhu Shiyu Huang Xiaoyan Zhu LLMAG 415 195 0 17 Mar 2020
Effects of Persuasive Dialogues: Testing Bot Identities and Inquiry StrategiesInternational Conference on Human Factors in Computing Systems (CHI), 2020 Weiyan Shi Xuewei Wang Y. Oh Jingwen Zhang Saurav Sahay Zhou Yu 171 93 0 13 Jan 2020