Approximating Interactive Human Evaluation with Self-Play for Open-Domain Dialog Systems

21 June 2019

Papers citing "Approximating Interactive Human Evaluation with Self-Play for Open-Domain Dialog Systems"

27 / 27 papers shown

Title
Online vs Offline: A Comparative Study of First-Party and Third-Party Evaluations of Social Chatbots Ekaterina Svikhnushina Pearl Pu 29 0 0 12 Sep 2024
Multi-Granularity Prompts for Topic Shift Detection in Dialogue Jian-Dong Lin Yaxin Fan Xiaomin Chu Peifeng Li Qiaoming Zhu 22 5 0 23 May 2023
Topic Shift Detection in Chinese Dialogues: Corpus and Benchmark Jian-Dong Lin Yaxin Fan Feng Jiang Xiaomin Chu Peifeng Li 37 4 0 02 May 2023
PoE: a Panel of Experts for Generalized Automatic Dialogue Assessment Chen Zhang L. F. D’Haro Qiquan Zhang Thomas Friedrichs Haizhou Li 33 7 0 18 Dec 2022
Bipartite-play Dialogue Collection for Practical Automatic Evaluation of Dialogue Systems Shiki Sato Yosuke Kishinami Hiroaki Sugiyama Reina Akama Ryoko Tokuhisa Jun Suzuki 21 2 0 19 Nov 2022
EnDex: Evaluation of Dialogue Engagingness at Scale Guangxuan Xu Ruibo Liu Fabrice Harel-Canada Nischal Reddy Chandra Nanyun Peng 21 5 0 22 Oct 2022
A Mixture-of-Expert Approach to RL-based Dialogue Management Yinlam Chow Azamat Tulepbergenov Ofir Nachum Moonkyung Ryu Mohammad Ghavamzadeh Craig Boutilier MoE 25 14 0 31 May 2022
Achieving Conversational Goals with Unsupervised Post-hoc Knowledge Injection Bodhisattwa Prasad Majumder Harsh Jhamtani Taylor Berg-Kirkpatrick Julian McAuley 36 8 0 22 Mar 2022
A Literature Survey of Recent Advances in Chatbots Guendalina Caldarini Sardar F. Jaf K. McGarry AI4CE 40 274 0 17 Jan 2022
OpenViDial 2.0: A Larger-Scale, Open-Domain Dialogue Generation Dataset with Visual Contexts Shuhe Wang Yuxian Meng Xiaoya Li Xiaofei Sun Rongbin Ouyang Jiwei Li MLLM VLM 32 21 0 27 Sep 2021
How to Evaluate Your Dialogue Models: A Review of Approaches Xinmeng Li Wansen Wu Long Qin Quanjun Yin ELM 30 8 0 03 Aug 2021
DynaEval: Unifying Turn and Dialogue Level Evaluation Chen Zhang Yiming Chen L. F. D’Haro Yan Zhang Thomas Friedrichs Grandee Lee Haizhou Li 24 73 0 02 Jun 2021
Nearly Horizon-Free Offline Reinforcement Learning Tongzheng Ren Jialian Li Bo Dai S. Du Sujay Sanghavi OffRL 32 49 0 25 Mar 2021
Advances and Challenges in Conversational Recommender Systems: A Survey Chongming Gao Wenqiang Lei Xiangnan He Maarten de Rijke Tat-Seng Chua 138 273 0 23 Jan 2021
OpenViDial: A Large-Scale, Open-Domain Dialogue Dataset with Visual Contexts Yuxian Meng Shuhe Wang Qinghong Han Xiaofei Sun Fei Wu Rui Yan Jiwei Li 29 28 0 30 Dec 2020
Collaborative Storytelling with Large-scale Neural Language Models Eric Nichols Leo Gao R. Gomez 29 43 0 20 Nov 2020
Human-centric Dialog Training via Offline Reinforcement Learning Natasha Jaques J. Shen Asma Ghandeharioun Craig Ferguson Àgata Lapedriza Noah J. Jones S. Gu Rosalind W. Picard OffRL 40 93 0 12 Oct 2020
A Survey of Evaluation Metrics Used for NLG Systems Ananya B. Sai Akash Kumar Mohankumar Mitesh M. Khapra ELM 33 230 0 27 Aug 2020
Open-Domain Conversational Agents: Current Progress, Open Problems, and Future Directions Stephen Roller Y-Lan Boureau Jason Weston Antoine Bordes Emily Dinan ... Kurt Shuster Eric Michael Smith Arthur Szlam Jack Urbanek Mary Williamson LLMAG AI4CE 28 51 0 22 Jun 2020
Towards Unified Dialogue System Evaluation: A Comprehensive Analysis of Current Evaluation Protocols Sarah E. Finch Jinho Choi ELM 29 67 0 10 Jun 2020
Probing Neural Dialog Models for Conversational Understanding Abdelrhman Saleh Tovly Deutsch Stephen Casper Yonatan Belinkov Stuart M. Shieber 21 13 0 07 Jun 2020
XPersona: Evaluating Multilingual Personalized Chatbot Zhaojiang Lin Zihan Liu Genta Indra Winata Samuel Cahyawijaya Andrea Madotto Yejin Bang Etsuko Ishii Pascale Fung 50 57 0 17 Mar 2020
Towards a Human-like Open-Domain Chatbot Daniel De Freitas Minh-Thang Luong David R. So Jamie Hall Noah Fiedel ... Zi Yang Apoorv Kulshreshtha Gaurav Nemade Yifeng Lu Quoc V. Le 42 924 0 27 Jan 2020
Automatic Reminiscence Therapy for Dementia Mariona Carós M. Garolera Petia Radeva Xavier Giró-i-Nieto 27 40 0 25 Oct 2019
Hierarchical Reinforcement Learning for Open-Domain Dialog Abdelrhman Saleh Natasha Jaques Asma Ghandeharioun J. Shen Rosalind W. Picard OffRL 14 59 0 17 Sep 2019
ACUTE-EVAL: Improved Dialogue Evaluation with Optimized Questions and Multi-turn Comparisons Margaret Li Jason Weston Stephen Roller 31 176 0 06 Sep 2019
Deep Reinforcement Learning for Dialogue Generation Jiwei Li Will Monroe Alan Ritter Michel Galley Jianfeng Gao Dan Jurafsky 220 1,328 0 05 Jun 2016