How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation

25 March 2016

Papers citing "How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation"

20 / 220 papers shown

Title
Challenges in Data-to-Document Generation Sam Wiseman Stuart M. Shieber Alexander M. Rush 19 581 0 25 Jul 2017
Why We Need New Evaluation Metrics for NLG Jekaterina Novikova Ondrej Dusek A. C. Curry Verena Rieser 37 453 0 21 Jul 2017
Relevance of Unsupervised Metrics in Task-Oriented Dialogue for Evaluating Natural Language Generation Shikhar Sharma Layla El Asri Hannes Schulz Jeremie Zumer 26 220 0 29 Jun 2017
Deal or No Deal? End-to-End Learning for Negotiation Dialogues M. Lewis Denis Yarats Yann N. Dauphin Devi Parikh Dhruv Batra LLMAG 32 407 0 16 Jun 2017
Best of Both Worlds: Transferring Knowledge from Discriminative Learning to a Generative Visual Dialog Model Jiasen Lu A. Kannan Jianwei Yang Devi Parikh Dhruv Batra BDL 20 136 0 05 Jun 2017
A Deep Reinforced Model for Abstractive Summarization Romain Paulus Caiming Xiong R. Socher AI4TS 32 1,547 0 11 May 2017
A Conditional Variational Framework for Dialog Generation Xiaoyu Shen Hui Su Yanran Li Wenjie Li Shuzi Niu Yang Zhao Akiko Aizawa Guoping Long 22 115 0 30 Apr 2017
Learning Symmetric Collaborative Dialogue Agents with Dynamic Knowledge Graph Embeddings He He Anusha Balakrishnan Mihail Eric Percy Liang 27 199 0 24 Apr 2017
Being Negative but Constructively: Lessons Learnt from Creating Better Visual Question Answering Datasets Wei-Lun Chao Hexiang Hu Fei Sha 22 37 0 24 Apr 2017
Data Distillation for Controlling Specificity in Dialogue Generation Jiwei Li Will Monroe Dan Jurafsky 15 22 0 22 Feb 2017
A Knowledge-Grounded Neural Conversation Model Marjan Ghazvininejad Chris Brockett Ming-Wei Chang W. Dolan Jianfeng Gao Wen-tau Yih Michel Galley BDL 22 569 0 07 Feb 2017
Adversarial Learning for Neural Dialogue Generation Jiwei Li Will Monroe Tianlin Shi Sébastien Jean Alan Ritter Dan Jurafsky 18 897 0 23 Jan 2017
RUBER: An Unsupervised Method for Automatic Evaluation of Open-Domain Dialog Systems Chongyang Tao Lili Mou Dongyan Zhao Rui Yan 20 217 0 11 Jan 2017
A Simple, Fast Diverse Decoding Algorithm for Neural Generation Jiwei Li Will Monroe Dan Jurafsky 33 239 0 25 Nov 2016
GuessWhat?! Visual object discovery through multi-modal dialogue H. D. Vries Florian Strub A. Chandar Olivier Pietquin Hugo Larochelle Aaron Courville VLM 30 425 0 23 Nov 2016
Chinese Poetry Generation with Planning based Neural Network Zhe Wang Wei He Hua-Hong Wu Haiyang Wu Wei Li Haifeng Wang Enhong Chen 19 133 0 31 Oct 2016
An Attentional Neural Conversation Model with Improved Specificity Kaisheng Yao Baolin Peng Geoffrey Zweig Kam-Fai Wong 29 30 0 03 Jun 2016
Multiresolution Recurrent Neural Networks: An Application to Dialogue Response Generation Iulian Serban Tim Klinger Gerald Tesauro Kartik Talamadupula Bowen Zhou Yoshua Bengio Aaron Courville 11 190 0 02 Jun 2016
A Hierarchical Latent Variable Encoder-Decoder Model for Generating Dialogues Iulian Serban Alessandro Sordoni Ryan J. Lowe Laurent Charlin Joelle Pineau Aaron Courville Yoshua Bengio BDL 46 1,104 0 19 May 2016
On the Evaluation of Dialogue Systems with Next Utterance Classification Ryan J. Lowe Iulian Serban Michael Noseworthy Laurent Charlin Joelle Pineau ELM 13 66 0 18 May 2016