Evaluating the State-of-the-Art of End-to-End Natural Language Generation: The E2E NLG Challenge

23 January 2019

Jekaterina Novikova

Papers citing "Evaluating the State-of-the-Art of End-to-End Natural Language Generation: The E2E NLG Challenge"

50 / 116 papers shown

Title
NoveltyBench: Evaluating Language Models for Humanlike Diversity Yiming Zhang Harshita Diddee Susan Holm Hanchen Liu Xinyue Liu Vinay Samuel Barry Wang Daphne Ippolito 29 1 0 07 Apr 2025
OpeNLGauge: An Explainable Metric for NLG Evaluation with Open-Weights LLMs Ivan Kartáč Mateusz Lango Ondrej Dusek ELM 49 1 0 14 Mar 2025
A Systematic Review of Open Datasets Used in Text-to-Image (T2I) Gen AI Model Safety Rakeen Rouf Trupti Bavalatti Osama Ahmed Dhaval Potdar Faraz Jawed EGVM 58 1 0 23 Feb 2025
DP-MemArc: Differential Privacy Transfer Learning for Memory Efficient Language Models Yanming Liu Xinyue Peng Yuwei Zhang Xiaolan Ke Songhang Deng ... Sheng Cheng Xun Wang Jianwei Yin Tianyu Du Xuhong Zhang 70 1 0 21 Feb 2025
M2R2: Mixture of Multi-Rate Residuals for Efficient Transformer Inference Nikhil Bhendawade Mahyar Najibi Devang Naik Irina Belousova MoE 85 0 0 04 Feb 2025
AmalREC: A Dataset for Relation Extraction and Classification Leveraging Amalgamation of Large Language Models Mansi Pranshu Pandya Mahek Bhavesh Vora Soumya Bharadwaj Ashish Anand 29 0 0 31 Dec 2024
An Extensive Evaluation of Factual Consistency in Large Language Models for Data-to-Text Generation Joy Mahapatra Utpal Garain HILM ALM 69 1 0 28 Nov 2024
Factors in Crowdsourcing for Evaluation of Complex Dialogue Systems Annalena Aicher Stefan Hillmann Isabel Feustel Thilo Michael Sebastian Möller Wolfgang Minker 32 0 0 17 Nov 2024
A Bayesian Approach to Data Point Selection Xinnuo Xu Minyoung Kim Royson Lee Brais Martínez Timothy M. Hospedales 33 0 0 06 Nov 2024
MALoRA: Mixture of Asymmetric Low-Rank Adaptation for Enhanced Multi-Task Learning Xujia Wang Haiyan Zhao Shuo Wang Hanqing Wang Zhiyuan Liu MoMe MoE 35 0 0 30 Oct 2024
Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologies L. Wang Sheng Chen Linnan Jiang Shu Pan Runze Cai Sen Yang Fei Yang 46 3 0 24 Oct 2024
Generative Subgraph Retrieval for Knowledge Graph-Grounded Dialog Generation Jinyoung Park Minseok Joo Joo-Kyung Kim H. Kim RALM 31 1 0 12 Oct 2024
Towards Understanding Multi-Task Learning (Generalization) of LLMs via Detecting and Exploring Task-Specific Neurons Yongqi Leng Deyi Xiong 34 5 0 09 Jul 2024
Themis: Towards Flexible and Interpretable NLG Evaluation Xinyu Hu Li Lin Mingqi Gao Xunjian Yin Xiaojun Wan ELM 34 6 0 26 Jun 2024
Modeling Comparative Logical Relation with Contrastive Learning for Text Generation Yuhao Dan Junfeng Tian Jie Zhou Ming Yan Ji Zhang Qin Chen Liang He 32 0 0 13 Jun 2024
ColA: Collaborative Adaptation with Gradient Learning Enmao Diao Qi Le Suya Wu Xinran Wang Ali Anwar Jie Ding Vahid Tarokh 22 1 0 22 Apr 2024
MAD Speech: Measures of Acoustic Diversity of Speech Matthieu Futeral A. Agostinelli Marco Tagliasacchi Neil Zeghidour Eugene Kharitonov 48 1 0 16 Apr 2024
Speculative Streaming: Fast LLM Inference without Auxiliary Models Nikhil Bhendawade Irina Belousova Qichen Fu Henry Mason Mohammad Rastegari Mahyar Najibi LRM 32 27 0 16 Feb 2024
C2Ideas: Supporting Creative Interior Color Design Ideation with Large Language Model Yihan Hou Manling Yang Hao Cui Lei Wang Jie Xu Wei Zeng 3DV LRM 29 24 0 23 Jan 2024
Beyond Traditional Benchmarks: Analyzing Behaviors of Open LLMs on Data-to-Text Generation Zdeněk Kasner Ondrej Dusek 33 8 0 18 Jan 2024
Unifying Structured Data as Graph for Data-to-Text Pre-Training Shujie Li Liang Li Ruiying Geng Min Yang Binhua Li ... Wanwei He Shao Yuan Can Ma Fei Huang Yongbin Li LMTD 28 13 0 02 Jan 2024
Compositional Generalization for Data-to-Text Generation Xinnuo Xu Ivan Titov Mirella Lapata 24 2 0 05 Dec 2023
Enhancing Task-Oriented Dialogues with Chitchat: a Comparative Study Based on Lexical Diversity and Divergence Armand Stricker P. Paroubek 27 1 0 23 Nov 2023
UniPCM: Universal Pre-trained Conversation Model with Task-aware Automatic Prompt Yucheng Cai Wentao Ma Yuchuan Wu Shuzheng Si Yuan Shao Zhijian Ou Yongbin Li 35 3 0 20 Sep 2023
Document Automation Architectures: Updated Survey in Light of Large Language Models Mohammad Ahmadi Achachlouei Omkar Patil Tarun Joshi V. Nair VLM AI4CE 29 2 0 18 Aug 2023
Few-Shot Data-to-Text Generation via Unified Representation and Multi-Source Learning A. Li Mingyue Shang Evangelia Spiliopoulou Jie Ma Patrick K. L. Ng ... William Yang Wang Kathleen McKeown Vittorio Castelli Dan Roth Bing Xiang 38 2 0 10 Aug 2023
In-Context Learning User Simulators for Task-Oriented Dialog Systems Silvia Terragni Modestas Filipavicius Nghia Khau Bruna Guedes A. Manso Roland Mathis 38 11 0 01 Jun 2023
Scaling Data-Constrained Language Models Niklas Muennighoff Alexander M. Rush Boaz Barak Teven Le Scao Aleksandra Piktus Nouamane Tazi S. Pyysalo Thomas Wolf Colin Raffel ALM 21 197 0 25 May 2023
Is GPT-4 a Good Data Analyst? Liying Cheng Xingxuan Li Lidong Bing LM&MA ELM 11 93 0 24 May 2023
Machine Reading Comprehension using Case-based Reasoning Dung Ngoc Thai Dhruv Agarwal Mudit Chaudhary Wenlong Zhao Rajarshi Das Manzil Zaheer J. Lee Hannaneh Hajishirzi Andrew McCallum 21 1 0 24 May 2023
Pruning Pre-trained Language Models with Principled Importance and Self-regularization Siyu Ren Kenny Q. Zhu 23 2 0 21 May 2023
Learning to Initialize: Can Meta Learning Improve Cross-task Generalization in Prompt Tuning? Chengwei Qin Q. Li Ruochen Zhao Shafiq R. Joty VLM LRM 21 15 0 16 Feb 2023
Is ChatGPT better than Human Annotators? Potential and Limitations of ChatGPT in Explaining Implicit Hate Speech Fan Huang Haewoon Kwak Jisun An AI4MH 11 252 0 11 Feb 2023
What Matters In The Structured Pruning of Generative Language Models? Michael Santacroce Zixin Wen Yelong Shen Yuan-Fang Li 18 32 0 07 Feb 2023
Contrastive Error Attribution for Finetuned Language Models Faisal Ladhak Esin Durmus Tatsunori Hashimoto HILM 25 9 0 21 Dec 2022
MURMUR: Modular Multi-Step Reasoning for Semi-Structured Data-to-Text Generation Swarnadeep Saha Xinyan Velocity Yu Mohit Bansal Ramakanth Pasunuru Asli Celikyilmaz ReLM LRM 17 10 0 16 Dec 2022
E2E Refined Dataset K. Toyama Katsuhito Sudoh Satoshi Nakamura 19 1 0 01 Nov 2022
Analyzing Multi-Task Learning for Abstractive Text Summarization Frederic Kirstein Jan Philip Wahle Terry Ruas Bela Gipp 17 4 0 26 Oct 2022
CAB: Comprehensive Attention Benchmarking on Long Sequence Modeling Jinchao Zhang Shuyang Jiang Jiangtao Feng Lin Zheng Lingpeng Kong 3DV 39 9 0 14 Oct 2022
Mind the Labels: Describing Relations in Knowledge Graphs With Pretrained Models Zdeněk Kasner Ioannis Konstas Ondrej Dusek 29 6 0 13 Oct 2022
Differentially Private Bias-Term Fine-tuning of Foundation Models Zhiqi Bu Yu-Xiang Wang Sheng Zha George Karypis 21 46 0 30 Sep 2022
The Whole Truth and Nothing But the Truth: Faithful and Controllable Dialogue Response Generation with Dataflow Transduction and Constrained Decoding Hao Fang Anusha Balakrishnan Harsh Jhamtani Jonathan Bufe J. Crawford Jayant Krishnamurthy Adam Pauls J. Eisner Jacob Andreas Dan Klein 16 5 0 16 Sep 2022
Chain of Explanation: New Prompting Method to Generate Higher Quality Natural Language Explanation for Implicit Hate Speech Fan Huang Haewoon Kwak Jisun An LRM 53 20 0 11 Sep 2022
GEMv2: Multilingual NLG Benchmarking in a Single Line of Code Sebastian Gehrmann Abhik Bhattacharjee Abinaya Mahendiran Alex Jinpeng Wang Alexandros Papangelis ... Yacine Jernite Yi Xu Yisi Sang Yixin Liu Yufang Hou 47 38 0 22 Jun 2022
KnowDA: All-in-One Knowledge Mixture Model for Data Augmentation in Low-Resource NLP Yufei Wang Jiayi Zheng Can Xu Xiubo Geng Tao Shen Chongyang Tao Daxin Jiang VLM MoE 15 2 0 21 Jun 2022
Automatic Clipping: Differentially Private Deep Learning Made Easier and Stronger Zhiqi Bu Yu-Xiang Wang Sheng Zha George Karypis 13 67 0 14 Jun 2022
Language Models are General-Purpose Interfaces Y. Hao Haoyu Song Li Dong Shaohan Huang Zewen Chi Wenhui Wang Shuming Ma Furu Wei MLLM 21 95 0 13 Jun 2022
Eliciting and Understanding Cross-Task Skills with Task-Level Mixture-of-Experts Qinyuan Ye Juan Zha Xiang Ren MoE 15 12 0 25 May 2022
Regularization-based Pruning of Irrelevant Weights in Deep Neural Architectures Giovanni Bonetta Matteo Ribero R. Cancelliere 14 6 0 11 Apr 2022
Neural Pipeline for Zero-Shot Data-to-Text Generation Zdeněk Kasner Ondrej Dusek 16 33 0 30 Mar 2022