v1v2v3v4v5 (latest)

Evaluating Creative Short Story Generation in Humans and Large Language Models

4 November 2024

Papers citing "Evaluating Creative Short Story Generation in Humans and Large Language Models"

35 / 35 papers shown

Title
NAMeGEn: Creative Name Generation via A Novel Agent-based Multiple Personalized Goal Enhancement Framework Shanlin Zhou Xinpeng Wang Jianxun Lian Zhenghao Liu L. Lakshmanan Xiaoyuan Yi Yongtao Hao LLMAG 314 0 0 19 Nov 2025
Evaluating Cultural Knowledge Processing in Large Language Models: A Cognitive Benchmarking Framework Integrating Retrieval-Augmented Generation Hung-Shin Lee Chen-Chi Chang Ching-Yuan Chen Yun-Hsiang Hsu 95 0 0 03 Nov 2025
CreativityPrism: A Holistic Benchmark for Large Language Model Creativity Zhaoyi Joey Hou Bowei Alvin Zhang Yining Lu Bhiman Kumar Baghel Anneliese Brei ... Faeze Brahman Snigdha Chaturvedi Haw-Shiuan Chang Daniel Khashabi Xiang Lorraine Li 128 0 0 23 Oct 2025
Evaluating LLM Story Generation through Large-scale Network Analysis of Social Structures Hiroshi Nonaka K. E. Perry 73 0 0 21 Oct 2025
Galton's Law of Mediocrity: Why Large Language Models Regress to the Mean and Fail at Creativity in Advertising Matt Keon Aabid Karim Bhoomika Lohana Abdul Karim Thai Nguyen Tara Hamilton Ali Abbas 96 0 0 30 Sep 2025
Aether Weaver: Multimodal Affective Narrative Co-Generation with Dynamic Scene Graphs Saeed Ghorbani VGen 137 0 0 29 Jul 2025
Has the Creativity of Large-Language Models peaked? An analysis of inter- and intra-LLM variability Jennifer Haase P. Hanel Sebastian Pokutta ALM LRM 261 5 0 10 Apr 2025
Learning to Reason for Long-Form Story Generation Alexander Gurung Mirella Lapata ReLM OffRL LRM 303 14 0 28 Mar 2025
Pencils to Pixels: A Systematic Study of Creative Drawings across Children, Adults and AI Surabhi S. Nath Guiomar del Cuvillo y Schröder Claire Stevenson 217 2 0 09 Feb 2025
Small Language Models can Outperform Humans in Short Creative Writing: A Study Comparing SLMs with Humans and LLMsInternational Conference on Computational Linguistics (COLING), 2024 Guillermo Marco Luz Rello Julio Gonzalo LM&MA ALM 273 22 0 17 Sep 2024
Pron vs Prompt: Can Large Language Models already Challenge a World-Class Fiction Author at Creative Text Writing? Guillermo Marco Julio Gonzalo Ramón del Castillo M. Girona 210 29 0 01 Jul 2024
LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks A. Bavaresco Raffaella Bernardi Leonardo Bertolazzi Desmond Elliott Raquel Fernández ... David Schlangen Alessandro Suglia Aditya K Surikuchi Ece Takmaz A. Testoni ALM ELM 559 164 0 26 Jun 2024
Do Language Models Enjoy Their Own Stories? Prompting Large Language Models for Automatic Story Evaluation Cyril Chhun Fabian M. Suchanek Chloé Clavel LRM 193 31 0 22 May 2024
Enhancing Creativity in Large Language Models through Associative Thinking Strategies Pronita Mehrotra Aishni Parab Sumit Gulwani LRM 172 11 0 09 May 2024
Creative Problem Solving in Large Language and Vision Models -- What Would it Take?Conference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Lakshmi Nair Evana Gizzi Jivko Sinapov MLLM 274 4 0 02 May 2024
Characterising the Creative Process in Humans and Large Language Models Surabhi S. Nath Peter Dayan Claire Stevenson 229 5 0 01 May 2024
Mechanistic Interpretability for AI Safety -- A Review Leonard Bereska E. Gavves AI4CE 304 279 0 22 Apr 2024
LLM Evaluators Recognize and Favor Their Own Generations Arjun Panickssery Samuel R. Bowman Shi Feng 309 333 0 15 Apr 2024
Humans or LLMs as the Judge? A Study on Judgement Biases Guiming Hardy Chen Shunian Chen Ziche Liu Feng Jiang Benyou Wang 459 188 0 16 Feb 2024
MacGyver: Are Large Language Models Creative Problem Solvers?North American Chapter of the Association for Computational Linguistics (NAACL), 2023 Yufei Tian Abhilasha Ravichander Lianhui Qin Ronan Le Bras Raja Marjieh Nanyun Peng Yejin Choi Thomas Griffiths Faeze Brahman AI4CE LLMAG 354 26 0 16 Nov 2023
Art or Artifice? Large Language Models and the False Promise of CreativityInternational Conference on Human Factors in Computing Systems (CHI), 2023 Tuhin Chakrabarty Philippe Laban Divyansh Agarwal Smaranda Muresan Chien-Sheng Wu 344 196 0 25 Sep 2023
Does Writing with Language Models Reduce Content Diversity?International Conference on Learning Representations (ICLR), 2023 Vishakh Padmakumar He He 357 133 0 11 Sep 2023
Towards General Text Embeddings with Multi-stage Contrastive Learning Zehan Li Xin Zhang Yanzhao Zhang Dingkun Long Pengjun Xie Meishan Zhang 340 673 0 07 Aug 2023
STORYWARS: A Dataset and Instruction Tuning Baselines for Collaborative Story Understanding and GenerationAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Yulun Du Lydia B. Chilton 170 9 0 14 May 2023
Can Large Language Models Be an Alternative to Human Evaluations?Annual Meeting of the Association for Computational Linguistics (ACL), 2023 Cheng-Han Chiang Hung-yi Lee ALM LM&MA 521 822 0 03 May 2023
G-Eval: NLG Evaluation using GPT-4 with Better Human AlignmentConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Yang Liu Dan Iter Yichong Xu Shuohang Wang Ruochen Xu Chenguang Zhu ELM ALM LM&MA 477 1,702 0 29 Mar 2023
ChatGPT Outperforms Crowd-Workers for Text-Annotation TasksProceedings of the National Academy of Sciences of the United States of America (PNAS), 2023 Fabrizio Gilardi Meysam Alizadeh M. Kubli AI4MH 444 1,188 0 27 Mar 2023
Visual Writing Prompts: Character-Grounded Story Generation with Curated Image SequencesTransactions of the Association for Computational Linguistics (TACL), 2023 Xudong Hong A. Sayeed K. Mehra Vera Demberg Bernt Schiele VGen 114 52 0 20 Jan 2023
Of Human Criteria and Automatic Metrics: A Benchmark of the Evaluation of Story GenerationInternational Conference on Computational Linguistics (COLING), 2022 Cyril Chhun Pierre Colombo Chloé Clavel Fabian M. Suchanek 500 67 0 24 Aug 2022
Putting GPT-3's Creativity to the (Alternative Uses) TestInternational Conference on Innovative Computing and Cloud Computing (ICCC), 2022 Claire E. Stevenson I. Smal M. Baas R. Grasman Han L. J. van der Maas 149 110 0 10 Jun 2022
Active Divergence with Generative Deep Learning -- A Survey and Taxonomy Terence Broad Sebastian Berns S. Colton M. Grierson AI4CE 115 26 0 12 Jul 2021
Plan-And-Write: Towards Better Automatic Storytelling Lili Yao Nanyun Peng R. Weischedel Kevin Knight Dongyan Zhao Rui Yan 271 439 0 14 Nov 2018
Hierarchical Neural Story Generation Angela Fan M. Lewis Yann N. Dauphin DiffM 527 1,817 0 13 May 2018
CAN: Creative Adversarial Networks, Generating "Art" by Learning About Styles and Deviating from Style Norms Ahmed Elgammal Bingchen Liu Mohamed Elhoseiny Marian Mazzone GAN 138 531 0 21 Jun 2017
Objective-Reinforced Generative Adversarial Networks (ORGAN) for Sequence Generation Models G. L. Guimaraes Benjamín Sánchez-Lengeling Carlos Outeiral Pedro Luis Cunha Farias Alán Aspuru-Guzik GAN 217 556 0 30 May 2017