Document Type
Conference Proceeding
Publication Date
2023
Publication Title
Proceedings of the 15th Conference on Creativity and Cognition (C&C ’23)
Abstract
Narrative story generation has gained emerging interest in the field of large language models. The present paper aims to compare stories generated by an LLM only (non-interleaved) with those generated by interleaving human-generated and LLM-generated text (interleaved). The study’s hypothesis is that interleaved stories would perform better than non-interleaved stories. To verify this hypothesis, we conducted two tests with roughly 500 participants each. Participants were asked to rate stories of each type, including an overall score or preference and four facets—logical soundness, plausibility, understandability, and novelty. Our findings indicate that interleaved stories were in fact less preferred than non-interleaved stories. The result has implications for the design and implementation of our story generators. This study contributes new insights into the potential uses and restrictions of interleaved and non-interleaved systems regarding generating narrative stories, which may help to improve the performance of such story generators.
Keywords
Story generator, neural networks, gaze detection, text tagging
Recommended Citation
Zhao, Zoie; Song, Sophie; Duah, Bridget; Macbeth, Jamie C.; Carter, Scott; Van, Monica; Bravo, Nayeli; Klenk, Matthew; Sieck, Katherine; and Filipowicz, Alexandre, "More Human than Human: LLM-Generated Narratives Outperform Human-LLM Interleaved Narratives" (2023). Computer Science: Faculty Publications, Smith College, Northampton, MA.
https://scholarworks.smith.edu/csc_facpubs/393
Comments
Archived as published.
Proceedings of the 15th Conference on Creativity and Cognition (C&C ’23), Gather, June 19-21, 2023.