Trustworthiness of Children Stories Generated by Large Language Models

• URL: http://arxiv.org/abs/2308.00073v1
• Date: Tue, 25 Jul 2023 22:55:51 GMT
• Title: Trustworthiness of Children Stories Generated by Large Language Models
• Authors: Prabin Bhandari and Hannah Marie Brennan
• Abstract summary: We evaluate the trustworthiness of children's stories generated by Large Language Models. Our findings suggest that LLMs still struggle to generate children's stories at the level of quality and nuance found in actual stories.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Large Language Models (LLMs) have shown a tremendous capacity for generating literary text. However, their effectiveness in generating children's stories has yet to be thoroughly examined. In this study, we evaluate the trustworthiness of children's stories generated by LLMs using various measures, and we compare and contrast our results with both old and new children's stories to better assess their significance. Our findings suggest that LLMs still struggle to generate children's stories at the level of quality and nuance found in actual stories

Related papers

• LLM Safety for Children [9.935219917903858]
  The study acknowledges the diverse nature of children often overlooked by standard safety evaluations. We develop Child User Models that reflect the varied personalities and interests of children informed by literature in child care and psychology.
  arXiv  Detail & Related papers  (2025-02-18T05:26:27Z)
• Benchmarking LLMs for Mimicking Child-Caregiver Language in Interaction [4.109949110722246]
  LLMs can generate human-like dialogues, yet their ability to simulate early child-adult interactions remains largely unexplored. We found that state-of-the-art LLMs can approximate child- caregiver dialogues at the word and utterance level, but they struggle to reproduce the child and caregiver's discursive patterns, exaggerate alignment, and fail to reach the level of diversity shown by humans.
  arXiv  Detail & Related papers  (2024-12-12T14:43:03Z)
• Are Large Language Models Capable of Generating Human-Level Narratives? [114.34140090869175]
  This paper investigates the capability of LLMs in storytelling, focusing on narrative development and plot progression. We introduce a novel computational framework to analyze narratives through three discourse-level aspects. We show that explicit integration of discourse features can enhance storytelling, as is demonstrated by over 40% improvement in neural storytelling.
  arXiv  Detail & Related papers  (2024-07-18T08:02:49Z)
• Creating Suspenseful Stories: Iterative Planning with Large Language Models [2.6923151107804055]
  We propose a novel iterative-prompting-based planning method that is grounded in two theoretical foundations of story suspense. To the best of our knowledge, this paper is the first attempt at suspenseful story generation with large language models.
  arXiv  Detail & Related papers  (2024-02-27T01:25:52Z)
• Improving Factual Consistency of News Summarization by Contrastive Preference Optimization [65.11227166319546]
  Large language models (LLMs) generate summaries that are factually inconsistent with original articles. These hallucinations are challenging to detect through traditional methods. We propose Contrastive Preference Optimization (CPO) to disentangle the LLMs' propensities to generate faithful and fake content.
  arXiv  Detail & Related papers  (2023-10-30T08:40:16Z)
• On the Automatic Generation and Simplification of Children's Stories [14.465545222216749]
  We first examine the ability of several popular large language models to generate stories with properly adjusted lexical and readability levels. As a second experiment, we explore the ability of state-of-the-art lexical simplification models to generalize to the domain of children's stories. We find that, while the strongest-performing current lexical simplification models do not perform as well on material designed for children due to their reliance on large language models behind the scenes.
  arXiv  Detail & Related papers  (2023-10-27T21:31:34Z)
• Language Models Hallucinate, but May Excel at Fact Verification [89.0833981569957]
  Large language models (LLMs) frequently "hallucinate," resulting in non-factual outputs. Even GPT-3.5 produces factual outputs less than 25% of the time. This underscores the importance of fact verifiers in order to measure and incentivize progress.
  arXiv  Detail & Related papers  (2023-10-23T04:39:01Z)
• Benchmarking Large Language Models for News Summarization [79.37850439866938]
  Large language models (LLMs) have shown promise for automatic summarization but the reasons behind their successes are poorly understood. We find instruction tuning, and not model size, is the key to the LLM's zero-shot summarization capability.
  arXiv  Detail & Related papers  (2023-01-31T18:46:19Z)
• The Next Chapter: A Study of Large Language Models in Storytelling [51.338324023617034]
  The application of prompt-based learning with large language models (LLMs) has exhibited remarkable performance in diverse natural language processing (NLP) tasks. This paper conducts a comprehensive investigation, utilizing both automatic and human evaluation, to compare the story generation capacity of LLMs with recent models. The results demonstrate that LLMs generate stories of significantly higher quality compared to other story generation models.
  arXiv  Detail & Related papers  (2023-01-24T02:44:02Z)
• MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Models [98.53511229517463]
  We propose a novel framework that uses large-scale language models and adds control to text generation by incorporating an external knowledge base. Our framework consists of a keyword predictor, a knowledge retriever, a contextual knowledge ranker, and a conditional text generator. The empirical results show that our model generates more fluent, consistent, and coherent stories with less repetition and higher diversity compared to prior work on the ROC story dataset.
  arXiv  Detail & Related papers  (2020-10-02T08:07:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.