Making AI Drafts Count: A Quality Threshold in Audio Description Workflows

• URL: http://arxiv.org/abs/2605.05348v1
• Date: Wed, 06 May 2026 18:18:15 GMT
• Title: Making AI Drafts Count: A Quality Threshold in Audio Description Workflows
• Abstract summary: Recent work has shown that giving novice describers an AI-generated draft to start from helps produce higher-quality AD.<n>We investigate this through GenAD, an AD generation pipeline that incorporates accessibility guidelines and contextual video information.<n>In a within-subjects study, we compared authoring from scratch against editing AI drafts of varying quality.
• Score: 4.174064443716107
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Audio description (AD) narrates visual elements in video for blind and low-vision audiences. Recent work has shown that giving novice describers an AI-generated draft to start from helps produce higher-quality AD and lowers the barrier to entry. What remains an open question is how draft quality shapes the editing process. We investigate this through GenAD, an AD generation pipeline that incorporates accessibility guidelines and contextual video information, and RefineAD, an editing interface for human revisions. Human-AI contributions are measured across text, timing, and delivery. In a within-subjects study, we compared authoring from scratch against editing AI drafts of varying quality. GenAD drafts cut completion time by more than half and significantly reduced cognitive load. In contrast, baseline drafts generated from simple, unguided prompts offered only modest benefits, pointing to a minimum quality threshold for effectiveness. Qualitative findings suggest this threshold is content-dependent; as visual complexity increases, so does the quality needed from AI drafts. We propose this as a design principle: effective AI assistance should clear a quality threshold suited to the target content, rather than simply be present.

Related papers

• What You See is What You Ask: Evaluating Audio Descriptions [27.76958202277314]
  We propose ADQA, a QA benchmark that evaluates ADs at the level of few-minute long, coherent video segments.<n>We show that current AD generation methods lag far behind human-authored ADs.
  arXiv  Detail & Related papers  (2025-10-01T12:14:15Z)
• CoCoNUTS: Concentrating on Content while Neglecting Uninformative Textual Styles for AI-Generated Peer Review Detection [60.52240468810558]
  We introduce CoCoNUTS, a content-oriented benchmark built upon a fine-grained dataset of AI-generated peer reviews.<n>We also develop CoCoDet, an AI review detector via a multi-task learning framework, to achieve more accurate and robust detection of AI involvement in review content.
  arXiv  Detail & Related papers  (2025-08-28T06:03:11Z)
• ArchiveGPT: A human-centered evaluation of using a vision language model for image cataloguing [0.0]
  This study examines whether Al-generated catalogue descriptions can approximate human-written quality.<n>A VLM (InternVL2) generated catalogue descriptions for photographic prints on labelled cardboard mounts with archaeological content.<n>Findings advocate for a collaborative approach where AI supports draft generation but remains subordinate to human verification.
  arXiv  Detail & Related papers  (2025-07-10T08:49:15Z)
• Shot-by-Shot: Film-Grammar-Aware Training-Free Audio Description Generation [110.79299467093006]
  We propose a two-stage framework that leverages "shots" as the fundamental units of video understanding.<n>This includes extending temporal context to neighbouring shots and incorporating film grammar devices, such as shot scales and thread structures.<n>Our method is compatible with both open-source and proprietary Visual-Language Models.
  arXiv  Detail & Related papers  (2025-04-01T17:59:57Z)
• AI-Generated Image Quality Assessment Based on Task-Specific Prompt and Multi-Granularity Similarity [62.00987205438436]
  We propose a novel quality assessment method for AIGIs named TSP-MGS. It designs task-specific prompts and measures multi-granularity similarity between AIGIs and the prompts. Experiments on the commonly used AGIQA-1K and AGIQA-3K benchmarks demonstrate the superiority of the proposed TSP-MGS.
  arXiv  Detail & Related papers  (2024-11-25T04:47:53Z)
• How Does the Disclosure of AI Assistance Affect the Perceptions of Writing? [29.068596156140913]
  We study whether and how the disclosure of the level and type of AI assistance in the writing process would affect people's perceptions of the writing. Our results suggest that disclosing the AI assistance in the writing process, especially if AI has provided assistance in generating new content, decreases the average quality ratings.
  arXiv  Detail & Related papers  (2024-10-06T16:45:33Z)
• Let's ViCE! Mimicking Human Cognitive Behavior in Image Generation Evaluation [96.74302670358145]
  We introduce an automated method for Visual Concept Evaluation (ViCE) to assess consistency between a generated/edited image and the corresponding prompt/instructions. ViCE combines the strengths of Large Language Models (LLMs) and Visual Question Answering (VQA) into a unified pipeline, aiming to replicate the human cognitive process in quality assessment.
  arXiv  Detail & Related papers  (2023-07-18T16:33:30Z)
• Active Learning for Abstractive Text Summarization [50.79416783266641]
  We propose the first effective query strategy for Active Learning in abstractive text summarization. We show that using our strategy in AL annotation helps to improve the model performance in terms of ROUGE and consistency scores.
  arXiv  Detail & Related papers  (2023-01-09T10:33:14Z)
• An Exploration of Post-Editing Effectiveness in Text Summarization [58.99765574294715]
  "Post-editing" AI-generated text reduces human workload and improves the quality of AI output. We compare post-editing provided summaries with manual summarization for summary quality, human efficiency, and user experience. This study sheds valuable insights on when post-editing is useful for text summarization.
  arXiv  Detail & Related papers  (2022-06-13T18:00:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.