Thinking with Comics: Enhancing Multimodal Reasoning through Structured Visual Storytelling

• URL: http://arxiv.org/abs/2602.02453v2
• Date: Tue, 03 Feb 2026 03:37:14 GMT
• Title: Thinking with Comics: Enhancing Multimodal Reasoning through Structured Visual Storytelling
• Abstract summary: Thinking with Comics is a visual reasoning paradigm that uses comics as a high information-density medium positioned between images and videos.<n>Comics preserve temporal structure, embedded text, and narrative coherence while requiring significantly lower reasoning cost.
• Score: 25.305621689469444
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Chain-of-Thought reasoning has driven large language models to extend from thinking with text to thinking with images and videos. However, different modalities still have clear limitations: static images struggle to represent temporal structure, while videos introduce substantial redundancy and computational cost. In this work, we propose Thinking with Comics, a visual reasoning paradigm that uses comics as a high information-density medium positioned between images and videos. Comics preserve temporal structure, embedded text, and narrative coherence while requiring significantly lower reasoning cost. We systematically study two reasoning paths based on comics and evaluate them on a range of reasoning tasks and long-context understanding tasks. Experimental results show that Thinking with Comics outperforms Thinking with Images on multi-step temporal and causal reasoning tasks, while remaining substantially more efficient than Thinking with Video. Further analysis indicates that different comic narrative structures and styles consistently affect performance across tasks, suggesting that comics serve as an effective intermediate visual representation for improving multimodal reasoning.

Related papers

• Optical Reasoning: Rethinking Images as an Expressive Reasoning Medium Beyond Text [15.504855816862587]
  Chain-of-Thought (CoT) improves the performance of Large Language Models (LLMs) and has been extended to Multimodal Large Language Models (MLLMs)<n>We propose optical reasoning, which treats images as a standalone reasoning medium.
  arXiv  Detail & Related papers  (2026-06-08T14:58:59Z)
• UniVLR: Unifying Text and Vision in Visual Latent Reasoning for Multimodal LLMs [36.74593429466411]
  We propose a unified visual latent reasoning framework that treats textual reasoning and auxiliary visual evidence as a shared visual workspace.<n>We show that UniVLR outperforms prior visual latent reasoning methods while using substantially fewer generated reasoning tokens.
  arXiv  Detail & Related papers  (2026-05-12T09:40:03Z)
• LogiStory: A Logic-Aware Framework for Multi-Image Story Visualization [59.35938978648807]
  We propose a logic-aware multi-image story visualization framework, LogiStory.<n>The framework is built around the central innovation of explicitly modeling visual logic in story visualization.<n>This work provides a foundational step towards modeling and enforcing visual logic in general image sequence and video generation tasks.
  arXiv  Detail & Related papers  (2026-03-30T06:37:12Z)
• Chatting with Images for Introspective Visual Thinking [50.7747647794877]
  ''Chatting with images'' is a new framework that reframes visual manipulation as language-guided feature modulation.<n>Under the guidance of expressive language prompts, the model dynamically performs joint re-encoding over multiple image regions.<n>ViLaVT achieves strong and consistent improvements on complex multi-image and video-based spatial reasoning tasks.
  arXiv  Detail & Related papers  (2026-02-11T17:42:37Z)
• Mull-Tokens: Modality-Agnostic Latent Thinking [83.76982012426055]
  Mull-Tokens are modality-agnostic latent tokens pre-trained to hold intermediate information in either image or text modalities.<n>We demonstrate that Mull-Tokens improve upon several baselines utilizing text-only reasoning or interleaved image-text reasoning.
  arXiv  Detail & Related papers  (2025-12-11T18:59:08Z)
• ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoning [76.95203056566191]
  Multimodal reasoning requires iterative coordination between language and vision, yet it remains unclear what constitutes a meaningful interleaved chain of thought.<n>We build ThinkMorph, a unified model fine-tuned on approximately 24K high-quality interleaved reasoning traces spanning tasks with varying visual engagement.<n>ThinkMorph learns to generate progressive text-image reasoning steps that concretely manipulate visual content while maintaining coherent verbal logic.
  arXiv  Detail & Related papers  (2025-10-30T17:51:38Z)
• ComicScene154: A Scene Dataset for Comic Analysis [5.052646224667598]
  Comics offer a compelling yet under-explored domain for computational narrative analysis.<n>ComicScene154 is a dataset of scene-level narrative arcs derived from public-domain comic books spanning diverse genres.
  arXiv  Detail & Related papers  (2025-08-22T08:11:58Z)
• MiCo: Multi-image Contrast for Reinforcement Visual Reasoning [72.81576836419373]
  Chain-of-Thought (CoT) reasoning can be used to link visual cues across multiple images.<n>We adapt rule-based reinforcement learning for Vision-Language Models (VLMs)<n>Our method achieves significant improvements on multi-image reasoning benchmarks and shows strong performance on general vision tasks.
  arXiv  Detail & Related papers  (2025-06-27T17:59:27Z)
• VideoMathQA: Benchmarking Mathematical Reasoning via Multimodal Understanding in Videos [89.39873803375498]
  VideoMathQA is a benchmark designed to evaluate whether models can perform temporally extended cross-modal reasoning on videos.<n>The benchmark spans 10 diverse mathematical domains, covering videos ranging from 10 seconds to over 1 hour.<n>It requires models to interpret structured visual content, understand instructional narratives, and jointly ground concepts across visual, audio, and textual modalities.
  arXiv  Detail & Related papers  (2025-06-05T17:59:58Z)
• Structured Graph Representations for Visual Narrative Reasoning: A Hierarchical Framework for Comics [1.320904960556043]
  This paper presents a hierarchical knowledge graph framework for the structured understanding of visual narratives, focusing on comics.<n>It represents them through integrated knowledge graphs that capture semantic, spatial, and temporal relationships.<n>At the panel level, we construct multimodal graphs that link visual elements such as characters, objects, and actions with corresponding textual components, including dialogue and captions.
  arXiv  Detail & Related papers  (2025-04-14T14:42:19Z)
• One missing piece in Vision and Language: A Survey on Comics Understanding [13.766672321462435]
  This survey is the first to propose a task-oriented framework for comics intelligence.<n>It aims to guide future research by addressing critical gaps in data availability and task definition.
  arXiv  Detail & Related papers  (2024-09-14T18:26:26Z)
• Cracking the Code of Juxtaposition: Can AI Models Understand the Humorous Contradictions [16.23585043442914]
  This paper focuses on comics with contradictory narratives, where each comic consists of two panels that create a humorous contradiction. We introduce the YesBut benchmark, which comprises tasks of varying difficulty aimed at assessing AI's capabilities in recognizing and interpreting these comics. Our results show that even state-of-the-art models still lag behind human performance on this task.
  arXiv  Detail & Related papers  (2024-05-29T13:51:43Z)
• Dense Multitask Learning to Reconfigure Comics [63.367664789203936]
  We develop a MultiTask Learning (MTL) model to achieve dense predictions for comics panels. Our method can successfully identify the semantic units as well as the notion of 3D in comic panels.
  arXiv  Detail & Related papers  (2023-07-16T15:10:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.