ArtChart: A Benchmark for Faithful Artistic Chart Generation with Integrated Text Rendering
- URL: http://arxiv.org/abs/2607.16060v1
- Date: Fri, 17 Jul 2026 15:38:33 GMT
- Title: ArtChart: A Benchmark for Faithful Artistic Chart Generation with Integrated Text Rendering
- Abstract summary: ArtChart is a framework for artistic chart generation with integrated text rendering.<n>This paper introduces ArtChart, a framework for artistic chart generation with integrated text rendering.
- Score: 12.880601142154767
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Artistic charts make data memorable and visually engaging, but generating them faithfully demands simultaneously preserving numerical geometry, rendering exact in-image text, binding labels to correct marks, and maintaining coherent artistic style. Current text-to-image and image editing models frequently fail on these coupled constraints, producing distorted geometries, hallucinated text, misbound labels, or over-stylized marks that undermine readability and mathematical integrity. This paper introduces ArtChart, a framework for artistic chart generation with integrated text rendering, encompassing a task definition, benchmark, and evaluation protocol. This is the first work to simultaneously address mathematically faithful chart synthesis, accurate in-image text rendering, and artistic stylization of chart elements. ArtChart features a chart-specific plug-and-play module conditioned on text-free grayscale chart layouts, ensuring mathematical and logical fidelity. A RL learning strategy with OCR accuracy, layout quality, and aesthetic rewards refines generation, while a multi-expert distillation framework resolves inter-reward conflicts through specialized expert optimization. We construct ArtChart-Bench, a bilingual 2K-prompt benchmark spanning four chart types and diverse label formats. We further design ArtChart-Eval, a six-axis evaluation suite covering mathematical logic, text accuracy, text layout, aesthetics, instruction following, and readability, supporting comparison across T2I, image-editing, controllable-generation, and closed-source API models. Extensive experiments demonstrate that ArtChart consistently outperforms open-source baselines, producing charts that are both visually appealing and math faithful.
Related papers
- ChartAnno: Evaluating MLLMs for Chart Annotation Generation [32.95031991526117]
We introduce ChartAnno, a benchmark for evaluating MLLMs on chart annotation generation.<n>It contains 1,200 real-world charts with paired code and annotation instructions across three levels of instruction specificity.<n>Results show that proprietary models remain stronger overall, although large-scale open-source models narrow the gap.
arXiv Detail & Related papers (2026-08-04T11:01:38Z) - ChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats [31.5696204376104]
We introduce ChartArena, a comprehensive benchmark covering eight chart families spanning both numeric charts and diagrammatic structures.<n>The dataset is built via a human-agent annotation pipeline with multi-stage human verification to ensure annotation reliability.<n>We observe three consistent findings: (i) frontier models such as Gemini 3.1 Pro lead overall, yet the strongest open-source systems are rapidly closing the gap.
arXiv Detail & Related papers (2026-05-31T17:00:17Z) - Semantic-Structural Alignment for Generative Pictorial Charts [59.45629259524998]
We present a generative framework for the automated synthesis of pictorial charts.<n>We frame the problem as a dual-conditioned generation task guided by two parallel external control signals.<n>Our method produces pictorial charts that are both artistically compelling and structurally consistent.
arXiv Detail & Related papers (2026-05-05T05:20:46Z) - ChartMaster: Advancing Chart-to-Code Generation with Real-World Charts and Chart Similarity Reinforcement Learning [64.4193334712998]
The chart-to-code generation task requires MLLMs to convert chart images into executable code.<n>This task faces two main challenges: limited data diversity and the difficulty of maintaining visual consistency between generated charts and the original ones.<n>We propose ReChartPrompt, leveraging real-world, human-designed charts extracted from arXiv papers as prompts.<n>We also propose ChartSimRL, a GRPO-based reinforcement learning algorithm guided by a novel chart similarity reward.
arXiv Detail & Related papers (2025-08-25T02:32:56Z) - ChartLens: Fine-grained Visual Attribution in Charts [106.44872805609673]
Post-Hoc Visual Attribution for Charts identifies fine-grained chart elements that validate a given chart-associated response.<n>We propose ChartLens, a novel chart attribution algorithm that uses segmentation-based techniques to identify chart objects.<n>Our evaluations show that ChartLens improves fine-grained attributions by 26-66%.
arXiv Detail & Related papers (2025-05-25T23:17:32Z) - FACTUAL: A Benchmark for Faithful and Consistent Textual Scene Graph
Parsing [66.70054075041487]
Existing scene graphs that convert image captions into scene graphs often suffer from two types of errors.
First, the generated scene graphs fail to capture the true semantics of the captions or the corresponding images, resulting in a lack of faithfulness.
Second, the generated scene graphs have high inconsistency, with the same semantics represented by different annotations.
arXiv Detail & Related papers (2023-05-27T15:38:31Z) - ChartReader: A Unified Framework for Chart Derendering and Comprehension
without Heuristic Rules [89.75395046894809]
We present ChartReader, a unified framework that seamlessly integrates chart derendering and comprehension tasks.
Our approach includes a transformer-based chart component detection module and an extended pre-trained vision-language model for chart-to-X tasks.
Our proposed framework can significantly reduce the manual effort involved in chart analysis, providing a step towards a universal chart understanding model.
arXiv Detail & Related papers (2023-04-05T00:25:27Z) - FactGraph: Evaluating Factuality in Summarization with Semantic Graph
Representations [114.94628499698096]
We propose FactGraph, a method that decomposes the document and the summary into structured meaning representations (MRs)
MRs describe core semantic concepts and their relations, aggregating the main content in both document and summary in a canonical form, and reducing data sparsity.
Experiments on different benchmarks for evaluating factuality show that FactGraph outperforms previous approaches by up to 15%.
arXiv Detail & Related papers (2022-04-13T16:45:33Z) - Text2Chart: A Multi-Staged Chart Generator from Natural Language Text [0.3518016233072556]
Text2Chart takes natural language text as input and produce visualization as two-dimensional charts.
It identifies the axis elements of a chart from the given text known as x and y entities.
It generates a chart type suitable for the given text: bar, line or pie.
arXiv Detail & Related papers (2021-04-09T19:42:24Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.