T2LSC-Bench: Benchmarking Localized Semantic Control in Text-to-Image Generation

• URL: http://arxiv.org/abs/2609.02255v1
• Date: Wed, 02 Sep 2026 08:02:40 GMT
• Title: T2LSC-Bench: Benchmarking Localized Semantic Control in Text-to-Image Generation
• Abstract summary: In product labeling, signage, and interface design, target text should be rendered within a designated text-bearing region without altering the predefined subject identity or surrounding scene semantics.<n>Existing visual-text benchmarks evaluate readability, spelling accuracy, and layout, leaving this form of semantic leakage largely unexamined.<n>We introduce T2LSC-Bench, a controlled diagnostic benchmark comprising 50 seed subjects and 1,200 prompt cases per model, yielding 7,160 evaluated images across six models.<n>A dual-branch protocol combines OCR-VLM text verification with structured VLM semantic judgments to measure Text-at-Anchor Accuracy (TAA), Semantic Subject Preservation (
• Score: 30.939965668317967
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent text-to-image models have become increasingly capable of rendering explicit text, but reliable localized text control requires more than generating the correct string. In applications such as product labeling, signage, and interface design, target text should be rendered within a designated text-bearing region without altering the predefined subject identity or surrounding scene semantics. We refer to violations of this requirement as target-text-associated semantic leakage, in which target-text semantics are expressed through non-textual visual content beyond the designated anchor. Existing visual-text benchmarks primarily evaluate readability, spelling accuracy, and layout, leaving this form of semantic leakage largely unexamined. We introduce T2LSC-Bench, a controlled diagnostic benchmark comprising 50 seed subjects and 1,200 prompt cases per model, yielding 7,160 evaluated images across six models. Its factorized design varies semantic relation, scene openness, prompt mode, and language. A dual-branch protocol combines OCR-VLM text verification with structured VLM semantic judgments to measure Text-at-Anchor Accuracy (TAA), Semantic Subject Preservation (SSP), Semantic Leakage Rate (SLR), and Conditional Semantic Leakage Rate (cSLR). Under stress-test conditions, SLR increases from 1.2% to 18.1% and cSLR from 1.3% to 18.2%, whereas TAA decreases only from 91.4% to 90.9%. Anti-leakage prompting reduces SLR from 16.6% to 8.4% without degrading rendering accuracy. Human validation on 420 images shows strong agreement between automatic and adjudicated annotations. These results show that accurate text rendering does not guarantee local containment of target-text semantics.

Related papers

• Confidence-Aware Ensemble and Long-Word Refinement for Artistic Text Recognition [0.6303112417588329]
  Artistic Text Recognition (ATR) remains challenging because word images often combine decorative fonts, curved layouts, object-like characters, clutter, and severe distortions.<n>This paper studies WordArt-V1.5 as a standardized benchmark for this setting and evaluates recent scene and artistic text recognizers under a common protocol.<n>We propose a confidence-aware ensemble that combines SVTRv2, PARSeq, and MAERec after fine-tuning on the official training split.
  arXiv  Detail & Related papers  (2026-08-30T18:56:04Z)
• QuISE: Defense against Typographic Attacks on VLMs via Query-Irrelevant Semantic Editing [4.1436924146144944]
  Typographic attacks pose a critical threat to vision-language models.<n>QuISE is a model-agnostic, training-free black-box defense based on query-irrelevant semantic editing.
  arXiv  Detail & Related papers  (2026-08-13T11:47:50Z)
• Text as Partial Constraint: Core-Residual Alignment for Robust Vision-Language Learning [9.515040235138084]
  Vision-language alignment powers open-vocabulary recognition, retrieval, and LVLM grounding, yet natural captions are often underspecified.<n>We propose Text as Partial Constraint, a core-residual alignment framework that treats multi-view captions as incomplete supervision.<n>Across zero-shot recognition and adversarial robustness, TPC achieves 81.42/64.05 Top-1 clean/robust accuracy on ImageNet and 76.19/52.03 on an Avg-14 transfer suite.
  arXiv  Detail & Related papers  (2026-07-03T09:32:01Z)
• TextSculptor: Training and Benchmarking Scene Text Editing [88.11688559021628]
  We present TextSculptor, a comprehensive framework for data construction and evaluation of scene text editing.<n>TextSculptor improves open-source text editing performance and narrows the gap to proprietary models.
  arXiv  Detail & Related papers  (2026-05-20T12:22:26Z)
• KidsNanny: A Two-Stage Multimodal Content Moderation Pipeline Integrating Visual Classification, Object Detection, OCR, and Contextual Reasoning for Child Safety [0.0]
  We present KidsNanny, a two-stage multimodal content moderation architecture for child safety.<n>Stage 1 combines a vision transformer (ViT) with an object detector for visual screening (11.7 ms)<n>Stage 2 applies OCR and a text based 7B language model for contextual reasoning (120 ms total pipeline)<n>We evaluate on the UnsafeBench Sexual category (1,054 images) under two regimes: vision-only, isolating Stage 1, and multimodal, evaluating the full Stage 1+2 pipeline.
  arXiv  Detail & Related papers  (2026-03-17T07:00:43Z)
• ASemConsist: Adaptive Semantic Feature Control for Training-Free Identity-Consistent Generation [14.341691123354195]
  ASemconsist enables explicit semantic control over character identity without sacrificing prompt alignment.<n>Our framework achieves state-of-the-art performance, effectively overcoming prior trade-offs.
  arXiv  Detail & Related papers  (2025-12-29T07:06:57Z)
• TextGuider: Training-Free Guidance for Text Rendering via Attention Alignment [68.91073792449201]
  We propose TextGuider, a training-free method that encourages accurate and complete text appearance.<n>Specifically, we analyze attention patterns in Multi-Modal Diffusion Transformer(MM-DiT) models, particularly for text-related tokens intended to be rendered in the image.<n>Our method achieves state-of-the-art performance in test-time text rendering, with significant gains in recall and strong results in OCR accuracy and CLIP score.
  arXiv  Detail & Related papers  (2025-12-10T06:18:30Z)
• SemiETS: Integrating Spatial and Content Consistencies for Semi-Supervised End-to-end Text Spotting [59.14029549151904]
  We propose a new Semi-supervised framework for End-to-end Text Spotting, namely SemiETS.<n>Specifically, it gradually generates reliable hierarchical pseudo labels for each task, thereby reducing noisy labels.<n>It extracts important information in locations and transcriptions from bidirectional flows to improve consistency.
  arXiv  Detail & Related papers  (2025-04-14T08:09:17Z)
• TextFormer: A Query-based End-to-End Text Spotter with Mixed Supervision [61.186488081379]
  We propose TextFormer, a query-based end-to-end text spotter with Transformer architecture. TextFormer builds upon an image encoder and a text decoder to learn a joint semantic understanding for multi-task modeling. It allows for mutual training and optimization of classification, segmentation, and recognition branches, resulting in deeper feature sharing.
  arXiv  Detail & Related papers  (2023-06-06T03:37:41Z)
• Self-supervised Character-to-Character Distillation for Text Recognition [54.12490492265583]
  We propose a novel self-supervised Character-to-Character Distillation method, CCD, which enables versatile augmentations to facilitate text representation learning. CCD achieves state-of-the-art results, with average performance gains of 1.38% in text recognition, 1.7% in text segmentation, 0.24 dB (PSNR) and 0.0321 (SSIM) in text super-resolution.
  arXiv  Detail & Related papers  (2022-11-01T05:48:18Z)
• TAP: Text-Aware Pre-training for Text-VQA and Text-Caption [75.44716665758415]
  We propose Text-Aware Pre-training (TAP) for Text-VQA and Text-Caption tasks. TAP explicitly incorporates scene text (generated from OCR engines) in pre-training. Our approach outperforms the state of the art by large margins on multiple tasks.
  arXiv  Detail & Related papers  (2020-12-08T18:55:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.