Text-based Tactile Graphics Generation for the Visually Impaired

• URL: http://arxiv.org/abs/2607.22674v1
• Date: Fri, 10 Jul 2026 03:04:30 GMT
• Title: Text-based Tactile Graphics Generation for the Visually Impaired
• Abstract summary: Tactile graphics are a primary medium for blind and low-vision (BLV) individuals to access non-textual information.<n>We present the first integrated generative system that produces fabrication-ready 2.5D tactile graphics directly from natural language prompts.
• Score: 51.53004839882403
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Tactile graphics are a primary medium for blind and low-vision (BLV) individuals to access non-textual information. However, they are difficult to scale or personalize. While recent generative models have revolutionized visual content creation, they are optimized for screen-based visual realism and fail to satisfy the haptic perceptual and physical fabrication constraints required for touch. We present the first integrated generative system that produces fabrication-ready 2.5D tactile graphics directly from natural language prompts, jointly generating global base geometry, fine-grained tactile surface textures, and standard-compliant braille within a unified 3D-printable representation. Our approach introduces fabrication-aware techniques, including template-guided relief generation, a fast diffusion-based text-to-texture module for high-resolution tileable normal maps, and strict base flattening to ensure tactile readability and printability, while supporting both automatic generation and interactive texture control. Extensive evaluations, together with in-person user studies with BLV participants and blindfolded sighted participants using physically 3D-printed outputs, show that participants consistently prefer our results over baselines. By extending generative graphics beyond screens to touchable reliefs, our work broadens access to generative AI for the BLV community and beyond.

Related papers

• Text-Image Conditioned 3D Generation [71.98375600100856]
  TIGON is a minimalist dual-branch baseline with separate image- and text-conditioned backbones and lightweight cross-modal fusion.<n>Our diagnostic study shows that even simple late fusion of text- and image-conditioned predictions outperforms single-modality models.<n>Extensive experiments show that text-image conditioning consistently improves over single-modality methods.
  arXiv  Detail & Related papers  (2026-03-22T15:36:16Z)
• LaFiTe: A Generative Latent Field for 3D Native Texturing [72.05710323154288]
  Existing native approaches are sparse by the absence of a powerful and versatile representation, which severely limits the fidelity and generality of their generated textures.<n>We introduce LaFiTe, which generates high-quality textures constrained by a sparse color representation and UV parameterization.
  arXiv  Detail & Related papers  (2025-12-04T13:33:49Z)
• A Scalable Attention-Based Approach for Image-to-3D Texture Mapping [3.8476192001237597]
  High-quality textures are critical for realistic 3D content creation.<n>Existing generative methods are slow, rely on UV maps, and often fail to remain faithful to a reference image.<n>We propose a transformer-based framework that predicts a 3D texture field directly from a single image and a mesh.
  arXiv  Detail & Related papers  (2025-09-05T14:18:52Z)
• SMPL-GPTexture: Dual-View 3D Human Texture Estimation using Text-to-Image Generation Models [7.436391283592317]
  SMPL-GPTexture is a novel pipeline that takes natural language prompts as input and leverages a state-of-the-art text-to-image generation model.<n>We show that our pipeline can generate high resolution texture aligned with user's prompts.
  arXiv  Detail & Related papers  (2025-04-17T23:28:38Z)
• TactileNet: Bridging the Accessibility Gap with AI-Generated Tactile Graphics for Individuals with Vision Impairment [5.627346969563955]
  Tactile graphics are essential for providing access to visual information for 43 million people globally living with vision loss.<n>Traditional methods for creating these graphics are labor-intensive and cannot meet growing demand.<n>We introduce TactileNet, the first comprehensive dataset and AI-driven framework for generating embossing-ready 2D tactile templates.
  arXiv  Detail & Related papers  (2025-04-07T04:21:31Z)
• InsTex: Indoor Scenes Stylized Texture Synthesis [81.12010726769768]
  High-quality textures are crucial for 3D scenes for augmented/virtual reality (ARVR) applications.<n>Current methods suffer from lengthy processing times and visual artifacts.<n>We introduce two-stage architecture designed to generate high-quality textures for 3D scenes.
  arXiv  Detail & Related papers  (2025-01-22T08:37:59Z)
• Tactile DreamFusion: Exploiting Tactile Sensing for 3D Generation [39.702921832009466]
  We introduce a new method that incorporates touch as an additional modality to improve the geometric details of generated 3D assets.<n>We design a lightweight 3D texture field to synthesize visual and tactile textures, guided by 2D diffusion model priors.<n>We are the first to leverage high-resolution tactile sensing to enhance geometric details for 3D generation tasks.
  arXiv  Detail & Related papers  (2024-12-09T18:59:45Z)
• DreamPolish: Domain Score Distillation With Progressive Geometry Generation [66.94803919328815]
  We introduce DreamPolish, a text-to-3D generation model that excels in producing refined geometry and high-quality textures. In the geometry construction phase, our approach leverages multiple neural representations to enhance the stability of the synthesis process. In the texture generation phase, we introduce a novel score distillation objective, namely domain score distillation (DSD), to guide neural representations toward such a domain.
  arXiv  Detail & Related papers  (2024-11-03T15:15:01Z)
• TouchSDF: A DeepSDF Approach for 3D Shape Reconstruction using Vision-Based Tactile Sensing [29.691786688595762]
  Humans rely on their visual and tactile senses to develop a comprehensive 3D understanding of their physical environment. We propose TouchSDF, a Deep Learning approach for tactile 3D shape reconstruction. Our technique consists of two components: (1) a Convolutional Neural Network that maps tactile images into local meshes representing the surface at the touch location, and (2) an implicit neural function that predicts a signed distance function to extract the desired 3D shape.
  arXiv  Detail & Related papers  (2023-11-21T13:43:06Z)
• DreamStone: Image as Stepping Stone for Text-Guided 3D Shape Generation [105.97545053660619]
  We present a new text-guided 3D shape generation approach DreamStone. It uses images as a stepping stone to bridge the gap between text and shape modalities for generating 3D shapes without requiring paired text and 3D data. Our approach is generic, flexible, and scalable, and it can be easily integrated with various SVR models to expand the generative space and improve the generative fidelity.
  arXiv  Detail & Related papers  (2023-03-24T03:56:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.