Vector Map as Language: Toward Unified Remote Sensing Vector Mapping

• URL: http://arxiv.org/abs/2606.10701v1
• Date: Tue, 09 Jun 2026 11:02:51 GMT
• Title: Vector Map as Language: Toward Unified Remote Sensing Vector Mapping
• Abstract summary: We propose Vector Map as Language (VecLang), a unified paradigm that reformulates multiclass vector mapping as structured text generation.<n>VecLang encodes the common elements of different geospatial entities into a GeoJSON-like vector language.<n>We show that VecLang handles both single-class and multiclass vector mapping while achieving strong cross-dataset and open-vocabulary generalization.
• Score: 52.15388144187478
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Remote sensing vector mapping aims to generate structured maps of geospatial entities, such as buildings, roads, and water bodies, from remote sensing imagery. In practice, vector maps usually contain multiple category layers and heterogeneous entity structures, requiring a unified model for diverse mapping needs. However, existing methods typically represent vector objects as polygons or graphs, making them suitable only for specific categories: polygons poorly capture topological relations, while graphs often blur instance boundaries. We observe that language, as a natural medium for human communication, offers a flexible and expressive representation that can accommodate heterogeneous map elements, including geometry, semantics, and topolog. Motivated by this insight, we propose Vector Map as Language (VecLang), a unified paradigm that reformulates multiclass vector mapping as structured text generation. VecLang encodes the common elements of different geospatial entities into a GeoJSON-like vector language, enabling cross-category modeling within a shared textual format. To generate this language reliably, we design a progressive vision-language mapping framework that first localizes vectorization units and then generates structured map elements. We further introduce Hierarchical Vector Language Optimization, which uses reinforcement learning to improve syntax validity, content fidelity, and map executability. We also build VecMap-Bench with 54K images and 800K instances, supporting training and evaluation across standard and generalization settings. Extensive experiments demonstrate that VecLang handles both single-class and multiclass vector mapping while achieving strong cross-dataset and open-vocabulary generalization. The model and dataset are publicly available at https://github.com/yyyyll0ss/VecLang.

Related papers

• StructGen: Disambiguating Multi-Reference Image Generation via Structured Context Modeling [112.49355973930555]
  Multi-reference image generation aims to synthesize images by integrating attributes from multiple reference images under textual instructions.<n>Existing approaches, which rely solely on natural language instruction, often fail to capture complex intentions precisely.<n>We propose StructGen, which employs a structured, dictionary-like format to encode multiple reference images.
  arXiv  Detail & Related papers  (2026-07-17T04:35:36Z)
• UniVector: Unified Vector Extraction via Instance-Geometry Interaction [28.129438331953452]
  Uni is a unified VE framework that leverages instancegeometry interaction to extract multiple vector types within a single model.<n>Uni encodes vectors as structured queries containing both instance- and geometry-level information, and iteratively updates them through an interaction module for cross-level context exchange.
  arXiv  Detail & Related papers  (2025-10-15T07:39:25Z)
• XISM: an eXploratory and Interactive Graph Tool to Visualize and Evaluate Semantic Map Models [10.479648773745442]
  Semantic map models represent meanings or functions as nodes in a graph constrained by the local connectivity hypothesis.<n>Traditionally built manually, they are inefficient for large datasets and lack visualization and evaluation tools.<n>This paper introduces XISM, an interactive tool based on our prior algorithm, which constructs semantic maps from user data via a top-down approach.
  arXiv  Detail & Related papers  (2025-07-05T15:21:42Z)
• MGMapNet: Multi-Granularity Representation Learning for End-to-End Vectorized HD Map Construction [75.93907511203317]
  We propose MGMapNet (Multi-Granularity Map Network) to model map element with a multi-granularity representation. The proposed MGMapNet achieves state-of-the-art performance, surpassing MapTRv2 by 5.3 mAP on nuScenes and 4.4 mAP on Argoverse2 respectively.
  arXiv  Detail & Related papers  (2024-10-10T09:05:23Z)
• Jointly Learning Representations for Map Entities via Heterogeneous Graph Contrastive Learning [38.415692986360995]
  We propose a novel method named HOME-GCL for learning representations of multiple categories of map entities. Our approach utilizes a heterogeneous map entity graph (HOME graph) that integrates both road segments and land parcels into a unified framework. To the best of our knowledge, HOME-GCL is the first attempt to jointly learn representations for road segments and land parcels using a unified model.
  arXiv  Detail & Related papers  (2024-02-09T01:47:18Z)
• BEVBert: Multimodal Map Pre-training for Language-guided Navigation [75.23388288113817]
  We propose a new map-based pre-training paradigm that is spatial-aware for use in vision-and-language navigation (VLN) We build a local metric map to explicitly aggregate incomplete observations and remove duplicates, while modeling navigation dependency in a global topological map. Based on the hybrid map, we devise a pre-training framework to learn a multimodal map representation, which enhances spatial-aware cross-modal reasoning thereby facilitating the language-guided navigation goal.
  arXiv  Detail & Related papers  (2022-12-08T16:27:54Z)
• Primitive Graph Learning for Unified Vector Mapping [14.20286798139897]
  GraphMapper is a unified framework for end-to-end vector map extraction from satellite images. We convert vector shape prediction, regularization, and topology reconstruction into a unique primitive graph learning problem. Our model outperforms state-of-the-art methods by 8-10% in both tasks on public benchmarks.
  arXiv  Detail & Related papers  (2022-06-28T12:33:18Z)
• VectorMapNet: End-to-end Vectorized HD Map Learning [18.451587680552464]
  We introduce an end-to-end vectorized HD map learning pipeline, termed VectorMapNet. This pipeline can explicitly model the spatial relation between map elements and generate vectorized maps friendly to downstream autonomous driving tasks. Experiments show that VectorMapNet achieve strong map learning performance on both nuScenes and Argo2 dataset.
  arXiv  Detail & Related papers  (2022-06-17T17:57:13Z)
• SemAffiNet: Semantic-Affine Transformation for Point Cloud Segmentation [94.11915008006483]
  We propose SemAffiNet for point cloud semantic segmentation. We conduct extensive experiments on the ScanNetV2 and NYUv2 datasets.
  arXiv  Detail & Related papers  (2022-05-26T17:00:23Z)
• CoordGAN: Self-Supervised Dense Correspondences Emerge from GANs [129.51129173514502]
  We introduce Coordinate GAN (CoordGAN), a structure-texture disentangled GAN that learns a dense correspondence map for each generated image. We show that the proposed generator achieves better structure and texture disentanglement compared to existing approaches.
  arXiv  Detail & Related papers  (2022-03-30T17:55:09Z)
• Exploring the Hierarchy in Relation Labels for Scene Graph Generation [75.88758055269948]
  The proposed method can improve several state-of-the-art baselines by a large margin (up to $33%$ relative gain) in terms of Recall@50. Experiments show that the proposed simple yet effective method can improve several state-of-the-art baselines by a large margin.
  arXiv  Detail & Related papers  (2020-09-12T17:36:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.