Parsing Line Segments of Floor Plan Images Using Graph Neural Networks

• URL: http://arxiv.org/abs/2303.03851v1
• Date: Tue, 7 Mar 2023 12:32:19 GMT
• Title: Parsing Line Segments of Floor Plan Images Using Graph Neural Networks
• Authors: Mingxiang Chen and Cihui Pan
• Abstract summary: We use a junction heatmap to predict line segments' endpoints, and graph neural networks to extract line segments and their categories. Our proposed method is able to output vectorized line segment and requires less post-processing steps to be put into practical use.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this paper, we present a GNN-based Line Segment Parser (GLSP), which uses a junction heatmap to predict line segments' endpoints, and graph neural networks to extract line segments and their categories. Different from previous floor plan recognition methods, which rely on semantic segmentation, our proposed method is able to output vectorized line segment and requires less post-processing steps to be put into practical use. Our experiments show that the methods outperform state-of-the-art line segment detection models on multi-class line segment detection tasks with floor plan images. In the paper, we use our floor plan dataset named Large-scale Residential Floor Plan data (LRFP). The dataset contains a total of 271,035 floor plan images. The label corresponding to each picture contains the scale information, the categories and outlines of rooms, and the endpoint positions of line segments such as doors, windows, and walls. Our augmentation method makes the dataset adaptable to the drawing styles of as many countries and regions as possible.

Related papers

• RoboHop: Segment-based Topological Map Representation for Open-World Visual Navigation [18.053914853235142]
  We propose a novel representation of an environment based on "image segments" Unlike 3D scene graphs, we create a purely topological graph with segments as nodes. This unveils a "continuous sense of a place", defined by inter-image persistence of segments.
  arXiv  Detail & Related papers  (2024-05-09T14:17:26Z)
• Geo-Tiles for Semantic Segmentation of Earth Observation Imagery [7.49377967268953]
  Existing methods and benchmark datasets rely on pixel-based tiling schemes or on geo-tiling schemes employed by web mapping applications. We propose a new segmentation pipeline for earth observation imagery relying on a tiling scheme that creates geo-tiles based on heterogeneous data. This approach exhibits several beneficial properties compared to pixel-based or common web mapping approaches. We demonstrate how the proposed tiling system allows to improve the results of current state-of-the-art semantic segmentation models.
  arXiv  Detail & Related papers  (2023-06-01T15:46:04Z)
• IFSeg: Image-free Semantic Segmentation via Vision-Language Model [67.62922228676273]
  We introduce a novel image-free segmentation task where the goal is to perform semantic segmentation given only a set of the target semantic categories. We construct this artificial training data by creating a 2D map of random semantic categories and another map of their corresponding word tokens. Our model not only establishes an effective baseline for this novel task but also demonstrates strong performances compared to existing methods.
  arXiv  Detail & Related papers  (2023-03-25T08:19:31Z)
• Connectivity-constrained Interactive Panoptic Segmentation [20.63490740362823]
  We address interactive panoptic annotation, where one segment all object and stuff regions in an image. We investigate two graph-based segmentation algorithms that both enforce connectivity of each region, with a notable class-aware Linear Programming (ILP) formulation that ensures global optimum.
  arXiv  Detail & Related papers  (2022-12-13T17:36:17Z)
• Open-world Semantic Segmentation via Contrasting and Clustering Vision-Language Embedding [95.78002228538841]
  We propose a new open-world semantic segmentation pipeline that makes the first attempt to learn to segment semantic objects of various open-world categories without any efforts on dense annotations. Our method can directly segment objects of arbitrary categories, outperforming zero-shot segmentation methods that require data labeling on three benchmark datasets.
  arXiv  Detail & Related papers  (2022-07-18T09:20:04Z)
• Distilling Ensemble of Explanations for Weakly-Supervised Pre-Training of Image Segmentation Models [54.49581189337848]
  We propose a method to enable the end-to-end pre-training for image segmentation models based on classification datasets. The proposed method leverages a weighted segmentation learning procedure to pre-train the segmentation network en masse. Experiment results show that, with ImageNet accompanied by PSSL as the source dataset, the proposed end-to-end pre-training strategy successfully boosts the performance of various segmentation models.
  arXiv  Detail & Related papers  (2022-07-04T13:02:32Z)
• PSSNet: Planarity-sensible Semantic Segmentation of Large-scale Urban Meshes [3.058685580689605]
  We introduce a novel deep learning-based framework to interpret 3D urban scenes represented as textured meshes. Our framework achieves semantic segmentation in two steps: planarity-sensible over-segmentation followed by semantic classification. Our approach outperforms the state-of-the-art methods in terms of boundary quality and mean IoU (intersection over union)
  arXiv  Detail & Related papers  (2022-02-07T14:16:10Z)
• Room Classification on Floor Plan Graphs using Graph Neural Networks [0.0]
  We present our approach to improve room classification task on floor plan maps of buildings by representing floor plans as undirected graphs. Rooms in the floor plans are represented as nodes in the graph with edges representing their adjacency in the map. Our results show that graph neural networks, specifically GraphSAGE and Topology Adaptive GCN were able to achieve accuracy of 80% and 81% respectively.
  arXiv  Detail & Related papers  (2021-08-12T19:59:22Z)
• FloorLevel-Net: Recognizing Floor-Level Lines with Height-Attention-Guided Multi-task Learning [49.30194762653723]
  This work tackles the problem of locating floor-level lines in street-view images, using a supervised deep learning approach. We first compile a new dataset and develop a new data augmentation scheme to synthesize training samples. Next, we design FloorLevel-Net, a multi-task learning network that associates explicit features of building facades and implicit floor-level lines.
  arXiv  Detail & Related papers  (2021-07-06T08:17:59Z)
• SOLD2: Self-supervised Occlusion-aware Line Description and Detection [95.8719432775724]
  We introduce the first joint detection and description of line segments in a single deep network. Our method does not require any annotated line labels and can therefore generalize to any dataset. We evaluate our approach against previous line detection and description methods on several multi-view datasets.
  arXiv  Detail & Related papers  (2021-04-07T19:27:17Z)
• Spatial Pyramid Based Graph Reasoning for Semantic Segmentation [67.47159595239798]
  We apply graph convolution into the semantic segmentation task and propose an improved Laplacian. The graph reasoning is directly performed in the original feature space organized as a spatial pyramid. We achieve comparable performance with advantages in computational and memory overhead.
  arXiv  Detail & Related papers  (2020-03-23T12:28:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.