Towards Global-Scale Crowd+AI Techniques to Map and Assess Sidewalks for People with Disabilities

• URL: http://arxiv.org/abs/2206.13677v1
• Date: Tue, 28 Jun 2022 01:05:08 GMT
• Title: Towards Global-Scale Crowd+AI Techniques to Map and Assess Sidewalks for People with Disabilities
• Authors: Maryam Hosseini, Mikey Saugstad, Fabio Miranda, Andres Sevtsuk, Claudio T. Silva, Jon E. Froehlich
• Abstract summary: There is a lack of data on the location, condition, and accessibility of sidewalks across the world. In this paper, we describe initial work in semi-automatically building a sidewalk network topology from satellite imagery. We close with a call to create a database of labeled satellite and streetscape scenes for sidewalks and sidewalk accessibility issues along with standardized benchmarks.
• Score: 10.096568479976725
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: There is a lack of data on the location, condition, and accessibility of sidewalks across the world, which not only impacts where and how people travel but also fundamentally limits interactive mapping tools and urban analytics. In this paper, we describe initial work in semi-automatically building a sidewalk network topology from satellite imagery using hierarchical multi-scale attention models, inferring surface materials from street-level images using active learning-based semantic segmentation, and assessing sidewalk condition and accessibility features using Crowd+AI. We close with a call to create a database of labeled satellite and streetscape scenes for sidewalks and sidewalk accessibility issues along with standardized benchmarks.

Related papers

• CrossViewDiff: A Cross-View Diffusion Model for Satellite-to-Street View Synthesis [54.852701978617056]
  CrossViewDiff is a cross-view diffusion model for satellite-to-street view synthesis. To address the challenges posed by the large discrepancy across views, we design the satellite scene structure estimation and cross-view texture mapping modules. To achieve a more comprehensive evaluation of the synthesis results, we additionally design a GPT-based scoring method.
  arXiv  Detail & Related papers  (2024-08-27T03:41:44Z)
• PathwayBench: Assessing Routability of Pedestrian Pathway Networks Inferred from Multi-City Imagery [15.563635571840733]
  Application to support pedestrian mobility in urban areas requires a complete, and routable graph representation of the built environment. Relative to road network pathways, pedestrian network pathways are narrower, more frequently disconnected, often visually and materially variable in smaller areas. Existing algorithms to extract pedestrian pathway network graphs are inconsistently evaluated and tend to ignore routability.
  arXiv  Detail & Related papers  (2024-07-23T22:47:32Z)
• How To Not Train Your Dragon: Training-free Embodied Object Goal Navigation with Semantic Frontiers [94.46825166907831]
  We present a training-free solution to tackle the object goal navigation problem in Embodied AI. Our method builds a structured scene representation based on the classic visual simultaneous localization and mapping (V-SLAM) framework. Our method propagates semantics on the scene graphs based on language priors and scene statistics to introduce semantic knowledge to the geometric frontiers.
  arXiv  Detail & Related papers  (2023-05-26T13:38:33Z)
• TrackletMapper: Ground Surface Segmentation and Mapping from Traffic Participant Trajectories [24.817728268091976]
  TrackletMapper is a framework for annotating ground surface types such as sidewalks, roads, and street crossings from object tracklets. We show that the model can be self-distilled for additional performance benefits by aggregating a ground surface map and projecting it into the camera images. We qualitatively and quantitatively attest our findings on a novel large-scale dataset for mobile robots operating in pedestrian areas.
  arXiv  Detail & Related papers  (2022-09-12T13:43:10Z)
• Sidewalk Measurements from Satellite Images: Preliminary Findings [10.870041943009722]
  We train a computer vision model to detect sidewalks, roads, and buildings from remote-sensing imagery. We apply shape analysis techniques to study different attributes of the extracted sidewalks.
  arXiv  Detail & Related papers  (2021-12-12T02:22:46Z)
• FloorLevel-Net: Recognizing Floor-Level Lines with Height-Attention-Guided Multi-task Learning [49.30194762653723]
  This work tackles the problem of locating floor-level lines in street-view images, using a supervised deep learning approach. We first compile a new dataset and develop a new data augmentation scheme to synthesize training samples. Next, we design FloorLevel-Net, a multi-task learning network that associates explicit features of building facades and implicit floor-level lines.
  arXiv  Detail & Related papers  (2021-07-06T08:17:59Z)
• Coming Down to Earth: Satellite-to-Street View Synthesis for Geo-Localization [9.333087475006003]
  Cross-view image based geo-localization is notoriously challenging due to drastic viewpoint and appearance differences between the two domains. We show that we can address this discrepancy explicitly by learning to synthesize realistic street views from satellite inputs. We propose a novel multi-task architecture in which image synthesis and retrieval are considered jointly.
  arXiv  Detail & Related papers  (2021-03-11T17:40:59Z)
• End-to-End Deep Structured Models for Drawing Crosswalks [98.9901717499058]
  We project both inputs onto the ground surface to produce a top down view of the scene. We then leverage convolutional neural networks to extract semantic cues about the location of the crosswalks. Experiments over crosswalks in a large city area show that 96.6% automation can be achieved.
  arXiv  Detail & Related papers  (2020-12-21T18:59:08Z)
• Hidden Footprints: Learning Contextual Walkability from 3D Human Trails [70.01257397390361]
  Current datasets only tell you where people are, not where they could be. We first augment the set of valid, labeled walkable regions by propagating person observations between images, utilizing 3D information to create what we call hidden footprints. We devise a training strategy designed for such sparse labels, combining a class-balanced classification loss with a contextual adversarial loss.
  arXiv  Detail & Related papers  (2020-08-19T23:19:08Z)
• Probabilistic Semantic Mapping for Urban Autonomous Driving Applications [1.181206257787103]
  We propose to fuse image and pre-built point cloud map information to perform automatic and accurate labeling of static landmarks such as roads, sidewalks, crosswalks, and lanes. The method performs semantic segmentation on 2D images, associates the semantic labels with point cloud maps to accurately localize them in the world, and leverages the confusion matrix formulation to construct a probabilistic semantic map in bird's eye view from semantic point clouds.
  arXiv  Detail & Related papers  (2020-06-08T19:29:09Z)
• Learning to Move with Affordance Maps [57.198806691838364]
  The ability to autonomously explore and navigate a physical space is a fundamental requirement for virtually any mobile autonomous agent. Traditional SLAM-based approaches for exploration and navigation largely focus on leveraging scene geometry. We show that learned affordance maps can be used to augment traditional approaches for both exploration and navigation, providing significant improvements in performance.
  arXiv  Detail & Related papers  (2020-01-08T04:05:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.