End-to-End Deep Structured Models for Drawing Crosswalks

• URL: http://arxiv.org/abs/2012.11585v3
• Date: Thu, 14 Jan 2021 20:35:01 GMT
• Title: End-to-End Deep Structured Models for Drawing Crosswalks
• Authors: Justin Liang, Raquel Urtasun
• Abstract summary: We project both inputs onto the ground surface to produce a top down view of the scene. We then leverage convolutional neural networks to extract semantic cues about the location of the crosswalks. Experiments over crosswalks in a large city area show that 96.6% automation can be achieved.
• Score: 98.9901717499058
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper we address the problem of detecting crosswalks from LiDAR and camera imagery. Towards this goal, given multiple LiDAR sweeps and the corresponding imagery, we project both inputs onto the ground surface to produce a top down view of the scene. We then leverage convolutional neural networks to extract semantic cues about the location of the crosswalks. These are then used in combination with road centerlines from freely available maps (e.g., OpenStreetMaps) to solve a structured optimization problem which draws the final crosswalk boundaries. Our experiments over crosswalks in a large city area show that 96.6% automation can be achieved.

Related papers

• PaRK-Detect: Towards Efficient Multi-Task Satellite Imagery Road Extraction via Patch-Wise Keypoints Detection [12.145321599949236]
  We propose a new scheme for multi-task satellite imagery road extraction, Patch-wise Road Keypoints Detection (PaRK-Detect) Our framework predicts the position of patch-wise road keypoints and the adjacent relationships between them to construct road graphs in a single pass. We evaluate our approach against the existing state-of-the-art methods on DeepGlobe, Massachusetts Roads, and RoadTracer datasets and achieve competitive or better results.
  arXiv  Detail & Related papers  (2023-02-26T08:26:26Z)
• TrackletMapper: Ground Surface Segmentation and Mapping from Traffic Participant Trajectories [24.817728268091976]
  TrackletMapper is a framework for annotating ground surface types such as sidewalks, roads, and street crossings from object tracklets. We show that the model can be self-distilled for additional performance benefits by aggregating a ground surface map and projecting it into the camera images. We qualitatively and quantitatively attest our findings on a novel large-scale dataset for mobile robots operating in pedestrian areas.
  arXiv  Detail & Related papers  (2022-09-12T13:43:10Z)
• From Pedestrian Detection to Crosswalk Estimation: An EM Algorithm and Analysis on Diverse Datasets [0.0]
  In this work, we contribute an EM algorithm for estimation of corner points and linear crossing segments for marked and unmarked pedestrian crosswalks using the detections of pedestrians from processed LiDAR point clouds or camera images. We demonstrate the algorithmic performance by analyzing three real-world datasets containing multiple periods of data collection for four-corner and two-corner intersections with marked and unmarked crosswalks.
  arXiv  Detail & Related papers  (2022-05-25T08:40:38Z)
• Cross-Camera Trajectories Help Person Retrieval in a Camera Network [124.65912458467643]
  Existing methods often rely on purely visual matching or consider temporal constraints but ignore the spatial information of the camera network. We propose a pedestrian retrieval framework based on cross-camera generation, which integrates both temporal and spatial information. To verify the effectiveness of our method, we construct the first cross-camera pedestrian trajectory dataset.
  arXiv  Detail & Related papers  (2022-04-27T13:10:48Z)
• Beyond Cross-view Image Retrieval: Highly Accurate Vehicle Localization Using Satellite Image [91.29546868637911]
  This paper addresses the problem of vehicle-mounted camera localization by matching a ground-level image with an overhead-view satellite map. The key idea is to formulate the task as pose estimation and solve it by neural-net based optimization. Experiments on standard autonomous vehicle localization datasets have confirmed the superiority of the proposed method.
  arXiv  Detail & Related papers  (2022-04-10T19:16:58Z)
• RNGDet: Road Network Graph Detection by Transformer in Aerial Images [19.141279413414082]
  Road network graphs provide critical information for autonomous vehicle applications. manually annotating road network graphs is inefficient and labor-intensive. We propose a novel approach based on transformer and imitation learning named RNGDet.
  arXiv  Detail & Related papers  (2022-02-16T01:59:41Z)
• SPIN Road Mapper: Extracting Roads from Aerial Images via Spatial and Interaction Space Graph Reasoning for Autonomous Driving [64.10636296274168]
  Road extraction is an essential step in building autonomous navigation systems. Using just convolution neural networks (ConvNets) for this problem is not effective as it is inefficient at capturing distant dependencies between road segments in the image. We propose a Spatial and Interaction Space Graph Reasoning (SPIN) module which when plugged into a ConvNet performs reasoning over graphs constructed on spatial and interaction spaces projected from the feature maps.
  arXiv  Detail & Related papers  (2021-09-16T03:52:17Z)
• Geometry-Guided Street-View Panorama Synthesis from Satellite Imagery [80.6282101835164]
  We present a new approach for synthesizing a novel street-view panorama given an overhead satellite image. Our method generates a Google's omnidirectional street-view type panorama, as if it is captured from the same geographical location as the center of the satellite patch.
  arXiv  Detail & Related papers  (2021-03-02T10:27:05Z)
• Convolutional Recurrent Network for Road Boundary Extraction [99.55522995570063]
  We tackle the problem of drivable road boundary extraction from LiDAR and camera imagery. We design a structured model where a fully convolutional network obtains deep features encoding the location and direction of road boundaries. We showcase the effectiveness of our method on a large North American city where we obtain perfect topology of road boundaries 99.3% of the time.
  arXiv  Detail & Related papers  (2020-12-21T18:59:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.