AI Powered Road Network Prediction with Multi-Modal Data
- URL: http://arxiv.org/abs/2312.17040v1
- Date: Thu, 28 Dec 2023 14:31:07 GMT
- Title: AI Powered Road Network Prediction with Multi-Modal Data
- Authors: Necip Enes Gengec, Ergin Tari, Ulas Bagci
- Abstract summary: This study presents an innovative approach for automatic road detection with deep learning, by employing fusion strategies for utilizing both lower-resolution satellite imagery and GPS trajectory data.
We rigorously investigate both early and late fusion strategies, and assess deep learning based road detection performance using different fusion settings.
- Score: 0.9426448361599084
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: This study presents an innovative approach for automatic road detection with
deep learning, by employing fusion strategies for utilizing both
lower-resolution satellite imagery and GPS trajectory data, a concept never
explored before. We rigorously investigate both early and late fusion
strategies, and assess deep learning based road detection performance using
different fusion settings. Our extensive ablation studies assess the efficacy
of our framework under diverse model architectures, loss functions, and
geographic domains (Istanbul and Montreal). For an unbiased and complete
evaluation of road detection results, we use both region-based and
boundary-based evaluation metrics for road segmentation. The outcomes reveal
that the ResUnet model outperforms U-Net and D-Linknet in road extraction
tasks, achieving superior results over the benchmark study using low-resolution
Sentinel-2 data. This research not only contributes to the field of automatic
road detection but also offers novel insights into the utilization of data
fusion methods in diverse applications.
Related papers
- Cross Dataset Analysis and Network Architecture Repair for Autonomous
Car Lane Detection [5.428120316375907]
We have performed cross dataset analysis and network architecture repair for the lane detection application in autonomous vehicles.
ERFCondLaneNet is an enhancement to the CondlaneNet used for lane identification framework to solve the difficulty of detecting lane lines with complex topologies.
arXiv Detail & Related papers (2024-09-10T20:27:49Z) - UDTIRI: An Online Open-Source Intelligent Road Inspection Benchmark
Suite [21.565438268381467]
We introduce the road pothole detection task, the first online competition published within this benchmark suite.
Our benchmark provides a systematic and thorough evaluation of state-of-the-art object detection, semantic segmentation, and instance segmentation networks.
By providing algorithms with a more comprehensive understanding of diverse road conditions, we seek to unlock their untapped potential.
arXiv Detail & Related papers (2023-04-18T09:13:52Z) - Road Rutting Detection using Deep Learning on Images [0.0]
Road rutting is a severe road distress that can cause premature failure of road incurring early and costly maintenance costs.
This paper proposes a novel road rutting dataset comprising of 949 images and provides both object level and pixel level annotations.
Object detection models and semantic segmentation models were deployed to detect road rutting on the proposed dataset.
arXiv Detail & Related papers (2022-09-28T16:53:05Z) - Recent Advances in Embedding Methods for Multi-Object Tracking: A Survey [71.10448142010422]
Multi-object tracking (MOT) aims to associate target objects across video frames in order to obtain entire moving trajectories.
Embedding methods play an essential role in object location estimation and temporal identity association in MOT.
We first conduct a comprehensive overview with in-depth analysis for embedding methods in MOT from seven different perspectives.
arXiv Detail & Related papers (2022-05-22T06:54:33Z) - Aerial Images Meet Crowdsourced Trajectories: A New Approach to Robust
Road Extraction [110.61383502442598]
We introduce a novel neural network framework termed Cross-Modal Message Propagation Network (CMMPNet)
CMMPNet is composed of two deep Auto-Encoders for modality-specific representation learning and a tailor-designed Dual Enhancement Module for cross-modal representation refinement.
Experiments on three real-world benchmarks demonstrate the effectiveness of our CMMPNet for robust road extraction.
arXiv Detail & Related papers (2021-11-30T04:30:10Z) - Pseudo-LiDAR Based Road Detection [5.9106199000537645]
We propose a novel road detection approach with RGB being the only input during inference.
We exploit pseudo-LiDAR using depth estimation, and propose a feature fusion network where RGB and learned depth information are fused.
The proposed method achieves state-of-the-art performance on two challenging benchmarks, KITTI and R2D.
arXiv Detail & Related papers (2021-07-28T11:21:42Z) - Divide-and-Conquer for Lane-Aware Diverse Trajectory Prediction [71.97877759413272]
Trajectory prediction is a safety-critical tool for autonomous vehicles to plan and execute actions.
Recent methods have achieved strong performances using Multi-Choice Learning objectives like winner-takes-all (WTA) or best-of-many.
Our work addresses two key challenges in trajectory prediction, learning outputs, and better predictions by imposing constraints using driving knowledge.
arXiv Detail & Related papers (2021-04-16T17:58:56Z) - Anomaly Detection on Attributed Networks via Contrastive Self-Supervised
Learning [50.24174211654775]
We present a novel contrastive self-supervised learning framework for anomaly detection on attributed networks.
Our framework fully exploits the local information from network data by sampling a novel type of contrastive instance pair.
A graph neural network-based contrastive learning model is proposed to learn informative embedding from high-dimensional attributes and local structure.
arXiv Detail & Related papers (2021-02-27T03:17:20Z) - LoRD-Net: Unfolded Deep Detection Network with Low-Resolution Receivers [104.01415343139901]
We propose a deep detector entitled LoRD-Net for recovering information symbols from one-bit measurements.
LoRD-Net has a task-based architecture dedicated to recovering the underlying signal of interest.
We evaluate the proposed receiver architecture for one-bit signal recovery in wireless communications.
arXiv Detail & Related papers (2021-02-05T04:26:05Z) - AutoOD: Automated Outlier Detection via Curiosity-guided Search and
Self-imitation Learning [72.99415402575886]
Outlier detection is an important data mining task with numerous practical applications.
We propose AutoOD, an automated outlier detection framework, which aims to search for an optimal neural network model.
Experimental results on various real-world benchmark datasets demonstrate that the deep model identified by AutoOD achieves the best performance.
arXiv Detail & Related papers (2020-06-19T18:57:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.