Improving Road Segmentation in Challenging Domains Using Similar Place Priors

• URL: http://arxiv.org/abs/2205.14112v1
• Date: Fri, 27 May 2022 17:22:52 GMT
• Title: Improving Road Segmentation in Challenging Domains Using Similar Place Priors
• Authors: Connor Malone, Sourav Garg, Ming Xu, Thierry Peynot and Michael Milford
• Abstract summary: Road segmentation in challenging domains, such as night, snow or rain, is a difficult task. Current approaches boost performance using fine-tuning, domain adaptation, style transfer. Visual Place Recognition (VPR) to find similar but geographically distinct places.
• Score: 25.883291494709688
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Road segmentation in challenging domains, such as night, snow or rain, is a difficult task. Most current approaches boost performance using fine-tuning, domain adaptation, style transfer, or by referencing previously acquired imagery. These approaches share one or more of three significant limitations: a reliance on large amounts of annotated training data that can be costly to obtain, both anticipation of and training data from the type of environmental conditions expected at inference time, and/or imagery captured from a previous visit to the location. In this research, we remove these restrictions by improving road segmentation based on similar places. We use Visual Place Recognition (VPR) to find similar but geographically distinct places, and fuse segmentations for query images and these similar place priors using a Bayesian approach and novel segmentation quality metric. Ablation studies show the need to re-evaluate notions of VPR utility for this task. We demonstrate the system achieving state-of-the-art road segmentation performance across multiple challenging condition scenarios including night time and snow, without requiring any prior training or previous access to the same geographical locations. Furthermore, we show that this method is network agnostic, improves multiple baseline techniques and is competitive against methods specialised for road prediction.

Related papers

• Physically Feasible Semantic Segmentation [58.17907376475596]
  State-of-the-art semantic segmentation models are typically optimized in a data-driven fashion. Our method, Physically Feasible Semantic (PhyFea), extracts explicit physical constraints that govern spatial class relations. PhyFea yields significant performance improvements in mIoU over each state-of-the-art network we use.
  arXiv  Detail & Related papers  (2024-08-26T22:39:08Z)
• Frequency Enhanced Pre-training for Cross-city Few-shot Traffic Forecasting [7.4525875528900665]
  The concept of cross-city few-shot forecasting has emerged as a viable approach. FEPCross has a pre-training stage and a fine-tuning stage. Empirical evaluations performed on real-world traffic datasets validate the exceptional efficacy of FEPCross.
  arXiv  Detail & Related papers  (2024-06-03T08:42:00Z)
• Adapt Before Comparison: A New Perspective on Cross-Domain Few-Shot Segmentation [0.0]
  Cross-domain few-shot segmentation (CD-FSS) has emerged. We show test-time task-adaption is the key for successful CD-FSS. Despite our self-restriction not to use any images other than the few labeled samples at test time, we achieve new state-of-the-art performance in CD-FSS.
  arXiv  Detail & Related papers  (2024-02-27T15:43:53Z)
• Towards Seamless Adaptation of Pre-trained Models for Visual Place Recognition [72.35438297011176]
  We propose a novel method to realize seamless adaptation of pre-trained models for visual place recognition (VPR) Specifically, to obtain both global and local features that focus on salient landmarks for discriminating places, we design a hybrid adaptation method. Experimental results show that our method outperforms the state-of-the-art methods with less training data and training time.
  arXiv  Detail & Related papers  (2024-02-22T12:55:01Z)
• Leveraging Topology for Domain Adaptive Road Segmentation in Satellite and Aerial Imagery [9.23555285827483]
  Road segmentation algorithms fail to generalize to new geographical locations. Road skeleton is an auxiliary task to impose the topological constraints. For self-training, we filter out the noisy pseudo-labels by using a connectivity-based pseudo-labels refinement strategy.
  arXiv  Detail & Related papers  (2023-09-27T12:50:51Z)
• Location-Aware Self-Supervised Transformers [74.76585889813207]
  We propose to pretrain networks for semantic segmentation by predicting the relative location of image parts. We control the difficulty of the task by masking a subset of the reference patch features visible to those of the query. Our experiments show that this location-aware pretraining leads to representations that transfer competitively to several challenging semantic segmentation benchmarks.
  arXiv  Detail & Related papers  (2022-12-05T16:24:29Z)
• Monocular BEV Perception of Road Scenes via Front-to-Top View Projection [57.19891435386843]
  We present a novel framework that reconstructs a local map formed by road layout and vehicle occupancy in the bird's-eye view. Our model runs at 25 FPS on a single GPU, which is efficient and applicable for real-time panorama HD map reconstruction.
  arXiv  Detail & Related papers  (2022-11-15T13:52:41Z)
• Stagewise Unsupervised Domain Adaptation with Adversarial Self-Training for Road Segmentation of Remote Sensing Images [93.50240389540252]
  Road segmentation from remote sensing images is a challenging task with wide ranges of application potentials. We propose a novel stagewise domain adaptation model called RoadDA to address the domain shift (DS) issue in this field. Experiment results on two benchmarks demonstrate that RoadDA can efficiently reduce the domain gap and outperforms state-of-the-art methods.
  arXiv  Detail & Related papers  (2021-08-28T09:29:14Z)
• Standardized Max Logits: A Simple yet Effective Approach for Identifying Unexpected Road Obstacles in Urban-Scene Segmentation [18.666365568765098]
  We propose a simple yet effective approach that standardizes the max logits in order to align the different distributions and reflect the relative meanings of max logits within each predicted class. Our method achieves a new state-of-the-art performance on the publicly available Fishyscapes Lost & Found leaderboard with a large margin.
  arXiv  Detail & Related papers  (2021-07-23T14:25:02Z)
• Pixel-Level Cycle Association: A New Perspective for Domain Adaptive Semantic Segmentation [169.82760468633236]
  We propose to build the pixel-level cycle association between source and target pixel pairs. Our method can be trained end-to-end in one stage and introduces no additional parameters.
  arXiv  Detail & Related papers  (2020-10-31T00:11:36Z)
• We Learn Better Road Pothole Detection: from Attention Aggregation to Adversarial Domain Adaptation [22.076261078410752]
  Road pothole detection results are always subjective, because they depend entirely on the individual experience. Our recently introduced disparity (or inverse depth) transformation algorithm allows better discrimination between damaged and undamaged road areas. We propose a novel attention aggregation (AA) framework, which takes the advantages of different types of attention modules.
  arXiv  Detail & Related papers  (2020-08-16T05:17:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.