Temporal Context for Robust Maritime Obstacle Detection

• URL: http://arxiv.org/abs/2203.05352v1
• Date: Thu, 10 Mar 2022 12:58:14 GMT
• Title: Temporal Context for Robust Maritime Obstacle Detection
• Authors: Lojze \v{Z}ust and Matej Kristan
• Abstract summary: We propose WaSR-T, a novel maritime obstacle detection network. By learning the local temporal characteristics of object reflection on the water surface, WaSR-T substantially improves obstacle detection accuracy. Compared with existing single-frame methods, WaSR-T reduces the number of false positive detections by 41% overall and by over 53% within the danger zone of the boat.
• Score: 10.773819584718648
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Robust maritime obstacle detection is essential for fully autonomous unmanned surface vehicles (USVs). The currently widely adopted segmentation-based obstacle detection methods are prone to misclassification of object reflections and sun glitter as obstacles, producing many false positive detections, effectively rendering the methods impractical for USV navigation. However, water-turbulence-induced temporal appearance changes on object reflections are very distinctive from the appearance dynamics of true objects. We harness this property to design WaSR-T, a novel maritime obstacle detection network, that extracts the temporal context from a sequence of recent frames to reduce ambiguity. By learning the local temporal characteristics of object reflection on the water surface, WaSR-T substantially improves obstacle detection accuracy in the presence of reflections and glitter. Compared with existing single-frame methods, WaSR-T reduces the number of false positive detections by 41% overall and by over 53% within the danger zone of the boat, while preserving a high recall, and achieving new state-of-the-art performance on the challenging MODS maritime obstacle detection benchmark.

Related papers

• Impact of Surface Reflections in Maritime Obstacle Detection [0.0]
  Maritime obstacle detection aims to detect possible obstacles for autonomous driving of unmanned surface vehicles. Previous works have indicated surface reflections as a source of false positives for object detectors in maritime obstacle detection tasks. We show that surface reflections indeed adversely affect detector performance.
  arXiv  Detail & Related papers  (2024-10-11T10:55:24Z)
• Real-Time Multi-Scene Visibility Enhancement for Promoting Navigational Safety of Vessels Under Complex Weather Conditions [48.529493393948435]
  The visible-light camera has emerged as an essential imaging sensor for marine surface vessels in intelligent waterborne transportation systems. The visual imaging quality inevitably suffers from several kinds of degradations under complex weather conditions. We develop a general-purpose multi-scene visibility enhancement method to restore degraded images captured under different weather conditions.
  arXiv  Detail & Related papers  (2024-09-02T23:46:27Z)
• RobMOT: Robust 3D Multi-Object Tracking by Observational Noise and State Estimation Drift Mitigation on LiDAR PointCloud [11.111388829965103]
  This work addresses limitations in recent 3D tracking-by-detection methods. We propose a novel online track validity mechanism that temporally distinguishes between legitimate and ghost tracks. We also introduce a refinement to the Kalman filter that enhances noise mitigation in trajectory drift, leading to more robust state estimation for occluded objects.
  arXiv  Detail & Related papers  (2024-05-19T12:49:21Z)
• Instantaneous Perception of Moving Objects in 3D [86.38144604783207]
  The perception of 3D motion of surrounding traffic participants is crucial for driving safety. We propose to leverage local occupancy completion of object point clouds to densify the shape cue, and mitigate the impact of swimming artifacts. Extensive experiments demonstrate superior performance compared to standard 3D motion estimation approaches.
  arXiv  Detail & Related papers  (2024-05-05T01:07:24Z)
• Learning Heavily-Degraded Prior for Underwater Object Detection [59.5084433933765]
  This paper seeks transferable prior knowledge from detector-friendly images. It is based on statistical observations that, the heavily degraded regions of detector-friendly (DFUI) and underwater images have evident feature distribution gaps. Our method with higher speeds and less parameters still performs better than transformer-based detectors.
  arXiv  Detail & Related papers  (2023-08-24T12:32:46Z)
• Adversarially-Aware Robust Object Detector [85.10894272034135]
  We propose a Robust Detector (RobustDet) based on adversarially-aware convolution to disentangle gradients for model learning on clean and adversarial images. Our model effectively disentangles gradients and significantly enhances the detection robustness with maintaining the detection ability on clean images.
  arXiv  Detail & Related papers  (2022-07-13T13:59:59Z)
• Learning Maritime Obstacle Detection from Weak Annotations by Scaffolding [15.80122710743313]
  Coastal water autonomous boats rely on robust perception methods for obstacle detection and timely collision avoidance. Per-pixel ground truth labeling of such datasets is labor-intensive and expensive. We propose a new scaffolding learning regime that allows training obstacle detection segmentation networks only from such weak annotations.
  arXiv  Detail & Related papers  (2021-08-01T23:37:57Z)
• MODS -- A USV-oriented object detection and obstacle segmentation benchmark [12.356257470551348]
  We introduce a new obstacle detection benchmark MODS, which considers two major perception tasks: maritime object detection and the more general maritime obstacle segmentation. We present a new diverse maritime evaluation dataset containing approximately 81k stereo images synchronized with an on-board IMU, with over 60k objects annotated. We propose a new obstacle segmentation performance evaluation protocol that reflects the detection accuracy in a way meaningful for practical USV navigation.
  arXiv  Detail & Related papers  (2021-05-05T22:40:27Z)
• Two-Stage Single Image Reflection Removal with Reflection-Aware Guidance [78.34235841168031]
  We present a novel two-stage network with reflection-aware guidance (RAGNet) for single image reflection removal (SIRR) RAG can be used (i) to mitigate the effect of reflection from the observation, and (ii) to generate mask in partial convolution for mitigating the effect of deviating from linear combination hypothesis. Experiments on five commonly used datasets demonstrate the quantitative and qualitative superiority of our RAGNet in comparison to the state-of-the-art SIRR methods.
  arXiv  Detail & Related papers  (2020-12-02T03:14:57Z)
• SCRDet++: Detecting Small, Cluttered and Rotated Objects via Instance-Level Feature Denoising and Rotation Loss Smoothing [131.04304632759033]
  Small and cluttered objects are common in real-world which are challenging for detection. In this paper, we first innovatively introduce the idea of denoising to object detection. Instance-level denoising on the feature map is performed to enhance the detection to small and cluttered objects.
  arXiv  Detail & Related papers  (2020-04-28T06:03:54Z)
• A water-obstacle separation and refinement network for unmanned surface vehicles [13.515085879331425]
  We propose a new deep encoder-decoder architecture, a water-obstacle separation and refinement network (WaSR) to address these issues. We show that WaSR outperforms the current state-of-the-art by a large margin, yielding a 14% increase in F-measure over the second-best method.
  arXiv  Detail & Related papers  (2020-01-07T07:47:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.