Streaming Object Detection on Fisheye Cameras for Automatic Parking

• URL: http://arxiv.org/abs/2305.14713v2
• Date: Tue, 29 Aug 2023 01:10:15 GMT
• Title: Streaming Object Detection on Fisheye Cameras for Automatic Parking
• Authors: Yixiong Yan, Liangzhu Cheng, Yongxu Li, Xinjuan Tuo
• Abstract summary: We propose a real-time detection framework equipped with a dualflow perception module that can predict the future and alleviate the time-lag problem. The standard bounding box is unsuitable for the object in fisheye camera images due to the strong radial distortion of the fisheye camera. We propose a new periodic angle loss function to regress the angle of the box, which is the simple and accurate representation method of objects.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Fisheye cameras are widely employed in automatic parking, and the video stream object detection (VSOD) of the fisheye camera is a fundamental perception function to ensure the safe operation of vehicles. In past research work, the difference between the output of the deep learning model and the actual situation at the current moment due to the existence of delay of the perception system is generally ignored. But the environment will inevitably change within the delay time which may cause a potential safety hazard. In this paper, we propose a real-time detection framework equipped with a dual-flow perception module (dynamic and static flows) that can predict the future and alleviate the time-lag problem. Meanwhile, we use a new scheme to evaluate latency and accuracy. The standard bounding box is unsuitable for the object in fisheye camera images due to the strong radial distortion of the fisheye camera and the primary detection objects of parking perception are vehicles and pedestrians, so we adopt the rotate bounding box and propose a new periodic angle loss function to regress the angle of the box, which is the simple and accurate representation method of objects. The instance segmentation ground truth is used to supervise the training. Experiments demonstrate the effectiveness of our approach. Code is released at: https://gitee.com/hiyanyx/fisheye-streaming-perception.

Related papers

• CamLoPA: A Hidden Wireless Camera Localization Framework via Signal Propagation Path Analysis [59.86280992504629]
  CamLoPA is a training-free wireless camera detection and localization framework. It operates with minimal activity space constraints using low-cost commercial-off-the-shelf (COTS) devices. It achieves 95.37% snooping camera detection accuracy and an average localization error of 17.23, under the significantly reduced activity space requirements.
  arXiv  Detail & Related papers  (2024-09-23T16:23:50Z)
• FisheyeDetNet: 360° Surround view Fisheye Camera based Object Detection System for Autonomous Driving [4.972459365804512]
  Object detection is a mature problem in autonomous driving with pedestrian detection being one of the first deployed algorithms. Standard bounding box representation fails in fisheye cameras due to heavy radial distortion, particularly in the periphery. We design rotated bounding boxes, ellipse, generic polygon as polar arc/angle representations and define an instance segmentation mIOU metric to analyze these representations. The proposed model FisheyeDetNet with polygon outperforms others and achieves a mAP score of 49.5 % on Valeo fisheye surround-view dataset for automated driving applications.
  arXiv  Detail & Related papers  (2024-04-20T18:50:57Z)
• SDGE: Stereo Guided Depth Estimation for 360$^\circ$ Camera Sets [65.64958606221069]
  Multi-camera systems are often used in autonomous driving to achieve a 360$circ$ perception. These 360$circ$ camera sets often have limited or low-quality overlap regions, making multi-view stereo methods infeasible for the entire image. We propose the Stereo Guided Depth Estimation (SGDE) method, which enhances depth estimation of the full image by explicitly utilizing multi-view stereo results on the overlap.
  arXiv  Detail & Related papers  (2024-02-19T02:41:37Z)
• Surround-view Fisheye Camera Perception for Automated Driving: Overview, Survey and Challenges [1.4452405977630436]
  Four fisheye cameras on four sides of the vehicle are sufficient to cover 360deg around the vehicle capturing the entire near-field region. Some primary use cases are automated parking, traffic jam assist, and urban driving. Due to the large radial distortion of fisheye cameras, standard algorithms can not be extended easily to the surround-view use case.
  arXiv  Detail & Related papers  (2022-05-26T11:38:04Z)
• Real-time Object Detection for Streaming Perception [84.2559631820007]
  Streaming perception is proposed to jointly evaluate the latency and accuracy into a single metric for video online perception. We build a simple and effective framework for streaming perception. Our method achieves competitive performance on Argoverse-HD dataset and improves the AP by 4.9% compared to the strong baseline.
  arXiv  Detail & Related papers  (2022-03-23T11:33:27Z)
• ARPD: Anchor-free Rotation-aware People Detection using Topview Fisheye Camera [3.0868856870169625]
  We propose ARPD, a single-stage anchor-free fully convolutional network to detect arbitrarily rotated people in fish-eye images. Our method competes favorably with state-of-the-art algorithms while running significantly faster.
  arXiv  Detail & Related papers  (2022-01-25T05:49:50Z)
• Real Time Monocular Vehicle Velocity Estimation using Synthetic Data [78.85123603488664]
  We look at the problem of estimating the velocity of road vehicles from a camera mounted on a moving car. We propose a two-step approach where first an off-the-shelf tracker is used to extract vehicle bounding boxes and then a small neural network is used to regress the vehicle velocity.
  arXiv  Detail & Related papers  (2021-09-16T13:10:27Z)
• Fisheye Lens Camera based Autonomous Valet Parking System [3.461121828373003]
  This paper proposes an efficient autonomous valet parking system utilizing only cameras which are the most widely used sensor. Fisheye cameras which have a wider angle of view compared to pinhole cameras are used.
  arXiv  Detail & Related papers  (2021-04-27T11:36:03Z)
• Detecting Invisible People [58.49425715635312]
  We re-purpose tracking benchmarks and propose new metrics for the task of detecting invisible objects. We demonstrate that current detection and tracking systems perform dramatically worse on this task. Second, we build dynamic models that explicitly reason in 3D, making use of observations produced by state-of-the-art monocular depth estimation networks.
  arXiv  Detail & Related papers  (2020-12-15T16:54:45Z)
• Spherical formulation of moving object geometric constraints for monocular fisheye cameras [0.0]
  We introduce a moving object detection algorithm for fisheye cameras used in autonomous driving. We reformulate the three commonly used constraints in rectilinear images to spherical coordinates.
  arXiv  Detail & Related papers  (2020-03-06T14:59:38Z)
• Road Curb Detection and Localization with Monocular Forward-view Vehicle Camera [74.45649274085447]
  We propose a robust method for estimating road curb 3D parameters using a calibrated monocular camera equipped with a fisheye lens. Our approach is able to estimate the vehicle to curb distance in real time with mean accuracy of more than 90%.
  arXiv  Detail & Related papers  (2020-02-28T00:24:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.