ULSD: Unified Line Segment Detection across Pinhole, Fisheye, and Spherical Cameras

• URL: http://arxiv.org/abs/2011.03174v1
• Date: Fri, 6 Nov 2020 03:30:17 GMT
• Title: ULSD: Unified Line Segment Detection across Pinhole, Fisheye, and Spherical Cameras
• Authors: Hao Li, Huai Yu, Wen Yang, Lei Yu and Sebastian Scherer
• Abstract summary: Line segment detection is essential for high-level tasks in computer vision and robotics. Currently, most stateof-the-art (SOTA) methods are dedicated to detecting straight line segments in undistorted pinhole images. We propose to target at the unified line segment detection (ULSD) for both distorted and undistorted images.
• Score: 17.943949895764938
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Line segment detection is essential for high-level tasks in computer vision and robotics. Currently, most stateof-the-art (SOTA) methods are dedicated to detecting straight line segments in undistorted pinhole images, thus distortions on fisheye or spherical images may largely degenerate their performance. Targeting at the unified line segment detection (ULSD) for both distorted and undistorted images, we propose to represent line segments with the Bezier curve model. Then the line segment detection is tackled by the Bezier curve regression with an end-to-end network, which is model-free and without any undistortion preprocessing. Experimental results on the pinhole, fisheye, and spherical image datasets validate the superiority of the proposed ULSD to the SOTA methods both in accuracy and efficiency (40.6fps for pinhole images). The source code is available at https://github.com/lh9171338/Unified-LineSegment-Detection.

Related papers

• RoFIR: Robust Fisheye Image Rectification Framework Impervious to Optical Center Deviation [88.54817424560056]
  We propose a distortion vector map (DVM) that measures the degree and direction of local distortion. By learning the DVM, the model can independently identify local distortions at each pixel without relying on global distortion patterns. In the pre-training stage, it predicts the distortion vector map and perceives the local distortion features of each pixel. In the fine-tuning stage, it predicts a pixel-wise flow map for deviated fisheye image rectification.
  arXiv  Detail & Related papers  (2024-06-27T06:38:56Z)
• DeepLSD: Line Segment Detection and Refinement with Deep Image Gradients [105.25109274550607]
  Line segments are increasingly used in vision tasks. Traditional line detectors based on the image gradient are extremely fast and accurate, but lack robustness in noisy images and challenging conditions. We propose to combine traditional and learned approaches to get the best of both worlds: an accurate and robust line detector.
  arXiv  Detail & Related papers  (2022-12-15T12:36:49Z)
• Detecting Line Segments in Motion-blurred Images with Events [38.39698414942873]
  Existing line segment detection methods face severe performance degradation when detecting line segments when motion blur occurs. We propose to leverage the complementary information of images and events to robustly detect line segments over motion blurs. Our method achieves 63.3% mean structural average precision (msAP) with the model pre-trained on the FE-Wireframe and fine-tuned on the FE-Blurframe.
  arXiv  Detail & Related papers  (2022-11-14T14:00:03Z)
• NeRF-SOS: Any-View Self-supervised Object Segmentation from Complex Real-World Scenes [80.59831861186227]
  This paper carries out the exploration of self-supervised learning for object segmentation using NeRF for complex real-world scenes. Our framework, called NeRF with Self-supervised Object NeRF-SOS, encourages NeRF models to distill compact geometry-aware segmentation clusters. It consistently surpasses other 2D-based self-supervised baselines and predicts finer semantics masks than existing supervised counterparts.
  arXiv  Detail & Related papers  (2022-09-19T06:03:17Z)
• ELSD: Efficient Line Segment Detector and Descriptor [9.64386089593887]
  We present the novel Efficient Line Segment Detector and Descriptor (ELSD) to simultaneously detect line segments and extract their descriptors in an image. ELSD provides the essential line features to the higher-level tasks like SLAM and image matching in real time. In the experiments, the proposed ELSD achieves the state-of-the-art performance on the Wireframe dataset and YorkUrban dataset.
  arXiv  Detail & Related papers  (2021-04-29T08:53:03Z)
• Fully Convolutional Line Parsing [25.80938920093857]
  We present a one-stage Fully Convolutional Line Parsing network (F-Clip) that detects line segments from images. F-Clip detects line segments in an end-to-end fashion by predicting them with each line's center position, length, and angle. We conduct extensive experiments and show that our method achieves a significantly better trade-off between efficiency and accuracy.
  arXiv  Detail & Related papers  (2021-04-22T17:41:12Z)
• SOLD2: Self-supervised Occlusion-aware Line Description and Detection [95.8719432775724]
  We introduce the first joint detection and description of line segments in a single deep network. Our method does not require any annotated line labels and can therefore generalize to any dataset. We evaluate our approach against previous line detection and description methods on several multi-view datasets.
  arXiv  Detail & Related papers  (2021-04-07T19:27:17Z)
• Learning Hybrid Representations for Automatic 3D Vessel Centerline Extraction [57.74609918453932]
  Automatic blood vessel extraction from 3D medical images is crucial for vascular disease diagnoses. Existing methods may suffer from discontinuities of extracted vessels when segmenting such thin tubular structures from 3D images. We argue that preserving the continuity of extracted vessels requires to take into account the global geometry. We propose a hybrid representation learning approach to address this challenge.
  arXiv  Detail & Related papers  (2020-12-14T05:22:49Z)
• Fisheye Distortion Rectification from Deep Straight Lines [34.61402494687801]
  We present a novel line-aware rectification network (LaRecNet) to address the problem of fisheye distortion rectification. Our model achieves state-of-the-art performance in terms of both geometric accuracy and image quality. In particular, the images rectified by LaRecNet achieve the highest peak signal-to-noise ratio (PSNR) and structure similarity index (SSIM) compared with the groundtruth.
  arXiv  Detail & Related papers  (2020-03-25T13:20:00Z)
• Holistically-Attracted Wireframe Parsing [123.58263152571952]
  This paper presents a fast and parsimonious parsing method to detect a vectorized wireframe in an input image with a single forward pass. The proposed method is end-to-end trainable, consisting of three components: (i) line segment and junction proposal generation, (ii) line segment and junction matching, and (iii) line segment and junction verification.
  arXiv  Detail & Related papers  (2020-03-03T17:43:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.