Leveraging Structure from Motion to Localize Inaccessible Bus Stops

• URL: http://arxiv.org/abs/2210.03646v1
• Date: Fri, 7 Oct 2022 15:55:34 GMT
• Title: Leveraging Structure from Motion to Localize Inaccessible Bus Stops
• Authors: Indu Panigrahi, Tom Bu, Christoph Mertz
• Abstract summary: This paper examines the detection of snow-covered sidewalks along bus routes. We introduce a method that utilizes Structure from Motion (SfM) rather than additional annotated data. Although we demonstrate an application for snow coverage along bus routes, this method can extend to other hazardous conditions as well.
• Score: 1.933681537640272
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The detection of hazardous conditions near public transit stations is necessary for ensuring the safety and accessibility of public transit. Smart city infrastructures aim to facilitate this task among many others through the use of computer vision. However, most state-of-the-art computer vision models require thousands of images in order to perform accurate detection, and there exist few images of hazardous conditions as they are generally rare. In this paper, we examine the detection of snow-covered sidewalks along bus routes. Previous work has focused on detecting other vehicles in heavy snowfall or simply detecting the presence of snow. However, our application has an added complication of determining if the snow covers areas of importance and can cause falls or other accidents (e.g. snow covering a sidewalk) or simply covers some background area (e.g. snow on a neighboring field). This problem involves localizing the positions of the areas of importance when they are not necessarily visible. We introduce a method that utilizes Structure from Motion (SfM) rather than additional annotated data to address this issue. Specifically, our method learns the locations of sidewalks in a given scene by applying a segmentation model and SfM to images from bus cameras during clear weather. Then, we use the learned locations to detect if and where the sidewalks become obscured with snow. After evaluating across various threshold parameters, we identify an optimal range at which our method consistently classifies different categories of sidewalk images correctly. Although we demonstrate an application for snow coverage along bus routes, this method can extend to other hazardous conditions as well. Code for this project is available at https://github.com/ind1010/SfM_for_BusEdge.

Related papers

• Nordic Vehicle Dataset (NVD): Performance of vehicle detectors using newly captured NVD from UAV in different snowy weather conditions [1.7452931180966467]
  Vehicle detection and recognition in drone images is a complex problem that has been used for different safety purposes. Various techniques have been employed to detect and track vehicles in different weather conditions. detecting vehicles in heavy snow is still in the early stages because of a lack of available data. This study aims to address this gap by providing data on vehicles captured by UAVs in different settings and under various snow cover conditions in the Nordic region.
  arXiv  Detail & Related papers  (2023-04-27T18:55:43Z)
• Road Detection in Snowy Forest Environment using RGB Camera [0.0]
  This paper introduces detection of snowy road in forest environment using RGB camera. The method combines noise filtering technique with morphological operation to classify the image component. The performance of algorithm is evaluated by two error value: False Negative Rate and False Positive Rate.
  arXiv  Detail & Related papers  (2022-12-16T14:49:27Z)
• Image-to-Image Translation for Autonomous Driving from Coarsely-Aligned Image Pairs [57.33431586417377]
  A self-driving car must be able to handle adverse weather conditions to operate safely. In this paper, we investigate the idea of turning sensor inputs captured in an adverse condition into a benign one. We show that our coarsely-aligned training scheme leads to a better image translation quality and improved downstream tasks.
  arXiv  Detail & Related papers  (2022-09-23T16:03:18Z)
• Location-Free Camouflage Generation Network [82.74353843283407]
  Camouflage is a common visual phenomenon, which refers to hiding the foreground objects into the background images, making them briefly invisible to the human eye. This paper proposes a novel Location-free Camouflage Generation Network (LCG-Net) that fuse high-level features of foreground and background image, and generate result by one inference. Experiments show that our method has results as satisfactory as state-of-the-art in the single-appearance regions and are less likely to be completely invisible, but far exceed the quality of the state-of-the-art in the multi-appearance regions.
  arXiv  Detail & Related papers  (2022-03-18T10:33:40Z)
• Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Images [128.881857704338]
  We study the problem of extracting a directed graph representing the local road network in BEV coordinates, from a single onboard camera image. We show that the method can be extended to detect dynamic objects on the BEV plane. We validate our approach against powerful baselines and show that our network achieves superior performance.
  arXiv  Detail & Related papers  (2021-10-05T12:40:33Z)
• Deep Dense Multi-scale Network for Snow Removal Using Semantic and Geometric Priors [78.61844008368587]
  We propose a Deep Dense Multi-Scale Network (textbfDDMSNet) for snow removal by exploiting semantic and geometric priors. We incorporate the semantic and geometric maps as input and learn the semantic-aware and geometry-aware representation to remove snow.
  arXiv  Detail & Related papers  (2021-03-21T03:30:30Z)
• Snowy Night-to-Day Translator and Semantic Segmentation Label Similarity for Snow Hazard Indicator [0.0]
  In 2021, Japan recorded more than three times as much snowfall as usual, so road user maybe come across dangerous situation. This paper propose a method to automate a snow hazard indicator that the road surface region is generated from the night snow image.
  arXiv  Detail & Related papers  (2021-02-28T16:08:07Z)
• Road Surface Translation Under Snow-covered and Semantic Segmentation for Snow Hazard Index [0.0]
  This study proposes a deep learning application with live image post-processing to automatically calculate a snow hazard ratio indicator. Based on these trained networks, we automatically compute the road to snow rate hazard index, indicating the amount of snow covered on the road surface.
  arXiv  Detail & Related papers  (2021-01-14T14:25:12Z)
• End-to-End Deep Structured Models for Drawing Crosswalks [98.9901717499058]
  We project both inputs onto the ground surface to produce a top down view of the scene. We then leverage convolutional neural networks to extract semantic cues about the location of the crosswalks. Experiments over crosswalks in a large city area show that 96.6% automation can be achieved.
  arXiv  Detail & Related papers  (2020-12-21T18:59:08Z)
• BoMuDANet: Unsupervised Adaptation for Visual Scene Understanding in Unstructured Driving Environments [54.22535063244038]
  We present an unsupervised adaptation approach for visual scene understanding in unstructured traffic environments. Our method is designed for unstructured real-world scenarios with dense and heterogeneous traffic consisting of cars, trucks, two-and three-wheelers, and pedestrians.
  arXiv  Detail & Related papers  (2020-09-22T08:25:44Z)
• DAWN: Vehicle Detection in Adverse Weather Nature Dataset [4.09920839425892]
  We present a new dataset consisting of real-world images collected under various adverse weather conditions called DAWN. The dataset comprises a collection of 1000 images from real-traffic environments, which are divided into four sets of weather conditions: fog, snow, rain and sandstorms. This data helps interpreting effects caused by the adverse weather conditions on the performance of vehicle detection systems.
  arXiv  Detail & Related papers  (2020-08-12T15:48:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.