Real-Time Idling Vehicles Detection using Combined Audio-Visual Deep Learning

• URL: http://arxiv.org/abs/2305.14579v3
• Date: Thu, 21 Sep 2023 21:16:15 GMT
• Title: Real-Time Idling Vehicles Detection using Combined Audio-Visual Deep Learning
• Authors: Xiwen Li, Tristalee Mangin, Surojit Saha, Evan Blanchard, Dillon Tang, Henry Poppe, Nathan Searle, Ouk Choi, Kerry Kelly, and Ross Whitaker
• Abstract summary: We present a real-time, dynamic vehicle idling detection algorithm. The proposed method relies on a multi-sensor, audio-visual, machine-learning workflow to detect idling vehicles. We test our system in real-time at a hospital drop-off point in Salt Lake City.
• Score: 1.2733164388167968
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Combustion vehicle emissions contribute to poor air quality and release greenhouse gases into the atmosphere, and vehicle pollution has been associated with numerous adverse health effects. Roadways with extensive waiting and/or passenger drop off, such as schools and hospital drop-off zones, can result in high incidence and density of idling vehicles. This can produce micro-climates of increased vehicle pollution. Thus, the detection of idling vehicles can be helpful in monitoring and responding to unnecessary idling and be integrated into real-time or off-line systems to address the resulting pollution. In this paper we present a real-time, dynamic vehicle idling detection algorithm. The proposed idle detection algorithm and notification rely on an algorithm to detect these idling vehicles. The proposed method relies on a multi-sensor, audio-visual, machine-learning workflow to detect idling vehicles visually under three conditions: moving, static with the engine on, and static with the engine off. The visual vehicle motion detector is built in the first stage, and then a contrastive-learning-based latent space is trained for classifying static vehicle engine sound. We test our system in real-time at a hospital drop-off point in Salt Lake City. This in-situ dataset was collected and annotated, and it includes vehicles of varying models and types. The experiments show that the method can detect engine switching on or off instantly and achieves 71.02 average precision (AP) for idle detections and 91.06 for engine off detections.

Related papers

• MEDAVET: Traffic Vehicle Anomaly Detection Mechanism based on spatial and temporal structures in vehicle traffic [2.8068840920981484]
  This paper aims to model vehicle tracking using computer vision to detect traffic anomalies on a highway. We develop the steps of detection, tracking, and analysis of traffic. Experimental results show that our method is acceptable on the Track4 test set.
  arXiv  Detail & Related papers  (2023-10-28T00:36:50Z)
• Efficient Real-time Smoke Filtration with 3D LiDAR for Search and Rescue with Autonomous Heterogeneous Robotic Systems [56.838297900091426]
  Smoke and dust affect the performance of any mobile robotic platform due to their reliance on onboard perception systems. This paper proposes a novel modular computation filtration pipeline based on intensity and spatial information.
  arXiv  Detail & Related papers  (2023-08-14T16:48:57Z)
• Automated Automotive Radar Calibration With Intelligent Vehicles [73.15674960230625]
  We present an approach for automated and geo-referenced calibration of automotive radar sensors. Our method does not require external modifications of a vehicle and instead uses the location data obtained from automated vehicles. Our evaluation on data from a real testing site shows that our method can correctly calibrate infrastructure sensors in an automated manner.
  arXiv  Detail & Related papers  (2023-06-23T07:01:10Z)
• Real-Time Accident Detection in Traffic Surveillance Using Deep Learning [0.8808993671472349]
  This paper presents a new efficient framework for accident detection at intersections for traffic surveillance applications. The proposed framework consists of three hierarchical steps, including efficient and accurate object detection based on the state-of-the-art YOLOv4 method. The robustness of the proposed framework is evaluated using video sequences collected from YouTube with diverse illumination conditions.
  arXiv  Detail & Related papers  (2022-08-12T19:07:20Z)
• Detection of Condensed Vehicle Gas Exhaust in LiDAR Point Clouds [7.924836086640871]
  We present a two-step approach for the detection of condensed vehicle gas exhaust. First, we identify for each vehicle in a scene its emission area and detect gas exhaust if present. Then, isolated clouds are detected by modeling through time the regions of space where gas exhaust is likely to be present.
  arXiv  Detail & Related papers  (2022-07-11T14:36:27Z)
• Real Time Monocular Vehicle Velocity Estimation using Synthetic Data [78.85123603488664]
  We look at the problem of estimating the velocity of road vehicles from a camera mounted on a moving car. We propose a two-step approach where first an off-the-shelf tracker is used to extract vehicle bounding boxes and then a small neural network is used to regress the vehicle velocity.
  arXiv  Detail & Related papers  (2021-09-16T13:10:27Z)
• Exploiting Playbacks in Unsupervised Domain Adaptation for 3D Object Detection [55.12894776039135]
  State-of-the-art 3D object detectors, based on deep learning, have shown promising accuracy but are prone to over-fit to domain idiosyncrasies. We propose a novel learning approach that drastically reduces this gap by fine-tuning the detector on pseudo-labels in the target domain. We show, on five autonomous driving datasets, that fine-tuning the detector on these pseudo-labels substantially reduces the domain gap to new driving environments.
  arXiv  Detail & Related papers  (2021-03-26T01:18:11Z)
• V2VNet: Vehicle-to-Vehicle Communication for Joint Perception and Prediction [74.42961817119283]
  We use vehicle-to-vehicle (V2V) communication to improve the perception and motion forecasting performance of self-driving vehicles. By intelligently aggregating the information received from multiple nearby vehicles, we can observe the same scene from different viewpoints.
  arXiv  Detail & Related papers  (2020-08-17T17:58:26Z)
• Testing the Safety of Self-driving Vehicles by Simulating Perception and Prediction [88.0416857308144]
  We propose an alternative to sensor simulation, as sensor simulation is expensive and has large domain gaps. We directly simulate the outputs of the self-driving vehicle's perception and prediction system, enabling realistic motion planning testing.
  arXiv  Detail & Related papers  (2020-08-13T17:20:02Z)
• Hearing What You Cannot See: Acoustic Vehicle Detection Around Corners [5.4960756528016335]
  We show that approaching vehicles behind blind corners can be detected by sound before such vehicles enter in line-of-sight. We have equipped a research vehicle with a roof-mounted microphone array, and show on data collected with this sensor setup. A novel method is presented to classify if and from what direction a vehicle is approaching before it is visible.
  arXiv  Detail & Related papers  (2020-07-30T20:57:13Z)
• Anomalous Motion Detection on Highway Using Deep Learning [14.617786106427834]
  This paper presents a new anomaly detection dataset - the Highway Traffic Anomaly (HTA) dataset. We evaluate state-of-the-art deep learning anomaly detection models and propose novel variations to these methods.
  arXiv  Detail & Related papers  (2020-06-15T05:40:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.