Real-time Deer Detection and Warning in Connected Vehicles via Thermal Sensing and Deep Learning

• URL: http://arxiv.org/abs/2509.18779v1
• Date: Tue, 23 Sep 2025 08:16:25 GMT
• Title: Real-time Deer Detection and Warning in Connected Vehicles via Thermal Sensing and Deep Learning
• Abstract summary: Deer-vehicle collisions represent a critical safety challenge in the United States.<n>This paper presents a real-time detection and driver warning system that integrates thermal imaging, deep learning, and vehicle-to-everything communication.<n>Our system achieves end to end latency consistently under 100 milliseconds from detection to driver alert.
• Score: 2.5690062252357184
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Deer-vehicle collisions represent a critical safety challenge in the United States, causing nearly 2.1 million incidents annually and resulting in approximately 440 fatalities, 59,000 injuries, and 10 billion USD in economic damages. These collisions also contribute significantly to declining deer populations. This paper presents a real-time detection and driver warning system that integrates thermal imaging, deep learning, and vehicle-to-everything communication to help mitigate deer-vehicle collisions. Our system was trained and validated on a custom dataset of over 12,000 thermal deer images collected in Mars Hill, North Carolina. Experimental evaluation demonstrates exceptional performance with 98.84 percent mean average precision, 95.44 percent precision, and 95.96 percent recall. The system was field tested during a follow-up visit to Mars Hill and readily sensed deer providing the driver with advanced warning. Field testing validates robust operation across diverse weather conditions, with thermal imaging maintaining between 88 and 92 percent detection accuracy in challenging scenarios where conventional visible light based cameras achieve less than 60 percent effectiveness. When a high probability threshold is reached sensor data sharing messages are broadcast to surrounding vehicles and roadside units via cellular vehicle to everything (CV2X) communication devices. Overall, our system achieves end to end latency consistently under 100 milliseconds from detection to driver alert. This research establishes a viable technological pathway for reducing deer-vehicle collisions through thermal imaging and connected vehicles.

Related papers

• Radar Guided Camera Verification for Automatic Emergency Braking Rethinking Object Detection in Radar Camera Fusion [1.8505741812953405]
  We propose a radar scoped edge density gate that performs obstacle verification within radar guided image regions of interest.<n>The proposed approach reduced the camera search space by up to 98.7 percentage.<n>Across 33 staged threat scenarios, the complete AEB system recorded zero missed brake events.
  arXiv  Detail & Related papers  (2026-06-25T21:13:00Z)
• Smart Railway Obstruction Detection System using IoT and Computer Vision [10.140020973493508]
  NETRA is a cost-effective, internet-independent intrusion detection system deployed on Raspberry Pi Zero W and Raspberry Pi 4 edge platforms.<n>It identifies threats including humans, large animals, and track obstructions.<n>Confirmed threats are transmitted via LoRa to alert the locomotive driver within 2.4 seconds end-to-end.
  arXiv  Detail & Related papers  (2026-05-07T10:16:32Z)
• Intelligent Traffic Surveillance for Real-Time Vehicle Detection, License Plate Recognition, and Speed Estimation [0.0]
  This study proposes a real-time intelligent traffic surveillance system tailored to developing countries.<n>License plate detection using YOLOv8 achieved a mean average precision (mAP) of 97.9%.<n>Speed estimation used source and target regions of interest, yielding a good performance of 10 km/h margin of error.
  arXiv  Detail & Related papers  (2026-01-01T13:54:29Z)
• AVOID: The Adverse Visual Conditions Dataset with Obstacles for Driving Scene Understanding [48.97660297411286]
  We introduce AVOID, a new dataset for real-time obstacle detection in a simulated environment.<n>AVOID consists of a large set of unexpected road obstacles located along each path captured under various weather and time conditions.<n>Each image is coupled with the corresponding semantic and depth maps, raw and semantic LiDAR data, and waypoints.
  arXiv  Detail & Related papers  (2025-12-29T05:34:26Z)
• AVOID-JACK: Avoidance of Jackknifing for Swarms of Long Heavy Articulated Vehicles [0.7176906280023593]
  This paper presents a novel approach to avoiding jackknifing and mutual collisions in Heavy Articulated Vehicles (HAVs) by leveraging decentralized swarm intelligence.<n>Despite its relevance to real-world applications such as logistics automation, remote mining, airport baggage transport, and agricultural operations, this problem has not been addressed in the existing literature.<n>The method presented in this paper prioritizes jackknifing avoidance and establishes a foundation for mutual collision avoidance.
  arXiv  Detail & Related papers  (2025-11-11T09:18:42Z)
• PaniCar: Securing the Perception of Advanced Driving Assistance Systems Against Emergency Vehicle Lighting [24.66689267891143]
  We unveil PaniCar, a digital phenomenon that causes an object detector's confidence score to fluctuate below detection thresholds when exposed to activated emergency vehicle lighting.<n>This vulnerability poses a significant safety risk, and can cause autonomous vehicles to fail to detect objects near emergency vehicles.<n>We propose Caracetamol, a framework designed to enhance the resilience of object detectors against the effects of activated emergency vehicle lighting.
  arXiv  Detail & Related papers  (2025-05-08T12:33:48Z)
• An Efficient Ground-aerial Transportation System for Pest Control Enabled by AI-based Autonomous Nano-UAVs [45.07031440932014]
  We design, fine-tune, and optimize a tiny image-based convolutional neural network (CNN) for pest detection.<n>Our CNN runs in real-time at 6.8 frame/s, requiring 33 mW on a GWT GAP9 System-on-Chip aboard a Crazyflie nano-UAV.<n>In this scenario, our efficient transportation system, compared to a traditional single-ground vehicle performing both inspection and treatment, can save up to 20 h working time.
  arXiv  Detail & Related papers  (2025-02-20T11:14:55Z)
• Endangered Alert: A Field-Validated Self-Training Scheme for Detecting and Protecting Threatened Wildlife on Roads and Roadsides [10.412505957288406]
  This paper presents an innovative self-training methodology aimed at detecting rare animals, such as the cassowary in Australia.<n>The proposed method addresses critical real-world challenges, including acquiring and labelling sensor data for rare animal species.<n>It achieves this by leveraging cloud and edge computing, and automatic data labelling to improve the detection performance of the field-deployed model.
  arXiv  Detail & Related papers  (2024-12-16T07:44:27Z)
• Cognitive Accident Prediction in Driving Scenes: A Multimodality Benchmark [77.54411007883962]
  We propose a Cognitive Accident Prediction (CAP) method that explicitly leverages human-inspired cognition of text description on the visual observation and the driver attention to facilitate model training. CAP is formulated by an attentive text-to-vision shift fusion module, an attentive scene context transfer module, and the driver attention guided accident prediction module. We construct a new large-scale benchmark consisting of 11,727 in-the-wild accident videos with over 2.19 million frames.
  arXiv  Detail & Related papers  (2022-12-19T11:43:02Z)
• CODA: A Real-World Road Corner Case Dataset for Object Detection in Autonomous Driving [117.87070488537334]
  We introduce a challenging dataset named CODA that exposes this critical problem of vision-based detectors. The performance of standard object detectors trained on large-scale autonomous driving datasets significantly drops to no more than 12.8% in mAR. We experiment with the state-of-the-art open-world object detector and find that it also fails to reliably identify the novel objects in CODA.
  arXiv  Detail & Related papers  (2022-03-15T08:32:56Z)
• A Multi-Stage model based on YOLOv3 for defect detection in PV panels based on IR and Visible Imaging by Unmanned Aerial Vehicle [65.99880594435643]
  We propose a novel model to detect panel defects on aerial images captured by unmanned aerial vehicle. The model combines detections of panels and defects to refine its accuracy. The proposed model has been validated on two big PV plants in the south of Italy.
  arXiv  Detail & Related papers  (2021-11-23T08:04:32Z)
• METEOR: A Massive Dense & Heterogeneous Behavior Dataset for Autonomous Driving [42.69638782267657]
  We present a new and complex traffic dataset, METEOR, which captures traffic patterns in unstructured scenarios in India. METEOR consists of more than 1000 one-minute video clips, over 2 million annotated frames with ego-vehicle trajectories, and more than 13 million bounding boxes for surrounding vehicles or traffic agents. We use our novel dataset to evaluate the performance of object detection and behavior prediction algorithms.
  arXiv  Detail & Related papers  (2021-09-16T01:01:55Z)
• Incident Detection on Junctions Using Image Processing [0.0]
  Trajectory information is provided by vehicle detection and tracking algorithms on visual data streamed from a fisheye camera. The proposed system has achieved 84.6% success in vehicle detection and 96.8% success in abnormality detection on synthetic data.
  arXiv  Detail & Related papers  (2021-04-27T19:18:05Z)
• Exploiting Playbacks in Unsupervised Domain Adaptation for 3D Object Detection [55.12894776039135]
  State-of-the-art 3D object detectors, based on deep learning, have shown promising accuracy but are prone to over-fit to domain idiosyncrasies. We propose a novel learning approach that drastically reduces this gap by fine-tuning the detector on pseudo-labels in the target domain. We show, on five autonomous driving datasets, that fine-tuning the detector on these pseudo-labels substantially reduces the domain gap to new driving environments.
  arXiv  Detail & Related papers  (2021-03-26T01:18:11Z)
• Vehicle trajectory prediction in top-view image sequences based on deep learning method [1.181206257787103]
  Estimating and predicting surrounding vehicles' movement is essential for an automated vehicle and advanced safety systems. A model with low computational complexity is proposed, which is trained by images taken from the road's aerial image. The proposed model can predict the vehicle's future path in any freeway only by viewing the images related to the history of the target vehicle's movement and its neighbors.
  arXiv  Detail & Related papers  (2021-02-02T20:48:19Z)
• Computer Vision based Animal Collision Avoidance Framework for Autonomous Vehicles [0.0]
  Animals have been a common sighting on roads in India which leads to several accidents between them and vehicles every year. This makes it vital to develop a support system for driverless vehicles that assists in preventing these forms of accidents. We propose a framework for avoiding vehicle-to-animal collisions by developing an efficient approach for the detection of animals on highways.
  arXiv  Detail & Related papers  (2020-12-20T09:51:23Z)
• Physically Realizable Adversarial Examples for LiDAR Object Detection [72.0017682322147]
  We present a method to generate universal 3D adversarial objects to fool LiDAR detectors. In particular, we demonstrate that placing an adversarial object on the rooftop of any target vehicle to hide the vehicle entirely from LiDAR detectors with a success rate of 80%. This is one step closer towards safer self-driving under unseen conditions from limited training data.
  arXiv  Detail & Related papers  (2020-04-01T16:11:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.