Robust Anomaly Detection through Multi-Modal Autoencoder Fusion for Small Vehicle Damage Detection

• URL: http://arxiv.org/abs/2509.01719v2
• Date: Fri, 17 Oct 2025 19:46:19 GMT
• Title: Robust Anomaly Detection through Multi-Modal Autoencoder Fusion for Small Vehicle Damage Detection
• Authors: Sara Khan, Mehmed Yüksel, Frank Kirchner,
• Abstract summary: Wear and tear detection in fleet and shared vehicle systems is a critical challenge, particularly in rental and car-sharing services.<n>Currently, manual inspection methods are the default approach, but are labour-intensive and prone to human error.<n>This work introduces a novel multi-modal architecture based on anomaly detection to address these issues.
• Score: 4.932130498861987
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Wear and tear detection in fleet and shared vehicle systems is a critical challenge, particularly in rental and car-sharing services, where minor damage, such as dents, scratches, and underbody impacts, often goes unnoticed or is detected too late. Currently, manual inspection methods are the default approach, but are labour-intensive and prone to human error. In contrast, state-of-the-art image-based methods are less reliable when the vehicle is moving, and they cannot effectively capture underbody damage due to limited visual access and spatial coverage. This work introduces a novel multi-modal architecture based on anomaly detection to address these issues. Sensors such as Inertial Measurement Units (IMUs) and microphones are integrated into a compact device mounted on the vehicle's windshield. This approach supports real-time damage detection while avoiding the need for highly resource-intensive sensors. We developed multiple variants of multi-modal autoencoder-based architectures and evaluated them against unimodal and state-of-the-art methods. Our multi-modal ensemble model with pooling achieved the highest performance, with a Receiver Operating Characteristic-Area Under Curve (ROC-AUC) of 92%, demonstrating its effectiveness in real-world applications. This approach can also be extended to other applications, such as improving automotive safety. It can integrate with airbag systems for efficient deployment and help autonomous vehicles by complementing other sensors in collision detection.

Related papers

• AttentionGuard: Transformer-based Misbehavior Detection for Secure Vehicular Platoons [0.0]
  Vehicle platooning is vulnerable to sophisticated falsification attacks by authenticated insiders.<n>We present AttentionGuard, a transformer-based framework for misbehavior detection.<n>We show that AttentionGuard achieves up to 0.95 F1-score in attack detection, with robust performance maintained during complex maneuvers.
  arXiv  Detail & Related papers  (2025-05-15T13:24:09Z)
• Lane-Wise Highway Anomaly Detection [8.086502588472783]
  This paper proposes a scalable and interpretable framework for lane-wise highway traffic anomaly detection.<n>Unlike traditional sensor-dependent methods, our approach uses AI-powered vision models to extract lane-specific features.<n>Our framework outperforms state-of-the-art methods in precision, recall, and F1-score.
  arXiv  Detail & Related papers  (2025-05-05T12:32:23Z)
• Optimizing Multispectral Object Detection: A Bag of Tricks and Comprehensive Benchmarks [49.84182981950623]
  Multispectral object detection, utilizing RGB and TIR (thermal infrared) modalities, is widely recognized as a challenging task.<n>It requires not only the effective extraction of features from both modalities and robust fusion strategies, but also the ability to address issues such as spectral discrepancies.<n>We introduce an efficient and easily deployable multispectral object detection framework that can seamlessly optimize high-performing single-modality models.
  arXiv  Detail & Related papers  (2024-11-27T12:18:39Z)
• DARTH: Holistic Test-time Adaptation for Multiple Object Tracking [87.72019733473562]
  Multiple object tracking (MOT) is a fundamental component of perception systems for autonomous driving. Despite the urge of safety in driving systems, no solution to the MOT adaptation problem to domain shift in test-time conditions has ever been proposed. We introduce DARTH, a holistic test-time adaptation framework for MOT.
  arXiv  Detail & Related papers  (2023-10-03T10:10:42Z)
• Unsupervised Domain Adaptation for Self-Driving from Past Traversal Features [69.47588461101925]
  We propose a method to adapt 3D object detectors to new driving environments. Our approach enhances LiDAR-based detection models using spatial quantized historical features. Experiments on real-world datasets demonstrate significant improvements.
  arXiv  Detail & Related papers  (2023-09-21T15:00:31Z)
• Cross-Domain Car Detection Model with Integrated Convolutional Block Attention Mechanism [3.3843451892622576]
  Cross-domain car target detection model with integrated convolutional block Attention mechanism is proposed. Experimental results show that the performance of the model improves by 40% over the model without our framework.
  arXiv  Detail & Related papers  (2023-05-31T17:28:13Z)
• Robust and Fast Vehicle Detection using Augmented Confidence Map [10.261351772602543]
  We introduce the concept of augmentation which highlights the region of interest containing the vehicles. The output of MR-MSER is supplied to fast CNN to generate a confidence map. Unlike existing models that implement complicated models for vehicle detection, we explore the combination of a rough set and fuzzy-based models.
  arXiv  Detail & Related papers  (2023-04-27T18:41:16Z)
• Camera-Radar Perception for Autonomous Vehicles and ADAS: Concepts, Datasets and Metrics [77.34726150561087]
  This work aims to carry out a study on the current scenario of camera and radar-based perception for ADAS and autonomous vehicles. Concepts and characteristics related to both sensors, as well as to their fusion, are presented. We give an overview of the Deep Learning-based detection and segmentation tasks, and the main datasets, metrics, challenges, and open questions in vehicle perception.
  arXiv  Detail & Related papers  (2023-03-08T00:48:32Z)
• Spatial-Temporal Anomaly Detection for Sensor Attacks in Autonomous Vehicles [1.7188280334580195]
  Time-of-flight (ToF) distance measurement devices are vulnerable to spoofing, triggering and false data injection attacks. We propose a spatial-temporal anomaly detection model textitSTAnDS which incorporates a residual error spatial detector, with a time-based expected change detection.
  arXiv  Detail & Related papers  (2022-12-15T12:21:27Z)
• Exploiting Playbacks in Unsupervised Domain Adaptation for 3D Object Detection [55.12894776039135]
  State-of-the-art 3D object detectors, based on deep learning, have shown promising accuracy but are prone to over-fit to domain idiosyncrasies. We propose a novel learning approach that drastically reduces this gap by fine-tuning the detector on pseudo-labels in the target domain. We show, on five autonomous driving datasets, that fine-tuning the detector on these pseudo-labels substantially reduces the domain gap to new driving environments.
  arXiv  Detail & Related papers  (2021-03-26T01:18:11Z)
• Exploring Adversarial Robustness of Multi-Sensor Perception Systems in Self Driving [87.3492357041748]
  In this paper, we showcase practical susceptibilities of multi-sensor detection by placing an adversarial object on top of a host vehicle. Our experiments demonstrate that successful attacks are primarily caused by easily corrupted image features. Towards more robust multi-modal perception systems, we show that adversarial training with feature denoising can boost robustness to such attacks significantly.
  arXiv  Detail & Related papers  (2021-01-17T21:15:34Z)
• Automotive Radar Interference Mitigation with Unfolded Robust PCA based on Residual Overcomplete Auto-Encoder Blocks [88.46770122522697]
  In autonomous driving, radar systems play an important role in detecting targets such as other vehicles on the road. Deep learning methods for automotive radar interference mitigation can succesfully estimate the amplitude of targets, but fail to recover the phase of the respective targets. We propose an efficient and effective technique that is able to estimate both amplitude and phase in the presence of interference.
  arXiv  Detail & Related papers  (2020-10-14T09:41:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.