Safety-Critical Learning for Long-Tail Events: The TUM Traffic Accident Dataset

• URL: http://arxiv.org/abs/2508.14567v1
• Date: Wed, 20 Aug 2025 09:38:50 GMT
• Title: Safety-Critical Learning for Long-Tail Events: The TUM Traffic Accident Dataset
• Authors: Walter Zimmer, Ross Greer, Xingcheng Zhou, Rui Song, Marc Pavel, Daniel Lehmberg, Ahmed Ghita, Akshay Gopalkrishnan, Mohan Trivedi, Alois Knoll,
• Abstract summary: We present the TUM Traffic Accident dataset, a collection of real-world highway accidents.<n>It contains ten sequences of vehicle crashes at high-speed driving with 294,924 labeled 2D and 93,012 labeled 3D boxes and track IDs within 48,144 labeled frames recorded from four roadside cameras and LiDARs at 10 Hz.<n>We propose Accid3nD, an accident detection model that combines a rule-based approach with a learning-based one.
• Score: 6.420737230522813
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Even though a significant amount of work has been done to increase the safety of transportation networks, accidents still occur regularly. They must be understood as an unavoidable and sporadic outcome of traffic networks. We present the TUM Traffic Accident (TUMTraf-A) dataset, a collection of real-world highway accidents. It contains ten sequences of vehicle crashes at high-speed driving with 294,924 labeled 2D and 93,012 labeled 3D boxes and track IDs within 48,144 labeled frames recorded from four roadside cameras and LiDARs at 10 Hz. The dataset contains ten object classes and is provided in the OpenLABEL format. We propose Accid3nD, an accident detection model that combines a rule-based approach with a learning-based one. Experiments and ablation studies on our dataset show the robustness of our proposed method. The dataset, model, and code are available on our project website: https://tum-traffic-dataset.github.io/tumtraf-a.

Related papers

• Towards Vision Zero: The TUM Traffic Accid3nD Dataset [18.133662927802614]
  We present the TUM Traffic Accid3nD dataset, a collection of real-world highway accidents in different weather and lighting conditions.<n>The dataset contains 111,945 labeled image and point cloud frames recorded from four roadside cameras and LiDARs at 25 Hz.<n>We propose an accident detection model that combines a rule-based approach with a learning-based one.
  arXiv  Detail & Related papers  (2025-03-15T11:42:16Z)
• Enhancing Highway Safety: Accident Detection on the A9 Test Stretch Using Roadside Sensors [6.420737230522813]
  Road traffic injuries are the leading cause of death for people aged 5-29, resulting in about 1.19 million deaths each year.<n>To reduce these fatalities, it is essential to address human errors like speeding, drunk driving, and distractions.<n>We propose an accident detection framework that combines a rule-based approach with a learning-based one.
  arXiv  Detail & Related papers  (2025-02-01T11:34:16Z)
• DAVE: Diverse Atomic Visual Elements Dataset with High Representation of Vulnerable Road Users in Complex and Unpredictable Environments [60.69159598130235]
  We present a new dataset, DAVE, designed for evaluating perception methods with high representation of Vulnerable Road Users (VRUs)<n>DAVE is a manually annotated dataset encompassing 16 diverse actor categories (spanning animals, humans, vehicles, etc.) and 16 action types (complex and rare cases like cut-ins, zigzag movement, U-turn, etc.)<n>Our experiments show that existing methods suffer degradation in performance when evaluated on DAVE, highlighting its benefit for future video recognition research.
  arXiv  Detail & Related papers  (2024-12-28T06:13:44Z)
• Advance Real-time Detection of Traffic Incidents in Highways using Vehicle Trajectory Data [3.061662434597097]
  This study uses vehicle trajectory data and traffic incident data on I-10, one of the most crash-prone highways in Louisiana. Various machine learning algorithms are used to detect a trajectory that is likely to face an incident in the downstream road section. Results suggest that the Random Forest model achieves the best performance for predicting an incident with reasonable recall value and discrimination capability.
  arXiv  Detail & Related papers  (2024-08-15T00:51:48Z)
• Learning Traffic Crashes as Language: Datasets, Benchmarks, and What-if Causal Analyses [76.59021017301127]
  We propose a large-scale traffic crash language dataset, named CrashEvent, summarizing 19,340 real-world crash reports. We further formulate the crash event feature learning as a novel text reasoning problem and further fine-tune various large language models (LLMs) to predict detailed accident outcomes. Our experiments results show that our LLM-based approach not only predicts the severity of accidents but also classifies different types of accidents and predicts injury outcomes.
  arXiv  Detail & Related papers  (2024-06-16T03:10:16Z)
• Abductive Ego-View Accident Video Understanding for Safe Driving Perception [75.60000661664556]
  We present MM-AU, a novel dataset for Multi-Modal Accident video Understanding. MM-AU contains 11,727 in-the-wild ego-view accident videos, each with temporally aligned text descriptions. We present an Abductive accident Video understanding framework for Safe Driving perception (AdVersa-SD)
  arXiv  Detail & Related papers  (2024-03-01T10:42:52Z)
• DeepAccident: A Motion and Accident Prediction Benchmark for V2X Autonomous Driving [76.29141888408265]
  We propose a large-scale dataset containing diverse accident scenarios that frequently occur in real-world driving. The proposed DeepAccident dataset includes 57K annotated frames and 285K annotated samples, approximately 7 times more than the large-scale nuScenes dataset.
  arXiv  Detail & Related papers  (2023-04-03T17:37:00Z)
• Augmenting Ego-Vehicle for Traffic Near-Miss and Accident Classification Dataset using Manipulating Conditional Style Translation [0.3441021278275805]
  There is no difference between accident and near-miss at the time before the accident happened. Our contribution is to redefine the accident definition and re-annotate the accident inconsistency on DADA-2000 dataset together with near-miss. The proposed method integrates two different components: conditional style translation (CST) and separable 3-dimensional convolutional neural network (S3D)
  arXiv  Detail & Related papers  (2023-01-06T22:04:47Z)
• Cognitive Accident Prediction in Driving Scenes: A Multimodality Benchmark [77.54411007883962]
  We propose a Cognitive Accident Prediction (CAP) method that explicitly leverages human-inspired cognition of text description on the visual observation and the driver attention to facilitate model training. CAP is formulated by an attentive text-to-vision shift fusion module, an attentive scene context transfer module, and the driver attention guided accident prediction module. We construct a new large-scale benchmark consisting of 11,727 in-the-wild accident videos with over 2.19 million frames.
  arXiv  Detail & Related papers  (2022-12-19T11:43:02Z)
• TAD: A Large-Scale Benchmark for Traffic Accidents Detection from Video Surveillance [2.1076255329439304]
  Existing datasets in traffic accidents are either small-scale, not from surveillance cameras, not open-sourced, or not built for freeway scenes. After integration and annotation by various dimensions, a large-scale traffic accidents dataset named TAD is proposed in this work.
  arXiv  Detail & Related papers  (2022-09-26T03:00:50Z)
• One Million Scenes for Autonomous Driving: ONCE Dataset [91.94189514073354]
  We introduce the ONCE dataset for 3D object detection in the autonomous driving scenario. The data is selected from 144 driving hours, which is 20x longer than the largest 3D autonomous driving dataset available. We reproduce and evaluate a variety of self-supervised and semi-supervised methods on the ONCE dataset.
  arXiv  Detail & Related papers  (2021-06-21T12:28:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.