CooperScene: Multi-Modal Cooperative Autonomy Benchmark with C-V2X Communication Characterization

• URL: http://arxiv.org/abs/2606.31219v1
• Date: Tue, 30 Jun 2026 06:57:27 GMT
• Title: CooperScene: Multi-Modal Cooperative Autonomy Benchmark with C-V2X Communication Characterization
• Abstract summary: CooperScene is a high-fidelity cooperative autonomy dataset with real-world C-V2X communication characterization.<n>Scenes involve three connected and autonomous vehicles (CAVs) and one infrastructure roadside unit (RSU)<n>All scenes are annotated with globally consistent 3D labels at 10 Hz, totaling 344K objects across 59K frames.
• Score: 18.54472796888168
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Cellular vehicle-to-everything (C-V2X) enables cooperative perception, prediction, and planning beyond the field of view of individual agents. However, existing datasets often overlook the complexities of real-world deployment, such as limited communication bandwidth and its dynamics, heterogeneous sensing modalities, and scalability beyond a single cooperative partner. In this paper, we introduce CooperScene, a high-fidelity cooperative autonomy dataset with real-world C-V2X communication characterization. The dataset is organized into diverse scenes, including intersections, highway ramps, and parking lots. These scenes involve three connected and autonomous vehicles (CAVs) and one infrastructure roadside unit (RSU), all equipped with multi-modal sensors and commercial off-the-shelf C-V2X communication radios. All scenes are annotated with globally consistent 3D labels at 10 Hz, totaling 344K objects across 59K frames, underpinned by tight sensor- and agent-synchronization, centimeter-level localization and spatial alignment, precise cross-modality calibration, and 3GPP-standard-compliant C-V2X communication. CooperScene establishes a rigorous benchmark for evaluating multi-agent scaling and actual performance in real-world deployable settings. Project website for data and benchmark: https://cisl.ucr.edu/CooperScene

Related papers

• SimBEV2X: A Large-Scale Dataset and Data Generation Tool for Multi-Task Vehicle-to-Everything Cooperative Perception [82.16905244601558]
  Vehicle-to-everything (V2X) communication can overcome the inherent physical limitations of individual autonomous vehicles.<n>The development of robust V2X algorithms is hampered by the lack of large-scale, multi-modal, multi-task datasets.<n>We introduce SimBEV2X, an advanced synthetic data generation tool built on the CARLA simulator.
  arXiv  Detail & Related papers  (2026-07-27T00:55:44Z)
• CATS-V2V: A Real-World Vehicle-to-Vehicle Cooperative Perception Dataset with Complex Adverse Traffic Scenarios [25.181569981722976]
  We introduce CATS-V2V, the first-of-its-kind real-world dataset for V2V cooperative perception under complex adverse traffic scenarios.<n>The 100-clip dataset includes 60K frames of 10 Hz LiDAR point clouds and 1.26M multi-view 30 Hz camera images.<n>On this basis, we propose a target-based temporal alignment method, ensuring that all objects are precisely aligned across all sensor modalities.
  arXiv  Detail & Related papers  (2025-11-14T11:07:04Z)
• UrbanIng-V2X: A Large-Scale Multi-Vehicle, Multi-Infrastructure Dataset Across Multiple Intersections for Cooperative Perception [45.81880967650386]
  UrbanIng-V2X consists of 34 temporally aligned and spatially calibrated sensor sequences lasting 20 seconds.<n>All sequences are annotated at a frequency of 10 Hz with 3D bounding boxes spanning 13 object classes.<n>In total, UrbanIng-V2X provides data from 12 vehicle-mounted RGB cameras, 2 vehicle LiDARs, 17 infrastructure thermal cameras, and 12 infrastructure LiDARs.
  arXiv  Detail & Related papers  (2025-10-27T16:12:12Z)
• AGC-Drive: A Large-Scale Dataset for Real-World Aerial-Ground Collaboration in Driving Scenarios [68.84774511206797]
  We present AGC-Drive, the first large-scale real-world dataset for Aerial-Ground Cooperative 3D perception.<n>AGC-Drive contains 350 scenes, each with approximately 100 frames and fully annotated 3D bounding boxes covering 13 object categories.<n>We provide benchmarks for two 3D perception tasks: vehicle-to-vehicle collaborative perception and vehicle-to-Ground collaborative perception.
  arXiv  Detail & Related papers  (2025-06-19T14:48:43Z)
• WHALES: A Multi-Agent Scheduling Dataset for Enhanced Cooperation in Autonomous Driving [14.977628973132099]
  We introduce WHALES, the first large-scale V2X dataset explicitly designed to benchmark communication-aware agent scheduling and scalable cooperative perception.<n>WHALES features an average of 8.4 cooperative agents per scene and 2.01 million annotated 3D objects across diverse traffic scenarios.<n>It incorporates detailed communication metadata to emulate real-world communication bottlenecks, enabling rigorous evaluation of scheduling strategies.
  arXiv  Detail & Related papers  (2024-11-20T14:12:34Z)
• Multi-V2X: A Large Scale Multi-modal Multi-penetration-rate Dataset for Cooperative Perception [3.10770247120758]
  We introduce Multi-V2X, a large-scale, multi-modal, multi-penetration-rate dataset for V2X perception. In total, our Multi-V2X dataset comprises 549k RGB frames, 146k LiDAR frames, and 4,219k annotated 3D bounding boxes. The highest possible CAV penetration rate reaches 86.21%, with up to 31 agents in communication range.
  arXiv  Detail & Related papers  (2024-09-08T05:22:00Z)
• CooPre: Cooperative Pretraining for V2X Cooperative Perception [47.00472259100765]
  CooPre is a self-supervised learning framwork for V2X cooperative perception.<n>We develop a V2X bird-eye-view (BEV) guided masking strategy which effectively allows the model to pay attention to 3D features across heterogeneous V2X agents.<n>CooPre achieves a 4% mAP improvement on V2X-Real dataset and surpasses baseline performance using only 50% of the training data.
  arXiv  Detail & Related papers  (2024-08-20T23:39:26Z)
• V2X-Real: a Large-Scale Dataset for Vehicle-to-Everything Cooperative Perception [22.3955949838171]
  We present V2X-Real, a large-scale dataset that includes a mixture of multiple vehicles and smart infrastructure.<n>Our dataset contains 33K LiDAR frames and 171K camera data with over 1.2M annotated bounding boxes of 10 categories in very challenging urban scenarios.
  arXiv  Detail & Related papers  (2024-03-24T06:30:02Z)
• V2V4Real: A Real-world Large-scale Dataset for Vehicle-to-Vehicle Cooperative Perception [49.7212681947463]
  Vehicle-to-Vehicle (V2V) cooperative perception system has great potential to revolutionize the autonomous driving industry. We present V2V4Real, the first large-scale real-world multi-modal dataset for V2V perception. Our dataset covers a driving area of 410 km, comprising 20K LiDAR frames, 40K RGB frames, 240K annotated 3D bounding boxes for 5 classes, and HDMaps.
  arXiv  Detail & Related papers  (2023-03-14T02:49:20Z)
• V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformer [58.71845618090022]
  We build a holistic attention model, namely V2X-ViT, to fuse information across on-road agents. V2X-ViT consists of alternating layers of heterogeneous multi-agent self-attention and multi-scale window self-attention. To validate our approach, we create a large-scale V2X perception dataset.
  arXiv  Detail & Related papers  (2022-03-20T20:18:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.