A Vendor-Agnostic LiDAR Data Conversion System with Multi-Signal Detection and Multi-Format Output

• URL: http://arxiv.org/abs/2606.22881v1
• Date: Mon, 22 Jun 2026 05:46:41 GMT
• Title: A Vendor-Agnostic LiDAR Data Conversion System with Multi-Signal Detection and Multi-Format Output
• Abstract summary: LiDAR (Light Detection and Ranging) sensors capture the surrounding environment as dense 3D point clouds.<n>PCAP (Packet Capture) files from these sensors are the starting point of most 3D perception pipelines.<n>Ouster, Velodyne, Hesai, and Livox each require their own SDK (Software Development Kit), their own environment setup, and their own conversion workflow.
• Score: 0.30586855806896046
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: LiDAR (Light Detection and Ranging) sensors capture the surrounding environment as dense 3D point clouds by measuring the time-of-flight of emitted laser pulses, making them foundational across autonomous vehicles, robotics, and large-scale mapping. PCAP (Packet Capture) files from these sensors are the starting point of most 3D perception pipelines, yet internal packet structures, UDP (User Datagram Protocol) port conventions and encoding schemes differ enough across manufacturers that no single tool reads them all. Ouster, Velodyne, Hesai, and Livox each require their own SDK (Software Development Kit), their own environment setup, and their own conversion workflow. Supporting all four means maintaining four disconnected pipelines with no shared infrastructure. The pipeline described here takes a raw PCAP as input and handles vendor identification automatically, scoring six independent file characteristics through a weighted multi-signal approach to determine the source sensor. C++ SDKs handle Ouster and Velodyne, while Hesai and Livox rely on Python-based dpkt parsing where no open source SDK exists. From there, a single command writes output to any of five industry-standard formats. We tested on real outdoor captures. Ouster peaks at 2.08M points per second, Velodyne at 1.47M, both running through native C++ packet decoding. Hesai and Livox land at 110K and 150K respectively, where Python-layer parsing introduces overhead that compounds under sustained load. The 8-10x gap held consistently across runs. Tested on a consumer-grade i3 with 8GB RAM, no vendor configuration required

Related papers

• Pre-Compiled Pipeline Shards for Distributed LLM Inference on Intel AI PC Fleets [0.0]
  We show that a handful of AIPCs can serve models beyond the capability of any single one.<n>A four-node deployment of Lunar Lake AI PCs on Intel Tiber Cloud serves a single user at interactive speed.
  arXiv  Detail & Related papers  (2026-08-19T17:33:28Z)
• RAG-Based Auto-Configuration for Industrial Fieldbus Devices [2.623633900557428]
  Industrial device commissioning requires engineers to manually extract hundreds of protocol-specific parameters from PDF manuals.<n>This paper presents a production-oriented pipeline that automates device configuration end-to-end for OPC-UA, Profibus DP, and CANopen.
  arXiv  Detail & Related papers  (2026-08-09T10:07:13Z)
• string2string Studio: An Interactive, In-Browser Platform for String-to-String Algorithms [53.57099780847477]
  string2string Studio is an interactive in-browser platform for string-to-string analysis.<n>System integrates six main modules, operating at character, word, token, line, and residue levels.<n>Core operations run locally by default without any installation or data upload.
  arXiv  Detail & Related papers  (2026-08-04T17:48:15Z)
• Causal-TS: A Python Library for Causal Discovery in High-Dimensional and Nonstationary Time Series [0.0]
  Causal-TS is an open-source library for causal discovery in high-dimensional and nonstationary time series.<n>It provides four specialized algorithms-CDNOTS, CDNOTS+, CEDAR, and GRACE-along with wrappers for GES, Granger, LGES, and LGES.<n>A regime discovery pipeline detects structural breaks via pluggable changepoint detectors and runs discovery per regime with regime-specific parameters.<n>A command-line interface, synthetic data generators, and optional DoWhy integration provide an end-to-end pipeline from raw time series to causal effect estimates.
  arXiv  Detail & Related papers  (2026-07-27T17:14:48Z)
• OctoSense: Self-Supervised Learning for Multimodal Robot Perception [50.20346079739425]
  We present OctoSense, an open-source sensor platform with stereo and event cameras, LiDAR, a thermal camera, an inertial measurement unit, and proprioception (CAN bus data from a car, and joint angles for a quadruped robot)<n>The eponymous OctoSense dataset contains 59 hours of time-synchronized driving data across different types of environments at different times of the day.<n>We demonstrate multi-modal self-supervised learning using such real-world data, where sensors have different representations, frequencies, latencies and noise.
  arXiv  Detail & Related papers  (2026-06-25T17:30:49Z)
• INSIGHT: Indoor Scene Intelligence from Geometric-Semantic Hierarchy Transfer for Public~Safety [41.99844472131922]
  This paper presents INSIGHT, a pipeline that projects 2D image understanding into 3D metric space via registered RGB-D data.<n>We report per-point labeling accuracy on 7 shared classes, detection sensitivity for 15 safety-critical classes absent from public 3D benchmarks alongside code-capped deployable estimates.
  arXiv  Detail & Related papers  (2026-04-25T01:17:45Z)
• On-Device Vision Training, Deployment, and Inference on a Thumb-Sized Microcontroller [0.0]
  This paper presents an end-to-end on-device vision machine learning pipeline, executing entirely on a microcontroller-class device costing $15-40 USD.<n>Running on the Seeed Studio ESP32-S3 XI Kit MLAO (8 MB PSRAM), the firmware achieves three-class 64x64 image classification in approximately 9 minutes per training run, with real-time inference at 6.3 FPS.
  arXiv  Detail & Related papers  (2026-04-24T20:59:16Z)
• CapBench: A Multi-PDK Dataset for Machine-Learning-Based Post-Layout Capacitance Extraction [3.790585344640331]
  The dataset is derived from open-source designs, including single-core CPUs, systems-on-chip, and media accelerators.<n>High-fidelity capacitance labels are generated using RWCap, a state-of-the-art random-walk solver, and validated against the industry-standard Raphael.<n>We evaluate 10 machine learning architectures that illustrate dataset usage and serve as baselines, including convolutional neural networks (CNNs), point cloud transformers, and graph neural networks (GNNs)
  arXiv  Detail & Related papers  (2026-04-13T09:01:12Z)
• DrivePI: Spatial-aware 4D MLLM for Unified Autonomous Driving Understanding, Perception, Prediction and Planning [94.62097655403683]
  We propose DrivePI, a novel spatial-aware 4D MLLM that serves as a unified Vision-Language-Action framework.<n>Our method jointly performs spatial understanding, 3D perception, prediction (i.e., occupancy flow), and planning (i.e., action outputs) in parallel.<n>With only a 0.5B Qwen2.5 model as MLLM backbone, DrivePI as a single unified model matches or exceeds both existing VLA models and specialized VA models.
  arXiv  Detail & Related papers  (2025-12-14T18:45:54Z)
• Tiny QA Benchmark++: Ultra-Lightweight, Synthetic Multilingual Dataset Generation & Smoke-Tests for Continuous LLM Evaluation [0.0]
  Tiny QA Benchmark++ (TQB++) is designed to give large-language-model (LLM) pipelines a unit-test style safety net dataset that runs in seconds with minimal cost.<n>TQB++ couples a 52-item English gold set with a tiny synthetic-data generator pypi package built on provider-agnostic LiteLLM.<n>Every dataset ships with Croissant metadata and plug-and-play files for OpenAI-Evals, LangChain, and standard CI tools.
  arXiv  Detail & Related papers  (2025-05-17T15:40:03Z)
• PyPulse: A Python Library for Biosignal Imputation [58.35269251730328]
  We introduce PyPulse, a Python package for imputation of biosignals in both clinical and wearable sensor settings.<n>PyPulse's framework provides a modular and extendable framework with high ease-of-use for a broad userbase, including non-machine-learning bioresearchers.<n>We released PyPulse under the MIT License on Github and PyPI.
  arXiv  Detail & Related papers  (2024-12-09T11:00:55Z)
• UniTR: A Unified and Efficient Multi-Modal Transformer for Bird's-Eye-View Representation [113.35352122662752]
  We present an efficient multi-modal backbone for outdoor 3D perception named UniTR. UniTR processes a variety of modalities with unified modeling and shared parameters. UniTR is also a fundamentally task-agnostic backbone that naturally supports different 3D perception tasks.
  arXiv  Detail & Related papers  (2023-08-15T12:13:44Z)
• DADApy: Distance-based Analysis of DAta-manifolds in Python [51.37841707191944]
  DADApy is a python software package for analysing and characterising high-dimensional data. It provides methods for estimating the intrinsic dimension and the probability density, for performing density-based clustering and for comparing different distance metrics.
  arXiv  Detail & Related papers  (2022-05-04T08:41:59Z)
• End-to-End Pseudo-LiDAR for Image-Based 3D Object Detection [62.34374949726333]
  Pseudo-LiDAR (PL) has led to a drastic reduction in the accuracy gap between methods based on LiDAR sensors and those based on cheap stereo cameras. PL combines state-of-the-art deep neural networks for 3D depth estimation with those for 3D object detection by converting 2D depth map outputs to 3D point cloud inputs. We introduce a new framework based on differentiable Change of Representation (CoR) modules that allow the entire PL pipeline to be trained end-to-end.
  arXiv  Detail & Related papers  (2020-04-07T02:18:38Z)
• Near-chip Dynamic Vision Filtering for Low-Bandwidth Pedestrian Detection [99.94079901071163]
  This paper presents a novel end-to-end system for pedestrian detection using Dynamic Vision Sensors (DVSs) We target applications where multiple sensors transmit data to a local processing unit, which executes a detection algorithm. Our detector is able to perform a detection every 450 ms, with an overall testing F1 score of 83%.
  arXiv  Detail & Related papers  (2020-04-03T17:36:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.