TPE-Net: Track Point Extraction and Association Network for Rail Path Proposal Generation

• URL: http://arxiv.org/abs/2302.05803v1
• Date: Sat, 11 Feb 2023 22:49:06 GMT
• Title: TPE-Net: Track Point Extraction and Association Network for Rail Path Proposal Generation
• Abstract summary: We propose a convolutional encoder-decoder architecture called TPE-Net to extract left-right rail pixels from 3D images. It generates strong rail route hypotheses without reliance on camera parameters, 3D data, and geometrical constraints.
• Score: 1.9181913148426697
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: One essential feature of an autonomous train is minimizing collision risks with third-party objects. To estimate the risk, the control system must identify topological information of all the rail routes ahead on which the train can possibly move, especially within merging or diverging rails. This way, the train can figure out the status of potential obstacles with respect to its route and hence, make a timely decision. Numerous studies have successfully extracted all rail tracks as a whole within forward-looking images without considering element instances. Still, some image-based methods have employed hard-coded prior knowledge of railway geometry on 3D data to associate left-right rails and generate rail route instances. However, we propose a rail path extraction pipeline in which left-right rail pixels of each rail route instance are extracted and associated through a fully convolutional encoder-decoder architecture called TPE-Net. Two different regression branches for TPE-Net are proposed to regress the locations of center points of each rail route, along with their corresponding left-right pixels. Extracted rail pixels are then spatially clustered to generate topological information of all the possible train routes (ego-paths), discarding non-ego-path ones. Experimental results on a challenging, publicly released benchmark show true-positive-pixel level average precision and recall of 0.9207 and 0.8721, respectively, at about 12 frames per second. Even though our evaluation results are not higher than the SOTA, the proposed regression pipeline performs remarkably in extracting the correspondences by looking once at the image. It generates strong rail route hypotheses without reliance on camera parameters, 3D data, and geometrical constraints.

Related papers

• Rail Track Extraction from Rasterized Classified Point Clouds Using a Full-Resolution, Fully Convolutional Recurrent Neural Network [46.84613650829397]
  Rail track extraction is essential for effective railway asset management and maintenance.<n>This paper introduces a novel method for extracting rail tracks from classified 3D point clouds.<n>A fully convolutional recurrent neural network is trained exclusively on synthetically generated data.
  arXiv  Detail & Related papers  (2026-07-07T21:51:46Z)
• Railway Artificial Intelligence Learning Benchmark (RAIL-BENCH): A Benchmark Suite for Perception in the Railway Domain [1.342309454877223]
  RAIL-BENCH is the first perception benchmark suite for the railway domain.<n>It comprises five challenges - rail track detection, object detection, vegetation segmentation, multi-object tracking, and monocular visual odometry.<n>LineAP is a novel segment-based average precision metric that evaluates the geometric accuracy of polyline predictions.
  arXiv  Detail & Related papers  (2026-04-24T12:37:04Z)
• RAP: 3D Rasterization Augmented End-to-End Planning [104.52778241744522]
  Imitation learning for end-to-end driving trains policies only on expert demonstrations.<n>We propose 3D Rasterization, which replaces costly rendering with lightweightization of annotated primitives.<n>RAP achieves state-of-the-art closed-loop and long-tail robustness, ranking first on four major benchmarks.
  arXiv  Detail & Related papers  (2025-10-05T19:31:24Z)
• RailSafeNet: Visual Scene Understanding for Tram Safety [0.3437656066916039]
  RailSafeNet is a real-time framework that fuses semantic segmentation, object detection and a distance assessor to highlight track intrusions.<n>Using only monocular video, the system identifies rails, localises nearby objects and classifies their risk by comparing projected distances with the standard 1435mm rail gauge.
  arXiv  Detail & Related papers  (2025-09-15T16:51:21Z)
• LaRI: Layered Ray Intersections for Single-view 3D Geometric Reasoning [75.9814389360821]
  layered ray intersections (LaRI) is a new method for unseen geometry reasoning from a single image. Benefiting from the compact and layered representation, LaRI enables complete, efficient, and view-aligned geometric reasoning. We build a complete training data generation pipeline for synthetic and real-world data, including 3D objects and scenes.
  arXiv  Detail & Related papers  (2025-04-25T15:31:29Z)
• St4RTrack: Simultaneous 4D Reconstruction and Tracking in the World [106.91539872943864]
  St4RTrack is a framework that simultaneously reconstructs and tracks dynamic video content in a world coordinate frame from RGB inputs. We predict both pointmaps at the same moment, in the same world, capturing both static and dynamic scene geometry. We establish a new extensive benchmark for world-frame reconstruction and tracking, demonstrating the effectiveness and efficiency of our unified, data-driven framework.
  arXiv  Detail & Related papers  (2025-04-17T17:55:58Z)
• VGGT: Visual Geometry Grounded Transformer [61.37669770946458]
  VGGT is a feed-forward neural network that directly infers all key 3D attributes of a scene. Network achieves state-of-the-art results in multiple 3D tasks.
  arXiv  Detail & Related papers  (2025-03-14T17:59:47Z)
• PillarTrack: Redesigning Pillar-based Transformer Network for Single Object Tracking on Point Clouds [5.524413892353708]
  LiDAR-based 3D single object tracking (3D SOT) is a critical issue in robotics and autonomous driving. We propose PillarTrack, a pillar-based 3D single object tracking framework. PillarTrack achieves state-of-the-art performance on the KITTI and nuScenes dataset and enables real-time tracking speed.
  arXiv  Detail & Related papers  (2024-04-11T06:06:56Z)
• 3DMOTFormer: Graph Transformer for Online 3D Multi-Object Tracking [15.330384668966806]
  State-of-the-art 3D multi-object tracking (MOT) approaches typically rely on non-learned model-based algorithms such as Kalman Filter. We propose 3DMOTFormer, a learned geometry-based 3D MOT framework building upon the transformer architecture. Our approach achieves 71.2% and 68.2% AMOTA on the nuScenes validation and test split, respectively.
  arXiv  Detail & Related papers  (2023-08-12T19:19:58Z)
• An Efficient Transformer for Simultaneous Learning of BEV and Lane Representations in 3D Lane Detection [55.281369497158515]
  We propose an efficient transformer for 3D lane detection. Different from the vanilla transformer, our model contains a cross-attention mechanism to simultaneously learn lane and BEV representations. Our method obtains 2D and 3D lane predictions by applying the lane features to the image-view and BEV features, respectively.
  arXiv  Detail & Related papers  (2023-06-08T04:18:31Z)
• Rail Detection: An Efficient Row-based Network and A New Benchmark [16.811407800603664]
  We present a real-world railway dataset, Rail-DB, with 7432 pairs of images and annotations. We present an efficient row-based rail detection method, Rail-Net, containing a lightweight convolutional backbone and an anchor classifier. We evaluate the Rail-Net on Rail-DB with extensive experiments, including cross-scene settings and network backbones ranging from ResNet to Vision Transformers.
  arXiv  Detail & Related papers  (2023-04-12T07:44:50Z)
• 3D Data Augmentation for Driving Scenes on Camera [50.41413053812315]
  We propose a 3D data augmentation approach termed Drive-3DAug, aiming at augmenting the driving scenes on camera in the 3D space. We first utilize Neural Radiance Field (NeRF) to reconstruct the 3D models of background and foreground objects. Then, augmented driving scenes can be obtained by placing the 3D objects with adapted location and orientation at the pre-defined valid region of backgrounds.
  arXiv  Detail & Related papers  (2023-03-18T05:51:05Z)
• Detecting train driveshaft damages using accelerometer signals and Differential Convolutional Neural Networks [67.60224656603823]
  This paper proposes the development of a railway axle condition monitoring system based on advanced 2D-Convolutional Neural Network (CNN) architectures. The resultant system converts the railway axle vibration signals into time-frequency domain representations, i.e., spectrograms, and, thus, trains a two-dimensional CNN to classify them depending on their cracks.
  arXiv  Detail & Related papers  (2022-11-15T15:04:06Z)
• JPerceiver: Joint Perception Network for Depth, Pose and Layout Estimation in Driving Scenes [75.20435924081585]
  JPerceiver can simultaneously estimate scale-aware depth and VO as well as BEV layout from a monocular video sequence. It exploits the cross-view geometric transformation (CGT) to propagate the absolute scale from the road layout to depth and VO. Experiments on Argoverse, Nuscenes and KITTI show the superiority of JPerceiver over existing methods on all the above three tasks.
  arXiv  Detail & Related papers  (2022-07-16T10:33:59Z)
• Simple and Effective Synthesis of Indoor 3D Scenes [78.95697556834536]
  We study the problem of immersive 3D indoor scenes from one or more images. Our aim is to generate high-resolution images and videos from novel viewpoints. We propose an image-to-image GAN that maps directly from reprojections of incomplete point clouds to full high-resolution RGB-D images.
  arXiv  Detail & Related papers  (2022-04-06T17:54:46Z)
• Real-time Rail Recognition Based on 3D Point Clouds [3.0980025155565376]
  A real-time rail recognition method based on 3D point clouds is proposed to solve the challenges, such as disorderly, uneven density and large volume of the point clouds. A multi-scale neural network is proposed to generate the prediction results of each voxel and the rail location. The results show that the method has good performance in detecting straight, curved and other complex topologies.
  arXiv  Detail & Related papers  (2022-01-08T01:42:02Z)
• Intelligent Railway Foreign Object Detection: A Semi-supervised Convolutional Autoencoder Based Method [7.557470133155959]
  We develop a semi-supervised convolutional autoencoder based framework that only requires railway track images without prior knowledge on the foreign objects in the training process. The proposed framework is useful for data analytics via the train Internet-of-Things (IoT) systems.
  arXiv  Detail & Related papers  (2021-08-05T07:32:23Z)
• Risk-Averse MPC via Visual-Inertial Input and Recurrent Networks for Online Collision Avoidance [95.86944752753564]
  We propose an online path planning architecture that extends the model predictive control (MPC) formulation to consider future location uncertainties. Our algorithm combines an object detection pipeline with a recurrent neural network (RNN) which infers the covariance of state estimates. The robustness of our methods is validated on complex quadruped robot dynamics and can be generally applied to most robotic platforms.
  arXiv  Detail & Related papers  (2020-07-28T07:34:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.