Multi-view Crowd Tracking Transformer with View-Ground Interactions Under Large Real-World Scenes

• URL: http://arxiv.org/abs/2604.19318v1
• Date: Tue, 21 Apr 2026 10:26:23 GMT
• Title: Multi-view Crowd Tracking Transformer with View-Ground Interactions Under Large Real-World Scenes
• Abstract summary: Multi-view crowd tracking estimates each person's tracking trajectories on the ground of the scene.<n>Recent research works mainly rely on CNNs-based multi-view crowd tracking architectures.<n>We propose a Transformer-based multi-view crowd tracking model, textitMVTrackTrans, which adopts interactions between camera views and the ground plane for enhanced multi-view tracking performance.
• Score: 48.537990488697965
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Multi-view crowd tracking estimates each person's tracking trajectories on the ground of the scene. Recent research works mainly rely on CNNs-based multi-view crowd tracking architectures, and most of them are evaluated and compared on relatively small datasets, such as Wildtrack and MultiviewX. Since these two datasets are collected in small scenes and only contain tens of frames in the evaluation stage, it is difficult for the current methods to be applied to real-world applications where scene size and occlusion are more complicated. In this paper, we propose a Transformer-based multi-view crowd tracking model, \textit{MVTrackTrans}, which adopts interactions between camera views and the ground plane for enhanced multi-view tracking performance. Besides, for better evaluation, we collect and label two large real-world multi-view tracking datasets, MVCrowdTrack and CityTrack, which contain a much larger scene size over a longer time period. Compared with existing methods on the two large and new datasets, the proposed MVTrackTrans model achieves better performance, demonstrating the advantages of the model design in dealing with large scenes. We believe the proposed datasets and model will push the frontiers of the task to more practical scenarios, and the datasets and code are available at: https://github.com/zqyq/MVTrackTrans.

Related papers

• MV2: Multi-View Multi-Vehicle Driving Dataset for Novel View Synthesis [17.447689425723045]
  Differentiable rendering has advanced novel view synthesis (NVS)<n>Applying it to real-world driving remains difficult due to sparse capture viewpoints, dynamic objects, and limited multi-trajectory data.<n>We introduce the Multi-View Multi-Vehicle dataset and benchmark for evaluating NVS models under large viewpoint changes in dynamic urban scenes.
  arXiv  Detail & Related papers  (2026-08-12T16:02:32Z)
• MV-TAP: Tracking Any Point in Multi-View Videos [34.91357343992975]
  MV-TAP is a novel point tracker that tracks points across multi-view videos of dynamic scenes by leveraging cross-view information.<n>To support this task, we construct a large-scale synthetic training dataset and real-world evaluation sets tailored for multi-view tracking.
  arXiv  Detail & Related papers  (2025-12-01T18:59:01Z)
• Multi-View 3D Point Tracking [67.21282192436031]
  We introduce the first data-driven multi-view 3D point tracker, designed to track arbitrary points in dynamic scenes using multiple camera views.<n>Our model directly predicts 3D correspondences using a practical number of cameras.<n>We train on 5K synthetic multi-view Kubric sequences and evaluate on two real-world benchmarks.
  arXiv  Detail & Related papers  (2025-08-28T17:58:20Z)
• CrowdTrack: A Benchmark for Difficult Multiple Pedestrian Tracking in Real Scenarios [41.96441237870711]
  We propose a large-scale dataset for multi-pedestrian tracking, shot mainly from the first-person view.<n>Our dataset consists of 33 videos, containing a total of 5,185 trajectories.<n>The dataset will provide a platform to facilitate the development of algorithms that remain effective in complex situations.
  arXiv  Detail & Related papers  (2025-07-03T09:36:44Z)
• MITracker: Multi-View Integration for Visual Object Tracking [15.713725317019321]
  We develop a novel MVOT method, Multi-View Integration Tracker (MITracker), to efficiently integrate multi-view object features.<n>MITracker can track any object in video frames of arbitrary length from arbitrary viewpoints.<n>MITracker outperforms existing methods on the MVTrack and GMTD datasets, achieving state-of-the-art performance.
  arXiv  Detail & Related papers  (2025-02-27T14:03:28Z)
• DIVOTrack: A Novel Dataset and Baseline Method for Cross-View Multi-Object Tracking in DIVerse Open Scenes [74.64897845999677]
  We introduce a new cross-view multi-object tracking dataset for DIVerse Open scenes with dense tracking pedestrians. Our DIVOTrack has fifteen distinct scenarios and 953 cross-view tracks, surpassing all cross-view multi-object tracking datasets currently available. Furthermore, we provide a novel baseline cross-view tracking method with a unified joint detection and cross-view tracking framework named CrossMOT.
  arXiv  Detail & Related papers  (2023-02-15T14:10:42Z)
• Cross-View Cross-Scene Multi-View Crowd Counting [56.83882084112913]
  Multi-view crowd counting has been previously proposed to utilize multi-cameras to extend the field-of-view of a single camera. We propose a cross-view cross-scene (CVCS) multi-view crowd counting paradigm, where the training and testing occur on different scenes with arbitrary camera layouts.
  arXiv  Detail & Related papers  (2022-05-03T15:03:44Z)
• Multiview Detection with Feature Perspective Transformation [59.34619548026885]
  We propose a novel multiview detection system, MVDet. We take an anchor-free approach to aggregate multiview information by projecting feature maps onto the ground plane. Our entire model is end-to-end learnable and achieves 88.2% MODA on the standard Wildtrack dataset.
  arXiv  Detail & Related papers  (2020-07-14T17:58:30Z)
• TAO: A Large-Scale Benchmark for Tracking Any Object [95.87310116010185]
  Tracking Any Object dataset consists of 2,907 high resolution videos, captured in diverse environments, which are half a minute long on average. We ask annotators to label objects that move at any point in the video, and give names to them post factum. Our vocabulary is both significantly larger and qualitatively different from existing tracking datasets.
  arXiv  Detail & Related papers  (2020-05-20T21:07:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.