Towards agile multi-robot systems in the real world: Fast onboard tracking of active blinking markers for relative localization

• URL: http://arxiv.org/abs/2502.01172v2
• Date: Mon, 29 Sep 2025 08:44:15 GMT
• Title: Towards agile multi-robot systems in the real world: Fast onboard tracking of active blinking markers for relative localization
• Abstract summary: Active blinking markers on multi-robot team members improve the robustness of relative localization for aerial vehicles in real-world deployments.<n>Traditional tracking algorithms struggle with fast-moving blinking markers due to their intermittent appearance in camera frames.<n>In outdoor experiments, the AMT approach outperformed state-of-the-art methods in tracking density, accuracy, and complexity.
• Score: 6.658153435676109
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: A novel onboard tracking approach enabling vision-based relative localization and communication using Active blinking Marker Tracking (AMT) is introduced in this article. Active blinking markers on multi-robot team members improve the robustness of relative localization for aerial vehicles in tightly coupled multi-robot systems during real-world deployments, while also serving as a resilient communication system. Traditional tracking algorithms struggle with fast-moving blinking markers due to their intermittent appearance in camera frames and the complexity of associating multiple of these markers across consecutive frames. AMT addresses this by using weighted polynomial regression to predict the future appearance of active blinking markers while accounting for uncertainty in the prediction. In outdoor experiments, the AMT approach outperformed state-of-the-art methods in tracking density, accuracy, and complexity. The experimental validation of this novel tracking approach for relative localization and optical communication involved testing motion patterns motivated by our research on agile multi-robot deployment.

Related papers

• GenTrack3: Hybrid Stochastic-Deterministic Online Multi-Object Tracking with Cluster-Aware Association [3.259045978275386]
  Multi-object tracking (MOT) involves maintaining consistent target identities as objects dynamically enter and leave a scene.<n>This paper presents an online framework that integrates deterministic and inference principles to achieve robust tracking under uncertainty.
  arXiv  Detail & Related papers  (2026-08-10T13:16:17Z)
• Markerless Robot Detection and 6D Pose Estimation for Multi-Agent SLAM [9.016715022913793]
  Multi-robot SLAM approaches to merge localization history and maps from different observers is often challenged by the difficulty in establishing data association.<n>We propose a novel solution leveraging recent advances in Deep-Learning-based 6D pose estimation.<n>We feature markerless pose estimation as part of a decentralized multi-robot SLAM system and demonstrate the benefit to the relative localization accuracy among the robotic team.
  arXiv  Detail & Related papers  (2026-02-18T09:38:06Z)
• A Hybrid Approach for Visual Multi-Object Tracking [3.259045978275386]
  This paper proposes a visual multi-object tracking method to ensure consistency for unknown and time-varying target numbers under nonlinear dynamics.<n>A particle filter addresses nonlinear dynamics and non-Gaussian noise, with support from particle optimization (PSO) to guide particles toward state distribution modes.<n>A novel scheme is proposed for the smooth updating of target states while preserving their identities.
  arXiv  Detail & Related papers  (2025-10-28T13:22:24Z)
• GL-DT: Multi-UAV Detection and Tracking with Global-Local Integration [0.6299766708197883]
  This paper proposes the Global-Local Detection and Tracking (GL-DT) framework.<n>It employs a Spatio-Temporal Feature Fusion (STFF) module to jointly model motion and appearance features, combined with a global-local collaborative detection strategy.<n> Experimental results demonstrate that the proposed approach significantly improves the continuity and stability of MOT while maintaining real-time performance.
  arXiv  Detail & Related papers  (2025-10-10T07:37:38Z)
• Multi-tracklet Tracking for Generic Targets with Adaptive Detection Clustering [8.637143090635396]
  This article proposes a tracklet tracker called Multi-Tracklet Tracking (MTT) that integrates flexible tracklet generation into a multi-tracklet association framework.<n> experiments on the benchmark for generic multiple object tracking demonstrate the competitiveness of the proposed framework.
  arXiv  Detail & Related papers  (2025-08-07T09:05:27Z)
• Tracking the Unstable: Appearance-Guided Motion Modeling for Robust Multi-Object Tracking in UAV-Captured Videos [58.156141601478794]
  Multi-object tracking (UAVT) aims to track multiple objects while maintaining consistent identities across frames of a given video.<n>Existing methods typically model motion cues and appearance separately, overlooking their interplay and resulting in suboptimal tracking performance.<n>We propose AMOT, which exploits appearance and motion cues through two key components: an Appearance-Motion Consistency (AMC) matrix and a Motion-aware Track Continuation (MTC) module.
  arXiv  Detail & Related papers  (2025-08-03T12:06:47Z)
• CAMELTrack: Context-Aware Multi-cue ExpLoitation for Online Multi-Object Tracking [68.24998698508344]
  We introduce CAMEL, a novel association module for Context-Aware Multi-Cue ExpLoitation.<n>Unlike end-to-end detection-by-tracking approaches, our method remains lightweight and fast to train while being able to leverage external off-the-shelf models.<n>Our proposed online tracking pipeline, CAMELTrack, achieves state-of-the-art performance on multiple tracking benchmarks.
  arXiv  Detail & Related papers  (2025-05-02T13:26:23Z)
• Real-Time Moving Flock Detection in Pedestrian Trajectories Using Sequential Deep Learning Models [1.2289361708127877]
  This paper investigates the use of sequential deep learning models, including Recurrent Neural Networks (RNNs), for real-time flock detection in multi-pedestrian trajectories. We validate our method using real-world group movement datasets, demonstrating its robustness across varying sequence lengths and diverse movement patterns. We extend our approach to identify other forms of collective motion, such as convoys and swarms, paving the way for more comprehensive multi-agent behavior analysis.
  arXiv  Detail & Related papers  (2025-02-21T07:04:34Z)
• Exploiting Multimodal Spatial-temporal Patterns for Video Object Tracking [53.33637391723555]
  We propose a unified multimodal spatial-temporal tracking approach named STTrack.<n>In contrast to previous paradigms, we introduced a temporal state generator (TSG) that continuously generates a sequence of tokens containing multimodal temporal information.<n>These temporal information tokens are used to guide the localization of the target in the next time state, establish long-range contextual relationships between video frames, and capture the temporal trajectory of the target.
  arXiv  Detail & Related papers  (2024-12-20T09:10:17Z)
• Event-Based Tracking Any Point with Motion-Augmented Temporal Consistency [58.719310295870024]
  This paper presents an event-based framework for tracking any point. It tackles the challenges posed by spatial sparsity and motion sensitivity in events. It achieves 150% faster processing with competitive model parameters.
  arXiv  Detail & Related papers  (2024-12-02T09:13:29Z)
• Trajectory Anomaly Detection with Language Models [21.401931052512595]
  This paper presents a novel approach for trajectory anomaly detection using an autoregressive causal-attention model, termed LM-TAD. By treating trajectories as sequences of tokens, our model learns the probability distributions over trajectories, enabling the identification of anomalous locations with high precision. Our experiments demonstrate the effectiveness of LM-TAD on both synthetic and real-world datasets.
  arXiv  Detail & Related papers  (2024-09-18T17:33:31Z)
• Machine Learning in Short-Reach Optical Systems: A Comprehensive Survey [2.425630641479336]
  This paper outlines the application of machine learning techniques in short-reach communications. We introduce a novel taxonomy for time-series methods employed in machine learning signal processing. We aim to pave the way for more practical and efficient deployment of machine learning approaches in short-reach optical communication systems.
  arXiv  Detail & Related papers  (2024-05-02T16:04:30Z)
• LEAP-VO: Long-term Effective Any Point Tracking for Visual Odometry [52.131996528655094]
  We present the Long-term Effective Any Point Tracking (LEAP) module. LEAP innovatively combines visual, inter-track, and temporal cues with mindfully selected anchors for dynamic track estimation. Based on these traits, we develop LEAP-VO, a robust visual odometry system adept at handling occlusions and dynamic scenes.
  arXiv  Detail & Related papers  (2024-01-03T18:57:27Z)
• Multi-Object Tracking by Iteratively Associating Detections with Uniform Appearance for Trawl-Based Fishing Bycatch Monitoring [22.228127377617028]
  The aim of in-trawl catch monitoring for use in fishing operations is to detect, track and classify fish targets in real-time from video footage. We propose a novel MOT method, built upon an existing observation-centric tracking algorithm, by adopting a new iterative association step. Our method offers improved performance in tracking targets with uniform appearance and outperforms state-of-the-art techniques on our underwater fish datasets as well as the MOT17 dataset.
  arXiv  Detail & Related papers  (2023-04-10T18:55:10Z)
• MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Tracking [56.92165669843006]
  We propose MotionTrack, which learns robust short-term and long-term motions in a unified framework to associate trajectories from a short to long range. For dense crowds, we design a novel Interaction Module to learn interaction-aware motions from short-term trajectories, which can estimate the complex movement of each target. For extreme occlusions, we build a novel Refind Module to learn reliable long-term motions from the target's history trajectory, which can link the interrupted trajectory with its corresponding detection.
  arXiv  Detail & Related papers  (2023-03-18T12:38:33Z)
• Modeling Continuous Motion for 3D Point Cloud Object Tracking [54.48716096286417]
  This paper presents a novel approach that views each tracklet as a continuous stream. At each timestamp, only the current frame is fed into the network to interact with multi-frame historical features stored in a memory bank. To enhance the utilization of multi-frame features for robust tracking, a contrastive sequence enhancement strategy is proposed.
  arXiv  Detail & Related papers  (2023-03-14T02:58:27Z)
• AiATrack: Attention in Attention for Transformer Visual Tracking [89.94386868729332]
  Transformer trackers have achieved impressive advancements recently, where the attention mechanism plays an important role. We propose an attention in attention (AiA) module, which enhances appropriate correlations and suppresses erroneous ones by seeking consensus among all correlation vectors. Our AiA module can be readily applied to both self-attention blocks and cross-attention blocks to facilitate feature aggregation and information propagation for visual tracking.
  arXiv  Detail & Related papers  (2022-07-20T00:44:03Z)
• Domain Adaptive Robotic Gesture Recognition with Unsupervised Kinematic-Visual Data Alignment [60.31418655784291]
  We propose a novel unsupervised domain adaptation framework which can simultaneously transfer multi-modality knowledge, i.e., both kinematic and visual data, from simulator to real robot. It remedies the domain gap with enhanced transferable features by using temporal cues in videos, and inherent correlations in multi-modal towards recognizing gesture. Results show that our approach recovers the performance with great improvement gains, up to 12.91% in ACC and 20.16% in F1score without using any annotations in real robot.
  arXiv  Detail & Related papers  (2021-03-06T09:10:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.