RRTrack: Robust and Recoverable Object 6D Pose Tracking for Dynamic Scenes

• URL: http://arxiv.org/abs/2607.23669v1
• Date: Sun, 26 Jul 2026 14:05:46 GMT
• Title: RRTrack: Robust and Recoverable Object 6D Pose Tracking for Dynamic Scenes
• Abstract summary: RRTrack is an efficient, recoverable object 6D pose tracker.<n>It enables robust tracking through fast motion and target disappearance--reappearance.<n>Experiments show RRTrack improves equal-subset mean ADD-S AR by 66.3% and ADD-S AUC by 65.7% over FoundationPose.
• Score: 55.15267980622371
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Robust object 6D pose tracking is critical for robotic systems operating in dynamic and occluded scenes. Per-frame estimators are accurate but computationally expensive, while current trackers struggle with fast motion and complete occlusion due to their reliance on continuous visibility. To address these challenges, we present RRTrack, an efficient, recoverable object 6D pose tracker that enables robust tracking through fast motion and target disappearance--reappearance. RRTrack introduces a 2D--6D closed-loop tracking strategy that integrates memory-based video object segmentation (VOS) with 6D pose refinement. The 2D branch maintains target localization, and the 6D branch verifies geometric consistency before memory updates. In addition, a DINOv2-based dual-bank template matching module is developed to recover lost targets by jointly exploiting offline synthetic templates and online observation anchors while maintaining real-time efficiency. We also introduce a synthetic RGB-D benchmark comprising three robotic scenarios with fast motion and full occlusion. Experimental results on the synthetic benchmark demonstrate that RRTrack improves equal-subset mean ADD-S AR by 66.3\% and ADD-S AUC by 65.7\% over FoundationPose while achieving 55.2 FPS. Real-world experiments further validate the robustness of RRTrack under noisy sensing conditions. Project page: https://github.com/7kevin24/RRTrack

Related papers

• Robust 6-DoF Object Pose Tracking with Built-In Recovery under Occlusions and Rapid Object Motions [15.479745132993566]
  Real-time 6-DoF object pose tracking is essential for many robotics applications.<n>In this paper, we address the problem of robust model-based 6-DoF tracking of unseen objects from RGB-D data.<n>We propose a novel method that combines efficient learning-based keypoint matching with optimization-based alignment.
  arXiv  Detail & Related papers  (2026-07-26T05:39:04Z)
• Event6D: Event-based Novel Object 6D Pose Tracking [67.12156260053027]
  Event cameras provide microsecond latency, making them suitable for 6D object pose tracking in fast, dynamic scenes.<n>We introduce EventTrack6D, an event-depth tracking framework that generalizes to novel objects without object-specific training.<n>Our method and datasets validate the effectiveness of event cameras for event-based 6D pose tracking of novel objects.
  arXiv  Detail & Related papers  (2026-03-30T05:11:57Z)
• DynamicPose: Real-time and Robust 6D Object Pose Tracking for Fast-Moving Cameras and Objects [4.15520326813392]
  We present DynamicPose, a retraining-free 6D pose tracking framework.<n>It improves tracking robustness in fast-moving camera and object scenarios.
  arXiv  Detail & Related papers  (2025-08-16T07:25:08Z)
• SpatialTrackerV2: 3D Point Tracking Made Easy [73.0350898700048]
  SpatialTrackerV2 is a feed-forward 3D point tracking method for monocular videos.<n>It decomposes world-space 3D motion into scene geometry, camera ego-motion, and pixel-wise object motion.<n>By learning geometry and motion jointly from such heterogeneous data, SpatialTrackerV2 outperforms existing 3D tracking methods by 30%.
  arXiv  Detail & Related papers  (2025-07-16T17:59:03Z)
• RGBTrack: Fast, Robust Depth-Free 6D Pose Estimation and Tracking [24.866881488130407]
  We introduce a robust framework, RGBTrack, for real-time 6D pose estimation and tracking.<n>We devise a novel binary search strategy combined with a render-and-compare mechanism to efficiently infer depth.<n>We show that RGBTrack's novel depth-free approach achieves competitive accuracy and real-time performance.
  arXiv  Detail & Related papers  (2025-06-20T16:19:28Z)
• Street Gaussians without 3D Object Tracker [84.89933388445185]
  Most existing methods rely on labor-intensive manual labeling of object poses.<n>We propose a stable object tracking module by leveraging associations from 2D deep trackers within a 3D object fusion strategy.<n>We address inevitable tracking errors by further introducing a motion learning strategy in an implicit feature space that autonomously corrects trajectory errors and recovers missed detections.
  arXiv  Detail & Related papers  (2024-12-07T05:49:42Z)
• 6DOPE-GS: Online 6D Object Pose Estimation using Gaussian Splatting [7.7145084897748974]
  We present 6DOPE-GS, a novel method for online 6D object pose estimation & tracking with a single RGB-D camera.<n>We show that 6DOPE-GS matches the performance of state-of-the-art baselines for model-free simultaneous 6D pose tracking and reconstruction.<n>We also demonstrate the method's suitability for live, dynamic object tracking and reconstruction in a real-world setting.
  arXiv  Detail & Related papers  (2024-12-02T14:32:19Z)
• ByteTrackV2: 2D and 3D Multi-Object Tracking by Associating Every Detection Box [81.45219802386444]
  Multi-object tracking (MOT) aims at estimating bounding boxes and identities of objects across video frames. We propose a hierarchical data association strategy to mine the true objects in low-score detection boxes. In 3D scenarios, it is much easier for the tracker to predict object velocities in the world coordinate.
  arXiv  Detail & Related papers  (2023-03-27T15:35:21Z)
• Enhancing Generalizable 6D Pose Tracking of an In-Hand Object with Tactile Sensing [31.49529551069215]
  TEG-Track is a tactile-enhanced 6D pose tracking system. It can track previously unseen objects held in hand. Results demonstrate that TEG-Track consistently enhances state-of-the-art generalizable 6D pose trackers.
  arXiv  Detail & Related papers  (2022-10-08T13:47:03Z)
• Monocular Quasi-Dense 3D Object Tracking [99.51683944057191]
  A reliable and accurate 3D tracking framework is essential for predicting future locations of surrounding objects and planning the observer's actions in numerous applications such as autonomous driving. We propose a framework that can effectively associate moving objects over time and estimate their full 3D bounding box information from a sequence of 2D images captured on a moving platform.
  arXiv  Detail & Related papers  (2021-03-12T15:30:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.