Event-based Motion & Appearance Fusion for 6D Object Pose Tracking

• URL: http://arxiv.org/abs/2603.08264v1
• Date: Mon, 09 Mar 2026 11:34:50 GMT
• Title: Event-based Motion & Appearance Fusion for 6D Object Pose Tracking
• Abstract summary: Event cameras have remarkable features such as high temporal resolution and low latency.<n>We propose a method that uses both a propagation step fused with a pose correction strategy.<n>Our learning-free method has comparable performance to the state-of-the-art algorithms.
• Score: 19.564467602010975
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Object pose tracking is a fundamental and essential task for robotics to perform tasks in the home and industrial settings. The most commonly used sensors to do so are RGB-D cameras, which can hit limitations in highly dynamic environments due to motion blur and frame-rate constraints. Event cameras have remarkable features such as high temporal resolution and low latency, which make them a potentially ideal vision sensors for object pose tracking at high speed. Even so, there are still only few works on 6D pose tracking with event cameras. In this work, we take advantage of the high temporal resolution and propose a method that uses both a propagation step fused with a pose correction strategy. Specifically, we use 6D object velocity obtained from event-based optical flow for pose propagation, after which, a template-based local pose correction module is utilized for pose correction. Our learning-free method has comparable performance to the state-of-the-art algorithms, and in some cases out performs them for fast-moving objects. The results indicate the potential for using event cameras in highly-dynamic scenarios where the use of deep network approaches are limited by low update rates.

Related papers

• Event6D: Event-based Novel Object 6D Pose Tracking [67.12156260053027]
  Event cameras provide microsecond latency, making them suitable for 6D object pose tracking in fast, dynamic scenes.<n>We introduce EventTrack6D, an event-depth tracking framework that generalizes to novel objects without object-specific training.<n>Our method and datasets validate the effectiveness of event cameras for event-based 6D pose tracking of novel objects.
  arXiv  Detail & Related papers  (2026-03-30T05:11:57Z)
• GeoMotion: Rethinking Motion Segmentation via Latent 4D Geometry [61.24189040578178]
  We propose a fully learning-based approach that directly infers moving objects from latent feature representations via attention mechanisms.<n>Our key insight is to bypass explicit correspondence estimation and instead let the model learn to implicitly disentangle object and camera motion.<n>Our approach achieves state-of-the-art motion segmentation performance with high efficiency.
  arXiv  Detail & Related papers  (2026-02-25T11:36:33Z)
• Optical Flow-Guided 6DoF Object Pose Tracking with an Event Camera [18.13747114612191]
  We present an optical flow-guided 6DoF object pose tracking method with an event camera.<n>We show that our methods outperform event-based state-of-the-art methods in terms of both accuracy and robustness.
  arXiv  Detail & Related papers  (2025-12-24T08:40:57Z)
• 6-DoF Object Tracking with Event-based Optical Flow and Frames [12.63903994540524]
  We propose an event-based optical flow algorithm for object motion measurement to implement an object 6-DoF velocity tracker.<n>By integrating the tracked object 6-DoF velocity with low frequency estimated pose from the global pose estimator, the method can track pose when objects move at high-speed.
  arXiv  Detail & Related papers  (2025-08-20T15:22:51Z)
• DynamicPose: Real-time and Robust 6D Object Pose Tracking for Fast-Moving Cameras and Objects [4.15520326813392]
  We present DynamicPose, a retraining-free 6D pose tracking framework.<n>It improves tracking robustness in fast-moving camera and object scenarios.
  arXiv  Detail & Related papers  (2025-08-16T07:25:08Z)
• From Sharp to Blur: Unsupervised Domain Adaptation for 2D Human Pose Estimation Under Extreme Motion Blur Using Event Cameras [47.65729940410823]
  Human pose estimation is critical for applications such as rehabilitation, sports analytics, and AR/VR systems.<n>Most datasets assume stable conditions, making models trained on sharp images struggle in blurred environments.<n>We introduce a novel domain adaptation approach that leverages event cameras, which capture high temporal resolution motion data.
  arXiv  Detail & Related papers  (2025-07-30T07:30:40Z)
• VICAN: Very Efficient Calibration Algorithm for Large Camera Networks [49.17165360280794]
  We introduce a novel methodology that extends Pose Graph Optimization techniques. We consider the bipartite graph encompassing cameras, object poses evolving dynamically, and camera-object relative transformations at each time step. Our framework retains compatibility with traditional PGO solvers, but its efficacy benefits from a custom-tailored optimization scheme.
  arXiv  Detail & Related papers  (2024-03-25T17:47:03Z)
• Continuous Pose for Monocular Cameras in Neural Implicit Representation [65.40527279809474]
  In this paper, we showcase the effectiveness of optimizing monocular camera poses as a continuous function of time. We exploit the proposed method in four diverse experimental settings. Using the assumption of continuous motion, changes in pose may actually live in a manifold that has lower than 6 degrees of freedom (DOF) We call this low DOF motion representation as the emphintrinsic motion and use the approach in vSLAM settings, showing impressive camera tracking performance.
  arXiv  Detail & Related papers  (2023-11-28T13:14:58Z)
• ESL: Event-based Structured Light [62.77144631509817]
  Event cameras are bio-inspired sensors providing significant advantages over standard cameras. We propose a novel structured-light system using an event camera to tackle the problem of accurate and high-speed depth sensing.
  arXiv  Detail & Related papers  (2021-11-30T15:47:39Z)
• ROFT: Real-Time Optical Flow-Aided 6D Object Pose and Velocity Tracking [7.617467911329272]
  We introduce ROFT, a Kalman filtering approach for 6D object pose and velocity tracking from a stream of RGB-D images. By leveraging real-time optical flow, ROFT synchronizes delayed outputs of low frame rate Convolutional Neural Networks for instance segmentation and 6D object pose estimation. Results demonstrate that our approach outperforms state-of-the-art methods for 6D object pose tracking, while also providing 6D object velocity tracking.
  arXiv  Detail & Related papers  (2021-11-06T07:30:00Z)
• VIPose: Real-time Visual-Inertial 6D Object Pose Tracking [3.44942675405441]
  We introduce a novel Deep Neural Network (DNN) called VIPose to address the object pose tracking problem in real-time. The key contribution is the design of a novel DNN architecture which fuses visual and inertial features to predict the objects' relative 6D pose. The approach presents accuracy performances comparable to state-of-the-art techniques, but with additional benefit to be real-time.
  arXiv  Detail & Related papers  (2021-07-27T06:10:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.