EdMCGS: Event-Driven Markov Chain Gaussian Splatting for Extreme-Low-Frame-Rate Dynamic Scene Reconstruction

• URL: http://arxiv.org/abs/2609.08332v1
• Date: Tue, 08 Sep 2026 06:59:27 GMT
• Title: EdMCGS: Event-Driven Markov Chain Gaussian Splatting for Extreme-Low-Frame-Rate Dynamic Scene Reconstruction
• Abstract summary: We present EdMCGS, an end-to-end method for rendering dynamic 3D scenes from extreme-low-frame-rate RGB together with an event stream.<n> Methods relying solely on RGB images generate numerous artifacts due to the lack of evidence from between consecutive frames.<n>Experiments on synthetic and real-world scenes show that EdMCGS outperforms both RGB-based and event-based baselines.
• Score: 9.357120004568564
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We present EdMCGS (Event-driven Markov chain Gaussian Splatting), an end-to-end method for reconstructing dynamic 3D scenes from extreme-low-frame-rate RGB together with an event stream, which can then be rendered at any intermediate timestamp. Methods relying solely on RGB images generate numerous artifacts due to the lack of evidence from between consecutive frames. To supply this missing evidence, we model the scene motion as an event-driven Markov chain, in which the sparse RGB frames anchor the state at their own timestamps while the events recorded within an interval drive the transition across it. Since the transition reads the events of the current interval, it remains active at inference and produces the in-between motion of the 3D Gaussians directly from the events rather than by interpolation, which sets our method apart from prior work that uses events only as training-time supervision. The state is carried by a compact set of control points, each driven by the events sampled in the neighborhood of its own image projection, and a temporal local isometry term keeps the propagated motion locally rigid. Experiments on synthetic and real-world scenes show that EdMCGS outperforms both RGB-based and event-based baselines, while rendering in real time with far fewer Gaussians than the strongest event-based baseline. We release our source code and a new dataset at https://github.com/joseclipse/EdMCGS.

Related papers

• ERF-GS: Reconstructing Fast Motion from Disjoint Event-RGB Viewpoints [37.08264457707477]
  Event-RGB fusion Gaussian splatting (ERF-GS) framework integrates event information into both optimization and densification stages.<n>ERF-GS was developed using realistic simulation settings and realizes event-based learning detached from RGB inputs.<n>Our experiments show that ERF-GS outperforms both the 4DGS baseline and the concurrent E-D3DGS on different variants of the Neu3D and Nvidia datasets.
  arXiv  Detail & Related papers  (2026-08-09T07:00:27Z)
• TIDES: Time-Derivative Event Simulation via Deformable Reconstruction [10.871120244987805]
  We present TIDES, a continuous-time event simulator built on dynamic splatting.<n> TIDES operates on an explicit 3D representation with learnt geometry and motion.<n>It can derive per-pixel intensity dynamics directly from the scene, rather than by differencing rendered frames.
  arXiv  Detail & Related papers  (2026-06-01T10:49:13Z)
• EventGait: Towards Robust Gait Recognition with Event Streams [50.890621860023]
  Event cameras offer microsecond temporal resolution and high dynamic range, naturally capturing robust dynamic cues and suppressing static noise.<n>We propose textbfEventGait, an end-to-end dual-stream framework that separately models motion and shape while preserving the advantages of events.<n>Our approach sets a new state of the art on both synthesized and real-world event-based gait benchmarks, highlighting the robustness and potential of event-driven gait analysis.
  arXiv  Detail & Related papers  (2026-05-21T08:12:04Z)
• Decoupling Amplitude and Phase Attention in Frequency Domain for RGB-Event based Visual Object Tracking [51.31378940976401]
  Existing RGB-Event tracking approaches fail to fully exploit the unique advantages of event cameras.<n>We propose a novel tracking framework that performs early fusion in the frequency domain, enabling effective aggregation of high-frequency information from the event modality.<n>Experiments on three widely used RGB-Event tracking benchmark datasets, including FE108, FELT, and COESOT, demonstrate the high performance and efficiency of our method.
  arXiv  Detail & Related papers  (2026-01-03T01:10:17Z)
• Geometric-Photometric Event-based 3D Gaussian Ray Tracing [36.13207105469902]
  Event cameras offer a high temporal resolution over traditional frame-based cameras.<n>It has been unclear how event-based 3D Gaussian Splatting approaches could leverage fine-grained temporal information of sparse events.<n>This work proposes a framework to address the trade-off between accuracy and temporal resolution in event-based 3DGS.
  arXiv  Detail & Related papers  (2025-12-21T08:31:02Z)
• Leveraging RGB Images for Pre-Training of Event-Based Hand Pose Estimation [64.8814078041756]
  RPEP is the first pre-training method for event-based 3D hand pose estimation using labeled RGB images and unpaired, unlabeled event data.<n>Our model significantly outperforms state-of-the-art methods on real event data, achieving up to 24% improvement on EvRealHands.
  arXiv  Detail & Related papers  (2025-09-21T07:07:49Z)
• Learning Flow-Guided Registration for RGB-Event Semantic Segmentation [22.996619370156584]
  Event cameras capture microsecond-level motion cues that complement RGB sensors.<n>We recast RGB-Event segmentation from fusion to registration.<n>We propose BRENet, a novel flow-guided bidirectional framework that adaptively matches correspondence between the asymmetric modalities.
  arXiv  Detail & Related papers  (2025-05-02T19:19:58Z)
• Spatio-temporal Transformers for Action Unit Classification with Event Cameras [28.98336123799572]
  We present FACEMORPHIC, a temporally synchronized multimodal face dataset composed of RGB videos and event streams. We show how temporal synchronization can allow effective neuromorphic face analysis without the need to manually annotate videos.
  arXiv  Detail & Related papers  (2024-10-29T11:23:09Z)
• EF-3DGS: Event-Aided Free-Trajectory 3D Gaussian Splatting [87.1077910795879]
  Event cameras, inspired by biological vision, record pixel-wise intensity changes asynchronously with high temporal resolution.<n>We propose Event-Aided Free-Trajectory 3DGS, which seamlessly integrates the advantages of event cameras into 3DGS.<n>We evaluate our method on the public Tanks and Temples benchmark and a newly collected real-world dataset, RealEv-DAVIS.
  arXiv  Detail & Related papers  (2024-10-20T13:44:24Z)
• EvDNeRF: Reconstructing Event Data with Dynamic Neural Radiance Fields [80.94515892378053]
  EvDNeRF is a pipeline for generating event data and training an event-based dynamic NeRF. NeRFs offer geometric-based learnable rendering, but prior work with events has only considered reconstruction of static scenes. We show that by training on varied batch sizes of events, we can improve test-time predictions of events at fine time resolutions.
  arXiv  Detail & Related papers  (2023-10-03T21:08:41Z)
• Learning Spatial-Temporal Implicit Neural Representations for Event-Guided Video Super-Resolution [9.431635577890745]
  Event cameras sense the intensity changes asynchronously and produce event streams with high dynamic range and low latency. This has inspired research endeavors utilizing events to guide the challenging video superresolution (VSR) task. We make the first attempt to address a novel problem of achieving VSR at random scales by taking advantages of the high temporal resolution property of events.
  arXiv  Detail & Related papers  (2023-03-24T02:42:16Z)
• EventNeRF: Neural Radiance Fields from a Single Colour Event Camera [81.19234142730326]
  This paper proposes the first approach for 3D-consistent, dense and novel view synthesis using just a single colour event stream as input. At its core is a neural radiance field trained entirely in a self-supervised manner from events while preserving the original resolution of the colour event channels. We evaluate our method qualitatively and numerically on several challenging synthetic and real scenes and show that it produces significantly denser and more visually appealing renderings.
  arXiv  Detail & Related papers  (2022-06-23T17:59:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.