DRFusion: Drift-Resilient Temporally Consistent Infrared-Visible Video Fusion

• URL: http://arxiv.org/abs/2605.25775v1
• Date: Mon, 25 May 2026 12:23:55 GMT
• Title: DRFusion: Drift-Resilient Temporally Consistent Infrared-Visible Video Fusion
• Abstract summary: Infrared and visible video fusion is essential for achieving comprehensive perception in dynamic scenes.<n>Maintaining temporal consistency remains a formidable challenge.<n>We propose a drift-resilient video fusion method that reformulates the task as history-conditioned motion generation.
• Score: 21.262410801452948
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Infrared and visible video fusion is essential for achieving comprehensive perception in dynamic scenes. However, maintaining temporal consistency remains a formidable challenge. Conventional methods relying on optical flow often suffer from geometric rigidity and ghosting artifacts. Moreover, standard diffusion-based fusion models typically operate in a frame-by-frame manner; when extended to autoregressive settings, they lack intrinsic temporal constraints and are prone to severe error accumulation and drifting, where minor artifacts amplify over time. To address these limitations, we propose a drift-resilient video fusion method that reformulates the task as history-conditioned motion generation. We introduce Stabilized History Guidance and Soft Temporal Anchoring to reframe temporal consistency as spectral filtering, implicitly aggregating motion dynamics without rigid alignment. Furthermore, our Decoupled Structure-Motion Adaptation strategy bridges pre-trained priors and structural constraints via two-stage training and latent refinement. Extensive experiments demonstrate that our method achieves state-of-the-art performance in both fusion quality and temporal stability.

Related papers

• Bridging Event Streams and DiT: Event-Guided Video Frame Interpolation [75.95737622994548]
  Event cameras provide high-resolution motion cues that are well suited for bridging temporal gaps.<n>We propose an adapter-based framework that incorporates event-derived cues into a pre-trained image-to-video diffusion model.
  arXiv  Detail & Related papers  (2026-08-11T04:47:44Z)
• In-Context Forcing: Uncovering Context Effects in Autoregressive Video Diffusion [52.18702395026718]
  We introduce In-Context Forcing, a progressive autoregressive paradigm that utilizes contexts with decreasing noise levels.<n>By applying less masking to distant frames and more masking to adjacent ones, this approach provides adaptive guidance.<n>Our method significantly outperforms state-of-the-art approaches in both visual fidelity and inference speed.
  arXiv  Detail & Related papers  (2026-08-05T13:54:31Z)
• Cycle-World: Mitigating Error Accumulation in Long-term Video World Models via Reverse-Prediction Cycle Consistency [123.12549538776109]
  Cycle-World is a framework designed for stable and temporally consistent long-video generation.<n>Our approach tackles error drift by enforcing strict temporal reversibility across both the training and inference phases.<n>Experiments on the VBench benchmark demonstrate that Cycle-World's dual-phase synergy significantly mitigates error drift.
  arXiv  Detail & Related papers  (2026-07-13T17:27:13Z)
• From Contrast to Consistency: Rethinking Event-based Continuous-Time Optical Flow Estimation [39.022447753493346]
  Event-based cameras capture brightness changes asynchronously, offering a unique opportunity to model motion with fine temporal precision.<n>We propose a hybrid-supervised framework for continuous-time optical flow estimation, grounded in the principle of Spatio-temporal Structural Consistency (STSC)<n>Our method achieves state-of-the-art performance in both continuous-time and standard optical flow estimation, demonstrating the effectiveness of the proposed learning paradigm.
  arXiv  Detail & Related papers  (2026-05-25T08:24:23Z)
• ReMATF: Recurrent Motion-Adaptive Multi-scale Turbulence Mitigation for Dynamic Scenes [4.282240730573401]
  Atmospheric turbulence severely degrades video quality by introducing distortions such as geometric warping, blur, and temporal flickering.<n>We propose ReMATF, a lightweight recurrent framework that restores videos using only two frames at a time while preserving spatial detail and temporal stability.
  arXiv  Detail & Related papers  (2026-05-20T17:28:49Z)
• TeDiO: Temporal Diagonal Optimization for Training-Free Coherent Video Diffusion [30.705936075333465]
  We show that incoherent videos consistently exhibit irregular, fragmented temporal diagonals in their intermediate self-attention maps.<n>We introduce TeDiO, a training-free, inference-time method that reinforces temporal consistency by regularizing these internal attention patterns.
  arXiv  Detail & Related papers  (2026-05-13T21:39:50Z)
• FTPFusion: Frequency-Aware Infrared and Visible Video Fusion with Temporal Perturbation [5.5275479200431406]
  FTP-Fusion is a frequency-aware infrared and visible video fusion method based on temporal and sparse cross-modal interaction.<n> FTP-Fusion consistently outperforms state-of-the-art methods across multiple metrics in both spatial fidelity and temporal consistency.
  arXiv  Detail & Related papers  (2026-04-02T11:08:14Z)
• LoCAtion: Long-time Collaborative Attention Framework for High Dynamic Range Video Reconstruction [17.88716377235245]
  We propose LoCAtion, a framework that reformulates HDR video generation from a fragile spatial warping task into a robust, alignment-free collaborative feature routing problem.<n>LoCAtion achieves state-of-the-art visual quality and temporal stability, offering a highly competitive balance between accuracy and computational efficiency.
  arXiv  Detail & Related papers  (2026-03-15T13:34:46Z)
• All-in-One Video Restoration under Smoothly Evolving Unknown Weather Degradations [102.94052335735326]
  All-in-one image restoration aims to recover clean images from diverse unknown degradations using a single model.<n>Existing approaches primarily focus on frame-wise degradation variation, overlooking the temporal continuity that naturally exists in real-world degradation processes.<n>We introduce the Smoothly Evolving Unknown Degradations (SEUD) scenario, where both the active degradation set and degradation intensity change continuously over time.
  arXiv  Detail & Related papers  (2026-01-02T02:20:57Z)
• STCDiT: Spatio-Temporally Consistent Diffusion Transformer for High-Quality Video Super-Resolution [60.06664986365803]
  We present STCDiT, a video super-resolution framework built upon a pre-trained video diffusion model.<n>It aims to restore structurally faithful and temporally stable videos from degraded inputs, even under complex camera motions.
  arXiv  Detail & Related papers  (2025-11-24T05:37:23Z)
• DiTVR: Zero-Shot Diffusion Transformer for Video Restoration [48.97196894658511]
  DiTVR is a zero shot video restoration framework that couples a diffusion transformer with trajectory aware attention and a flow consistent sampler.<n>Our attention mechanism aligns tokens along optical flow trajectories, with particular emphasis on vital layers that exhibit the highest sensitivity to temporal dynamics.<n>The flow guided sampler injects data consistency only into low-frequency bands, preserving high frequency priors while accelerating cache.
  arXiv  Detail & Related papers  (2025-08-11T09:54:45Z)
• Low-Light Video Enhancement via Spatial-Temporal Consistent Decomposition [52.89441679581216]
  Low-Light Video Enhancement (LLVE) seeks to restore dynamic or static scenes plagued by severe invisibility and noise.<n>We present an innovative video decomposition strategy that incorporates view-independent and view-dependent components.<n>Our framework consistently outperforms existing methods, establishing a new SOTA performance.
  arXiv  Detail & Related papers  (2024-05-24T15:56:40Z)
• Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolution [65.91317390645163]
  Upscale-A-Video is a text-guided latent diffusion framework for video upscaling. It ensures temporal coherence through two key mechanisms: locally, it integrates temporal layers into U-Net and VAE-Decoder, maintaining consistency within short sequences. It also offers greater flexibility by allowing text prompts to guide texture creation and adjustable noise levels to balance restoration and generation.
  arXiv  Detail & Related papers  (2023-12-11T18:54:52Z)
• Intrinsic Temporal Regularization for High-resolution Human Video Synthesis [59.54483950973432]
  temporal consistency is crucial for extending image processing pipelines to the video domain. We propose an effective intrinsic temporal regularization scheme, where an intrinsic confidence map is estimated via the frame generator to regulate motion estimation. We apply our intrinsic temporal regulation to single-image generator, leading to a powerful " INTERnet" capable of generating $512times512$ resolution human action videos.
  arXiv  Detail & Related papers  (2020-12-11T05:29:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.