Boosting Neural Video Codec via Scale-Driven Online Flow Refinement

• URL: http://arxiv.org/abs/2606.23023v1
• Date: Mon, 22 Jun 2026 08:36:23 GMT
• Title: Boosting Neural Video Codec via Scale-Driven Online Flow Refinement
• Abstract summary: We propose a Training-Free Scale-Driven Online Flow Refinement (SOFR) method.<n>It fuses motion information from coarse and fine scales according to warping accuracy, effectively rectifying motion estimation errors.<n>It brings an average of 2.84% and 4.05% savings in terms of PSNR and MS-SSIM, respectively.
• Score: 59.68390983151205
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Although state-of-the-art neural video codecs (NVCs) have achieved remarkable performance, they suffer from limited generalization when encountering complex motion patterns unseen during training. To bridge this domain gap without the expensive cost of online fine-tuning, we propose a Training-Free Scale-Driven Online Flow Refinement (SOFR) method. Serving as a plug-and-play module, SOFR integrates motion information from coarse and fine scales and dynamically fuses them according to warping accuracy, effectively rectifying motion estimation errors with negligible computational overhead. Furthermore, we design a rate-aware strategy that selects different dynamic fusion strategies according to bitrate modes, and employs a reliability check based on warping error to ensure robustness. Extensive experiments on the USTC-TD dataset verify the effectiveness and generalization of SOFR across various NVC frameworks, including DCVC-SDD, DCVC-FM, and EHVC. Notably, it brings an average of 2.84% and 4.05% bitrate savings in terms of PSNR and MS-SSIM, respectively, to DCVC-FM with negligible coding time increase. Our code is available at https://github.com/SunnyMass/SOFR.

Related papers

• AdaVLA: Adaptive Step Flow Matching for Training-free Acceleration of Vision-Language-Action Models [1.0323063834827415]
  We propose AdaVLA, an online, training-free adaptive framework for fast yet accurate flow-matching-based Vision-Language-Action models.<n>We show that our method achieves $1.87times$ and $2.24times$ speedups for $_0.5$ and X-VLA, respectively, with negligible degradation in success rates.
  arXiv  Detail & Related papers  (2026-08-29T11:44:18Z)
• Neural Video Compression with Domain Transfer [67.17233008935996]
  DCVC-DT is a domain transfer enhanced neural video compression framework.<n>We develop a frame-level dynamic RD (Rate and Distortion) adjustment scheme that actively regulates the ratio of R and D in the loss based on quality fluctuation.
  arXiv  Detail & Related papers  (2026-05-13T13:02:40Z)
• Enhancing Neural Video Compression of Static Scenes with Positive-Incentive Noise [51.028614105626154]
  Static scene videos, such as surveillance feeds and videotelephony streams, constitute a dominant share of storage consumption and network traffic.<n>Traditional standardized codecs and neural video compression (NVC) methods struggle to encode these videos efficiently due to inadequate usage of temporal redundancy and severe distribution gaps between training and test data.<n>We propose to incorporate positive-incentive noise into NVC for static scene videos, where short-term temporal changes are reinterpreted as positive-incentive noise to facilitate model finetuning.
  arXiv  Detail & Related papers  (2026-03-06T09:47:25Z)
• Learned Rate Control for Frame-Level Adaptive Neural Video Compression via Dynamic Neural Network [8.645355715511702]
  We propose a dynamic video compression framework designed for variable scenarios.<n>The proposed method achieves an average BD-Rate reduction of 14.8% and BD-PSNR gain of 0.47dB over state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-08-28T12:27:23Z)
• NinA: Normalizing Flows in Action. Training VLA Models with Normalizing Flows [75.70583906344815]
  Diffusion models have been widely adopted as action decoders due to their ability to model complex, multimodal action distributions.<n>We present NinA, a fast and expressive alternative to diffusion-based decoders for Vision-Language-Action (VLA) models.
  arXiv  Detail & Related papers  (2025-08-23T00:02:15Z)
• Towards Practical Real-Time Neural Video Compression [60.390180067626396]
  We introduce a practical real-time neural video (NVC) designed to deliver high compression ratio, low latency and broad versatility.<n>Experiments show our proposed DCVC-RT achieves an impressive average encoding/desampling speed 125.2/112.8 (frames per second) for 1080p video, while saving an average of 21% in fps compared to H.266/VTM.
  arXiv  Detail & Related papers  (2025-02-28T06:32:23Z)
• Neural Video Coding using Multiscale Motion Compensation and Spatiotemporal Context Model [45.46660511313426]
  We propose an end-to-end deep neural video coding framework (NVC) It uses variational autoencoders (VAEs) with joint spatial and temporal prior aggregation (PA) to exploit the correlations in intra-frame pixels, inter-frame motions and inter-frame compensation residuals. NVC is evaluated for the low-delay causal settings and compared with H.265/HEVC, H.264/AVC and the other learnt video compression methods.
  arXiv  Detail & Related papers  (2020-07-09T06:15:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.