HiReFF: High-Resolution Feedforward Human Reconstruction from Uncalibrated Sparse-View Video

• URL: http://arxiv.org/abs/2606.29333v1
• Date: Sun, 28 Jun 2026 11:01:36 GMT
• Title: HiReFF: High-Resolution Feedforward Human Reconstruction from Uncalibrated Sparse-View Video
• Abstract summary: HiReFF is a feed-forward method for 2K-resolution 360 human video reconstruction from uncalibrated sparse-view videos.<n>Our framework decomposes the problem into two key tasks: 3D Gaussian reconstruction from sparse-view videos and computationally efficient high-resolution synthesis.<n> Experiments demonstrate that HiReFF significantly outperforms existing methods in high-resolution streaming video reconstruction.
• Score: 58.85548854304172
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Uncalibrated volumetric video streaming for human reconstruction is essential for holographic communication and AR/VR, yet remains challenging due to the need for temporal consistency and computational efficiency from sparse-view inputs. Existing methods rely on per-scene optimization or calibrated cameras, while recent feed-forward models are limited to low-resolution (0.5K) single-frame synthesis. We present HiReFF, a feed-forward method for 2K-resolution 360° human video reconstruction from uncalibrated sparse-view videos. Our framework decomposes the problem into two key tasks: foreground 3D Gaussian reconstruction from sparse-view videos (four views separated by 90°) and computationally efficient high-resolution synthesis. To enable the former, we propose Scale-synchronized Camera Calibration to resolve scale ambiguity for multi-view supervision, and Gaussian-wise Foreground Masking to reconstruct clean foregrounds by modulating Gaussian parameters. For efficient high-resolution synthesis, our High-resolution Side-tuning achieves 2K rendering by augmenting the Gaussian head with supplementary features while keeping the backbone at 0.5K, drastically reducing computational overhead. Experiments demonstrate that HiReFF significantly outperforms existing methods in high-resolution streaming volumetric video reconstruction. https://iridescentjiang.github.io/HiReFF

Related papers

• VidSplat: Gaussian Splatting Reconstruction with Geometry-Guided Video Diffusion Priors [79.88300861391114]
  VidSplat is a training-free generative reconstruction framework.<n>We tackle two key challenges that enable the effective integration of generation and reconstruction.<n>Experiments on widely used benchmarks demonstrate our superior performance in sparse-view scene reconstruction.
  arXiv  Detail & Related papers  (2026-05-12T02:20:31Z)
• ViBe: Ultra-High-Resolution Video Synthesis Born from Pure Images [30.646542711556787]
  Transformer-based video diffusion models rely on 3D attention over spatial and temporal tokens.<n>We propose a pure image adaptation framework that upgrades a video Diffusion Transformer pre-trained at its native scale to synthesize higher-resolution videos.
  arXiv  Detail & Related papers  (2026-03-24T15:27:22Z)
• 3One2: One-step Regression Plus One-step Diffusion for One-hot Modulation in Dual-path Video Snapshot Compressive Imaging [15.082139132074294]
  Video snapshot imaging (SCI) captures dynamic scene sequences through a two-dimensional (2D) snapshot.<n>One-hot modulation, activating only one sub-frame per pixel, provides a promising solution for achieving perfect temporal decoupling.<n>We propose an algorithm specifically designed for one-hot masks.
  arXiv  Detail & Related papers  (2025-12-19T13:44:36Z)
• M2SVid: End-to-End Inpainting and Refinement for Monocular-to-Stereo Video Conversion [60.728003408015844]
  We propose a novel architecture for inpainting and refinement of the warped right view obtained by depth-based reprojection of the input left view.<n>Our approach outperforms previous state-of-the-art methods, obtaining an average rank of 1.43 among the 4 compared methods in a user study.
  arXiv  Detail & Related papers  (2025-05-22T11:58:54Z)
• Pixel to Gaussian: Ultra-Fast Continuous Super-Resolution with 2D Gaussian Modeling [50.34513854725803]
  Arbitrary-scale super-resolution (ASSR) aims to reconstruct high-resolution (HR) images from low-resolution (LR) inputs with arbitrary upsampling factors.<n>We propose a novel ContinuousSR framework with a Pixel-to-Gaussian paradigm, which explicitly reconstructs 2D continuous HR signals from LR images using Gaussian Splatting.
  arXiv  Detail & Related papers  (2025-03-09T13:43:57Z)
• DGTR: Distributed Gaussian Turbo-Reconstruction for Sparse-View Vast Scenes [81.56206845824572]
  Novel-view synthesis (NVS) approaches play a critical role in vast scene reconstruction. Few-shot methods often struggle with poor reconstruction quality in vast environments. This paper presents DGTR, a novel distributed framework for efficient Gaussian reconstruction for sparse-view vast scenes.
  arXiv  Detail & Related papers  (2024-11-19T07:51:44Z)
• Towards Interpretable Video Super-Resolution via Alternating Optimization [115.85296325037565]
  We study a practical space-time video super-resolution (STVSR) problem which aims at generating a high-framerate high-resolution sharp video from a low-framerate blurry video. We propose an interpretable STVSR framework by leveraging both model-based and learning-based methods.
  arXiv  Detail & Related papers  (2022-07-21T21:34:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.