H-OmniStereo: Zero-Shot Omnidirectional Stereo Matching with Heading-Aligned Normal Priors

• URL: http://arxiv.org/abs/2605.14963v2
• Date: Sat, 16 May 2026 11:48:36 GMT
• Title: H-OmniStereo: Zero-Shot Omnidirectional Stereo Matching with Heading-Aligned Normal Priors
• Abstract summary: H- OmniStereo is a zero-shot omnidirectional stereo matching framework.<n>We construct high-quality synthetic dataset comprising over 2.8 million top-bottom equirectangular stereo pairs.<n>Our approach achieves higher accuracy than existing methods on out-of-domain datasets.
• Score: 39.6437115448559
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Stereo matching on top-bottom equirectangular images provides an effective framework for full-surround perception, as vertically aligned epipolar lines enable the use of advanced perspective stereo architectures that are largely driven by large-scale datasets and monocular priors. However, the performance of such adaptations is severely limited by the scarcity of omnidirectional stereo datasets and the degradation of perspective monocular priors under spherical distortions. To address these challenges, we propose H-OmniStereo, a zero-shot omnidirectional stereo matching framework. First, we construct high-quality synthetic dataset comprising over 2.8 million top-bottom equirectangular stereo pairs to scale up training. Second, we introduce an equirectangular monocular normal estimator, specifically operating in a heading-aligned coordinate system. Beyond providing distortion-robust and cross-view-consistent geometric priors for establishing reliable correspondences in stereo matching, this design boosts training efficiency and accommodates train-test FoV mismatches. Extensive experiments show that our approach achieves higher accuracy than existing methods on out-of-domain datasets and successfully generalizes to real-world consumer camera setups using a single model. The model and dataset will be released at https://github.com/JIANG-CX/H-OmniStereo.

Related papers

• StereoGS: Sparse-View 3D Gaussian Splatting via Stereo Priors [0.9326260051834822]
  3D Gaussian Splatting (3DGS) has achieved remarkable success in real-time novel view synthesis.<n>It suffers from severe overfitting under sparse-view settings due to insufficient geometric constraints.<n>We propose StereoGS, a novel sparse-view 3DGS framework that integrates stereo priors to establish reliable binocular consistency.
  arXiv  Detail & Related papers  (2026-06-29T16:45:57Z)
• StereoGenBench: A Synthetic Multi-Camera Benchmark for Stereo Generation under Controlled Baseline Regimes [14.691582964882565]
  StereoGenBench is a benchmark for stereo generation evaluation.<n>Each scene is rendered with a rigid six-camera lateral array.<n>Views are released with RGB, metric depth, intrinsics, per-pair baselines, and per-frame poses.
  arXiv  Detail & Related papers  (2026-05-22T05:10:57Z)
• Stereo World Model: Camera-Guided Stereo Video Generation [52.3922115596956]
  We present StereoWorld, a camera-conditioned stereo world model that jointly learns appearance and binocular geometry for end-to-end stereo video generation.<n>Unlike monocular RGB or RGBD approaches, StereoWorld operates exclusively within the RGB modality, while simultaneously grounding geometry directly from disparity.
  arXiv  Detail & Related papers  (2026-03-18T05:42:22Z)
• Boosting Omnidirectional Stereo Matching with a Pre-trained Depth Foundation Model [70.67610495024459]
  Camera-based setups offer a cost-effective option by using stereo depth estimation to generate dense, high-resolution depth maps.<n>Existing omnidirectional stereo matching approaches achieve only limited depth accuracy across diverse environments.<n>We present DFI-OmniStereo, a novel omnidirectional stereo matching method that leverages a large-scale pre-trained foundation model for relative monocular depth estimation.
  arXiv  Detail & Related papers  (2025-03-30T16:24:22Z)
• FoundationStereo: Zero-Shot Stereo Matching [50.79202911274819]
  FoundationStereo is a foundation model for stereo depth estimation.<n>We first construct a large-scale (1M stereo pairs) synthetic training dataset.<n>We then design a number of network architecture components to enhance scalability.
  arXiv  Detail & Related papers  (2025-01-17T01:01:44Z)
• Stereo Anything: Unifying Zero-shot Stereo Matching with Large-Scale Mixed Data [77.27700893908012]
  Stereo matching serves as a cornerstone in 3D vision, aiming to establish pixel-wise correspondences between stereo image pairs for depth recovery.<n>Current models often exhibit severe performance degradation when deployed in unseen domains.<n>We introduce StereoAnything, a data-centric framework that substantially enhances the zero-shot generalization capability of existing stereo models.
  arXiv  Detail & Related papers  (2024-11-21T11:59:04Z)
• ChiTransformer:Towards Reliable Stereo from Cues [10.756828396434033]
  Current stereo matching techniques are challenged by restricted searching space, occluded regions and sheer size. We present an optic-chiasm-inspired self-supervised binocular depth estimation method. ChiTransformer architecture yields substantial improvements over state-of-the-art self-supervised stereo approaches by 11%.
  arXiv  Detail & Related papers  (2022-03-09T07:19:58Z)
• AdaStereo: A Simple and Efficient Approach for Adaptive Stereo Matching [50.06646151004375]
  A novel domain-adaptive pipeline called AdaStereo aims to align multi-level representations for deep stereo matching networks. Our AdaStereo models achieve state-of-the-art cross-domain performance on multiple stereo benchmarks, including KITTI, Middlebury, ETH3D, and DrivingStereo.
  arXiv  Detail & Related papers  (2020-04-09T16:15:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.