MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Details

• URL: http://arxiv.org/abs/2507.02546v1
• Date: Thu, 03 Jul 2025 11:40:01 GMT
• Title: MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Details
• Abstract summary: MoGe-2 is an advanced open-domain geometry estimation model.<n>It recovers a metric scale 3D point map of a scene from a single image.
• Score: 26.5687684583391
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We propose MoGe-2, an advanced open-domain geometry estimation model that recovers a metric scale 3D point map of a scene from a single image. Our method builds upon the recent monocular geometry estimation approach, MoGe, which predicts affine-invariant point maps with unknown scales. We explore effective strategies to extend MoGe for metric geometry prediction without compromising the relative geometry accuracy provided by the affine-invariant point representation. Additionally, we discover that noise and errors in real data diminish fine-grained detail in the predicted geometry. We address this by developing a unified data refinement approach that filters and completes real data from different sources using sharp synthetic labels, significantly enhancing the granularity of the reconstructed geometry while maintaining the overall accuracy. We train our model on a large corpus of mixed datasets and conducted comprehensive evaluations, demonstrating its superior performance in achieving accurate relative geometry, precise metric scale, and fine-grained detail recovery -- capabilities that no previous methods have simultaneously achieved.

Related papers

• MoGe-3: Fine-Detail Monocular Geometry Estimation with Self-Guided Sparse Volumetric Refinement [25.087145043756355]
  MoGe-3 is a fine-detail monocular geometry estimation model with Self-Guided Sparse 3D Refinement (SSR)<n>MoGe-3 lifts the coarse point map from a foundation base model onto a sparse voxel shell and refines it via SSR.<n> SSR employs sparse convolutions that aggregate features based on 3D spatial locality, avoiding feature mixing across depth discontinuities.
  arXiv  Detail & Related papers  (2026-07-20T14:07:32Z)
• SCOPE: Scale-Consistent One-Pass Estimation of 3D Geometry [69.89196162649091]
  SCOPE (Scale-Consistent One-Pass Estimation of 3D Geometry) is a novel approach for estimating 3D geometry from extended monocular video sequences.<n>Our approach generates affine-invariant 3D point maps with shared parameters across entire sequences, enabling consistent scale-invariant representations.
  arXiv  Detail & Related papers  (2026-06-19T10:23:25Z)
• GeoDM: Geometry-aware Distribution Matching for Dataset Distillation [5.993128231927707]
  We propose a geometry-aware distribution-matching framework, called textbfGeoDM.<n>To adapt to the underlying data geometry, we introduce learnable curvature and weight parameters for three kinds of geometries.<n>Our theoretical analysis shows that the geometry-aware distribution matching in a product space yields a smaller generalization error bound than the Euclidean counterparts.
  arXiv  Detail & Related papers  (2025-12-09T07:31:57Z)
• Follow the Energy, Find the Path: Riemannian Metrics from Energy-Based Models [35.5088111343308]
  We propose a method for deriving Riemannian metrics directly from pretrained Energy-Based Models.<n>These metrics define spatially varying distances, enabling the computation of geodesics.<n>We show that EBM-derived metrics consistently outperform established baselines.
  arXiv  Detail & Related papers  (2025-05-23T12:18:08Z)
• Sparse2DGS: Geometry-Prioritized Gaussian Splatting for Surface Reconstruction from Sparse Views [45.125032766506536]
  We propose Sparse2DGS, an MVS-d Gaussian Splatting pipeline for complete and accurate reconstruction.<n>Our key insight is to incorporate the geometric-prioritized enhancement schemes, allowing for direct and robust geometric learning under ill-posed conditions.<n>Sparse2DGS outperforms existing methods by notable margins while being $2times$ faster than the NeRF-based fine-tuning approach.
  arXiv  Detail & Related papers  (2025-04-29T02:47:02Z)
• GeomGS: LiDAR-Guided Geometry-Aware Gaussian Splatting for Robot Localization [20.26969580492428]
  We propose a novel 3DGS method called Geometry-Aware Gaussian Splatting (GeomGS)<n>Our GeomGS demonstrates state-of-the-art geometric and localization performance across several benchmarks, while also improving photometric performance.
  arXiv  Detail & Related papers  (2025-01-23T06:43:38Z)
• MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervision [23.12838070960566]
  We present MoGe, a powerful model for recovering 3D geometry from monocular open-domain images.<n>Given a single image, our model directly predicts a 3D point map of the captured scene with an affine-invariant representation.<n>We propose a set of novel global and local geometry supervisions that empower the model to learn high-quality geometry.
  arXiv  Detail & Related papers  (2024-10-24T19:29:02Z)
• Score-based Pullback Riemannian Geometry: Extracting the Data Manifold Geometry using Anisotropic Flows [10.649159213723106]
  We propose a framework for data-driven Riemannian geometry that is scalable in both geometry and learning.<n>We show that the proposed framework produces high-quality geodesics passing through the data support.<n>This is the first scalable framework for extracting the complete geometry of the data manifold.
  arXiv  Detail & Related papers  (2024-10-02T18:52:12Z)
• (Deep) Generative Geodesics [57.635187092922976]
  We introduce a newian metric to assess the similarity between any two data points. Our metric leads to the conceptual definition of generative distances and generative geodesics. Their approximations are proven to converge to their true values under mild conditions.
  arXiv  Detail & Related papers  (2024-07-15T21:14:02Z)
• Trim 3D Gaussian Splatting for Accurate Geometry Representation [72.00970038074493]
  We introduce Trim 3D Gaussian Splatting (TrimGS) to reconstruct accurate 3D geometry from images. Our experimental and theoretical analyses reveal that a relatively small Gaussian scale is a non-negligible factor in representing and optimizing the intricate details. When combined with the original 3DGS and the state-of-the-art 2DGS, TrimGS consistently yields more accurate geometry and higher perceptual quality.
  arXiv  Detail & Related papers  (2024-06-11T17:34:46Z)
• SAGS: Structure-Aware 3D Gaussian Splatting [53.6730827668389]
  We propose a structure-aware Gaussian Splatting method (SAGS) that implicitly encodes the geometry of the scene. SAGS reflects to state-of-the-art rendering performance and reduced storage requirements on benchmark novel-view synthesis datasets.
  arXiv  Detail & Related papers  (2024-04-29T23:26:30Z)
• FrozenRecon: Pose-free 3D Scene Reconstruction with Frozen Depth Models [67.96827539201071]
  We propose a novel test-time optimization approach for 3D scene reconstruction. Our method achieves state-of-the-art cross-dataset reconstruction on five zero-shot testing datasets.
  arXiv  Detail & Related papers  (2023-08-10T17:55:02Z)
• A Model for Multi-View Residual Covariances based on Perspective Deformation [88.21738020902411]
  We derive a model for the covariance of the visual residuals in multi-view SfM, odometry and SLAM setups. We validate our model with synthetic and real data and integrate it into photometric and feature-based Bundle Adjustment.
  arXiv  Detail & Related papers  (2022-02-01T21:21:56Z)
• Mix Dimension in Poincar\'{e} Geometry for 3D Skeleton-based Action Recognition [57.98278794950759]
  Graph Convolutional Networks (GCNs) have already demonstrated their powerful ability to model the irregular data. We present a novel spatial-temporal GCN architecture which is defined via the Poincar'e geometry. We evaluate our method on two current largest scale 3D datasets.
  arXiv  Detail & Related papers  (2020-07-30T18:23:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.