A Calibration Audit of Confidence in Feed-Forward 3D Reconstruction

• URL: http://arxiv.org/abs/2608.29705v2
• Date: Wed, 02 Sep 2026 14:04:24 GMT
• Title: A Calibration Audit of Confidence in Feed-Forward 3D Reconstruction
• Abstract summary: 3D reconstruction models emit per-pixel confidence that downstream systems read as a reliability signal.<n>We score the confidence on four properties, how well it ranks error, whether its level is right on average, whether it holds across the confidence range, and whether its intervals cover the truth.<n>The confidence ranks error well, but the predicted uncertainty is too low when it is read under conditions that are not exactly those of training.
• Score: 45.496856835431885
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Feed-forward 3D reconstruction models emit a per-pixel confidence that downstream systems read as a reliability signal. It is trained as a loss weight, not as an uncertainty magnitude, and whether it can be used as an error prediction has not been measured. We audit seven released backbones on thirteen datasets and score the confidence on four properties, how well it ranks error, whether its level is right on average, whether it holds across the confidence range, and whether its intervals cover the truth. The confidence ranks error well, but the predicted uncertainty is too low when it is read under conditions that are not exactly those of training. The median case is off by 2.4x across all seven models, and the error prediction is further off the more confident the model is. We show that this phenomenon can appear even though the loss's optimum is reached. A released model resumed under its own loss reaches that optimum on its training data within a few hundred updates and stays overconfident on unseen frames. A power law with two constants per backbone and dataset corrects the overall magnitude of the predicted uncertainty and leaves the ranking untouched. What no rescaling reaches is the scene, which we attribute to the model's missing knowledge of scale across predictions. Every correction we tried is close to right on average and still leaves two thirds of held-out scenes outside a five-point band, because what a scene is missing is a shape rather than a shift. We release the audit protocol, its results, and the fitted constants per model and dataset. Fitted with the target dataset held out, the constants bring the median case from 2.4x off to 1.35x, and a refit on a few labelled scenes of that dataset reaches 1.12x.

Related papers

• Explanatory Engagement Under Rare Anomalous Failure: Asymptotic Rarity in Model Behavior (or: The Asymptotic AI) [0.0]
  We build a local, zero-cost harness on three open-weight models (qwen3:8b, llama3.1:8b, mistral:7b) running a repeated tool-call task.<n>We hypothesized a rise in engagement as failures grew rarer, then a collapse near a detectability threshold.<n>A companion guaranteed-failure run shows models differ in whether they recognize an anomaly, distinct from engagement once recognized.
  arXiv  Detail & Related papers  (2026-08-13T10:25:40Z)
• Bigger or Cheaper? Scale and Quantization Effects on Uncertainty Signals in Vision-Language Models Under Image Degradation [0.0]
  We measure, on identical inputs, how model scale and 4-bit quantization affect two confidence signals in the Qwen2-VL family.<n>We find that scale sharply improves the model's internal uncertainty signal.<n>We argue that error-detection AUROC, not calibration error, is the metric that exposes the difference between the two signals.
  arXiv  Detail & Related papers  (2026-07-27T13:47:44Z)
• Track-Leakage-Free Hold-Out Self-Validation for Photogrammetric Reconstruction: Protocol, Sensitivity, and Limits [0.0]
  We formalise a track-leakage-free hold-out protocol for image reconstructions.<n>We evaluate it on five-referenced captures, 13 ETH3D laser-scan scenes, a EuRoC flight, and 30 IMC 2025 scenes.
  arXiv  Detail & Related papers  (2026-07-25T17:00:11Z)
• Architectural Observability Collapse in Transformers [0.0]
  Training preserved an internal decision-quality signal that output confidence does not expose.<n>Confidence controls absorb on average 60.3% of raw probe signal across 14 models in 6 families.<n>Training preserved observability where Llama 3.1 8B collapses at identical 32-layer, 32-head, 4096-hidden shape.
  arXiv  Detail & Related papers  (2026-04-27T02:39:02Z)
• On the Calibration of Human Pose Estimation [39.15814732856338]
  Calibrated ConfidenceNet (CCNet) is a light-weight post-hoc addition that improves AP by up to 1.4% on off-the-shelf pose estimation frameworks. applied to the downstream task of mesh recovery, CCNet facilitates an additional 1.0mm decrease in 3D keypoint error.
  arXiv  Detail & Related papers  (2023-11-28T09:31:09Z)
• POCO: 3D Pose and Shape Estimation with Confidence [99.91683561240549]
  We develop POCO, a novel framework for training HPS regressors to estimate not only a 3D human body, but also their confidence. Specifically, POCO estimates both the 3D body pose and a per-sample variance. In all cases, training the network to reason about uncertainty helps it learn to more accurately estimate 3D pose.
  arXiv  Detail & Related papers  (2023-08-24T17:59:04Z)
• Toward Reliable Human Pose Forecasting with Uncertainty [51.628234388046195]
  We develop an open-source library for human pose forecasting, including multiple models, supporting several datasets. We devise two types of uncertainty in the problem to increase performance and convey better trust.
  arXiv  Detail & Related papers  (2023-04-13T17:56:08Z)
• Beyond calibration: estimating the grouping loss of modern neural networks [68.8204255655161]
  Proper scoring rule theory shows that given the calibration loss, the missing piece to characterize individual errors is the grouping loss. We show that modern neural network architectures in vision and NLP exhibit grouping loss, notably in distribution shifts settings.
  arXiv  Detail & Related papers  (2022-10-28T07:04:20Z)
• Reliability-Aware Prediction via Uncertainty Learning for Person Image Retrieval [51.83967175585896]
  UAL aims at providing reliability-aware predictions by considering data uncertainty and model uncertainty simultaneously. Data uncertainty captures the noise" inherent in the sample, while model uncertainty depicts the model's confidence in the sample's prediction.
  arXiv  Detail & Related papers  (2022-10-24T17:53:20Z)
• Learning to Predict Trustworthiness with Steep Slope Loss [69.40817968905495]
  We study the problem of predicting trustworthiness on real-world large-scale datasets. We observe that the trustworthiness predictors trained with prior-art loss functions are prone to view both correct predictions and incorrect predictions to be trustworthy. We propose a novel steep slope loss to separate the features w.r.t. correct predictions from the ones w.r.t. incorrect predictions by two slide-like curves that oppose each other.
  arXiv  Detail & Related papers  (2021-09-30T19:19:09Z)
• Probabilistic Regression for Visual Tracking [193.05958682821444]
  We propose a probabilistic regression formulation and apply it to tracking. Our network predicts the conditional probability density of the target state given an input image. Our tracker sets a new state-of-the-art on six datasets, achieving 59.8% AUC on LaSOT and 75.8% Success on TrackingNet.
  arXiv  Detail & Related papers  (2020-03-27T17:58:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.