Cross-View Variance Correlation in Path-Traced Stereo:A Hidden Shortcut in Synthetic Training Data
- URL: http://arxiv.org/abs/2606.25483v1
- Date: Wed, 24 Jun 2026 07:13:00 GMT
- Title: Cross-View Variance Correlation in Path-Traced Stereo:A Hidden Shortcut in Synthetic Training Data
- Abstract summary: Path-traced synthetic stereo data underlie a large fraction of disparity-estimation training pipelines.<n>We show that the underlying emphvariance fields are highly correlated once aligned by the ground-truth disparity warp.<n>This signal is unique to MC-rendered data and constitutes a candidate sim-to-real shortcut.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Path-traced synthetic stereo data underlie a large fraction of modern disparity-estimation training pipelines. We report a previously unrecognised property of such data: while the Monte Carlo (MC) noise streams of the two cameras are statistically independent, the underlying \emph{variance fields} -- deterministic per-pixel functions of the rendering integrand -- are highly correlated once aligned by the ground-truth disparity warp. Across 20 scenes rendered with Mitsuba~3, the warped Pearson correlation reaches $ρ{=}0.754{\pm}0.016$ across 20 scenes at $\mathrm{SPP}{=}512$, and on a representative scene remains essentially invariant ($ρ{=}0.778{\pm}0.001$) over a $16\times$ range of samples per pixel. The effect is strongest in Lambertian regions ($ρ{\approx}0.78$) and substantially weaker in glass ($ρ{\approx}0.30$), as predicted by an integrand decomposition into view-independent and view-dependent components. A residual-shuffle intervention that breaks the cross-view alignment while preserving the clean image degrades the GT cost margin by $33\%$ on non-glass and the variance-based winner-take-all accuracy on glass by $4.3\times$, confirming the structure functions as a matching cue. This signal is unique to MC-rendered data and constitutes a candidate sim-to-real shortcut whose impact on trained networks remains to be quantified.
Related papers
- CyFM: Cylindrical Optimal Transport for Few-Step Complex-Valued Flow Matching [0.0]
Complex-valued signals, such as Magnetic Resonance Imaging (MRI) and audio spectrograms, are almost always modelled as flat two-channel Euclidean data.<n>We replace the inherited metric $dA2 + A2 d2$ by the decoupled product metric $dA2 + d2$ and measure what that substitution costs and what it buys.<n>We analyze Cylindrical Flow Matching (CyFM), which strictly bounds the regression target, and couple noise and data by exact minibatch Optimal Transport computed jointly over whole fields in the cylindrical metric.
arXiv Detail & Related papers (2026-09-12T22:12:33Z) - Disparity Has a Sign: Stereo Matching Beyond the Zero-Disparity Plane [52.210414985125816]
We show how a stereoscopic content contains objects behind the zero-disparity plane corresponding to negative disparities.<n>We propose textitZDPShift, a benchmark of $21,495$ stereo pairs from seven cinematographer-authored open movies.<n>On identical scene content, Foundation goes from $2.24$ EPE to $75.33$px, with every backbone leaving roughly half of all pixels exceeding a three-pixel disparity error.
arXiv Detail & Related papers (2026-09-06T19:58:35Z) - Inferring Missing Trajectory Data with Temporal Convolutional Networks [0.0]
We propose a Temporal Convolutional Network (TCN) with symmetric dilation that relaxes the standard causality constraint.<n>The model is trained with a composite loss that combines weighted mean squared error, boundary--continuity penalties, and a smoothness regularizer.<n>Trained on a synthetic dataset of $1,000$ (train), $200$ (validation), and $300$ (test) two-dimensional trajectories with randomly placed 20% masked segments, the model achieves good R$2$, MSE and MAE metrics.
arXiv Detail & Related papers (2026-07-27T23:46:15Z) - A Spectral Phase Diagram for Binary Few-Shot Classification: Intrinsic Dimensionality, Geometric Saturation, and Representational Diagnosis [0.0]
The saturation index $S(K) = operatornameerank(widehat_W(K)) / K$ measures the ratio of the effective rank of the pooled within-class sample covariance to the shot count.<n>The index is computable in $O(d3)$ time from support features alone, requiring no test labels or trained classifier.
arXiv Detail & Related papers (2026-06-12T16:46:24Z) - CaricHarmony: Contrastive Diffusion Paths for Identity-Preserving Caricature Synthesis [49.596677723190886]
Sketch-based caricature synthesis suffers from a fundamental failure mode.<n>Identity and shape conditions are combined in diffusion models, causing collapse toward bland portraits or unrecognizable distortions.<n>We present CaricHarmony, the first training-free method that explicitly resolves this contamination through parallel uncontaminated diffusion paths.
arXiv Detail & Related papers (2026-06-11T22:57:59Z) - Prism: Structural Symmetry Scanning via Duality-Constrained Laplacian Projection [0.0]
We introduce textbfPrism, a framework for structural symmetry diagnosis in complex networks.<n>Prism computes the emphduality defect $(L,P) = |LP - PL|_F / |L|_F$ -- a scalar measuring how far the network deviates from structural self-consistency.
arXiv Detail & Related papers (2026-05-18T04:20:05Z) - Hardware Validation of DAGI via a Modular "Ridge" Signature and High-Order Synergistic Information [0.0]
DAGI (Directed Acyclic Graph Information) framework on IBM Quantum hardware.<n>Small, controlled experiment whose ideal output distribution is constrained to a low-dimensional modular manifold (a "ridge)<n>Key recovery exceeds chance: per-shot accuracy 0.1689 (chance 0.125, 95% Wilson CI [0.1610, 0.1772])<n>These results support the claim that DAGI detects and quantifies non-trivial, hardware-resilient information structure.
arXiv Detail & Related papers (2026-04-16T14:16:59Z) - Not All Forgetting Is Equal: Architecture-Dependent Retention Dynamics in Fine-Tuned Image Classifiers [0.0]
We track per-sample correctness at every intrinsic during fine-tuning of ResNet-18 and DeiT-Small.<n>Fifth, a sample's loss after head warmup predicts its long-term decay constant.<n>Findings suggest that architectural diversity in ensembles provides retention coverage.
arXiv Detail & Related papers (2026-04-13T14:11:47Z) - $\mathbb{X}$-Sample Contrastive Loss: Improving Contrastive Learning with Sample Similarity Graphs [62.565573316667276]
We develop an objective that encodes how a sample relates to others.
We train vision models based on similarities in class or text caption descriptions.
Our objective appears to work particularly well in lower-data regimes, with gains over CLIP of $16.8%$ on ImageNet and $18.1%$ on ImageNet Real.
arXiv Detail & Related papers (2024-07-25T15:38:16Z) - Projection by Convolution: Optimal Sample Complexity for Reinforcement Learning in Continuous-Space MDPs [56.237917407785545]
We consider the problem of learning an $varepsilon$-optimal policy in a general class of continuous-space Markov decision processes (MDPs) having smooth Bellman operators.
Key to our solution is a novel projection technique based on ideas from harmonic analysis.
Our result bridges the gap between two popular but conflicting perspectives on continuous-space MDPs.
arXiv Detail & Related papers (2024-05-10T09:58:47Z) - SimCon Loss with Multiple Views for Text Supervised Semantic
Segmentation [10.735102459660057]
Learning to segment images purely by relying on the image-text alignment from web data can lead to sub-optimal performance due to noise in the data.
This paper proposes a novel loss function termed SimCon, which accounts for intra-modal similarities to determine the appropriate set of positive samples to align.
arXiv Detail & Related papers (2023-02-07T12:36:35Z) - Permuted AdaIN: Reducing the Bias Towards Global Statistics in Image
Classification [97.81205777897043]
Recent work has shown that convolutional neural network classifiers overly rely on texture at the expense of shape cues.
We make a similar but different distinction between shape and local image cues, on the one hand, and global image statistics, on the other.
Our method, called Permuted Adaptive Instance Normalization (pAdaIN), reduces the representation of global statistics in the hidden layers of image classifiers.
arXiv Detail & Related papers (2020-10-09T16:38:38Z) - A Random Matrix Analysis of Random Fourier Features: Beyond the Gaussian
Kernel, a Precise Phase Transition, and the Corresponding Double Descent [85.77233010209368]
This article characterizes the exacts of random Fourier feature (RFF) regression, in the realistic setting where the number of data samples $n$ is all large and comparable.
This analysis also provides accurate estimates of training and test regression errors for large $n,p,N$.
arXiv Detail & Related papers (2020-06-09T02:05:40Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.