Across-Design Uncertainty in Short Pricing Panels: Inference and Identification
- URL: http://arxiv.org/abs/2608.21334v2
- Date: Mon, 24 Aug 2026 21:06:07 GMT
- Title: Across-Design Uncertainty in Short Pricing Panels: Inference and Identification
- Abstract summary: We evaluate the inferential consequences of sparsity in a synthetic data-generating process.<n>Across-design component accounts for 97.6% of estimation error variance for a gradient-boosted specification.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Short observational pricing panels often contain many observations but few distinct price movements. We evaluate the inferential consequences of this sparsity in a synthetic data-generating process by separating estimation error into uncertainty conditional on a realized price trajectory and variation across alternative trajectories. In baseline simulations, this across-design component accounts for 97.6% of estimation error variance for a gradient-boosted specification, causing coverage shortfalls driven by design-specific centering error that standard within-panel resampling and cluster-robust procedures fail to capture. Three main results organize the analysis. First, across-design dispersion follows the empirical relation sigma_b approx 0.182 V^(-0.271), where V = n_moves * magnitude^2, with -0.271 treated as a simulation regularity. Second, adding regions sharing a common price path improves nuisance estimation but creates no independent price trajectories; only averaging across units with independent design errors reduces across-design standard deviation at the sqrt(k) rate. Third, a Paule-Mandel variance component estimated across independently priced units increases empirical coverage under homogeneity from 0.469 to 0.931. Broadly, improving inference in passive panels requires generating independent identifying variation, such as through controlled regional randomization. Finally, an application to scanner data (Dominick's Finer Foods, Soft Drinks) confirms these findings: nominal price zones and products behave as a small fraction of their count in independent design draws, yielding between-unit dispersion intervals far wider than conventional within-panel bootstraps.
Related papers
- Resolution-Aware Experimental Design under Partial Identifiability [0.0]
Experimental design is commonly framed as choosing the experiment expected to provide the most information.<n>We introduce Resolution-Aware Experimental Design (RAED), which selects an experiment by the smallest expected nonempty structural candidate set achievable subject to false-trivial control.<n>We prove an exact cross-nuisance aliasing separation: an experiment can be preferred by structural and full-latent information gain, average classification, and nuisance-marginalized informativeness while having arbitrarily poorer valid structural resolution.
arXiv Detail & Related papers (2026-09-03T11:23:10Z) - Simplex Relaxation for Discrete Diffusion [58.33696160279345]
We introduce Simplax, an exact Dirichlet--categorical augmentation that couples each corrupted categorical state with an auxiliary simplex-valued variable.<n>Simplax improves the generative perplexity--entropy tradeoff on unconditional OpenWebText generation.
arXiv Detail & Related papers (2026-08-11T07:58:17Z) - Equation-Free Period-Aware Forecast-Error Contraction for Estimating Negative Largest Lyapunov Exponents from Short Trajectory Ensembles [4.689984557057394]
We introduce a period-aware forecast-error contraction procedure for estimating a dominant negative Lyapunov exponent from ensembles of short scalar trajectories.<n>A k-nearest-neighbor predictor is trained on trajectory histories, the geometric-mean absolute forecast error is evaluated at phase-consistent horizons, and the exponent is obtained from the slope of the logarithmic error profile.
arXiv Detail & Related papers (2026-08-06T01:58:00Z) - The Price of Isolation: Estimating the Ecosystem Cost of Symmetric Two-Sided A/B Testing [8.026599954667267]
symmetric two-sided isolation is widely used for creator-side and cold-start experiments.<n>Isolation thins each viewer's candidate catalog, and intuition suggests the resulting engagement cost should fade as the platform grows.<n>We show that, in an order-statistics model of engagement, whether this intuition holds depends on the upper tail of match quality.
arXiv Detail & Related papers (2026-08-05T04:22:05Z) - Dual-Branch Cross-Projection Debiasing through Diffusion-based Disentanglement [66.67463557274358]
Foundation models trained on biased datasets often rely on spurious correlations between target labels and non-causal attributes.<n>We introduce Confidence-guided Concept Mining (CBCM) to identify reliable spurious attributes without attribute annotations.<n>We propose Dual-branch Cross-projection Debiasing (DCD), a prompt-tuning framework that separates target and spurious representations into two branches.
arXiv Detail & Related papers (2026-06-23T05:28:47Z) - Beyond Point Estimates: Benchmarking Uncertainty Quantification Methods on the AION-1 Astronomical Foundation Model [47.71489969727656]
Conformalized Quantile Regression (CQR) delivers the best coverage in the bin with the poorest model predictions.<n>Only the Locally Valid and Discriminative (LVD) framework provides finite-sample emphlocal validity.
arXiv Detail & Related papers (2026-06-05T18:29:19Z) - Kernel-based potential mean-field games with unbiased random Fourier $U$-statistics [0.0]
We study the subclass of potential mean-field games in which the running interaction cost and the terminal target cost are both expressed through reproducing- kernel maximum mean discrepancy penalties.<n>Both costs are estimated from finite-sample empirical distributions using a random Fourier U-statistic representation that is unbiased and has linear cost in the batch size.
arXiv Detail & Related papers (2026-05-28T05:15:25Z) - Calibrated Inference for the Conditional Average Treatment Effect in the Few-Placebo Regime via Gaussian Processes [0.0]
We study the few-placebo regime, in which one treatment arm is much smaller than the other.<n>We show that intervals under-cover: they contain the true effect less often than their nominal level.<n>We propose GP-CATE, which models each arm's outcome surface with a Gaussian process.
arXiv Detail & Related papers (2026-05-26T11:18:42Z) - Stochastic Estimation of the Layer-wise Hessian Trace for Monitoring Neural-network Training [45.88028371034407]
We present a parameter estimator of the trace of the diagonal blocks of the Hessian matrix of the empirical risk of a neural network.<n>The procedure combines the Hutchinson trace estimator with a single Hessian-vector product over the whole parameter vector.<n>We show that correctness under weight sharing requires the layer-wise Hessian to be assembled before the second differentiation.
arXiv Detail & Related papers (2026-05-25T10:24:32Z) - Why SGD is not Brownian Motion: A New Perspective on Stochastic Dynamics [92.39053980710702]
Gradient Descent (SGD) is commonly modeled as a Langevin process, assuming that minibatch noise acts as Brownian motion.<n>This approximation relies on a continuous-time limit and a sqrt(eta) noise scaling that does not match the discrete SGD update at finite learning rate.<n>We propose an alternative formulation of SGD as deterministic dynamics in a fluctuating loss landscape induced by minibatch sampling.
arXiv Detail & Related papers (2026-05-21T15:50:40Z) - Partial Causal Structure Learning for Valid Selective Conformal Inference under Interventions [0.0]
In genomics experiments, exchangeability often holds only within subsets of interventions that leave a target variable "unaffected"<n>Our contributions are: (i) a contamination-robust conformal coverage theorem that quantifies how misclassification of "unaffected" calibration examples degrades coverage via an explicit function $g(,n)$ of the contamination fraction and calibration set size; and (ii) a task-driven partial causal learning formulation that estimates only the binary descendant indicators $Z_a,i=mathbf1iinmathrmdesc(a)$ needed
arXiv Detail & Related papers (2026-03-02T18:58:22Z) - Sharp Convergence Rates for Masked Diffusion Models [53.117058231393834]
We develop a total-variation based analysis for the Euler method that overcomes limitations.<n>Our results relax assumptions on score estimation, improve parameter dependencies, and establish convergence guarantees.<n>Overall, our analysis introduces a direct TV-based error decomposition along the CTMC trajectory and a decoupling-based path-wise analysis for FHS.
arXiv Detail & Related papers (2026-02-26T00:47:51Z) - Model-free Methods for Event History Analysis and Efficient Adjustment (PhD Thesis) [55.2480439325792]
This thesis is a series of independent contributions to statistics unified by a model-free perspective.<n>The first chapter elaborates on how a model-free perspective can be used to formulate flexible methods that leverage prediction techniques from machine learning.<n>The second chapter studies the concept of local independence, which describes whether the evolution of one process is directly influenced by another.
arXiv Detail & Related papers (2025-02-11T19:24:09Z) - Data-Driven Switchback Experiments: Theoretical Tradeoffs and Empirical Bayes Designs [1.9376226959814953]
We study the design and analysis of switchback experiments conducted on a single aggregate unit.
We show that the estimation error depends on four factors: carryover effects, periodicity, serially correlated outcomes, and impacts from simultaneous experiments.
arXiv Detail & Related papers (2024-06-10T20:06:53Z) - Clustered Switchback Designs for Experimentation Under Spatio-temporal Interference [44.644520116360106]
We estimate the global average treatment effect (GATE), the difference between average outcomes having exposed all units at all times to treatment or to control.<n>We propose a clustered switchback design, where units are grouped into clusters and time steps are grouped into blocks.<n>We show that for graphs that admit good clustering, a truncated Horvitz-Thompson estimator achieves a $tilde O(1/NT)$ mean squared error (MSE)<n>Our results simultaneously generalize the results from citethu2022switchback,ugander2013graph and citetleung2022rate
arXiv Detail & Related papers (2023-12-25T01:00:58Z) - TIC-TAC: A Framework for Improved Covariance Estimation in Deep Heteroscedastic Regression [109.69084997173196]
Deepscedastic regression involves jointly optimizing the mean and covariance of the predicted distribution using the negative log-likelihood.
Recent works show that this may result in sub-optimal convergence due to the challenges associated with covariance estimation.
We study two questions: (1) Does the predicted covariance truly capture the randomness of the predicted mean?
Our results show that not only does TIC accurately learn the covariance, it additionally facilitates an improved convergence of the negative log-likelihood.
arXiv Detail & Related papers (2023-10-29T09:54:03Z) - Environment Invariant Linear Least Squares [16.831875263656027]
This paper considers a multi-environment linear regression model in which data from multiple experimental settings are collected.<n>We construct a novel environment invariant linear least squares (EILLS) objective function, a multi-environment version of linear least-squares regression.
arXiv Detail & Related papers (2023-03-06T13:10:54Z) - Log-Likelihood Ratio Minimizing Flows: Towards Robust and Quantifiable
Neural Distribution Alignment [52.02794488304448]
We propose a new distribution alignment method based on a log-likelihood ratio statistic and normalizing flows.
We experimentally verify that minimizing the resulting objective results in domain alignment that preserves the local structure of input domains.
arXiv Detail & Related papers (2020-03-26T22:10:04Z) - Estimating Gradients for Discrete Random Variables by Sampling without
Replacement [93.09326095997336]
We derive an unbiased estimator for expectations over discrete random variables based on sampling without replacement.
We show that our estimator can be derived as the Rao-Blackwellization of three different estimators.
arXiv Detail & Related papers (2020-02-14T14:15:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.