SYN-DIGITS: A Synthetic Control Framework for Calibrated Digital Twin Simulation
- URL: http://arxiv.org/abs/2604.07513v1
- Date: Wed, 08 Apr 2026 18:50:01 GMT
- Title: SYN-DIGITS: A Synthetic Control Framework for Calibrated Digital Twin Simulation
- Abstract summary: SYN-DIGITS is a principled and lightweight calibration framework for AI-based persona simulation.<n>It learns latent structure from digital-twin responses and transfers it to align predictions with human ground truth.<n>It supports both individual-level and distributional simulation for previously unseen questions.
- Score: 9.671885065974857
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: AI-based persona simulation -- often referred to as digital twin simulation -- is increasingly used for market research, recommender systems, and social sciences. Despite their flexibility, large language models (LLMs) often exhibit systematic bias and miscalibration relative to real human behavior, limiting their reliability. Inspired by synthetic control methods from causal inference, we propose SYN-DIGITS (SYNthetic Control Framework for Calibrated DIGItal Twin Simulation), a principled and lightweight calibration framework that learns latent structure from digital-twin responses and transfers it to align predictions with human ground truth. SYN-DIGITS operates as a post-processing layer on top of any LLM-based simulator and thus is model-agnostic. We develop a latent factor model that formalizes when and why calibration succeeds through latent space alignment conditions, and we systematically evaluate ten calibration methods across thirteen persona constructions, three LLMs, and two datasets. SYN-DIGITS supports both individual-level and distributional simulation for previously unseen questions and unobserved populations, with provable error guarantees. Experiments show that SYN-DIGITS achieves up to 50% relative improvements in individual-level correlation and 50--90% relative reductions in distributional discrepancy compared to uncalibrated baselines.
Related papers
- Stop Drawing Scientific Claims from LLM Social Simulations Without Robustness Audits [11.902271500463934]
Generative agents bring new expressive power to agent-based modeling.<n>Small perturbations that appear minor to researchers can cascade into macro-level outcomes.<n>We introduce TRAILS, a robustness-audit taxonomy spanning three levels of simulation design.
arXiv Detail & Related papers (2026-05-17T00:21:53Z) - Multimodal Learning on Low-Quality Data with Conformal Predictive Self-Calibration [72.0672328514289]
Multimodal learning often grapples with the challenge of low-quality data.<n>We propose a unified framework, termed Conformal Predictive Self-Calibration.<n>Our framework consistently outperforms existing state-of-the-art methods.
arXiv Detail & Related papers (2026-05-05T14:48:52Z) - Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond [209.35045331678043]
We introduce a "levels x laws" taxonomy organized along two axes.<n>The first defines three capability levels: L1 Predictor, which learns one-step local transition operators; L2 Simulator, which composes them into multi-step, action-conditioned rollouts that respect domain laws; and L3 Evolver, which autonomously revises its own model when predictions fail against new evidence.<n>We synthesize over 400 works and summarize more than 100 representative systems spanning model-based reinforcement learning, video generation, web and GUI agents, multi-agent social simulation, and AI-driven scientific discovery.
arXiv Detail & Related papers (2026-04-24T17:48:47Z) - Towards Real-world Human Behavior Simulation: Benchmarking Large Language Models on Long-horizon, Cross-scenario, Heterogeneous Behavior Traces [81.41397370235102]
We introduce OmniBehavior, the first user simulation benchmark constructed entirely from real-world data.<n>We show that current models struggle to accurately simulate complex behaviors, with performance plateauing even as context windows expand.<n>This results in the loss of individual differences and long-tail behaviors, highlighting critical directions for future high-fidelity simulation research.
arXiv Detail & Related papers (2026-04-09T15:26:21Z) - GaussTwin: Unified Simulation and Correction with Gaussian Splatting for Robotic Digital Twins [15.345154779819302]
GaussTwin is a real-time digital twin that combines position-based dynamics with discrete Cosserat rod formulations for simulation.<n>We show that GaussTwin consistently improves tracking accuracy and robustness compared to shape-matching and rigid-only baselines.
arXiv Detail & Related papers (2026-03-05T12:27:05Z) - Hybrid Modeling, Sim-to-Real Reinforcement Learning, and Large Language Model Driven Control for Digital Twins [4.34315145996134]
This work investigates the use of digital twins for dynamical system modeling and control.<n>It integrates physics-based, data-driven, and hybrid approaches with both traditional and AI-driven controllers.
arXiv Detail & Related papers (2025-10-27T21:43:42Z) - G-Sim: Generative Simulations with Large Language Models and Gradient-Free Calibration [48.948187359727996]
G-Sim is a hybrid framework that automates simulator construction with rigorous empirical calibration.<n>It produces reliable, causally-informed simulators, mitigating data-inefficiency and enabling robust system-level interventions.
arXiv Detail & Related papers (2025-06-10T22:14:34Z) - Digital Twin Calibration with Model-Based Reinforcement Learning [3.0435175689911595]
This paper presents a novel methodological framework, called the Actor-Simulator, that incorporates the calibration of digital twins into model-based reinforcement learning.<n>Our approach jointly calibrates the digital twin and searches for an optimal control policy, thus accounting for and reducing model error.<n>This dual-component approach provably converges to the optimal policy, and outperforms existing methods in extensive numerical experiments based on the biopharmaceutical manufacturing domain.
arXiv Detail & Related papers (2025-01-04T06:15:28Z) - Addressing Misspecification in Simulation-based Inference through Data-driven Calibration [43.811367860375825]
This work introduces robust posterior estimation(RoPE), a framework that overcomes model misspecification with a small real-world calibration set of ground-truth parameter measurements.<n>Results on four synthetic tasks and two real-world problems with ground-truth labels demonstrate that RoPE outperforms baselines and consistently returns informative and calibrated credible intervals.
arXiv Detail & Related papers (2024-05-14T16:04:39Z) - MS-MANO: Enabling Hand Pose Tracking with Biomechanical Constraints [50.61346764110482]
We integrate a musculoskeletal system with a learnable parametric hand model, MANO, to create MS-MANO.
This model emulates the dynamics of muscles and tendons to drive the skeletal system, imposing physiologically realistic constraints on the resulting torque trajectories.
We also propose a simulation-in-the-loop pose refinement framework, BioPR, that refines the initial estimated pose through a multi-layer perceptron network.
arXiv Detail & Related papers (2024-04-16T02:18:18Z) - Investigating the Robustness of Counterfactual Learning to Rank Models: A Reproducibility Study [71.04084063541777]
Counterfactual learning to rank has attracted extensive attention in the IR community.<n>Models can be theoretically unbiased when the user behavior assumption is correct and the propensity estimation is accurate.<n>Their effectiveness is usually empirically evaluated via simulation-based experiments due to a lack of widely available, large-scale, real click logs.
arXiv Detail & Related papers (2024-04-04T10:54:38Z) - A Multi-Grained Symmetric Differential Equation Model for Learning Protein-Ligand Binding Dynamics [73.35846234413611]
In drug discovery, molecular dynamics (MD) simulation provides a powerful tool for predicting binding affinities, estimating transport properties, and exploring pocket sites.
We propose NeuralMD, the first machine learning (ML) surrogate that can facilitate numerical MD and provide accurate simulations in protein-ligand binding dynamics.
We demonstrate the efficiency and effectiveness of NeuralMD, achieving over 1K$times$ speedup compared to standard numerical MD simulations.
arXiv Detail & Related papers (2024-01-26T09:35:17Z) - Maximum Likelihood Learning of Unnormalized Models for Simulation-Based
Inference [44.281860162298564]
We introduce two synthetic likelihood methods for Simulation-Based Inference.
We learn a conditional energy-based model (EBM) of the likelihood using synthetic data generated by the simulator.
We demonstrate the properties of both methods on a range of synthetic datasets, and apply them to a model of the neuroscience network in the crab.
arXiv Detail & Related papers (2022-10-26T14:38:24Z) - Style-Hallucinated Dual Consistency Learning for Domain Generalized
Semantic Segmentation [117.3856882511919]
We propose the Style-HAllucinated Dual consistEncy learning (SHADE) framework to handle domain shift.
Our SHADE yields significant improvement and outperforms state-of-the-art methods by 5.07% and 8.35% on the average mIoU of three real-world datasets.
arXiv Detail & Related papers (2022-04-06T02:49:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.