Who Bears the Risk When Generative AI Enters Transport? A Distributional Sociotechnical Audit of Algorithmic Equity, Synthetic-Data Validity, and Public Trust
- URL: http://arxiv.org/abs/2609.11611v1
- Date: Thu, 10 Sep 2026 14:29:09 GMT
- Title: Who Bears the Risk When Generative AI Enters Transport? A Distributional Sociotechnical Audit of Algorithmic Equity, Synthetic-Data Validity, and Public Trust
- Abstract summary: Generative artificial intelligence is entering transportation through traveler-facing advisories, synthetic crash-record generation, and policy decision support.<n>We develop a Distributional Audit that integrates algorithmic equity, synthetic-data validity, and public-attitude into one empirical pipeline.
- Score: 1.089614199781423
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Generative artificial intelligence is entering transportation through traveler-facing advisories, synthetic crash-record generation, and policy decision support. Existing governance frameworks lack transport-specific statistical tools to measure distributional risks across heterogeneous populations. We develop a Distributional Sociotechnical Audit (DSA) that integrates algorithmic equity, synthetic-data validity, and public-attitude heterogeneity into one empirical pipeline. The audit analyzes 5,760 persona-controlled queries to four LLM families across 12 demographic cues and four transport topics, uses two cross-family judges and a Wasserstein-2 Equity Dispersion Index, tests three FARS crash-record generators with conditional projected maximum mean discrepancy (cpMMD), fits a Bayesian ordered-logit model to Pew American Trends Panel Wave 152 (N = 4,538), and combines the signals into a continuous Sociotechnical Risk Index. Congestion-pricing advice has the highest persona-based dispersion (mean EDI = 1.96; highest direct EDI = 2.20). CART synthetic crash records fail all conditional tests (p < 0.001), while the Gaussian copula has borderline conditional stress (p = 0.105) despite passing marginal checks. Attitudes to AI vary across demographic strata. Distributional audits and continuous risk indices with sensitivity reporting offer a more defensible basis for transport GenAI governance than categorical approval tiers, which show a 75% assignment flip rate under weight perturbation.
Related papers
- Cloud-Native Evaluation-as-a-Service: A Microservices Architecture for Scalable AI Monitoring with Conformal Guarantees [4.262007271558123]
We present E, a cloud-native reference architecture that operationalizes AI evaluation methods as six stateless methods.<n>E includes conformal prediction with finite-sample-corrected Adaptive Prediction Sets, calibration assessment, drift detection via RFF-approximated Mean Discrepancy, fairness monitoring with bootstrap confidence intervals, a DAG-based pipeline orchestrator, and a result storage API.
arXiv Detail & Related papers (2026-07-04T01:39:59Z) - Synthetic Network Packet Generation through Statistical Learning and Genetic Algorithms [6.42094170804706]
This paper proposes and compares two constraint-enforcing approaches for synthetic IoT network packet generation.<n> Evaluation on the complete ACI IoT 2023 dataset demonstrates that both methods achieve PASS status across all categories.
arXiv Detail & Related papers (2026-06-18T18:52:51Z) - LegalHalluLens: Typed Hallucination Auditing and Calibrated Multi-Agent Debate for Trustworthy Legal AI [0.0]
LegalHalluLens is an auditing framework for legal AI deployed in the wild.<n>Typed profiles and RDI surface failure modes that aggregate metrics hide.<n>The framework supports direction-aware procurement, accountability, and agent design for legal AI deployed in the wild.
arXiv Detail & Related papers (2026-06-16T15:02:37Z) - Output Type Before Quality: A Standards-Derived XAI Admissibility Rubric for Autonomous-Driving Safety [0.4958589793470846]
Safety standards for ML-based autonomous driving specify the kind of evidence an assurance case must contain (directed cause-and-effect chains, quantified interventional effects, named root-cause variables)<n>Yet the XAI literature is organised by output type and technique family (saliency maps, feature attribution, counterfactuals, causal graphs, language traces)<n>We name this mismatch the evidence-type gap.<n>XAI method selection for safety assurance should be driven by lifecycle-stage evidence demand, not by method popularity.
arXiv Detail & Related papers (2026-06-03T21:37:52Z) - TRUST: A Framework for Decentralized AI Service v.0.1 [47.384270414446604]
Large Reasoning Models (LRMs) and Multi-Agent Systems (MAS) in high-stakes domains demand reliable verification.<n>We introduce TRUST (Transparent, Robust, and Unified Services for Trustworthy AI), a decentralized framework with three innovations.<n>We prove a Safety-Profitability Theorem ensuring honest auditors profit while malicious actors incur losses.
arXiv Detail & Related papers (2026-04-29T19:32:58Z) - Reliable Self-Harm Risk Screening via Adaptive Multi-Agent LLM Systems [6.14481021961242]
We present a statistical framework for multi-agent pipelines structured as directed acyclic graphs (DAGs)<n>We model each agent as a categorical decision and introduce tighter agent-level performance confidence bounds.<n>We evaluate our system on two labeled datasets in behavioral health.
arXiv Detail & Related papers (2026-04-24T01:52:54Z) - Sanity Checks for Agentic Data Science [43.38296659030703]
Agentic data science (ADS) pipelines have grown rapidly in both capability and adoption.<n>These systems can reach falsely optimistic conclusions that are difficult for users to detect.<n>We propose a pair of lightweight sanity checks grounded in the Predictability-Computability-Stability framework.
arXiv Detail & Related papers (2026-04-13T05:11:28Z) - How Independent are Large Language Models? A Statistical Framework for Auditing Behavioral Entanglement and Reweighting Verifier Ensembles [46.63622714488747]
Shared pretraining data, distillation, and alignment pipelines can induce hidden behavioral dependencies, latent entanglement.<n>In practice, this manifests as correlated reasoning patterns and synchronized failures.<n>We develop a statistical framework for auditing behavioral entanglement among black-box language models.
arXiv Detail & Related papers (2026-04-08T23:32:06Z) - Automated Self-Testing as a Quality Gate: Evidence-Driven Release Management for LLM Applications [51.56484100374058]
We present an automated self-testing framework that introduces quality gates with evidence-based release decisions.<n>We evaluate the framework through a longitudinal case study of an internally deployed multi-agent conversational AI system.
arXiv Detail & Related papers (2026-03-13T20:44:15Z) - Improving Search Agent with One Line of Code [68.58667107354253]
Tool-based Agentic Reinforcement Learning (TARL) has emerged as a promising paradigm for training search agents to interact with external tools.<n>We propose textbfSearch textbfAgent textbfPolicy textbfOptimization (textbfSAPO), which stabilizes training via a conditional token-level KL constraint.
arXiv Detail & Related papers (2026-03-10T04:07:39Z) - Unsupervised Anomaly Detection in Multi-Agent Trajectory Prediction via Transformer-Based Models [45.08545174556591]
We propose an unsupervised anomaly detection framework based on a multi-agent Transformer.<n>A dual evaluation scheme has been proposed to assess both detection stability and physical alignment.<n>Our framework identifies 388 unique anomalies missed by Time-to-Collision and statistical baselines.
arXiv Detail & Related papers (2026-01-28T08:33:10Z) - Eigen-1: Adaptive Multi-Agent Refinement with Monitor-Based RAG for Scientific Reasoning [53.45095336430027]
We develop a unified framework that combines implicit retrieval and structured collaboration.<n>On Humanity's Last Exam (HLE) Bio/Chem Gold, our framework achieves 48.3% accuracy.<n>Results on SuperGPQA and TRQA confirm robustness across domains.
arXiv Detail & Related papers (2025-09-25T14:05:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.