A Comparative Simulation Study of the Fairness and Accuracy of Predictive Policing Systems in Baltimore City

• URL: http://arxiv.org/abs/2602.02566v1
• Date: Fri, 30 Jan 2026 19:34:46 GMT
• Title: A Comparative Simulation Study of the Fairness and Accuracy of Predictive Policing Systems in Baltimore City
• Authors: Samin Semsar, Kiran Laxmikant Prabhu, Gabriella Waters, James Foulds,
• Abstract summary: We perform a comprehensive comparative simulation study on the fairness and accuracy of predictive policing systems in Baltimore.<n>Our results suggest that the situation around bias in predictive policing is more complex than was previously assumed.<n> Predictive policing was found to be more fair and accurate than hot spots policing in the short term, although it amplified bias faster.
• Score: 0.5774786149181391
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: There are ongoing discussions about predictive policing systems, such as those deployed in Los Angeles, California and Baltimore, Maryland, being unfair, for example, by exhibiting racial bias. Studies found that unfairness may be due to feedback loops and being trained on historically biased recorded data. However, comparative studies on predictive policing systems are few and are not sufficiently comprehensive. In this work, we perform a comprehensive comparative simulation study on the fairness and accuracy of predictive policing technologies in Baltimore. Our results suggest that the situation around bias in predictive policing is more complex than was previously assumed. While predictive policing exhibited bias due to feedback loops as was previously reported, we found that the traditional alternative, hot spots policing, had similar issues. Predictive policing was found to be more fair and accurate than hot spots policing in the short term, although it amplified bias faster, suggesting the potential for worse long-run behavior. In Baltimore, in some cases the bias in these systems tended toward over-policing in White neighborhoods, unlike in previous studies. Overall, this work demonstrates a methodology for city-specific evaluation and behavioral-tendency comparison of predictive policing systems, showing how such simulations can reveal inequities and long-term tendencies.

Related papers

• Behaviour Policy Optimization: Provably Lower Variance Return Estimates for Off-Policy Reinforcement Learning [52.97053840476386]
  We show that well-designed behaviour policies can be used to collect off-policy data for provably lower variance return estimates.<n>We extend this key insight to the online reinforcement learning setting, where both policy evaluation and improvement are interleaved.
  arXiv  Detail & Related papers  (2025-11-13T23:06:40Z)
• Likelihood-Free Estimation for Spatiotemporal Hawkes processes with missing data and application to predictive policing [24.33098548975857]
  We introduce a Wasserstein Generative Adrial Networks (WGAN) driven likelihood-free approach to account for unreported crimes in Spatiotemporal Hawkes models.<n>We demonstrate through empirical analysis how this methodology improves the accuracy of parametric estimation in the presence of data missingness.
  arXiv  Detail & Related papers  (2025-02-10T23:09:12Z)
• How far can bias go? -- Tracing bias from pretraining data to alignment [54.51310112013655]
  This study examines the correlation between gender-occupation bias in pre-training data and their manifestation in LLMs.<n>Our findings reveal that biases present in pre-training data are amplified in model outputs.
  arXiv  Detail & Related papers  (2024-11-28T16:20:25Z)
• A Causal Framework to Evaluate Racial Bias in Law Enforcement Systems [13.277413612930102]
  We present a multi-stage causal framework incorporating criminality. In settings like airport security, the primary source of observed bias against a race is likely to be bias in law enforcement against innocents of that race. In police-civilian interaction, the primary source of observed bias against a race could be bias in law enforcement against that race or bias from the general public in reporting against the other race.
  arXiv  Detail & Related papers  (2024-02-22T20:41:43Z)
• Provable Detection of Propagating Sampling Bias in Prediction Models [1.7709344190822935]
  We provide a theoretical analysis of how a specific form of data bias, differential sampling bias, propagates from the data stage to the prediction stage. Under reasonable assumptions, we quantify how the amount of bias in the model predictions varies as a function of the amount of differential sampling bias in the data. We demonstrate that the theoretical results hold in practice even when our assumptions are relaxed.
  arXiv  Detail & Related papers  (2023-02-13T23:39:35Z)
• Fair Enough: Standardizing Evaluation and Model Selection for Fairness Research in NLP [64.45845091719002]
  Modern NLP systems exhibit a range of biases, which a growing literature on model debiasing attempts to correct. This paper seeks to clarify the current situation and plot a course for meaningful progress in fair learning.
  arXiv  Detail & Related papers  (2023-02-11T14:54:00Z)
• The SAME score: Improved cosine based bias score for word embeddings [49.75878234192369]
  We introduce SAME, a novel bias score for semantic bias in embeddings. We show that SAME is capable of measuring semantic bias and identify potential causes for social bias in downstream tasks.
  arXiv  Detail & Related papers  (2022-03-28T09:28:13Z)
• Statistical discrimination in learning agents [64.78141757063142]
  Statistical discrimination emerges in agent policies as a function of both the bias in the training population and of agent architecture. We show that less discrimination emerges with agents that use recurrent neural networks, and when their training environment has less bias.
  arXiv  Detail & Related papers  (2021-10-21T18:28:57Z)
• The effect of differential victim crime reporting on predictive policing systems [84.86615754515252]
  We show how differential victim crime reporting rates can lead to outcome disparities in common crime hot spot prediction models. Our results suggest that differential crime reporting rates can lead to a displacement of predicted hotspots from high crime but low reporting areas to high or medium crime and high reporting areas.
  arXiv  Detail & Related papers  (2021-01-30T01:57:22Z)
• The role of collider bias in understanding statistics on racially biased policing [0.0]
  Contradictory conclusions have been made about whether unarmed blacks are more likely to be shot by police than unarmed whites using the same data. We provide a causal Bayesian network model to explain this bias, which is called collider bias or Berkson's paradox.
  arXiv  Detail & Related papers  (2020-07-16T15:26:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.