Mitigating biases in big mobility data: a case study of monitoring large-scale transit systems

• URL: http://arxiv.org/abs/2407.14541v1
• Date: Tue, 16 Jul 2024 02:22:16 GMT
• Title: Mitigating biases in big mobility data: a case study of monitoring large-scale transit systems
• Abstract summary: This study evaluates biases in big mobility datasets and develops mitigation methods. Using Google and Apple mobility data as examples, this study compares them with benchmark data from governmental agencies.
• Score: 12.332645165759406
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Big mobility datasets (BMD) have shown many advantages in studying human mobility and evaluating the performance of transportation systems. However, the quality of BMD remains poorly understood. This study evaluates biases in BMD and develops mitigation methods. Using Google and Apple mobility data as examples, this study compares them with benchmark data from governmental agencies. Spatio-temporal discrepancies between BMD and benchmark are observed and their impacts on transportation applications are investigated, emphasizing the urgent need to address these biases to prevent misguided policymaking. This study further proposes and tests a bias mitigation method. It is shown that the mitigated BMD could generate valuable insights into large-scale public transit systems across 100+ US counties, revealing regional disparities of the recovery of transit systems from the COVID-19. This study underscores the importance of caution when using BMD in transportation research and presents effective mitigation strategies that would benefit practitioners.

Related papers

• Towards Improving the External Validity of Software Engineering Experiments with Transportability Methods [3.9236728810856714]
  We introduce transportability methods, their prerequisites, and demonstrate their potential through a simulation.<n>We then outline several SE research scenarios in which these methods could apply, e.g., how to effectively use students as substitutes for developers.<n>Finally, we outline a road map and practical guidelines to support SE researchers in applying them.
  arXiv  Detail & Related papers  (2026-04-09T12:57:26Z)
• The Illusion of Fairness: Auditing Fairness Interventions with Audit Studies [12.7910460546047]
  We investigate how data from audit studies can be used to improve our ability to both train and evaluate automated hiring algorithms.<n>We find that such data reveals cases where the common fairness intervention method of equalizing base rates across classes appears to achieve parity using traditional measures.
  arXiv  Detail & Related papers  (2025-07-02T21:15:56Z)
• Enhancing Epidemic Forecasting: Evaluating the Role of Mobility Data and Graph Convolutional Networks [9.460023981858319]
  This study addresses the gap between machine learning algorithms and their epidemiological applications.<n>We adopt a two-phase approach: first, assessing the significance of mobility data through a pilot study, then evaluating the impact of Graph Convolutional Networks (GCNs) on a transformer backbone.<n>Our findings reveal that while mobility data and GCN modules do not significantly enhance forecasting performance, the inclusion of mortality and hospitalization data markedly improves model accuracy.
  arXiv  Detail & Related papers  (2025-05-20T12:23:18Z)
• How far can bias go? -- Tracing bias from pretraining data to alignment [54.51310112013655]
  This study examines the correlation between gender-occupation bias in pre-training data and their manifestation in LLMs. Our findings reveal that biases present in pre-training data are amplified in model outputs.
  arXiv  Detail & Related papers  (2024-11-28T16:20:25Z)
• Model Inversion Attacks: A Survey of Approaches and Countermeasures [59.986922963781]
  Recently, a new type of privacy attack, the model inversion attacks (MIAs), aims to extract sensitive features of private data for training. Despite the significance, there is a lack of systematic studies that provide a comprehensive overview and deeper insights into MIAs. This survey aims to summarize up-to-date MIA methods in both attacks and defenses.
  arXiv  Detail & Related papers  (2024-11-15T08:09:28Z)
• A Comprehensive Library for Benchmarking Multi-class Visual Anomaly Detection [52.228708947607636]
  This paper proposes a comprehensive visual anomaly detection benchmark, ADer, which is a modular framework for new methods.<n>The benchmark includes multiple datasets from industrial and medical domains, implementing fifteen state-of-the-art methods and nine comprehensive metrics.<n>We objectively reveal the strengths and weaknesses of different methods and provide insights into the challenges and future directions of multi-class visual anomaly detection.
  arXiv  Detail & Related papers  (2024-06-05T13:40:07Z)
• DispaRisk: Auditing Fairness Through Usable Information [21.521208250966918]
  DispaRisk is a framework designed to assess the potential risks of disparities in datasets during the initial stages of machine learning pipeline. DispaRisk identifies datasets with a high risk of discrimination, detect model families prone to biases within an ML pipeline, and enhance the explainability of these bias risks. This work contributes to the development of fairer ML systems by providing a robust tool for early bias detection and mitigation.
  arXiv  Detail & Related papers  (2024-05-20T20:56:01Z)
• Analyzing and Mitigating Bias for Vulnerable Classes: Towards Balanced Representation in Dataset [2.143460356353513]
  This research focuses on investigating class imbalances among vulnerable road users. We utilize popular CNN models and Vision Transformers (ViTs) with the nuScenes dataset. Using the proposed mitigation approaches, we see improvement in IoU(%) and NDS(%) metrics from 71.3 to 75.6 and 80.6 to 83.7 for the CNN model.
  arXiv  Detail & Related papers  (2024-01-18T22:10:46Z)
• DeCrisisMB: Debiased Semi-Supervised Learning for Crisis Tweet Classification via Memory Bank [52.20298962359658]
  In crisis events, people often use social media platforms such as Twitter to disseminate information about the situation, warnings, advice, and support. fully-supervised approaches require annotating vast amounts of data and are impractical due to limited response time. Semi-supervised models can be biased, performing moderately well for certain classes while performing extremely poorly for others. We propose a simple but effective debiasing method, DeCrisisMB, that utilizes a Memory Bank to store and perform equal sampling for generated pseudo-labels from each class at each training.
  arXiv  Detail & Related papers  (2023-10-23T05:25:51Z)
• Biases in human mobility data impact epidemic modeling [0.0]
  We identify two types of bias caused by unequal access to, and unequal usage of mobile phones. We find evidence for data generation bias in all examined datasets in that high-wealth individuals are overrepresented. To mitigate the skew, we present a framework to debias data and show how simple techniques can be used to increase representativeness.
  arXiv  Detail & Related papers  (2021-12-23T13:20:54Z)
• Causal-BALD: Deep Bayesian Active Learning of Outcomes to Infer Treatment-Effects from Observational Data [37.15330590319357]
  Existing approaches rely on fitting deep models on outcomes observed for treated and control populations. Deep Bayesian active learning provides a framework for efficient data acquisition by selecting points with high uncertainty. We introduce causal, Bayesian acquisition functions grounded in information theory that bias data acquisition towards regions with overlapping support.
  arXiv  Detail & Related papers  (2021-11-03T15:11:39Z)
• Estimating and Improving Fairness with Adversarial Learning [65.99330614802388]
  We propose an adversarial multi-task training strategy to simultaneously mitigate and detect bias in the deep learning-based medical image analysis system. Specifically, we propose to add a discrimination module against bias and a critical module that predicts unfairness within the base classification model. We evaluate our framework on a large-scale public-available skin lesion dataset.
  arXiv  Detail & Related papers  (2021-03-07T03:10:32Z)
• Combining Graph Neural Networks and Spatio-temporal Disease Models to Predict COVID-19 Cases in Germany [0.0]
  Several experts have called for the necessity to account for human mobility to explain the spread of COVID-19. Most statistical or epidemiological models cannot directly incorporate unstructured data sources, including data that may encode human mobility. We propose a trade-off between both research directions and present a novel learning approach that combines the advantages of statistical regression and machine learning models.
  arXiv  Detail & Related papers  (2021-01-03T16:39:00Z)
• Leveraging Administrative Data for Bias Audits: Assessing Disparate Coverage with Mobility Data for COVID-19 Policy [61.60099467888073]
  We show how linking administrative data can enable auditing mobility data for bias. We show that older and non-white voters are less likely to be captured by mobility data. We show that allocating public health resources based on such mobility data could disproportionately harm high-risk elderly and minority groups.
  arXiv  Detail & Related papers  (2020-11-14T02:04:14Z)
• Provably Efficient Causal Reinforcement Learning with Confounded Observational Data [135.64775986546505]
  We study how to incorporate the dataset (observational data) collected offline, which is often abundantly available in practice, to improve the sample efficiency in the online setting. We propose the deconfounded optimistic value iteration (DOVI) algorithm, which incorporates the confounded observational data in a provably efficient manner.
  arXiv  Detail & Related papers  (2020-06-22T14:49:33Z)
• A Survey on Causal Inference [64.45536158710014]
  Causal inference is a critical research topic across many domains, such as statistics, computer science, education, public policy and economics. Various causal effect estimation methods for observational data have sprung up.
  arXiv  Detail & Related papers  (2020-02-05T21:35:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.