Adaptive Reinforcement Learning Model for Simulation of Urban Mobility during Crises

• URL: http://arxiv.org/abs/2009.01359v1
• Date: Wed, 2 Sep 2020 21:47:18 GMT
• Title: Adaptive Reinforcement Learning Model for Simulation of Urban Mobility during Crises
• Authors: Chao Fan, Xiangqi Jiang, Ali Mostafavi
• Abstract summary: This study proposes and tests an adaptive reinforcement learning model that can learn the patterns of human mobility in a normal context. The application of the proposed model is shown in the context of Houston and the flooding scenario caused by Hurricane Harvey in August 2017.
• Score: 2.5876546798940616
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The objective of this study is to propose and test an adaptive reinforcement learning model that can learn the patterns of human mobility in a normal context and simulate the mobility during perturbations caused by crises, such as flooding, wildfire, and hurricanes. Understanding and predicting human mobility patterns, such as destination and trajectory selection, can inform emerging congestion and road closures raised by disruptions in emergencies. Data related to human movement trajectories are scarce, especially in the context of emergencies, which places a limitation on applications of existing urban mobility models learned from empirical data. Models with the capability of learning the mobility patterns from data generated in normal situations and which can adapt to emergency situations are needed to inform emergency response and urban resilience assessments. To address this gap, this study creates and tests an adaptive reinforcement learning model that can predict the destinations of movements, estimate the trajectory for each origin and destination pair, and examine the impact of perturbations on humans' decisions related to destinations and movement trajectories. The application of the proposed model is shown in the context of Houston and the flooding scenario caused by Hurricane Harvey in August 2017. The results show that the model can achieve more than 76\% precision and recall. The results also show that the model could predict traffic patterns and congestion resulting from to urban flooding. The outcomes of the analysis demonstrate the capabilities of the model for analyzing urban mobility during crises, which can inform the public and decision-makers about the response strategies and resilience planning to reduce the impacts of crises on urban mobility.

Related papers

• SMA-Hyper: Spatiotemporal Multi-View Fusion Hypergraph Learning for Traffic Accident Prediction [2.807532512532818]
  Current data-driven models often struggle with data sparsity and the integration of diverse urban data sources. We introduce a deep dynamic learning framework designed for traffic accident prediction. It incorporates dual adaptive graph learning mechanisms that enable high-order cross-regional learning. It also employs an advance attention mechanism to fuse multiple views of accident data and urban functional features.
  arXiv  Detail & Related papers  (2024-07-24T21:10:34Z)
• Physics-guided Active Sample Reweighting for Urban Flow Prediction [75.24539704456791]
  Urban flow prediction is a nuanced-temporal modeling that estimates the throughput of transportation services like buses, taxis and ride-driven models. Some recent prediction solutions bring remedies with the notion of physics-guided machine learning (PGML) We develop a atized physics-guided network (PN), and propose a data-aware framework Physics-guided Active Sample Reweighting (P-GASR)
  arXiv  Detail & Related papers  (2024-07-18T15:44:23Z)
• Deep Activity Model: A Generative Approach for Human Mobility Pattern Synthesis [11.90100976089832]
  We develop a novel generative deep learning approach for human mobility modeling and synthesis. It incorporates both activity patterns and location trajectories using open-source data. The model can be fine-tuned with local data, allowing it to adapt to accurately represent mobility patterns across diverse regions.
  arXiv  Detail & Related papers  (2024-05-24T02:04:10Z)
• A Short Survey of Human Mobility Prediction in Epidemic Modeling from Transformers to LLMs [0.0]
  Understanding how people move during epidemics is essential for modeling the spread of diseases. Forecasting population movement is crucial for informing models and facilitating effective response planning in public health emergencies. We review a range of approaches utilizing both pretrained language models like BERT and Large Language Models (LLMs) tailored specifically for mobility prediction tasks.
  arXiv  Detail & Related papers  (2024-04-25T17:52:19Z)
• Reinforcement Learning with Human Feedback for Realistic Traffic Simulation [53.85002640149283]
  Key element of effective simulation is the incorporation of realistic traffic models that align with human knowledge. This study identifies two main challenges: capturing the nuances of human preferences on realism and the unification of diverse traffic simulation models.
  arXiv  Detail & Related papers  (2023-09-01T19:29:53Z)
• Uncertainty Quantification for Image-based Traffic Prediction across Cities [63.136794104678025]
  Uncertainty quantification (UQ) methods provide an approach to induce probabilistic reasoning. We investigate their application to a large-scale image-based traffic dataset spanning multiple cities. We find that our approach can capture both temporal and spatial effects on traffic behaviour in a representative case study for the city of Moscow.
  arXiv  Detail & Related papers  (2023-08-11T13:35:52Z)
• Predicting Hurricane Evacuation Decisions with Interpretable Machine Learning Models [0.0]
  This study proposes a new methodology for predicting households' evacuation decisions constructed by easily accessible demographic and resource-related predictors. The proposed methodology could provide a new tool and framework for the emergency management authorities to improve the estimation of evacuation traffic demands.
  arXiv  Detail & Related papers  (2023-03-12T03:45:44Z)
• TrafficBots: Towards World Models for Autonomous Driving Simulation and Motion Prediction [149.5716746789134]
  We show data-driven traffic simulation can be formulated as a world model. We present TrafficBots, a multi-agent policy built upon motion prediction and end-to-end driving. Experiments on the open motion dataset show TrafficBots can simulate realistic multi-agent behaviors.
  arXiv  Detail & Related papers  (2023-03-07T18:28:41Z)
• A Deep Learning Approach for Network-wide Dynamic Traffic Prediction during Hurricane Evacuation [1.3706331473063877]
  We present a novel data-driven approach for predicting evacuation traffic at a network scale. We develop a dynamic graph convolution LSTM (DGCN-LSTM) model to learn the network dynamics of hurricane evacuation.
  arXiv  Detail & Related papers  (2022-02-25T05:40:24Z)
• A model for traffic incident prediction using emergency braking data [77.34726150561087]
  We address the fundamental problem of data scarcity in road traffic accident prediction by training our model on emergency braking events instead of accidents. We present a prototype implementing a traffic incident prediction model for Germany based on emergency braking data from Mercedes-Benz vehicles.
  arXiv  Detail & Related papers  (2021-02-12T18:17:12Z)
• An Optimal Control Approach to Learning in SIDARTHE Epidemic model [67.22168759751541]
  We propose a general approach for learning time-variant parameters of dynamic compartmental models from epidemic data. We forecast the epidemic evolution in Italy and France.
  arXiv  Detail & Related papers  (2020-10-28T10:58:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.