Optimization-Augmented Machine Learning for Vehicle Operations in Emergency Medical Services

• URL: http://arxiv.org/abs/2503.11848v1
• Date: Fri, 14 Mar 2025 20:15:26 GMT
• Title: Optimization-Augmented Machine Learning for Vehicle Operations in Emergency Medical Services
• Authors: Maximiliane Rautenstrauß, Maximilian Schiffer,
• Abstract summary: Minimizing response times to meet legal requirements and serve patients in a timely manner is crucial for Emergency Medical Service (EMS) systems.<n>We study a centrally controlled EMS system for which we learn an online ambulance dispatching and redeployment policy.<n>We propose a novel optimization-augmented machine learning scheme that allows to learn efficient policies for ambulance dispatching and redeployment.
• Score: 2.5690340428649328
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Minimizing response times to meet legal requirements and serve patients in a timely manner is crucial for Emergency Medical Service (EMS) systems. Achieving this goal necessitates optimizing operational decision-making to efficiently manage ambulances. Against this background, we study a centrally controlled EMS system for which we learn an online ambulance dispatching and redeployment policy that aims at minimizing the mean response time of ambulances within the system by dispatching an ambulance upon receiving an emergency call and redeploying it to a waiting location upon the completion of its service. We propose a novel combinatorial optimization-augmented machine learning pipeline that allows to learn efficient policies for ambulance dispatching and redeployment. In this context, we further show how to solve the underlying full-information problem to generate training data and propose an augmentation scheme that improves our pipeline's generalization performance by mitigating a possible distribution mismatch with respect to the considered state space. Compared to existing methods that rely on augmentation during training, our approach offers substantial runtime savings of up to 87.9% while yielding competitive performance. To evaluate the performance of our pipeline against current industry practices, we conduct a numerical case study on the example of San Francisco's 911 call data. Results show that the learned policies outperform the online benchmarks across various resource and demand scenarios, yielding a reduction in mean response time of up to 30%.

Related papers

• Self-Regulation and Requesting Interventions [63.5863047447313]
  We propose an offline framework that trains a "helper" policy to request interventions.<n>We score optimal intervention timing with PRMs and train the helper model on these labeled trajectories.<n>This offline approach significantly reduces costly intervention calls during training.
  arXiv  Detail & Related papers  (2025-02-07T00:06:17Z)
• Multi-Agent Reinforcement Learning with Hierarchical Coordination for Emergency Responder Stationing [8.293120269016834]
  An emergency responder management (ERM) system dispatches responders when it receives requests for medical aid. ERM systems can proactively reposition responders between predesignated waiting locations to cover any gaps. The state-of-the-art approach in proactive repositioning is a hierarchical approach based on spatial decomposition and online Monte Carlo tree search. We introduce a novel reinforcement learning (RL) approach, based on the same hierarchical decomposition, but replacing online search with learning.
  arXiv  Detail & Related papers  (2024-05-21T21:15:45Z)
• Ambulance Demand Prediction via Convolutional Neural Networks [4.1423579563037505]
  Minimizing response times is crucial for emergency medical services to reduce patients' waiting times and to increase their survival rates. We present a novel convolutional neural network (CNN) architecture that transforms time series data into heatmaps to predict ambulance demand. We show that the developed CNN architecture outperforms existing state-of-the-art methods and industry practice by more than 9%.
  arXiv  Detail & Related papers  (2023-06-08T07:29:42Z)
• Policy Optimization for Personalized Interventions in Behavioral Health [8.10897203067601]
  Behavioral health interventions, delivered through digital platforms, have the potential to significantly improve health outcomes. We study the problem of optimizing personalized interventions for patients to maximize a long-term outcome. We present a new approach for this problem that we dub DecompPI, which decomposes the state space for a system of patients to the individual level.
  arXiv  Detail & Related papers  (2023-03-21T21:42:03Z)
• Modelling Hospital Strategies in City-Scale Ambulance Dispatching [0.0]
  The paper proposes an approach to model and simulate the ambulance dispatching process in multi-agents healthcare environments of large cities. The proposed approach is based on using the coupled game-theoretic (GT) approach to identify hospital strategies. The study considers the problem of dispatching ambulances to patients with the ACS directed to the PCI in the target hospital.
  arXiv  Detail & Related papers  (2022-01-05T22:20:12Z)
• An Online Data-Driven Emergency-Response Method for Autonomous Agents in Unforeseen Situations [4.339510167603376]
  This paper presents an online, data-driven, emergency-response method. It aims to provide autonomous agents the ability to react to unexpected situations. We demonstrate the potential of this approach in a simulated 3D car driving scenario.
  arXiv  Detail & Related papers  (2021-12-17T18:31:37Z)
• Optimal discharge of patients from intensive care via a data-driven policy learning framework [58.720142291102135]
  It is important that the patient discharge task addresses the nuanced trade-off between decreasing a patient's length of stay and the risk of readmission or even death following the discharge decision. This work introduces an end-to-end general framework for capturing this trade-off to recommend optimal discharge timing decisions. A data-driven approach is used to derive a parsimonious, discrete state space representation that captures a patient's physiological condition.
  arXiv  Detail & Related papers  (2021-12-17T04:39:33Z)
• A Deep Value-network Based Approach for Multi-Driver Order Dispatching [55.36656442934531]
  We propose a deep reinforcement learning based solution for order dispatching. We conduct large scale online A/B tests on DiDi's ride-dispatching platform. Results show that CVNet consistently outperforms other recently proposed dispatching methods.
  arXiv  Detail & Related papers  (2021-06-08T16:27:04Z)
• Resource Planning for Hospitals Under Special Consideration of the COVID-19 Pandemic: Optimization and Sensitivity Analysis [87.31348761201716]
  Crises like the COVID-19 pandemic pose a serious challenge to health-care institutions. BaBSim.Hospital is a tool for capacity planning based on discrete event simulation. We aim to investigate and optimize these parameters to improve BaBSim.Hospital.
  arXiv  Detail & Related papers  (2021-05-16T12:38:35Z)
• MUSBO: Model-based Uncertainty Regularized and Sample Efficient Batch Optimization for Deployment Constrained Reinforcement Learning [108.79676336281211]
  Continuous deployment of new policies for data collection and online learning is either cost ineffective or impractical. We propose a new algorithmic learning framework called Model-based Uncertainty regularized and Sample Efficient Batch Optimization. Our framework discovers novel and high quality samples for each deployment to enable efficient data collection.
  arXiv  Detail & Related papers  (2021-02-23T01:30:55Z)
• Optimal Dispatch in Emergency Service System via Reinforcement Learning [0.0]
  In the United States, medical responses by fire departments over the last four decades increased by 367%. We model the ambulance dispatch problem as an average-cost Markov decision process and present a policy iteration approach to find an optimal dispatch policy. Our findings suggest that emergency response departments can improve their performance with minimal to no cost.
  arXiv  Detail & Related papers  (2020-10-15T04:37:41Z)
• Transforming unstructured voice and text data into insight for paramedic emergency service using recurrent and convolutional neural networks [68.8204255655161]
  Paramedics often have to make lifesaving decisions within a limited time in an ambulance. This study aims to automatically fuse voice and text data to provide tailored situational awareness information to paramedics.
  arXiv  Detail & Related papers  (2020-05-30T06:47:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.