Machine Learning for Mechanical Ventilation Control (Extended Abstract)
- URL: http://arxiv.org/abs/2111.10434v1
- Date: Fri, 19 Nov 2021 20:54:41 GMT
- Title: Machine Learning for Mechanical Ventilation Control (Extended Abstract)
- Authors: Daniel Suo, Cyril Zhang, Paula Gradu, Udaya Ghai, Xinyi Chen, Edgar
Minasyan, Naman Agarwal, Karan Singh, Julienne LaChance, Tom Zajdel, Manuel
Schottdorf, Daniel Cohen, Elad Hazan
- Abstract summary: Mechanical ventilation is one of the most widely used therapies in the ICU.
We frame these as a control problem: ventilators must let air in and out of the patient's lungs according to a prescribed trajectory of airway pressure.
Our data-driven approach learns to control an invasive ventilator by training on a simulator itself trained on data collected from the ventilator.
This method outperforms popular reinforcement learning algorithms and even controls the physical ventilator more accurately and robustly than PID.
- Score: 52.65490904484772
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Mechanical ventilation is one of the most widely used therapies in the ICU.
However, despite broad application from anaesthesia to COVID-related life
support, many injurious challenges remain. We frame these as a control problem:
ventilators must let air in and out of the patient's lungs according to a
prescribed trajectory of airway pressure. Industry-standard controllers, based
on the PID method, are neither optimal nor robust. Our data-driven approach
learns to control an invasive ventilator by training on a simulator itself
trained on data collected from the ventilator. This method outperforms popular
reinforcement learning algorithms and even controls the physical ventilator
more accurately and robustly than PID. These results underscore how effective
data-driven methodologies can be for invasive ventilation and suggest that more
general forms of ventilation (e.g., non-invasive, adaptive) may also be
amenable.
Related papers
- Machine learning-based algorithms for at-home respiratory disease monitoring and respiratory assessment [45.104212062055424]
This work aims to develop machine learning-based algorithms to facilitate at-home respiratory disease monitoring and assessment.
Data were collected from 30 healthy adults, encompassing respiratory pressure, flow, and dynamic thoraco-abdominal circumferential measurements.
Various machine learning models, including the random forest classifier, logistic regression, and support vector machine (SVM), were trained to predict breathing types.
arXiv Detail & Related papers (2024-09-05T02:14:31Z) - Optimizing Diffusion Models for Joint Trajectory Prediction and Controllable Generation [49.49868273653921]
Diffusion models are promising for joint trajectory prediction and controllable generation in autonomous driving.
We introduce Optimal Gaussian Diffusion (OGD) and Estimated Clean Manifold (ECM) Guidance.
Our methodology streamlines the generative process, enabling practical applications with reduced computational overhead.
arXiv Detail & Related papers (2024-08-01T17:59:59Z) - Methodology for Interpretable Reinforcement Learning for Optimizing Mechanical Ventilation [2.3349787245442966]
This paper proposes a methodology for interpretable reinforcement learning using decision trees for mechanical ventilation control.
Numerical experiments using MIMIC-III data on the stays of real patients' intensive care unit stays demonstrate that the decision tree policy outperforms the behavior cloning policy.
arXiv Detail & Related papers (2024-04-03T23:07:24Z) - Unsupervised Discovery of Interpretable Directions in h-space of
Pre-trained Diffusion Models [63.1637853118899]
We propose the first unsupervised and learning-based method to identify interpretable directions in h-space of pre-trained diffusion models.
We employ a shift control module that works on h-space of pre-trained diffusion models to manipulate a sample into a shifted version of itself.
By jointly optimizing them, the model will spontaneously discover disentangled and interpretable directions.
arXiv Detail & Related papers (2023-10-15T18:44:30Z) - Spectrum Breathing: Protecting Over-the-Air Federated Learning Against
Interference [101.9031141868695]
Mobile networks can be compromised by interference from neighboring cells or jammers.
We propose Spectrum Breathing, which cascades-gradient pruning and spread spectrum to suppress interference without bandwidth expansion.
We show a performance tradeoff between gradient-pruning and interference-induced error as regulated by the breathing depth.
arXiv Detail & Related papers (2023-05-10T07:05:43Z) - Towards Safe Mechanical Ventilation Treatment Using Deep Offline
Reinforcement Learning [35.10140674005337]
DeepVent is a Conservative Q-Learning (CQL) based offline Deep Reinforcement Learning (DRL) agent that learns to predict the optimal ventilator parameters for a patient to promote 90 day survival.
We find that DeepVent recommends ventilation parameters within safe ranges, as outlined in recent clinical trials.
The CQL algorithm offers additional safety by mitigating the overestimation of the value estimates of out-of-distribution states/actions.
arXiv Detail & Related papers (2022-10-05T20:41:17Z) - Machine Learning for Mechanical Ventilation Control [52.65490904484772]
We consider the problem of controlling an invasive mechanical ventilator for pressure-controlled ventilation.
A PID controller must let air in and out of a sedated patient's lungs according to a trajectory of airway pressures specified by a clinician.
We show that our controllers are able to track target pressure waveforms significantly better than PID controllers.
arXiv Detail & Related papers (2021-02-12T21:23:33Z) - Airflow recovery from thoracic and abdominal movements using
Synchrosqueezing Transform and Locally Stationary Gaussian Process Regression [6.496038875667294]
We propose to use the nonlinear-type time-frequency analysis tool, synchrosqueezing transform, to represent the thoracic and abdominal movement signals as the features.
We show that, using a dataset that contains respiratory signals under normal sleep conditions, an accurate prediction can be achieved by fitting the proposed model in the feature space.
arXiv Detail & Related papers (2020-08-11T01:37:38Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.