Multimodal Spatio-Temporal Deep Learning Approach for Neonatal Postoperative Pain Assessment

• URL: http://arxiv.org/abs/2012.02175v1
• Date: Thu, 3 Dec 2020 18:52:35 GMT
• Title: Multimodal Spatio-Temporal Deep Learning Approach for Neonatal Postoperative Pain Assessment
• Authors: Md Sirajus Salekin, Ghada Zamzmi, Dmitry Goldgof, Rangachar Kasturi, Thao Ho, Yu Sun
• Abstract summary: Current practice for assessing neonatal postoperative pain is subjective, inconsistent, slow and discontinuous. We present a novel multimodal-temporal approach that integrates visual and vocal signals and uses them for assessing neonatal postoperative pain.
• Score: 3.523040451502402
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: The current practice for assessing neonatal postoperative pain relies on bedside caregivers. This practice is subjective, inconsistent, slow, and discontinuous. To develop a reliable medical interpretation, several automated approaches have been proposed to enhance the current practice. These approaches are unimodal and focus mainly on assessing neonatal procedural (acute) pain. As pain is a multimodal emotion that is often expressed through multiple modalities, the multimodal assessment of pain is necessary especially in case of postoperative (acute prolonged) pain. Additionally, spatio-temporal analysis is more stable over time and has been proven to be highly effective at minimizing misclassification errors. In this paper, we present a novel multimodal spatio-temporal approach that integrates visual and vocal signals and uses them for assessing neonatal postoperative pain. We conduct comprehensive experiments to investigate the effectiveness of the proposed approach. We compare the performance of the multimodal and unimodal postoperative pain assessment, and measure the impact of temporal information integration. The experimental results, on a real-world dataset, show that the proposed multimodal spatio-temporal approach achieves the highest AUC (0.87) and accuracy (79%), which are on average 6.67% and 6.33% higher than unimodal approaches. The results also show that the integration of temporal information markedly improves the performance as compared to the non-temporal approach as it captures changes in the pain dynamic. These results demonstrate that the proposed approach can be used as a viable alternative to manual assessment, which would tread a path toward fully automated pain monitoring in clinical settings, point-of-care testing, and homes.

Related papers

• Optimizing Skin Lesion Classification via Multimodal Data and Auxiliary Task Integration [54.76511683427566]
  This research introduces a novel multimodal method for classifying skin lesions, integrating smartphone-captured images with essential clinical and demographic information. A distinctive aspect of this method is the integration of an auxiliary task focused on super-resolution image prediction. The experimental evaluations have been conducted using the PAD-UFES20 dataset, applying various deep-learning architectures.
  arXiv  Detail & Related papers  (2024-02-16T05:16:20Z)
• Uncertainty Quantification in Neural-Network Based Pain Intensity Estimation [0.0]
  The evaluation of pain intensity is challenging because different individuals experience pain differently. This study presents a neural network-based method for objective pain interval estimation.
  arXiv  Detail & Related papers  (2023-11-14T22:14:07Z)
• Predicting Adverse Neonatal Outcomes for Preterm Neonates with Multi-Task Learning [51.487856868285995]
  We first analyze the correlations between three adverse neonatal outcomes and then formulate the diagnosis of multiple neonatal outcomes as a multi-task learning (MTL) problem. In particular, the MTL framework contains shared hidden layers and multiple task-specific branches.
  arXiv  Detail & Related papers  (2023-03-28T00:44:06Z)
• Preoperative Prognosis Assessment of Lumbar Spinal Surgery for Low Back Pain and Sciatica Patients based on Multimodalities and Multimodal Learning [8.809304978076305]
  Low back pain (LBP) and sciatica may require surgical therapy when they are symptomatic of severe pain. There is no effective measures to evaluate the surgical outcomes in advance. This work combined elements of Eastern medicine and machine learning to develop a preoperative assessment tool.
  arXiv  Detail & Related papers  (2023-03-16T05:06:06Z)
• Real-time landmark detection for precise endoscopic submucosal dissection via shape-aware relation network [51.44506007844284]
  We propose a shape-aware relation network for accurate and real-time landmark detection in endoscopic submucosal dissection surgery. We first devise an algorithm to automatically generate relation keypoint heatmaps, which intuitively represent the prior knowledge of spatial relations among landmarks. We then develop two complementary regularization schemes to progressively incorporate the prior knowledge into the training process.
  arXiv  Detail & Related papers  (2021-11-08T07:57:30Z)
• SurvITE: Learning Heterogeneous Treatment Effects from Time-to-Event Data [83.50281440043241]
  We study the problem of inferring heterogeneous treatment effects from time-to-event data. We propose a novel deep learning method for treatment-specific hazard estimation based on balancing representations.
  arXiv  Detail & Related papers  (2021-10-26T20:13:17Z)
• Semi-Supervised Variational Reasoning for Medical Dialogue Generation [70.838542865384]
  Two key characteristics are relevant for medical dialogue generation: patient states and physician actions. We propose an end-to-end variational reasoning approach to medical dialogue generation. A physician policy network composed of an action-classifier and two reasoning detectors is proposed for augmented reasoning ability.
  arXiv  Detail & Related papers  (2021-05-13T04:14:35Z)
• Deep learning in the ultrasound evaluation of neonatal respiratory status [11.308283140003676]
  Lung ultrasound imaging is reaching growing interest from the scientific community. Image analysis and pattern recognition approaches have proven their ability to fully exploit the rich information contained in these data. We present a thorough analysis of recent deep learning networks and training strategies carried out on a vast and challenging multicenter dataset.
  arXiv  Detail & Related papers  (2020-10-31T18:57:55Z)
• MIA-Prognosis: A Deep Learning Framework to Predict Therapy Response [58.0291320452122]
  This paper aims at a unified deep learning approach to predict patient prognosis and therapy response. We formalize the prognosis modeling as a multi-modal asynchronous time series classification task. Our predictive model could further stratify low-risk and high-risk patients in terms of long-term survival.
  arXiv  Detail & Related papers  (2020-10-08T15:30:17Z)
• Peri-Diagnostic Decision Support Through Cost-Efficient Feature Acquisition at Test-Time [37.160335232396406]
  A sub-problem in CADx is to guide the physician during the entire peri-diagnostic workflow, including the acquisition stage. We propose a novel approach which is enticingly simple: use dropout at the input layer, and integrated gradients of the trained network at test-time to attribute feature importance dynamically. Results show that our proposed approach is more cost- and feature-efficient than prior approaches and achieves a higher overall accuracy.
  arXiv  Detail & Related papers  (2020-03-31T12:00:44Z)
• First Investigation Into the Use of Deep Learning for Continuous Assessment of Neonatal Postoperative Pain [4.121183008006413]
  It specifically investigates the use of Bilinear Convolutional Neural Network (B-CNN) to extract facial features during different levels of postoperative pain. Our experimental results indicate a clear difference between the pattern of acute and postoperative pain. They also suggest the efficiency of using a combination of bilinear CNN with RNN model for the continuous assessment of postoperative pain intensity.
  arXiv  Detail & Related papers  (2020-03-24T01:13:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.