How to Count Coughs: An Event-Based Framework for Evaluating Automatic Cough Detection Algorithm Performance

• URL: http://arxiv.org/abs/2406.01529v1
• Date: Mon, 3 Jun 2024 16:59:48 GMT
• Title: How to Count Coughs: An Event-Based Framework for Evaluating Automatic Cough Detection Algorithm Performance
• Authors: Lara Orlandic, Jonathan Dan, Jerome Thevenot, Tomas Teijeiro, Alain Sauty, David Atienza,
• Abstract summary: Chronic cough disorders are challenging to assess because they rely on subjective patient questionnaires about cough frequency. There is a mismatch between state-of-the-art metrics for cough counting algorithms and the information relevant to clinicians. We propose using event-based evaluation metrics aligned with clinical guidelines on significant cough counting endpoints.
• Score: 3.3977325856478457
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Chronic cough disorders are widespread and challenging to assess because they rely on subjective patient questionnaires about cough frequency. Wearable devices running Machine Learning (ML) algorithms are promising for quantifying daily coughs, providing clinicians with objective metrics to track symptoms and evaluate treatments. However, there is a mismatch between state-of-the-art metrics for cough counting algorithms and the information relevant to clinicians. Most works focus on distinguishing cough from non-cough samples, which does not directly provide clinically relevant outcomes such as the number of cough events or their temporal patterns. In addition, typical metrics such as specificity and accuracy can be biased by class imbalance. We propose using event-based evaluation metrics aligned with clinical guidelines on significant cough counting endpoints. We use an ML classifier to illustrate the shortcomings of traditional sample-based accuracy measurements, highlighting their variance due to dataset class imbalance and sample window length. We also present an open-source event-based evaluation framework to test algorithm performance in identifying cough events and rejecting false positives. We provide examples and best practice guidelines in event-based cough counting as a necessary first step to assess algorithm performance with clinical relevance.

Related papers

• Quality assurance of organs-at-risk delineation in radiotherapy [7.698565355235687]
  The delineation of tumor target and organs-at-risk is critical in the radiotherapy treatment planning. The quality assurance of the automatic segmentation is still an unmet need in clinical practice. Our proposed model, which introduces residual network and attention mechanism in the one-class classification framework, was able to detect the various types of OAR contour errors with high accuracy.
  arXiv  Detail & Related papers  (2024-05-20T02:32:46Z)
• A Fixed-Point Approach to Unified Prompt-Based Counting [51.20608895374113]
  This paper aims to establish a comprehensive prompt-based counting framework capable of generating density maps for objects indicated by various prompt types, such as box, point, and text. Our model excels in prominent class-agnostic datasets and exhibits superior performance in cross-dataset adaptation tasks.
  arXiv  Detail & Related papers  (2024-03-15T12:05:44Z)
• Multi-task Explainable Skin Lesion Classification [54.76511683427566]
  We propose a few-shot-based approach for skin lesions that generalizes well with few labelled data. The proposed approach comprises a fusion of a segmentation network that acts as an attention module and classification network.
  arXiv  Detail & Related papers  (2023-10-11T05:49:47Z)
• CenTime: Event-Conditional Modelling of Censoring in Survival Analysis [49.44664144472712]
  We introduce CenTime, a novel approach to survival analysis that directly estimates the time to event. Our method features an innovative event-conditional censoring mechanism that performs robustly even when uncensored data is scarce. Our results indicate that CenTime offers state-of-the-art performance in predicting time-to-death while maintaining comparable ranking performance.
  arXiv  Detail & Related papers  (2023-09-07T17:07:33Z)
• Sample Size in Natural Language Processing within Healthcare Research [0.14865681381012494]
  Lack of sufficient corpora of previously collected data can be a limiting factor when determining sample sizes for new studies. This paper tries to address the issue by making recommendations on sample sizes for text classification tasks in the healthcare domain.
  arXiv  Detail & Related papers  (2023-09-05T13:42:43Z)
• Federated Few-shot Learning for Cough Classification with Edge Devices [6.141439238018306]
  This work aims to develop a framework that can perform cough classification even in situations when enormous cough data is not available. We adopt few-shot learning and federated learning to design a novel framework, termed F2LCough, for solving the newly formulated problem. Our results show the feasibility of few-shot learning combined with federated learning to build a classification model of cough sounds.
  arXiv  Detail & Related papers  (2023-09-03T04:48:41Z)
• Accounting For Informative Sampling When Learning to Forecast Treatment Outcomes Over Time [66.08455276899578]
  We show that informative sampling can prohibit accurate estimation of treatment outcomes if not properly accounted for. We present a general framework for learning treatment outcomes in the presence of informative sampling using inverse intensity-weighting. We propose a novel method, TESAR-CDE, that instantiates this framework using Neural CDEs.
  arXiv  Detail & Related papers  (2023-06-07T08:51:06Z)
• Time Associated Meta Learning for Clinical Prediction [78.99422473394029]
  We propose a novel time associated meta learning (TAML) method to make effective predictions at multiple future time points. To address the sparsity problem after task splitting, TAML employs a temporal information sharing strategy to augment the number of positive samples. We demonstrate the effectiveness of TAML on multiple clinical datasets, where it consistently outperforms a range of strong baselines.
  arXiv  Detail & Related papers  (2023-03-05T03:54:54Z)
• A Novel Multi-Centroid Template Matching Algorithm and Its Application to Cough Detection [7.89949025321688]
  Coughing is a major symptom of respiratory-related diseases. Head motion data could be used to detect coughs using a template matching algorithm.
  arXiv  Detail & Related papers  (2021-09-01T21:52:36Z)
• Cough Detection Using Selected Informative Features from Audio Signals [24.829135966052142]
  The models are trained by the dataset combined ESC-50 dataset with self-recorded cough recordings. The best cough detection model realizes the accuracy, recall, precision and F1-score with 94.9%, 97.1%, 93.1% and 0.95 respectively.
  arXiv  Detail & Related papers  (2021-08-07T23:05:18Z)
• Predictive Modeling of ICU Healthcare-Associated Infections from Imbalanced Data. Using Ensembles and a Clustering-Based Undersampling Approach [55.41644538483948]
  This work is focused on both the identification of risk factors and the prediction of healthcare-associated infections in intensive-care units. The aim is to support decision making addressed at reducing the incidence rate of infections.
  arXiv  Detail & Related papers  (2020-05-07T16:13:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.