The voice of COVID-19: Acoustic correlates of infection

• URL: http://arxiv.org/abs/2012.09478v1
• Date: Thu, 17 Dec 2020 10:12:41 GMT
• Title: The voice of COVID-19: Acoustic correlates of infection
• Authors: Katrin D. Bartl-Pokorny, Florian B. Pokorny, Anton Batliner, Shahin Amiriparian, Anastasia Semertzidou, Florian Eyben, Elena Kramer, Florian Schmidt, Rainer Sch\"onweiler, Markus Wehler, Bj\"orn W. Schuller
• Abstract summary: COVID-19 is a global health crisis that has been affecting many aspects of our daily lives throughout the past year. We compare acoustic features extracted from recordings of the vowels /i:/, /e:/, /o:/, /u:/, and /a:/ produced by 11 symptomatic COVID-19 positive and 11 COVID-19 negative German-speaking participants.
• Score: 9.7390888107204
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: COVID-19 is a global health crisis that has been affecting many aspects of our daily lives throughout the past year. The symptomatology of COVID-19 is heterogeneous with a severity continuum. A considerable proportion of symptoms are related to pathological changes in the vocal system, leading to the assumption that COVID-19 may also affect voice production. For the very first time, the present study aims to investigate voice acoustic correlates of an infection with COVID-19 on the basis of a comprehensive acoustic parameter set. We compare 88 acoustic features extracted from recordings of the vowels /i:/, /e:/, /o:/, /u:/, and /a:/ produced by 11 symptomatic COVID-19 positive and 11 COVID-19 negative German-speaking participants. We employ the Mann-Whitney U test and calculate effect sizes to identify features with the most prominent group differences. The mean voiced segment length and the number of voiced segments per second yield the most important differences across all vowels indicating discontinuities in the pulmonic airstream during phonation in COVID-19 positive participants. Group differences in the front vowels /i:/ and /e:/ are additionally reflected in the variation of the fundamental frequency and the harmonics-to-noise ratio, group differences in back vowels /o:/ and /u:/ in statistics of the Mel-frequency cepstral coefficients and the spectral slope. Findings of this study can be considered an important proof-of-concept contribution for a potential future voice-based identification of individuals infected with COVID-19.

Related papers

• Analyzing the impact of SARS-CoV-2 variants on respiratory sound signals [23.789227109218118]
  We explore whether acoustic signals, collected from COVID-19 subjects, show computationally distinguishable acoustic patterns. Our findings suggest that multiple sound categories, such as cough, breathing, and speech, indicate significant acoustic feature differences when comparing COVID-19 subjects with omicron and delta variants.
  arXiv  Detail & Related papers  (2022-06-24T14:10:31Z)
• COVYT: Introducing the Coronavirus YouTube and TikTok speech dataset featuring the same speakers with and without infection [4.894353840908006]
  We introduce the COVYT dataset -- a novel COVID-19 dataset collected from public sources containing more than 8 hours of speech from 65 speakers. As compared to other existing COVID-19 sound datasets, the unique feature of the COVYT dataset is that it comprises both COVID-19 positive and negative samples from all 65 speakers.
  arXiv  Detail & Related papers  (2022-06-20T16:26:51Z)
• Evaluating the COVID-19 Identification ResNet (CIdeR) on the INTERSPEECH COVID-19 from Audio Challenges [59.78485839636553]
  CIdeR is an end-to-end deep learning neural network originally designed to classify whether an individual is COVID-positive or COVID-negative. We demonstrate the potential of CIdeR at binary COVID-19 diagnosis from both the COVID-19 Cough and Speech Sub-Challenges of INTERSPEECH 2021, ComParE and DiCOVA.
  arXiv  Detail & Related papers  (2021-07-30T10:59:08Z)
• Quantification of pulmonary involvement in COVID-19 pneumonia by means of a cascade oftwo U-nets: training and assessment on multipledatasets using different annotation criteria [83.83783947027392]
  This study aims at exploiting Artificial intelligence (AI) for the identification, segmentation and quantification of COVID-19 pulmonary lesions. We developed an automated analysis pipeline, the LungQuant system, based on a cascade of two U-nets. The accuracy in predicting the CT-Severity Score (CT-SS) of the LungQuant system has been also evaluated.
  arXiv  Detail & Related papers  (2021-05-06T10:21:28Z)
• Detecting COVID-19 from Breathing and Coughing Sounds using Deep Neural Networks [68.8204255655161]
  We adapt an ensemble of Convolutional Neural Networks to classify if a speaker is infected with COVID-19 or not. Ultimately, it achieves an Unweighted Average Recall (UAR) of 74.9%, or an Area Under ROC Curve (AUC) of 80.7% by ensembling neural networks.
  arXiv  Detail & Related papers  (2020-12-29T01:14:17Z)
• Interpreting glottal flow dynamics for detecting COVID-19 from voice [18.387162887917164]
  This paper proposes a method that analyzes the differential dynamics of the glottal flow waveform (GFW) during voice production. We infer it from recorded speech signals and compare it to the GFW computed from physical model of phonation. Our proposed method uses a CNN-based 2-step attention model that locates anomalies in time-feature space in the difference of the two GFWs.
  arXiv  Detail & Related papers  (2020-10-29T13:16:57Z)
• Detection of COVID-19 through the analysis of vocal fold oscillations [18.387162887917164]
  Phonation, or the vibration of the vocal folds, is the primary source of vocalization in the production of voiced sounds by humans. Since most symptomatic cases of COVID-19 present with moderate to severe impairment of respiratory functions, we hypothesize that signatures of COVID-19 may be observable by examining the vibrations of the vocal folds. Our goal is to validate this hypothesis, and to quantitatively characterize the changes observed to enable the detection of COVID-19 from voice.
  arXiv  Detail & Related papers  (2020-10-21T01:44:42Z)
• Studying the Similarity of COVID-19 Sounds based on Correlation Analysis of MFCC [1.9659095632676098]
  We illustrate the importance of speech signal processing in the extraction of the Mel-Frequency Cepstral Coefficients (MFCCs) of the COVID-19 and non-COVID-19 samples. Our results show high similarity in MFCCs between different COVID-19 cough and breathing sounds, while MFCC of voice is more robust between COVID-19 and non-COVID-19 samples.
  arXiv  Detail & Related papers  (2020-10-17T11:38:05Z)
• Understanding the temporal evolution of COVID-19 research through machine learning and natural language processing [66.63200823918429]
  The outbreak of the novel coronavirus disease 2019 (COVID-19), caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has been continuously affecting human lives and communities around the world. We used multiple data sources, i.e., PubMed and ArXiv, and built several machine learning models to characterize the landscape of current COVID-19 research. Our findings confirm the types of research available in PubMed and ArXiv differ significantly, with the former exhibiting greater diversity in terms of COVID-19 related issues.
  arXiv  Detail & Related papers  (2020-07-22T18:02:39Z)
• COVID-DA: Deep Domain Adaptation from Typical Pneumonia to COVID-19 [92.4955073477381]
  The outbreak of novel coronavirus disease 2019 (COVID-19) has already infected millions of people and is still rapidly spreading all over the globe. Deep learning has been used recently as effective computer-aided means to improve diagnostic efficiency. We propose a new deep domain adaptation method for COVID-19 diagnosis, namely COVID-DA.
  arXiv  Detail & Related papers  (2020-04-30T03:13:40Z)
• Severity Assessment of Coronavirus Disease 2019 (COVID-19) Using Quantitative Features from Chest CT Images [54.919022945740515]
  The aim of this study is to realize automatic severity assessment (non-severe or severe) of COVID-19 based on chest CT images. A random forest (RF) model is trained to assess the severity (non-severe or severe) based on quantitative features. Several quantitative features, which have the potential to reflect the severity of COVID-19, were revealed.
  arXiv  Detail & Related papers  (2020-03-26T15:49:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.