A Perspective on Crowdsourcing and Human-in-the-Loop Workflows in Precision Health

• URL: http://arxiv.org/abs/2303.03578v2
• Date: Mon, 3 Jun 2024 21:56:08 GMT
• Title: A Perspective on Crowdsourcing and Human-in-the-Loop Workflows in Precision Health
• Authors: Peter Washington,
• Abstract summary: This viewpoint describes existing work in this emerging field and discusses ongoing challenges and opportunities with crowd-powered diagnostic systems. Crowd workers are paid to annotate complex behavioral features in return for monetary compensation or a gamified experience. These labels can then be used to derive a diagnosis, either directly or by using the labels as inputs to a diagnostic machine learning model.
• Score: 1.0895307583148537
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Modern machine learning approaches have led to performant diagnostic models for a variety of health conditions. Several machine learning approaches, such as decision trees and deep neural networks, can, in principle, approximate any function. However, this power can be considered to be both a gift and a curse, as the propensity toward overfitting is magnified when the input data are heterogeneous and high dimensional and the output class is highly nonlinear. This issue can especially plague diagnostic systems that predict behavioral and psychiatric conditions that are diagnosed with subjective criteria. An emerging solution to this issue is crowdsourcing, where crowd workers are paid to annotate complex behavioral features in return for monetary compensation or a gamified experience. These labels can then be used to derive a diagnosis, either directly or by using the labels as inputs to a diagnostic machine learning model. This viewpoint describes existing work in this emerging field and discusses ongoing challenges and opportunities with crowd-powered diagnostic systems, a nascent field of study. With the correct considerations, the addition of crowdsourcing to human-in-the-loop machine learning workflows for the prediction of complex and nuanced health conditions can accelerate screening, diagnostics, and ultimately access to care.

Related papers

• Recent advancement in Disease Diagnostic using machine learning: Systematic survey of decades, comparisons, and challenges [0.0]
  Pattern recognition and machine learning in the biomedical area promise to increase the precision of disease detection and diagnosis. This review article examines machine-learning algorithms for detecting diseases, including hepatitis, diabetes, liver disease, dengue fever, and heart disease.
  arXiv  Detail & Related papers  (2023-07-31T16:35:35Z)
• Validating polyp and instrument segmentation methods in colonoscopy through Medico 2020 and MedAI 2021 Challenges [58.32937972322058]
  "Medico automatic polyp segmentation (Medico 2020)" and "MedAI: Transparency in Medical Image (MedAI 2021)" competitions. We present a comprehensive summary and analyze each contribution, highlight the strength of the best-performing methods, and discuss the possibility of clinical translations of such methods into the clinic.
  arXiv  Detail & Related papers  (2023-07-30T16:08:45Z)
• Machine learning-based approach for online fault Diagnosis of Discrete Event System [0.0]
  The problem is the online diagnosis of Automated Production Systems with sensors and actuators delivering discrete binary signals. We propose a Machine Learning-based approach of a diagnostic system.
  arXiv  Detail & Related papers  (2022-10-24T08:56:13Z)
• AutoPrognosis 2.0: Democratizing Diagnostic and Prognostic Modeling in Healthcare with Automated Machine Learning [72.2614468437919]
  We present a machine learning framework, AutoPrognosis 2.0, to develop diagnostic and prognostic models. We provide an illustrative application where we construct a prognostic risk score for diabetes using the UK Biobank. Our risk score has been implemented as a web-based decision support tool and can be publicly accessed by patients and clinicians worldwide.
  arXiv  Detail & Related papers  (2022-10-21T16:31:46Z)
• Scalable Online Disease Diagnosis via Multi-Model-Fused Actor-Critic Reinforcement Learning [9.274138493400436]
  For those seeking healthcare advice online, AI based dialogue agents capable of interacting with patients to perform automatic disease diagnosis are a viable option. This can be formulated as a problem of sequential feature (symptom) selection and classification for which reinforcement learning (RL) approaches have been proposed as a natural solution. We propose a Multi-Model-Fused Actor-Critic (MMF-AC) RL framework that consists of a generative actor network and a diagnostic critic network.
  arXiv  Detail & Related papers  (2022-06-08T03:06:16Z)
• NeuralSympCheck: A Symptom Checking and Disease Diagnostic Neural Model with Logic Regularization [59.15047491202254]
  symptom checking systems inquire users for their symptoms and perform a rapid and affordable medical assessment of their condition. We propose a new approach based on the supervised learning of neural models with logic regularization. Our experiments show that the proposed approach outperforms the best existing methods in the accuracy of diagnosis when the number of diagnoses and symptoms is large.
  arXiv  Detail & Related papers  (2022-06-02T07:57:17Z)
• Challenges and Opportunities for Machine Learning Classification of Behavior and Mental State from Images [3.7445390865272588]
  Computer Vision (CV) classifiers distinguish and detect nonverbal social human behavior and mental state. There are several pain points which arise when attempting this process for behavioral phenotyping. We discuss current state-of-the-art research endeavors in CV such as data curation, data augmentation, crowdsourced labeling, active learning, reinforcement learning, generative models, representation learning, federated learning, and meta-learning.
  arXiv  Detail & Related papers  (2022-01-26T21:35:17Z)
• Unsupervised deep learning techniques for powdery mildew recognition based on multispectral imaging [63.62764375279861]
  This paper presents a deep learning approach to automatically recognize powdery mildew on cucumber leaves. We focus on unsupervised deep learning techniques applied to multispectral imaging data. We propose the use of autoencoder architectures to investigate two strategies for disease detection.
  arXiv  Detail & Related papers  (2021-12-20T13:29:13Z)
• Quantifying machine learning-induced overdiagnosis in sepsis [0.0]
  We present an innovative approach that allows us to preemptively detect potential cases of overdiagnosis. This is one of the first attempts to quantify machine-learning induced overdiagnosis.
  arXiv  Detail & Related papers  (2021-07-03T11:55:55Z)
• The Medkit-Learn(ing) Environment: Medical Decision Modelling through Simulation [81.72197368690031]
  We present a new benchmarking suite designed specifically for medical sequential decision making. The Medkit-Learn(ing) Environment is a publicly available Python package providing simple and easy access to high-fidelity synthetic medical data.
  arXiv  Detail & Related papers  (2021-06-08T10:38:09Z)
• Inheritance-guided Hierarchical Assignment for Clinical Automatic Diagnosis [50.15205065710629]
  Clinical diagnosis, which aims to assign diagnosis codes for a patient based on the clinical note, plays an essential role in clinical decision-making. We propose a novel framework to combine the inheritance-guided hierarchical assignment and co-occurrence graph propagation for clinical automatic diagnosis.
  arXiv  Detail & Related papers  (2021-01-27T13:16:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.