Decoding Virtual Healthcare Success through Knowledge-Aware and Multimodal Predictive Modeling

• URL: http://arxiv.org/abs/2306.03833v5
• Date: Thu, 30 Oct 2025 21:09:12 GMT
• Title: Decoding Virtual Healthcare Success through Knowledge-Aware and Multimodal Predictive Modeling
• Authors: Shuang Geng, Wenli Zhang, Jiaheng Xie, Gemin Liang, Ben Niu, Sudha Ram,
• Abstract summary: This study develops a predictive modeling approach that fuses multimodal data and knowledge networks to capture latent relationships among patients, physicians, and consultation contexts.<n>The findings offer implications for designing hybrid healthcare ecosystems that combine online and offline services through data-driven intelligence.
• Score: 4.879855036729861
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Online healthcare consultations have transformed how patients seek medical advice, offering convenience while introducing new challenges for ensuring consultation success. Predicting whether an online consultation will be successful is critical for improving patient experiences and sustaining platform competitiveness. Yet, such prediction is inherently difficult due to the fragmented nature of patients' care journeys and the lack of integration between virtual and traditional healthcare systems. Furthermore, the data collected from online platforms, including textual conversations, interaction sequences, and behavioral traces, are often sparse and incomplete. This study develops a predictive modeling approach that fuses multimodal data and dynamically constructed knowledge networks to capture latent relationships among patients, physicians, and consultation contexts. By integrating heterogeneous information sources and uncovering the evolving structure of digital interactions, the model enhances the accuracy and interpretability of consultation success prediction. The findings offer implications for designing hybrid healthcare ecosystems that combine online and offline services through data-driven intelligence.

Related papers

• Beyond Traditional Diagnostics: Transforming Patient-Side Information into Predictive Insights with Knowledge Graphs and Prototypes [55.310195121276074]
  We propose a Knowledge graph-enhanced, Prototype-aware, and Interpretable (KPI) framework to predict diseases.<n>It integrates structured and trusted medical knowledge into a unified disease knowledge graph, constructs clinically meaningful disease prototypes, and employs contrastive learning to enhance predictive accuracy.<n>It provides clinically valid explanations that closely align with patient narratives, highlighting its practical value for patient-centered healthcare delivery.
  arXiv  Detail & Related papers  (2025-12-09T05:37:54Z)
• Federated Data Analytics for Cancer Immunotherapy: A Privacy-Preserving Collaborative Platform for Patient Management [0.03262230127283451]
  Connected health is a multidisciplinary approach focused on health management.<n>Data analytics can provide critical insights for informed decision-making and health co-creation.<n>This paper contributes with a collaborative digital framework integrating stakeholders across the care continuum.
  arXiv  Detail & Related papers  (2025-10-10T08:57:41Z)
• Socially Constructed Treatment Plans: Analyzing Online Peer Interactions to Understand How Patients Navigate Complex Medical Conditions [1.660288273261283]
  We characterize how treatment plans for complex conditions are "socially constructed" We investigate whether and how socially constructed treatment-related knowledge is reflected in a state-of-the-art large language model (LLM)
  arXiv  Detail & Related papers  (2025-03-27T21:06:07Z)
• From Patient Consultations to Graphs: Leveraging LLMs for Patient Journey Knowledge Graph Construction [3.0874677990361246]
  Patient Journey Knowledge Graphs (PJKGs) represent a novel approach to addressing the challenge of fragmented healthcare data.<n>PJKGs process and structure both formal clinical documentation and unstructured patient-provider conversations.<n>These graphs encapsulate temporal and causal relationships among clinical encounters, diagnoses, treatments, and outcomes.
  arXiv  Detail & Related papers  (2025-03-18T14:44:28Z)
• Towards Privacy-aware Mental Health AI Models: Advances, Challenges, and Opportunities [61.633126163190724]
  Mental illness is a widespread and debilitating condition with substantial societal and personal costs. Recent advances in Artificial Intelligence (AI) hold great potential for recognizing and addressing conditions such as depression, anxiety disorder, bipolar disorder, schizophrenia, and post-traumatic stress disorder. Privacy concerns, including the risk of sensitive data leakage from datasets and trained models, remain a critical barrier to deploying these AI systems in real-world clinical settings.
  arXiv  Detail & Related papers  (2025-02-01T15:10:02Z)
• Continually Evolved Multimodal Foundation Models for Cancer Prognosis [50.43145292874533]
  Cancer prognosis is a critical task that involves predicting patient outcomes and survival rates.<n>Previous studies have integrated diverse data modalities, such as clinical notes, medical images, and genomic data, leveraging their complementary information.<n>Existing approaches face two major limitations. First, they struggle to incorporate newly arrived data with varying distributions into training, such as patient records from different hospitals.<n>Second, most multimodal integration methods rely on simplistic concatenation or task-specific pipelines, which fail to capture the complex interdependencies across modalities.
  arXiv  Detail & Related papers  (2025-01-30T06:49:57Z)
• Which Client is Reliable?: A Reliable and Personalized Prompt-based Federated Learning for Medical Image Question Answering [51.26412822853409]
  We present a novel personalized federated learning (pFL) method for medical visual question answering (VQA) models. Our method introduces learnable prompts into a Transformer architecture to efficiently train it on diverse medical datasets without massive computational costs.
  arXiv  Detail & Related papers  (2024-10-23T00:31:17Z)
• Attention on Personalized Clinical Decision Support System: Federated Learning Approach [15.642569319806716]
  We propose a deep learning-based clinical decision support system trained and managed under a federated learning paradigm. We focus on a novel strategy to guarantee the safety of patient privacy and overcome the risk of cyberattacks.
  arXiv  Detail & Related papers  (2024-01-22T07:24:15Z)
• Generative AI-Driven Human Digital Twin in IoT-Healthcare: A Comprehensive Survey [53.691704671844406]
  The Internet of things (IoT) can significantly enhance the quality of human life, specifically in healthcare. The human digital twin (HDT) is proposed as an innovative paradigm that can comprehensively characterize the replication of the individual human body. HDT is envisioned to empower IoT-healthcare beyond the application of healthcare monitoring by acting as a versatile and vivid human digital testbed. Recently, generative artificial intelligence (GAI) may be a promising solution because it can leverage advanced AI algorithms to automatically create, manipulate, and modify valuable while diverse data.
  arXiv  Detail & Related papers  (2024-01-22T03:17:41Z)
• Yes, this is what I was looking for! Towards Multi-modal Medical Consultation Concern Summary Generation [46.42604861624895]
  We propose a new task of multi-modal medical concern summary generation. Nonverbal cues, such as patients' gestures and facial expressions, aid in accurately identifying patients' concerns. We construct the first multi-modal medical concern summary generation corpus.
  arXiv  Detail & Related papers  (2024-01-10T12:56:47Z)
• Towards Smart Healthcare: Challenges and Opportunities in IoT and ML [0.0]
  The COVID-19 pandemic and other ongoing health crises have underscored the need for prompt healthcare services worldwide. This chapter focuses exclusively on exploring the hurdles encountered when integrating machine learning methods into the IoT healthcare sector. It offers a comprehensive summary of current research challenges and potential opportunities, categorized into three scenarios.
  arXiv  Detail & Related papers  (2023-12-09T10:45:44Z)
• Multimodal Federated Learning in Healthcare: a Review [5.983768682145731]
  Federated Learning (FL) provides a decentralized mechanism where data need not be consolidated. This paper outlines the current state-of-the-art approaches to Multimodal Federated Learning (MMFL) within the healthcare domain. It aims to bridge the gap between cutting-edge AI technology and the imperative need for patient data privacy in healthcare applications.
  arXiv  Detail & Related papers  (2023-10-14T19:43:06Z)
• ENOTO: Improving Offline-to-Online Reinforcement Learning with Q-Ensembles [52.34951901588738]
  We propose a novel framework called ENsemble-based Offline-To-Online (ENOTO) RL. By increasing the number of Q-networks, we seamlessly bridge offline pre-training and online fine-tuning without degrading performance. Experimental results demonstrate that ENOTO can substantially improve the training stability, learning efficiency, and final performance of existing offline RL methods.
  arXiv  Detail & Related papers  (2023-06-12T05:10:10Z)
• MedNgage: A Dataset for Understanding Engagement in Patient-Nurse Conversations [4.847266237348932]
  Patients who effectively manage their symptoms often demonstrate higher levels of engagement in conversations and interventions with healthcare practitioners. It is crucial for AI systems to understand the engagement in natural conversations between patients and practitioners to better contribute toward patient care. We present a novel dataset (MedNgage) which consists of patient-nurse conversations about cancer symptom management.
  arXiv  Detail & Related papers  (2023-05-31T16:06:07Z)
• Transitioning towards fit-for-purpose Public Health Surveillance Systems [1.345821655503426]
  The COVID-19 pandemic has exposed several weaknesses in the public health infrastructure. The expansion of testing and contact tracing has been key to identifying and isolating infected individuals. Digital technologies, such as telemedicine and virtual consultations, have experienced a surge in demand.
  arXiv  Detail & Related papers  (2023-05-26T11:04:41Z)
• The Design and Implementation of a National AI Platform for Public Healthcare in Italy: Implications for Semantics and Interoperability [62.997667081978825]
  The Italian National Health Service is adopting Artificial Intelligence through its technical agencies. Such a vast programme requires special care in formalising the knowledge domain. Questions have been raised about the impact that AI could have on patients, practitioners, and health systems.
  arXiv  Detail & Related papers  (2023-04-24T08:00:02Z)
• Privacy-preserving machine learning for healthcare: open challenges and future perspectives [72.43506759789861]
  We conduct a review of recent literature concerning Privacy-Preserving Machine Learning (PPML) for healthcare. We primarily focus on privacy-preserving training and inference-as-a-service. The aim of this review is to guide the development of private and efficient ML models in healthcare.
  arXiv  Detail & Related papers  (2023-03-27T19:20:51Z)
• Forecasting User Interests Through Topic Tag Predictions in Online Health Communities [16.088586964818703]
  This paper proposes an innovative approach to suggesting reliable information to participants in online communities. We pose the problem of predicting topic tags that describe the future information needs of users based on their profiles. The result is a variant of the collaborative information filtering or recommendation system tailored to the needs of users of online health communities.
  arXiv  Detail & Related papers  (2022-11-05T00:09:45Z)
• VBridge: Connecting the Dots Between Features, Explanations, and Data for Healthcare Models [85.4333256782337]
  VBridge is a visual analytics tool that seamlessly incorporates machine learning explanations into clinicians' decision-making workflow. We identified three key challenges, including clinicians' unfamiliarity with ML features, lack of contextual information, and the need for cohort-level evidence. We demonstrated the effectiveness of VBridge through two case studies and expert interviews with four clinicians.
  arXiv  Detail & Related papers  (2021-08-04T17:34:13Z)
• MIMO: Mutual Integration of Patient Journey and Medical Ontology for Healthcare Representation Learning [49.57261599776167]
  We propose an end-to-end robust Transformer-based solution, Mutual Integration of patient journey and Medical Ontology (MIMO) for healthcare representation learning and predictive analytics.
  arXiv  Detail & Related papers  (2021-07-20T07:04:52Z)
• Clinical Outcome Prediction from Admission Notes using Self-Supervised Knowledge Integration [55.88616573143478]
  Outcome prediction from clinical text can prevent doctors from overlooking possible risks. Diagnoses at discharge, procedures performed, in-hospital mortality and length-of-stay prediction are four common outcome prediction targets. We propose clinical outcome pre-training to integrate knowledge about patient outcomes from multiple public sources.
  arXiv  Detail & Related papers  (2021-02-08T10:26:44Z)
• Retrieving and ranking short medical questions with two stages neural matching model [3.8020157990268206]
  80 percent of internet users have asked health-related questions online. Those representative questions and answers in medical fields are valuable raw data sources for medical data mining. We propose a novel two-stage framework for the semantic matching of query-level medical questions.
  arXiv  Detail & Related papers  (2020-11-16T07:00:35Z)
• Assessing the Severity of Health States based on Social Media Posts [62.52087340582502]
  We propose a multiview learning framework that models both the textual content as well as contextual-information to assess the severity of the user's health state. The diverse NLU views demonstrate its effectiveness on both the tasks and as well as on the individual disease to assess a user's health.
  arXiv  Detail & Related papers  (2020-09-21T03:45:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.