Towards Narrative Medical Visualization

• URL: http://arxiv.org/abs/2108.05462v1
• Date: Wed, 11 Aug 2021 22:01:34 GMT
• Title: Towards Narrative Medical Visualization
• Authors: Monique Meuschke, Laura Garrison, Noeska Smit, Stefan Bruckner, Kai Lawonn, Bernhard Preim
• Abstract summary: Narrative visualization aims to communicate scientific results to a general audience. Merging exploratory and explanatory visualization could effectively support a non-expert understanding of scientific processes.
• Score: 12.654190663732509
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Narrative visualization aims to communicate scientific results to a general audience and garners significant attention in various applications. Merging exploratory and explanatory visualization could effectively support a non-expert understanding of scientific processes. Medical research results, e.g., mechanisms of the healthy human body, explanations of pathological processes, or avoidable risk factors for diseases, are also interesting to a general audience that includes patients and their relatives. This paper discusses how narrative techniques can be applied to medical visualization to tell data-driven stories about diseases. We address the general public comprising people interested in medicine without specific medical background knowledge. We derived a general template for the narrative medical visualization of diseases. Applying this template to three diseases selected to span bone, vascular, and organ systems, we discuss how narrative techniques can support visual communication and facilitate understanding of medical data. Other scientists can adapt our proposed template to inform an audience on other diseases. With our work, we show the potential of narrative medical visualization and conclude with a comprehensive research agenda.

Related papers

• A Survey of Medical Vision-and-Language Applications and Their Techniques [48.268198631277315]
  Medical vision-and-language models (MVLMs) have attracted substantial interest due to their capability to offer a natural language interface for interpreting complex medical data. Here, we provide a comprehensive overview of MVLMs and the various medical tasks to which they have been applied. We also examine the datasets used for these tasks and compare the performance of different models based on standardized evaluation metrics.
  arXiv  Detail & Related papers  (2024-11-19T03:27:05Z)
• Are Generative AI systems Capable of Supporting Information Needs of Patients? [4.485098382568721]
  We investigate whether and how generative visual question answering systems can responsibly support patient information needs in the context of radiology imaging data. We conducted a formative need-finding study in which participants discussed chest computed tomography (CT) scans and associated radiology reports of a fictitious close relative with a cardiothoracic radiologist. Using thematic analysis of the conversation between participants and medical experts, we identified commonly occurring themes across interactions. We evaluate two state-of-the-art generative visual language models against the radiologist's responses.
  arXiv  Detail & Related papers  (2024-01-31T23:24:37Z)
• Yes, this is what I was looking for! Towards Multi-modal Medical Consultation Concern Summary Generation [46.42604861624895]
  We propose a new task of multi-modal medical concern summary generation. Nonverbal cues, such as patients' gestures and facial expressions, aid in accurately identifying patients' concerns. We construct the first multi-modal medical concern summary generation corpus.
  arXiv  Detail & Related papers  (2024-01-10T12:56:47Z)
• Descriptive Knowledge Graph in Biomedical Domain [26.91431888505873]
  We present a novel system that automatically extracts and generates informative and descriptive sentences from the biomedical corpus. Unlike previous search engines or exploration systems that retrieve unconnected passages, our system organizes descriptive sentences as a graph. We spotlight the application of our system in COVID-19 research, illustrating its utility in areas such as drug repurposing and literature curation.
  arXiv  Detail & Related papers  (2023-10-18T03:10:25Z)
• Experience and Evidence are the eyes of an excellent summarizer! Towards Knowledge Infused Multi-modal Clinical Conversation Summarization [46.613541673040544]
  We propose a knowledge-infused, multi-modal, multi-tasking medical domain identification and clinical conversation summary generation framework. We develop a multi-modal, multi-intent clinical conversation summarization corpus annotated with intent, symptom, and summary. The extensive set of experiments led to the following findings: (a) critical significance of visuals, (b) more precise and medical entity preserving summary with additional knowledge infusion, and (c) a correlation between medical department identification and clinical synopsis generation.
  arXiv  Detail & Related papers  (2023-09-27T15:49:43Z)
• Narrative Visualization to Communicate Neurological Diseases [8.326479391467725]
  We investigate how neurological disease data can be communicated through narrative visualization techniques to a general audience in an understandable way. We designed a narrative visualization explaining cerebral small vessel disease. We found that the combination of a carefully thought-out storyline with a clear key message, appealing visualizations combined with easy-to-use interactions, and credible references are crucial for creating a narrative visualization about a neurological disease that engages an audience.
  arXiv  Detail & Related papers  (2022-12-20T09:39:57Z)
• Improving Radiology Summarization with Radiograph and Anatomy Prompts [60.30659124918211]
  We propose a novel anatomy-enhanced multimodal model to promote impression generation. In detail, we first construct a set of rules to extract anatomies and put these prompts into each sentence to highlight anatomy characteristics. We utilize a contrastive learning module to align these two representations at the overall level and use a co-attention to fuse them at the sentence level.
  arXiv  Detail & Related papers  (2022-10-15T14:05:03Z)
• Align, Reason and Learn: Enhancing Medical Vision-and-Language Pre-training with Knowledge [68.90835997085557]
  We propose a systematic and effective approach to enhance structured medical knowledge from three perspectives. First, we align the representations of the vision encoder and the language encoder through knowledge. Second, we inject knowledge into the multi-modal fusion model to enable the model to perform reasoning using knowledge as the supplementation of the input image and text. Third, we guide the model to put emphasis on the most critical information in images and texts by designing knowledge-induced pretext tasks.
  arXiv  Detail & Related papers  (2022-09-15T08:00:01Z)
• Dr. Summarize: Global Summarization of Medical Dialogue by Exploiting Local Structures [4.3012765978447565]
  We present a novel approach to medical conversation summarization that leverages the unique and independent local structures created when gathering a patient's medical history. Our approach is preferred on twice the number of pointers to the baseline pointer generator model and captures most or all of the information in 80% of the conversations.
  arXiv  Detail & Related papers  (2020-09-18T07:35:44Z)
• COVID-19 Literature Knowledge Graph Construction and Drug Repurposing Report Generation [79.33545724934714]
  We have developed a novel and comprehensive knowledge discovery framework, COVID-KG, to extract fine-grained multimedia knowledge elements from scientific literature. Our framework also provides detailed contextual sentences, subfigures, and knowledge subgraphs as evidence.
  arXiv  Detail & Related papers  (2020-07-01T16:03:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.