Narrative Visualization to Communicate Neurological Diseases

• URL: http://arxiv.org/abs/2212.10121v1
• Date: Tue, 20 Dec 2022 09:39:57 GMT
• Title: Narrative Visualization to Communicate Neurological Diseases
• Authors: Sarah Mittenentzwei, Veronika Wei{\ss}, Stefanie Schreiber, Laura A. Garrison, Stefan Bruckner, Malte Pfister, Bernhard Preim, and Monique Meuschke
• Abstract summary: We investigate how neurological disease data can be communicated through narrative visualization techniques to a general audience in an understandable way. We designed a narrative visualization explaining cerebral small vessel disease. We found that the combination of a carefully thought-out storyline with a clear key message, appealing visualizations combined with easy-to-use interactions, and credible references are crucial for creating a narrative visualization about a neurological disease that engages an audience.
• Score: 8.326479391467725
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: While narrative visualization has been used successfully in various applications to communicate scientific data in the format of a story to a general audience, the same has not been true for medical data. There are only a few exceptions that present tabular medical data to non-experts. However, a key component of medical visualization is the interactive analysis of 3D data, such as 3D models of anatomical structures, which were rarely included in narrative visualizations so far. In this design study, we investigate how neurological disease data can be communicated through narrative visualization techniques to a general audience in an understandable way. We designed a narrative visualization explaining cerebral small vessel disease. Learning about its avoidable risk factors serves to motivate the audience watching the resulting visual data story. Using this example, we discuss the adaption of basic narrative components. This includes the conflict and characters of a story, as well as the story's structure and content to address and communicate specific characteristics of medical data. Furthermore, we explore the extent to which complex medical relationships need to be simplified to be understandable to a general audience without distorting the underlying data and evidence. In particular, the data needs to be preprocessed for non-experts and appropriate forms of interaction must be found. We explore approaches to make the data more personally relatable, such as including a fictional patient. We evaluated our approach in a user study with 40 participants in a web-based implementation of the designed story. We found that the combination of a carefully thought-out storyline with a clear key message, appealing visualizations combined with easy-to-use interactions, and credible references are crucial for creating a narrative visualization about a neurological disease that engages an audience.

Related papers

• Autoregressive Sequence Modeling for 3D Medical Image Representation [48.706230961589924]
  We introduce a pioneering method for learning 3D medical image representations through an autoregressive sequence pre-training framework. Our approach various 3D medical images based on spatial, contrast, and semantic correlations, treating them as interconnected visual tokens within a token sequence.
  arXiv  Detail & Related papers  (2024-09-13T10:19:10Z)
• Evaluating and Analyzing Relationship Hallucinations in Large Vision-Language Models [69.79709804046325]
  We introduce R-Bench, a novel benchmark for evaluating Vision Relationship Hallucination. R-Bench features image-level questions that focus on the existence of relationships and instance-level questions that assess local visual comprehension. We identify three types of relationship co-occurrences that lead to hallucinations: relationship-relationship, subject-relationship, and relationship-object.
  arXiv  Detail & Related papers  (2024-06-24T08:42:42Z)
• A Textbook Remedy for Domain Shifts: Knowledge Priors for Medical Image Analysis [48.84443450990355]
  Deep networks have achieved broad success in analyzing natural images, when applied to medical scans, they often fail in unexcepted situations. We investigate this challenge and focus on model sensitivity to domain shifts, such as data sampled from different hospitals or data confounded by demographic variables such as sex, race, etc, in the context of chest X-rays and skin lesion images. Taking inspiration from medical training, we propose giving deep networks a prior grounded in explicit medical knowledge communicated in natural language.
  arXiv  Detail & Related papers  (2024-05-23T17:55:02Z)
• Topicwise Separable Sentence Retrieval for Medical Report Generation [41.812337937025084]
  We introduce a Topicwise Separable Sentence Retrieval (Teaser) for medical report generation. To ensure comprehensive learning of both common and rare topics, we categorize queries into common and rare types, and then propose Topic Contrastive Loss. Experiments on the MIMIC-CXR and IU X-ray datasets demonstrate that Teaser surpasses state-of-the-art models.
  arXiv  Detail & Related papers  (2024-05-07T10:21:23Z)
• Medical Vision-Language Pre-Training for Brain Abnormalities [96.1408455065347]
  We show how to automatically collect medical image-text aligned data for pretraining from public resources such as PubMed. In particular, we present a pipeline that streamlines the pre-training process by initially collecting a large brain image-text dataset. We also investigate the unique challenge of mapping subfigures to subcaptions in the medical domain.
  arXiv  Detail & Related papers  (2024-04-27T05:03:42Z)
• Knowledge-augmented Graph Neural Networks with Concept-aware Attention for Adverse Drug Event Detection [9.334701229573739]
  Adverse drug events (ADEs) are an important aspect of drug safety. Various texts contain a wealth of information about ADEs. Recent studies have applied word embedding and deep learning -based natural language processing to automate ADE detection from text. We propose a concept-aware attention mechanism which learns features differently for the different types of nodes in the graph.
  arXiv  Detail & Related papers  (2023-01-25T08:01:45Z)
• Improving Radiology Summarization with Radiograph and Anatomy Prompts [60.30659124918211]
  We propose a novel anatomy-enhanced multimodal model to promote impression generation. In detail, we first construct a set of rules to extract anatomies and put these prompts into each sentence to highlight anatomy characteristics. We utilize a contrastive learning module to align these two representations at the overall level and use a co-attention to fuse them at the sentence level.
  arXiv  Detail & Related papers  (2022-10-15T14:05:03Z)
• Towards Narrative Medical Visualization [12.654190663732509]
  Narrative visualization aims to communicate scientific results to a general audience. Merging exploratory and explanatory visualization could effectively support a non-expert understanding of scientific processes.
  arXiv  Detail & Related papers  (2021-08-11T22:01:34Z)
• Visual Exploration and Knowledge Discovery from Biomedical Dark Data [0.0]
  We employ a natural language processing based pipeline to discover knowledge out of the biomedical dark data. We aim to proffer a potential solution to overcome the problem of analyzing overwhelming amounts of information.
  arXiv  Detail & Related papers  (2020-09-28T04:27:05Z)
• Once Upon A Time In Visualization: Understanding the Use of Textual Narratives for Causality [21.67542584041709]
  Causality visualization can help people understand temporal chains of events. But as the scale and complexity of these event sequences grows, even these visualizations can become overwhelming to use. We propose the use of textual narratives as a data-driven storytelling method to augment causality visualization.
  arXiv  Detail & Related papers  (2020-09-06T05:46:24Z)
• Hide-and-Tell: Learning to Bridge Photo Streams for Visual Storytelling [86.42719129731907]
  We propose to explicitly learn to imagine a storyline that bridges the visual gap. We train the network to produce a full plausible story even with missing photo(s) In experiments, we show that our scheme of hide-and-tell, and the network design are indeed effective at storytelling.
  arXiv  Detail & Related papers  (2020-02-03T14:22:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.