Clinical Document Corpora -- Real Ones, Translated and Synthetic Substitutes, and Assorted Domain Proxies: A Survey of Diversity in Corpus Design, with Focus on German Text Data

• URL: http://arxiv.org/abs/2412.00230v2
• Date: Tue, 18 Feb 2025 20:17:34 GMT
• Title: Clinical Document Corpora -- Real Ones, Translated and Synthetic Substitutes, and Assorted Domain Proxies: A Survey of Diversity in Corpus Design, with Focus on German Text Data
• Authors: Udo Hahn,
• Abstract summary: Due to rigid data privacy legislation in Germany these resources are stored in safe clinical data spaces and locked against clinic-external researchers. This situation stands in stark contrast with established in the field of natural language processing where easy accessibility and reuse of data collections are common practice.
• Score: 2.6936101156436956
• License:
• Abstract: We survey clinical document corpora, with focus on German textual data. Due to rigid data privacy legislation in Germany these resources, with only few exceptions, are stored in safe clinical data spaces and locked against clinic-external researchers. This situation stands in stark contrast with established workflows in the field of natural language processing where easy accessibility and reuse of data collections are common practice. Hence, alternative corpus designs have been examined to escape from this data poverty. Besides machine translation of English clinical datasets and the generation of synthetic corpora with fictitious clinical contents, several other types of domain proxies have come up as substitutes for clinical documents. Common instances of close proxies are medical journal publications, therapy guidelines, drug labels, etc., more distant proxies include online encyclopedic medical articles or medical contents from social media channels. After PRISM-conformant identification of 362 hits from 4 bibliographic systems, 78 relevant documents were finally selected for this review. They contained overall 92 different published versions of corpora from which 71 were truly unique in terms of their underlying document sets. Out of these, the majority were clinical corpora -- 46 real ones, 5 translated ones, and 6 synthetic ones. As to domain proxies, we identified 18 close and 17 distant ones. There is a clear divide between the large number of non-accessible authentic clinical German-language corpora and their publicly accessible substitutes: translated or synthetic, close or more distant proxies. So on first sight, the data bottleneck seems broken. Yet differences in genre-specific writing style, wording and medical domain expertise in this typological space are also obvious. This raises the question how valid alternative corpus designs really are.

Related papers

• Development and validation of a natural language processing algorithm to pseudonymize documents in the context of a clinical data warehouse [53.797797404164946]
  The study highlights the difficulties faced in sharing tools and resources in this domain. We annotated a corpus of clinical documents according to 12 types of identifying entities. We build a hybrid system, merging the results of a deep learning model as well as manual rules.
  arXiv  Detail & Related papers  (2023-03-23T17:17:46Z)
• An Easy-to-use and Robust Approach for the Differentially Private De-Identification of Clinical Textual Documents [0.0]
  This paper shows how an efficient and differentially private de-identification approach can be achieved by strengthening the less robust de-identification. The result is an approach for de-identifying clinical documents in French language, but also generalizable to other languages.
  arXiv  Detail & Related papers  (2022-11-02T14:25:09Z)
• De-Identification of French Unstructured Clinical Notes for Machine Learning Tasks [0.0]
  We propose a new comprehensive de-identification method dedicated to French-language medical documents. The approach has been evaluated on a French language medical dataset of a French public hospital.
  arXiv  Detail & Related papers  (2022-09-16T13:00:47Z)
• Cross-Lingual Knowledge Transfer for Clinical Phenotyping [55.92262310716537]
  We investigate cross-lingual knowledge transfer strategies to execute this task for clinics that do not use the English language. We evaluate these strategies for a Greek and a Spanish clinic leveraging clinical notes from different clinical domains. Our results show that using multilingual data overall improves clinical phenotyping models and can compensate for data sparseness.
  arXiv  Detail & Related papers  (2022-08-03T08:33:21Z)
• A Medical Information Extraction Workbench to Process German Clinical Text [5.519657218427976]
  We introduce a workbench: a collection of German clinical text processing models. The models are trained on a de-identified corpus of German nephrology reports. Our workbench is made publicly available so it can be used out of the box, as a benchmark or transferred to related problems.
  arXiv  Detail & Related papers  (2022-07-08T13:19:19Z)
• Few-Shot Cross-lingual Transfer for Coarse-grained De-identification of Code-Mixed Clinical Texts [56.72488923420374]
  Pre-trained language models (LMs) have shown great potential for cross-lingual transfer in low-resource settings. We show the few-shot cross-lingual transfer property of LMs for named recognition (NER) and apply it to solve a low-resource and real-world challenge of code-mixed (Spanish-Catalan) clinical notes de-identification in the stroke.
  arXiv  Detail & Related papers  (2022-04-10T21:46:52Z)
• Towards more patient friendly clinical notes through language models and ontologies [57.51898902864543]
  We present a novel approach to automated medical text based on word simplification and language modelling. We use a new dataset pairs of publicly available medical sentences and a version of them simplified by clinicians. Our method based on a language model trained on medical forum data generates simpler sentences while preserving both grammar and the original meaning.
  arXiv  Detail & Related papers  (2021-12-23T16:11:19Z)
• Self-supervised Answer Retrieval on Clinical Notes [68.87777592015402]
  We introduce CAPR, a rule-based self-supervision objective for training Transformer language models for domain-specific passage matching. We apply our objective in four Transformer-based architectures: Contextual Document Vectors, Bi-, Poly- and Cross-encoders. We report that CAPR outperforms strong baselines in the retrieval of domain-specific passages and effectively generalizes across rule-based and human-labeled passages.
  arXiv  Detail & Related papers  (2021-08-02T10:42:52Z)
• Clinical Named Entity Recognition using Contextualized Token Representations [49.036805795072645]
  This paper introduces the technique of contextualized word embedding to better capture the semantic meaning of each word based on its context. We pre-train two deep contextualized language models, Clinical Embeddings from Language Model (C-ELMo) and Clinical Contextual String Embeddings (C-Flair) Explicit experiments show that our models gain dramatic improvements compared to both static word embeddings and domain-generic language models.
  arXiv  Detail & Related papers  (2021-06-23T18:12:58Z)
• GGPONC: A Corpus of German Medical Text with Rich Metadata Based on Clinical Practice Guidelines [4.370297546680015]
  GGPONC is a freely distributable German language corpus based on clinical practice guidelines for oncology. GGPONC is the first corpus for the German language covering diverse conditions in a large medical subfield. By applying and evaluating existing medical information extraction pipelines for German text, we are able to draw comparisons for the use of medical language.
  arXiv  Detail & Related papers  (2020-07-13T14:25:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.