AI-Generated Content Enhanced Computer-Aided Diagnosis Model for Thyroid Nodules: A ChatGPT-Style Assistant

• URL: http://arxiv.org/abs/2402.02401v1
• Date: Sun, 4 Feb 2024 08:24:13 GMT
• Title: AI-Generated Content Enhanced Computer-Aided Diagnosis Model for Thyroid Nodules: A ChatGPT-Style Assistant
• Authors: Jincao Yao (1 and 2 and 3 and 4 and 5 and 6), Yunpeng Wang (7), Zhikai Lei (8), Kai Wang (9), Xiaoxian Li (10) Jianhua Zhou (10), Xiang Hao (7), Jiafei Shen (1 and 2), Zhenping Wang (9), Rongrong Ru (11), Yaqing Chen (11), Yahan Zhou (6), Chen Chen (1 and 2), Yanming Zhang (12 and 13), Ping Liang (14), Dong Xu (1 and 2 and 3 and 4 and 5 and 6) ((1) Department of Radiology, Zhejiang Cancer Hospital, Hangzhou, 310022, China (2) Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, 310000, China,(3) Key Laboratory of Head and Neck Cancer Translational Research of Zhejiang Province, Hangzhou, 310022, China,(4) Zhejiang Provincial Research Center for Cancer Intelligent Diagnosis and Molecular Technology, Hangzhou, 310000, China, (5) Wenling Medical Big Data and Artificial Intelligence Research Institute, 24th Floor, Machang Road, Taizhou, 310061, China,(6) Taizhou Key Laboratory of Minimally Invasive Interventional Therapy and Artificial Intelligence, Taizhou Campus of Zhejiang Cancer Hospital (Taizhou Cancer Hospital), Taizhou, 317502, China,(7) College of Optical Science and Engineering, Zhejiang University, No.38 of Zheda Road, Hangzhou, Zhejiang Province, China,(8) Zhejiang Provincial Hospital of Chinese Medicine, 54 Youdian Road, Hangzhou, 310003, China,(9) Department of Ultrasound, The Affiliated Dongyang Hospital of Wenzhou Medical University, Dongyang, 322100, China,(10) Department of Ultrasound, Sun Yat sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangzhou, 510060, China, (11) Affiliated Xiaoshan Hospital, Hangzhou Normal University, No.728 North Yucai Road, Hangzhou, 311202, China,(12) Zhejiang Provincial People's Hospital Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, 314408, China,(13) Key Laboratory of Endocrine Gland Diseases of Zhejiang Province, Hangzhou, 314408, China,(14) Department of Ultrasound, Chinese PLA General Hospital, Chinese PLA Medical School, Beijing, 100853, China)
• Abstract summary: An artificial intelligence-generated computer-aided diagnosis (AIGC-CAD) model, designated as ThyGPT, has been developed. This model, inspired by the architecture of ChatGPT, could assist radiologists in assessing the risk of thyroid nodules through semantic-level human-machine interaction.
• Score: 36.02145235227822
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: An artificial intelligence-generated content-enhanced computer-aided diagnosis (AIGC-CAD) model, designated as ThyGPT, has been developed. This model, inspired by the architecture of ChatGPT, could assist radiologists in assessing the risk of thyroid nodules through semantic-level human-machine interaction. A dataset comprising 19,165 thyroid nodule ultrasound cases from Zhejiang Cancer Hospital was assembled to facilitate the training and validation of the model. After training, ThyGPT could automatically evaluate thyroid nodule and engage in effective communication with physicians through human-computer interaction. The performance of ThyGPT was rigorously quantified using established metrics such as the receiver operating characteristic (ROC) curve, area under the curve (AUC), sensitivity, and specificity. The empirical findings revealed that radiologists, when supplemented with ThyGPT, markedly surpassed the diagnostic acumen of their peers utilizing traditional methods as well as the performance of the model in isolation. These findings suggest that AIGC-CAD systems, exemplified by ThyGPT, hold the promise to fundamentally transform the diagnostic workflows of radiologists in forthcoming years.

Related papers

• Nodule-DETR: A Novel DETR Architecture with Frequency-Channel Attention for Ultrasound Thyroid Nodule Detection [11.368372526576879]
  Thyroid cancer is the most common endocrine malignancy, and its incidence is rising globally.<n>We propose Nodule-DETR, a novel detection transformer (DETR) architecture designed for robust thyroid nodule detection in ultrasound images.<n>Nodule-DETR introduces three key innovations: a Multi-Spectral Frequency-domain Channel Attention (MSFCA) module that leverages frequency analysis to enhance features of low-contrast nodules; a Hierarchical Feature Fusion (HFF) module for efficient multi-scale integration, and Multi-Scale Deformable Attention (MSDA) to flexibly capture small and irregularly shaped nodules.
  arXiv  Detail & Related papers  (2026-01-05T08:53:04Z)
• MGH Radiology Llama: A Llama 3 70B Model for Radiology [50.42811030970618]
  This paper presents an advanced radiology-focused large language model: MGH Radiology Llama. It is developed using the Llama 3 70B model, building upon previous domain-specific models like Radiology-GPT and Radiology-Llama2. Our evaluation, incorporating both traditional metrics and a GPT-4-based assessment, highlights the enhanced performance of this work over general-purpose LLMs.
  arXiv  Detail & Related papers  (2024-08-13T01:30:03Z)
• ChatRadio-Valuer: A Chat Large Language Model for Generalizable Radiology Report Generation Based on Multi-institution and Multi-system Data [115.0747462486285]
  ChatRadio-Valuer is a tailored model for automatic radiology report generation that learns generalizable representations. The clinical dataset utilized in this study encompasses a remarkable total of textbf332,673 observations. ChatRadio-Valuer consistently outperforms state-of-the-art models, especially ChatGPT (GPT-3.5-Turbo) and GPT-4 et al.
  arXiv  Detail & Related papers  (2023-10-08T17:23:17Z)
• Radiology-Llama2: Best-in-Class Large Language Model for Radiology [71.27700230067168]
  This paper introduces Radiology-Llama2, a large language model specialized for radiology through a process known as instruction tuning. Quantitative evaluations using ROUGE metrics on the MIMIC-CXR and OpenI datasets demonstrate that Radiology-Llama2 achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2023-08-29T17:44:28Z)
• Shape-Margin Knowledge Augmented Network for Thyroid Nodule Segmentation and Diagnosis [0.788657961743755]
  This paper proposes a shape-margin knowledge augmented network (SkaNet) for simultaneously thyroid nodule segmentation and diagnosis. SkaNet shares visual features in the feature extraction stage and then utilizes a dual-branch architecture to perform thyroid nodule segmentation and diagnosis tasks simultaneously. It embeds shape and margin characteristics through numerical computation and models the relationship between the thyroid nodule diagnosis results and segmentation masks.
  arXiv  Detail & Related papers  (2023-08-29T15:29:06Z)
• Radiology-GPT: A Large Language Model for Radiology [74.07944784968372]
  We introduce Radiology-GPT, a large language model for radiology. It demonstrates superior performance compared to general language models such as StableLM, Dolly and LLaMA. It exhibits significant versatility in radiological diagnosis, research, and communication.
  arXiv  Detail & Related papers  (2023-06-14T17:57:24Z)
• Extracting Thyroid Nodules Characteristics from Ultrasound Reports Using Transformer-based Natural Language Processing Methods [22.35979441935564]
  The characteristics of thyroid nodules are often documented in clinical narratives such as ultrasound reports. To the best of our knowledge, this is the first study to systematically categorize and apply transformer-based NLP models to extract a large number of clinical relevant thyroid nodule characteristics from ultrasound reports.
  arXiv  Detail & Related papers  (2023-03-31T20:23:58Z)
• Towards Trust of Explainable AI in Thyroid Nodule Diagnosis [0.0]
  We apply state-of-the-art eXplainable artificial intelligence (XAI) methods to explain the prediction of the black-box AI models in the thyroid nodule diagnosis application. We propose new statistic-based XAI methods, namely Kernel Density Estimation and Density map, to explain the case of no nodule detected.
  arXiv  Detail & Related papers  (2023-03-08T17:18:13Z)
• Medical Image Captioning via Generative Pretrained Transformers [57.308920993032274]
  We combine two language models, the Show-Attend-Tell and the GPT-3, to generate comprehensive and descriptive radiology records. The proposed model is tested on two medical datasets, the Open-I, MIMIC-CXR, and the general-purpose MS-COCO.
  arXiv  Detail & Related papers  (2022-09-28T10:27:10Z)
• Key-frame Guided Network for Thyroid Nodule Recognition using Ultrasound Videos [13.765306481109988]
  This paper proposes a novel method for the automated recognition of thyroid nodules through an exploration of ultrasound videos and key-frames. We first propose a detection-localization framework to automatically identify the clinical key-frame with a typical nodule in each ultrasound video. Based on the localized key-frame, we develop a key-frame guided video classification model for thyroid recognition.
  arXiv  Detail & Related papers  (2022-06-27T14:03:26Z)
• Multi-Scale Hybrid Vision Transformer for Learning Gastric Histology: AI-Based Decision Support System for Gastric Cancer Treatment [50.89811515036067]
  Gastric endoscopic screening is an effective way to decide appropriate gastric cancer (GC) treatment at an early stage, reducing GC-associated mortality rate. We propose a practical AI system that enables five subclassifications of GC pathology, which can be directly matched to general GC treatment guidance.
  arXiv  Detail & Related papers  (2022-02-17T08:33:52Z)
• A systematic review on the role of artificial intelligence in sonographic diagnosis of thyroid cancer: Past, present and future [0.6523396727243321]
  This review follows a methodology-based classification of the different techniques available for thyroid cancer diagnosis. We reflect on the trends and challenges of the field of sonographic diagnosis of thyroid malignancies. Machine learning will continue to play a fundamental role in the development of future thyroid cancer diagnosis frameworks.
  arXiv  Detail & Related papers  (2020-06-10T14:38:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.