GPT-4 Vision on Medical Image Classification -- A Case Study on COVID-19
Dataset
- URL: http://arxiv.org/abs/2310.18498v1
- Date: Fri, 27 Oct 2023 21:28:36 GMT
- Title: GPT-4 Vision on Medical Image Classification -- A Case Study on COVID-19
Dataset
- Authors: Ruibo Chen, Tianyi Xiong, Yihan Wu, Guodong Liu, Zhengmian Hu, Lichang
Chen, Yanshuo Chen, Chenxi Liu, Heng Huang
- Abstract summary: This technical report delves into the application of GPT-4 Vision (GPT-4V) in the realm of COVID-19 image classification, leveraging the transformative potential of in-context learning to enhance diagnostic processes.
- Score: 58.493596972033195
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: This technical report delves into the application of GPT-4 Vision (GPT-4V) in
the nuanced realm of COVID-19 image classification, leveraging the
transformative potential of in-context learning to enhance diagnostic
processes.
Related papers
- Evaluating GPT-4 with Vision on Detection of Radiological Findings on Chest Radiographs [8.780264809946505]
The study examines the application of GPT-4V, a multi-modal large language model equipped with visual recognition, in detecting radiological findings from a set of 100 chest radiographs.
It suggests that GPT-4V is currently not ready for real-world diagnostic usage in interpreting chest radiographs.
arXiv Detail & Related papers (2024-03-22T17:27:18Z) - Exploiting GPT-4 Vision for Zero-shot Point Cloud Understanding [114.4754255143887]
We tackle the challenge of classifying the object category in point clouds.
We employ GPT-4 Vision (GPT-4V) to overcome these challenges.
We set a new benchmark in zero-shot point cloud classification.
arXiv Detail & Related papers (2024-01-15T10:16:44Z) - From Text to Image: Exploring GPT-4Vision's Potential in Advanced
Radiological Analysis across Subspecialties [1.326604946241079]
The study evaluates and compares GPT-4 and GPT-4Vision for radiological tasks, suggesting GPT-4Vision may recognize radiological features from images, thereby enhancing its diagnostic potential over text-based descriptions.
arXiv Detail & Related papers (2023-11-24T15:39:29Z) - GPT-4V(ision) Unsuitable for Clinical Care and Education: A Clinician-Evaluated Assessment [6.321623278767821]
GPT-4V was recently developed for general image interpretation.
Board-certified physicians and senior residents assessed GPT-4V's proficiency across a range of medical conditions.
GPT-4V's diagnostic accuracy and clinical decision-making abilities are poor, posing risks to patient safety.
arXiv Detail & Related papers (2023-11-14T17:06:09Z) - Holistic Evaluation of GPT-4V for Biomedical Imaging [113.46226609088194]
GPT-4V represents a breakthrough in artificial general intelligence for computer vision.
We assess GPT-4V's performance across 16 medical imaging categories, including radiology, oncology, ophthalmology, pathology, and more.
Results show GPT-4V's proficiency in modality and anatomy recognition but difficulty with disease diagnosis and localization.
arXiv Detail & Related papers (2023-11-10T18:40:44Z) - A Systematic Evaluation of GPT-4V's Multimodal Capability for Medical
Image Analysis [87.25494411021066]
GPT-4V's multimodal capability for medical image analysis is evaluated.
It is found that GPT-4V excels in understanding medical images and generates high-quality radiology reports.
It is found that its performance for medical visual grounding needs to be substantially improved.
arXiv Detail & Related papers (2023-10-31T11:39:09Z) - Can GPT-4V(ision) Serve Medical Applications? Case Studies on GPT-4V for
Multimodal Medical Diagnosis [59.35504779947686]
GPT-4V is OpenAI's newest model for multimodal medical diagnosis.
Our evaluation encompasses 17 human body systems.
GPT-4V demonstrates proficiency in distinguishing between medical image modalities and anatomy.
It faces significant challenges in disease diagnosis and generating comprehensive reports.
arXiv Detail & Related papers (2023-10-15T18:32:27Z) - Few-shot medical image classification with simple shape and texture text
descriptors using vision-language models [1.1172382217477128]
We investigate the usefulness of vision-language models (VLMs) and large language models for binary few-shot classification of medical images.
We utilize the GPT-4 model to generate text descriptors that encapsulate the shape and texture characteristics of objects in medical images.
arXiv Detail & Related papers (2023-08-08T02:48:46Z) - Adaptive Feature Selection Guided Deep Forest for COVID-19
Classification with Chest CT [49.09507792800059]
We propose an Adaptive Feature Selection guided Deep Forest (AFS-DF) for COVID-19 classification based on chest CT images.
We evaluate our proposed AFS-DF on COVID-19 dataset with 1495 patients of COVID-19 and 1027 patients of community acquired pneumonia (CAP)
arXiv Detail & Related papers (2020-05-07T06:00:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.