Give me a knee radiograph, I will tell you where the knee joint area is:
a deep convolutional neural network adventure
- URL: http://arxiv.org/abs/2202.05382v1
- Date: Fri, 11 Feb 2022 00:46:37 GMT
- Title: Give me a knee radiograph, I will tell you where the knee joint area is:
a deep convolutional neural network adventure
- Authors: Shi Yan, Taghi Ramazanian, Elham Sagheb, Walter K. Kremers, Vipin
Chaudhary, Michael Taunton, Hilal Maradit Kremers, Ahmad P. Tafti
- Abstract summary: The work proposes an accurate and effective pipeline for autonomous detection, localization, and classification of knee joint area in plain radiographs.
The present work is expected to stimulate more interest from the deep learning computer vision community to this pragmatic and clinical application.
- Score: 5.92701972981462
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Knee pain is undoubtedly the most common musculoskeletal symptom that impairs
quality of life, confines mobility and functionality across all ages. Knee pain
is clinically evaluated by routine radiographs, where the widespread adoption
of radiographic images and their availability at low cost, make them the
principle component in the assessment of knee pain and knee pathologies, such
as arthritis, trauma, and sport injuries. However, interpretation of the knee
radiographs is still highly subjective, and overlapping structures within the
radiographs and the large volume of images needing to be analyzed on a daily
basis, make interpretation challenging for both naive and experienced
practitioners. There is thus a need to implement an artificial intelligence
strategy to objectively and automatically interpret knee radiographs,
facilitating triage of abnormal radiographs in a timely fashion. The current
work proposes an accurate and effective pipeline for autonomous detection,
localization, and classification of knee joint area in plain radiographs
combining the You Only Look Once (YOLO v3) deep convolutional neural network
with a large and fully-annotated knee radiographs dataset. The present work is
expected to stimulate more interest from the deep learning computer vision
community to this pragmatic and clinical application.
Related papers
- Real-Time Model-Based Quantitative Ultrasound and Radar [65.268245109828]
We propose a neural network based on the physical model of wave propagation, which defines the relationship between the received signals and physical properties.
Our network can reconstruct multiple physical properties in less than one second for complex and realistic scenarios.
arXiv Detail & Related papers (2024-02-16T09:09:16Z) - XrayGPT: Chest Radiographs Summarization using Medical Vision-Language
Models [60.437091462613544]
We introduce XrayGPT, a novel conversational medical vision-language model.
It can analyze and answer open-ended questions about chest radiographs.
We generate 217k interactive and high-quality summaries from free-text radiology reports.
arXiv Detail & Related papers (2023-06-13T17:59:59Z) - Act Like a Radiologist: Radiology Report Generation across Anatomical Regions [50.13206214694885]
X-RGen is a radiologist-minded report generation framework across six anatomical regions.
In X-RGen, we seek to mimic the behaviour of human radiologists, breaking them down into four principal phases.
We enhance the recognition capacity of the image encoder by analysing images and reports across various regions.
arXiv Detail & Related papers (2023-05-26T07:12:35Z) - Improving Radiology Summarization with Radiograph and Anatomy Prompts [60.30659124918211]
We propose a novel anatomy-enhanced multimodal model to promote impression generation.
In detail, we first construct a set of rules to extract anatomies and put these prompts into each sentence to highlight anatomy characteristics.
We utilize a contrastive learning module to align these two representations at the overall level and use a co-attention to fuse them at the sentence level.
arXiv Detail & Related papers (2022-10-15T14:05:03Z) - Knee Cartilage Defect Assessment by Graph Representation and Surface
Convolution [40.36360714443767]
Cartilage defects are regarded as major manifestations of knee osteoarthritis (OA)
Many attempts have been made on knee cartilage defect assessment by applying convolutional neural networks (CNNs) to knee MRI.
We model the cartilages structure and appearance from knee MRI into a graph representation, which is capable of handling highly diverse clinical data.
Then, guided by the cartilage graph representation, we design a non-Euclidean deep learning network with the self-attention mechanism, to extract cartilage features in the local and global.
arXiv Detail & Related papers (2022-01-12T05:55:32Z) - Generative Residual Attention Network for Disease Detection [51.60842580044539]
We present a novel approach for disease generation in X-rays using a conditional generative adversarial learning.
We generate a corresponding radiology image in a target domain while preserving the identity of the patient.
We then use the generated X-ray image in the target domain to augment our training to improve the detection performance.
arXiv Detail & Related papers (2021-10-25T14:15:57Z) - Knee Osteoarthritis Severity Prediction using an Attentive Multi-Scale
Deep Convolutional Neural Network [8.950918531231158]
This paper presents a deep learning-based framework, namely OsteoHRNet, that automatically assesses the Knee Osteoarthritis severity in terms of Kellgren and Lawrence grade classification from X-rays.
Our proposed model has achieved the best multiclass accuracy of 71.74% and MAE of 0.311 on the baseline cohort of the OAI dataset.
arXiv Detail & Related papers (2021-06-27T17:29:46Z) - XraySyn: Realistic View Synthesis From a Single Radiograph Through CT
Priors [118.27130593216096]
A radiograph visualizes the internal anatomy of a patient through the use of X-ray, which projects 3D information onto a 2D plane.
To the best of our knowledge, this is the first work on radiograph view synthesis.
We show that by gaining an understanding of radiography in 3D space, our method can be applied to radiograph bone extraction and suppression without groundtruth bone labels.
arXiv Detail & Related papers (2020-12-04T05:08:53Z) - A Lightweight CNN and Joint Shape-Joint Space (JS2) Descriptor for
Radiological Osteoarthritis Detection [2.3204178451683264]
We propose a fully automated novel method, based on combination of joint shape and convolutional neural network (CNN) based bone texture features.
Our results demonstrate that fusing the proposed shape and texture parameters achieves the state-of-the art performance in radiographic osteoarthritis detection yielding area under the ROC curve (AUC) of 95.21%.
arXiv Detail & Related papers (2020-05-24T10:48:38Z) - Knee Injury Detection using MRI with Efficiently-Layered Network (ELNet) [1.8374319565577157]
We present the Efficiently-Layered Network (ELNet), a convolutional neural network (CNN) architecture optimized for the task of initial knee MRI diagnosis for triage.
The proposed model is extremely lightweight ($$ 1MB) and therefore easy to train and deploy in real clinical settings.
arXiv Detail & Related papers (2020-05-06T10:21:16Z) - Bone Suppression on Chest Radiographs With Adversarial Learning [21.331378067323573]
Dual-energy (DE) chest radiography provides the capability of selectively imaging two clinically relevant materials.
We learn the mapping between conventional radiographs and bone suppressed radiographs.
We compare the effectiveness of training with patient-wisely paired and unpaired radiographs.
arXiv Detail & Related papers (2020-02-08T02:53:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.