MSKdeX: Musculoskeletal (MSK) decomposition from an X-ray image for
fine-grained estimation of lean muscle mass and muscle volume
- URL: http://arxiv.org/abs/2305.19920v2
- Date: Fri, 21 Jul 2023 11:27:30 GMT
- Title: MSKdeX: Musculoskeletal (MSK) decomposition from an X-ray image for
fine-grained estimation of lean muscle mass and muscle volume
- Authors: Yi Gu, Yoshito Otake, Keisuke Uemura, Masaki Takao, Mazen Soufi, Yuta
Hiasa, Hugues Talbot, Seiji Okata, Nobuhiko Sugano, Yoshinobu Sato
- Abstract summary: Musculoskeletal diseases such as sarcopenia and osteoporosis are major obstacles to health during aging.
We propose a method to estimate fine-grained muscle properties from a plain X-ray image, a low-cost, low-radiation, and highly accessible imaging modality.
- Score: 5.1294076116231455
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Musculoskeletal diseases such as sarcopenia and osteoporosis are major
obstacles to health during aging. Although dual-energy X-ray absorptiometry
(DXA) and computed tomography (CT) can be used to evaluate musculoskeletal
conditions, frequent monitoring is difficult due to the cost and accessibility
(as well as high radiation exposure in the case of CT). We propose a method
(named MSKdeX) to estimate fine-grained muscle properties from a plain X-ray
image, a low-cost, low-radiation, and highly accessible imaging modality,
through musculoskeletal decomposition leveraging fine-grained segmentation in
CT. We train a multi-channel quantitative image translation model to decompose
an X-ray image into projections of CT of individual muscles to infer the lean
muscle mass and muscle volume. We propose the object-wise intensity-sum loss, a
simple yet surprisingly effective metric invariant to muscle deformation and
projection direction, utilizing information in CT and X-ray images collected
from the same patient. While our method is basically an unpaired image-to-image
translation, we also exploit the nature of the bone's rigidity, which provides
the paired data through 2D-3D rigid registration, adding strong pixel-wise
supervision in unpaired training. Through the evaluation using a 539-patient
dataset, we showed that the proposed method significantly outperformed
conventional methods. The average Pearson correlation coefficient between the
predicted and CT-derived ground truth metrics was increased from 0.460 to
0.863. We believe our method opened up a new musculoskeletal diagnosis method
and has the potential to be extended to broader applications in multi-channel
quantitative image translation tasks. Our source code will be released soon.
Related papers
- A Diffusion-based Xray2MRI Model: Generating Pseudo-MRI Volumes From one Single X-ray [6.014316825270666]
We introduce a novel diffusion-based Xray2MRI model capable of generating pseudo-MRI volumes from a single X-ray image.
Experimental results demonstrate that our proposed approach is capable of generating pseudo-MRI sequences that approximate real MRI scans.
arXiv Detail & Related papers (2024-10-09T15:44:34Z) - Bootstrapping Chest CT Image Understanding by Distilling Knowledge from X-ray Expert Models [17.75505740079875]
We explore the feasibility of leveraging language as a naturally high-quality supervision for chest CT imaging.
We bootstrap the understanding of 3D chest CT images by distilling chest-related diagnostic knowledge from an extensively pre-trained 2D X-ray expert model.
We train our model with over 12,000 pairs of chest CT images and radiology reports.
arXiv Detail & Related papers (2024-04-07T12:17:40Z) - UMedNeRF: Uncertainty-aware Single View Volumetric Rendering for Medical
Neural Radiance Fields [38.62191342903111]
We propose an Uncertainty-aware MedNeRF (UMedNeRF) network based on generated radiation fields.
We show the results of CT projection rendering with a single X-ray and compare our method with other methods based on generated radiation fields.
arXiv Detail & Related papers (2023-11-10T02:47:15Z) - Patched Diffusion Models for Unsupervised Anomaly Detection in Brain MRI [55.78588835407174]
We propose a method that reformulates the generation task of diffusion models as a patch-based estimation of healthy brain anatomy.
We evaluate our approach on data of tumors and multiple sclerosis lesions and demonstrate a relative improvement of 25.1% compared to existing baselines.
arXiv Detail & Related papers (2023-03-07T09:40:22Z) - Image Synthesis with Disentangled Attributes for Chest X-Ray Nodule
Augmentation and Detection [52.93342510469636]
Lung nodule detection in chest X-ray (CXR) images is common to early screening of lung cancers.
Deep-learning-based Computer-Assisted Diagnosis (CAD) systems can support radiologists for nodule screening in CXR.
To alleviate the limited availability of such datasets, lung nodule synthesis methods are proposed for the sake of data augmentation.
arXiv Detail & Related papers (2022-07-19T16:38:48Z) - BMD-GAN: Bone mineral density estimation using x-ray image decomposition
into projections of bone-segmented quantitative computed tomography using
hierarchical learning [1.8762753243053634]
We propose an approach using the QCT for training a generative adversarial network (GAN) and decomposing an x-ray image into a projection of bone-segmented QCT.
The evaluation of 200 patients with osteoarthritis using the proposed method demonstrated a Pearson correlation coefficient of 0.888 between the predicted and ground truth.
arXiv Detail & Related papers (2022-07-07T10:33:12Z) - Weakly-supervised Biomechanically-constrained CT/MRI Registration of the
Spine [72.85011943179894]
We propose a weakly-supervised deep learning framework that preserves the rigidity and the volume of each vertebra while maximizing the accuracy of the registration.
We specifically design these losses to depend only on the CT label maps since automatic vertebra segmentation in CT gives more accurate results contrary to MRI.
Our results show that adding the anatomy-aware losses increases the plausibility of the inferred transformation while keeping the accuracy untouched.
arXiv Detail & Related papers (2022-05-16T10:59:55Z) - Fast and Robust Femur Segmentation from Computed Tomography Images for
Patient-Specific Hip Fracture Risk Screening [48.46841573872642]
We propose a deep neural network for fully automated, accurate, and fast segmentation of the proximal femur from CT.
Our method is apt for hip-fracture risk screening, bringing us one step closer to a clinically viable option for screening at-risk patients for hip-fracture susceptibility.
arXiv Detail & Related papers (2022-04-20T16:16:16Z) - Breast Cancer Induced Bone Osteolysis Prediction Using Temporal
Variational Auto-Encoders [65.95959936242993]
We develop a deep learning framework that can accurately predict and visualize the progression of osteolytic bone lesions.
It will assist in planning and evaluating treatment strategies to prevent skeletal related events (SREs) in breast cancer patients.
arXiv Detail & Related papers (2022-03-20T21:00:10Z) - Semi-Supervised Learning for Bone Mineral Density Estimation in Hip
X-ray Images [19.17169803995019]
Bone mineral density is a clinically critical indicator of osteoporosis.
Due to the limited accessibility of DEXA machines and examinations, osteoporosis is often under-diagnosed and under-treated.
arXiv Detail & Related papers (2021-03-24T20:59:54Z) - Improved Slice-wise Tumour Detection in Brain MRIs by Computing
Dissimilarities between Latent Representations [68.8204255655161]
Anomaly detection for Magnetic Resonance Images (MRIs) can be solved with unsupervised methods.
We have proposed a slice-wise semi-supervised method for tumour detection based on the computation of a dissimilarity function in the latent space of a Variational AutoEncoder.
We show that by training the models on higher resolution images and by improving the quality of the reconstructions, we obtain results which are comparable with different baselines.
arXiv Detail & Related papers (2020-07-24T14:02:09Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.