Domain Specific Transporter Framework to Detect Fractures in Ultrasound
- URL: http://arxiv.org/abs/2106.05929v1
- Date: Wed, 9 Jun 2021 16:54:39 GMT
- Title: Domain Specific Transporter Framework to Detect Fractures in Ultrasound
- Authors: Arpan Tripathi, Abhilash Rakkunedeth, Mahesh Raveendranatha Panicker,
Jack Zhang, Naveenjyote Boora, Jacob Jaremko
- Abstract summary: We propose an unsupervised, domain specific transporter framework to identify relevant keypoints from wrist ultrasound scans.
Our framework provides a concise geometric representation highlighting regions with high structural variation in a 3D ultrasound sequence.
We validate the technique on 3DUS videos obtained from 30 subjects.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Ultrasound examination for detecting fractures is ideally suited for
Emergency Departments (ED) as it is relatively fast, safe (from ionizing
radiation), has dynamic imaging capability and is easily portable. High
interobserver variability in manual assessment of ultrasound scans has piqued
research interest in automatic assessment techniques using Deep Learning (DL).
Most DL techniques are supervised and are trained on large numbers of labeled
data which is expensive and requires many hours of careful annotation by
experts. In this paper, we propose an unsupervised, domain specific transporter
framework to identify relevant keypoints from wrist ultrasound scans. Our
framework provides a concise geometric representation highlighting regions with
high structural variation in a 3D ultrasound (3DUS) sequence. We also
incorporate domain specific information represented by instantaneous local
phase (LP) which detects bone features from 3DUS. We validate the technique on
3DUS videos obtained from 30 subjects. Each ultrasound scan was independently
assessed by three readers to identify fractures along with the corresponding
x-ray. Saliency of keypoints detected in the image\ are compared against manual
assessment based on distance from relevant features.The transporter neural
network was able to accurately detect 180 out of 250 bone regions sampled from
wrist ultrasound videos. We expect this technique to increase the applicability
of ultrasound in fracture detection.
Related papers
- Deep Spectral Methods for Unsupervised Ultrasound Image Interpretation [53.37499744840018]
This paper proposes a novel unsupervised deep learning strategy tailored to ultrasound to obtain easily interpretable tissue separations.
We integrate key concepts from unsupervised deep spectral methods, which combine spectral graph theory with deep learning methods.
We utilize self-supervised transformer features for spectral clustering to generate meaningful segments based on ultrasound-specific metrics and shape and positional priors, ensuring semantic consistency across the dataset.
arXiv Detail & Related papers (2024-08-04T14:30:14Z) - CathFlow: Self-Supervised Segmentation of Catheters in Interventional Ultrasound Using Optical Flow and Transformers [66.15847237150909]
We introduce a self-supervised deep learning architecture to segment catheters in longitudinal ultrasound images.
The network architecture builds upon AiAReSeg, a segmentation transformer built with the Attention in Attention mechanism.
We validated our model on a test dataset, consisting of unseen synthetic data and images collected from silicon aorta phantoms.
arXiv Detail & Related papers (2024-03-21T15:13:36Z) - AiAReSeg: Catheter Detection and Segmentation in Interventional
Ultrasound using Transformers [75.20925220246689]
endovascular surgeries are performed using the golden standard of Fluoroscopy, which uses ionising radiation to visualise catheters and vasculature.
This work proposes a solution using an adaptation of a state-of-the-art machine learning transformer architecture to detect and segment catheters in axial interventional Ultrasound image sequences.
arXiv Detail & Related papers (2023-09-25T19:34:12Z) - VertMatch: A Semi-supervised Framework for Vertebral Structure Detection
in 3D Ultrasound Volume [26.29675263407612]
Three-dimensional (3D) ultrasound imaging technique has been applied for scoliosis assessment.
Current assessment method only uses coronal projection image and cannot illustrate the 3D deformity and vertebra rotation.
We propose VertMatch, a two-step framework to detect vertebral structures in 3D ultrasound volume.
arXiv Detail & Related papers (2022-12-28T06:50:35Z) - Comparison of Representation Learning Techniques for Tracking in time
resolved 3D Ultrasound [0.7734726150561088]
3D ultrasound (3DUS) becomes more interesting for target tracking in radiation therapy due to its capability to provide volumetric images in real-time without using ionizing radiation.
For this, a method for learning meaningful representations would be useful to recognize anatomical structures in different time frames in representation space (r-space)
In this study, 3DUS patches are reduced into a 128-dimensional r-space using conventional autoencoder, variational autoencoder and sliced-wasserstein autoencoder.
arXiv Detail & Related papers (2022-01-10T12:38:22Z) - Voice-assisted Image Labelling for Endoscopic Ultrasound Classification
using Neural Networks [48.732863591145964]
We propose a multi-modal convolutional neural network architecture that labels endoscopic ultrasound (EUS) images from raw verbal comments provided by a clinician during the procedure.
Our results show a prediction accuracy of 76% at image level on a dataset with 5 different labels.
arXiv Detail & Related papers (2021-10-12T21:22:24Z) - Deep Learning for Ultrasound Beamforming [120.12255978513912]
Beamforming, the process of mapping received ultrasound echoes to the spatial image domain, lies at the heart of the ultrasound image formation chain.
Modern ultrasound imaging leans heavily on innovations in powerful digital receive channel processing.
Deep learning methods can play a compelling role in the digital beamforming pipeline.
arXiv Detail & Related papers (2021-09-23T15:15:21Z) - Physics Driven Domain Specific Transporter Framework with Attention
Mechanism for Ultrasound Imaging [0.0]
We propose an unsupervised, physics driven domain specific transporter framework with an attention mechanism to identify relevant key points with applications in ultrasound imaging.
The proposed framework identifies key points that provide a concise geometric representation highlighting regions with high structural variation in ultrasound videos.
arXiv Detail & Related papers (2021-09-13T22:11:22Z) - Assisted Probe Positioning for Ultrasound Guided Radiotherapy Using
Image Sequence Classification [55.96221340756895]
Effective transperineal ultrasound image guidance in prostate external beam radiotherapy requires consistent alignment between probe and prostate at each session during patient set-up.
We demonstrate a method for ensuring accurate probe placement through joint classification of images and probe position data.
Using a multi-input multi-task algorithm, spatial coordinate data from an optically tracked ultrasound probe is combined with an image clas-sifier using a recurrent neural network to generate two sets of predictions in real-time.
The algorithm identified optimal probe alignment within a mean (standard deviation) range of 3.7$circ$ (1.2$circ$) from
arXiv Detail & Related papers (2020-10-06T13:55:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.