Fast ultrasonic imaging using end-to-end deep learning
- URL: http://arxiv.org/abs/2009.02194v1
- Date: Fri, 4 Sep 2020 13:53:46 GMT
- Title: Fast ultrasonic imaging using end-to-end deep learning
- Authors: Georgios Pilikos, Lars Horchens, Kees Joost Batenburg, Tristan van
Leeuwen, Felix Lucka
- Abstract summary: Deep neural networks (DNNs) are being used for the data pre-processing and the image post-processing steps separately.
We propose a novel deep learning architecture that integrates all three steps to enable end-to-end training.
- Score: 1.0266286487433585
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Ultrasonic imaging algorithms used in many clinical and industrial
applications consist of three steps: A data pre-processing, an image formation
and an image post-processing step. For efficiency, image formation often relies
on an approximation of the underlying wave physics. A prominent example is the
Delay-And-Sum (DAS) algorithm used in reflectivity-based ultrasonic imaging.
Recently, deep neural networks (DNNs) are being used for the data
pre-processing and the image post-processing steps separately. In this work, we
propose a novel deep learning architecture that integrates all three steps to
enable end-to-end training. We examine turning the DAS image formation method
into a network layer that connects data pre-processing layers with image
post-processing layers that perform segmentation. We demonstrate that this
integrated approach clearly outperforms sequential approaches that are trained
separately. While network training and evaluation is performed only on
simulated data, we also showcase the potential of our approach on real data
from a non-destructive testing scenario.
Related papers
- Experimental Validation of Ultrasound Beamforming with End-to-End Deep Learning for Single Plane Wave Imaging [0.810120481608724]
Ultrafast ultrasound imaging insonifies a medium with one or a combination of a few plane waves at different beam-steered angles instead of many focused waves.
Deep learning approaches have been proposed to mitigate this disadvantage, in particular for single plane wave imaging.
We consider data-to-image networks which incorporate a conventional image formation techniques as differentiable layers in the network architecture.
arXiv Detail & Related papers (2024-04-22T13:58:36Z) - Disruptive Autoencoders: Leveraging Low-level features for 3D Medical
Image Pre-training [51.16994853817024]
This work focuses on designing an effective pre-training framework for 3D radiology images.
We introduce Disruptive Autoencoders, a pre-training framework that attempts to reconstruct the original image from disruptions created by a combination of local masking and low-level perturbations.
The proposed pre-training framework is tested across multiple downstream tasks and achieves state-of-the-art performance.
arXiv Detail & Related papers (2023-07-31T17:59:42Z) - Unsupervised Domain Transfer with Conditional Invertible Neural Networks [83.90291882730925]
We propose a domain transfer approach based on conditional invertible neural networks (cINNs)
Our method inherently guarantees cycle consistency through its invertible architecture, and network training can efficiently be conducted with maximum likelihood.
Our method enables the generation of realistic spectral data and outperforms the state of the art on two downstream classification tasks.
arXiv Detail & Related papers (2023-03-17T18:00:27Z) - Label-Free Synthetic Pretraining of Object Detectors [67.17371526567325]
We propose a new approach, Synthetic optimized layout with Instance Detection (SOLID), to pretrain object detectors with synthetic images.
Our "SOLID" approach consists of two main components: (1) generating synthetic images using a collection of unlabelled 3D models with optimized scene arrangement; (2) pretraining an object detector on "instance detection" task.
Our approach does not need any semantic labels for pretraining and allows the use of arbitrary, diverse 3D models.
arXiv Detail & Related papers (2022-08-08T16:55:17Z) - Is Deep Image Prior in Need of a Good Education? [57.3399060347311]
Deep image prior was introduced as an effective prior for image reconstruction.
Despite its impressive reconstructive properties, the approach is slow when compared to learned or traditional reconstruction techniques.
We develop a two-stage learning paradigm to address the computational challenge.
arXiv Detail & Related papers (2021-11-23T15:08:26Z) - Single Plane-Wave Imaging using Physics-Based Deep Learning [2.1410799064827226]
In plane-wave imaging, multiple unfocused ultrasound waves are transmitted into a medium of interest from different angles.
Deep learning methods have been proposed to improve ultrasound imaging.
We propose a data-to-image architecture that incorporates a wave-physics-based image formation algorithm in-between deep convolutional neural networks.
arXiv Detail & Related papers (2021-09-08T14:06:29Z) - Deep Learning for Multi-View Ultrasonic Image Fusion [2.1410799064827226]
Delay-And-Sum (DAS) algorithm forms images using the main path on which reflected signals travel back to transducers.
Traditional image fusion techniques typically use ad-hoc combinations of pre-defined image transforms, pooling operations and thresholding.
We propose a deep neural network architecture that directly maps all available data to a segmentation map while explicitly incorporating the DAS image formation for the different insonification paths as network layers.
arXiv Detail & Related papers (2021-09-08T13:04:07Z) - Two-shot Spatially-varying BRDF and Shape Estimation [89.29020624201708]
We propose a novel deep learning architecture with a stage-wise estimation of shape and SVBRDF.
We create a large-scale synthetic training dataset with domain-randomized geometry and realistic materials.
Experiments on both synthetic and real-world datasets show that our network trained on a synthetic dataset can generalize well to real-world images.
arXiv Detail & Related papers (2020-04-01T12:56:13Z) - Subset Sampling For Progressive Neural Network Learning [106.12874293597754]
Progressive Neural Network Learning is a class of algorithms that incrementally construct the network's topology and optimize its parameters based on the training data.
We propose to speed up this process by exploiting subsets of training data at each incremental training step.
Experimental results in object, scene and face recognition problems demonstrate that the proposed approach speeds up the optimization procedure considerably.
arXiv Detail & Related papers (2020-02-17T18:57:33Z) - Extracting dispersion curves from ambient noise correlations using deep
learning [1.0237120900821557]
We present a machine-learning approach to classifying the phases of surface wave dispersion curves.
Standard FTAN analysis of surfaces observed on an array of receivers is converted to an image.
We use a convolutional neural network (U-net) architecture with a supervised learning objective and incorporate transfer learning.
arXiv Detail & Related papers (2020-02-05T23:41:12Z) - RDAnet: A Deep Learning Based Approach for Synthetic Aperture Radar
Image Formation [0.0]
We train a deep neural network that performs both the image formation and image processing tasks, integrating the SAR processing pipeline.
Results show that our integrated pipeline can output accurately classified SAR imagery with image quality comparable to those formed using a traditional algorithm.
arXiv Detail & Related papers (2020-01-22T18:44:40Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.