Spectral2Spectral: Image-spectral Similarity Assisted Spectral CT Deep
Reconstruction without Reference
- URL: http://arxiv.org/abs/2210.01125v3
- Date: Thu, 16 Nov 2023 07:48:30 GMT
- Title: Spectral2Spectral: Image-spectral Similarity Assisted Spectral CT Deep
Reconstruction without Reference
- Authors: Xiaodong Guo, Longhui Li, Dingyue Chang, Peng He, Peng Feng, Hengyong
Yu, Weiwen Wu
- Abstract summary: We propose an iterative deep reconstruction network to synergize unsupervised method and data priors into a unified framework, named as Spectral2Spectral.
Our Spectral2Spectral employs an unsupervised deep training strategy to obtain high-quality images from noisy data in an end-to-end fashion.
Three large-scale preclinical datasets experiments demonstrate that the Spectral2spectral reconstructs better image quality than other the state-of-the-art methods.
- Score: 5.109423491004876
- License: http://creativecommons.org/publicdomain/zero/1.0/
- Abstract: Spectral computed tomography based on a photon-counting detector (PCD)
attracts more and more attentions since it has the capability to provide more
accurate identification and quantitative analysis for biomedical materials. The
limited number of photons within narrow energy bins leads to imaging results of
low signal-noise ratio. The existing supervised deep reconstruction networks
for CT reconstruction are difficult to address these challenges because it is
usually impossible to acquire noise-free clinical images with clear structures
as references. In this paper, we propose an iterative deep reconstruction
network to synergize unsupervised method and data priors into a unified
framework, named as Spectral2Spectral. Our Spectral2Spectral employs an
unsupervised deep training strategy to obtain high-quality images from noisy
data in an end-to-end fashion. The structural similarity prior within
image-spectral domain is refined as a regularization term to further constrain
the network training. The weights of neural network are automatically updated
to capture image features and structures within the iterative process. Three
large-scale preclinical datasets experiments demonstrate that the
Spectral2spectral reconstructs better image quality than other the
state-of-the-art methods.
Related papers
- Deep Spectral Methods for Unsupervised Ultrasound Image Interpretation [53.37499744840018]
This paper proposes a novel unsupervised deep learning strategy tailored to ultrasound to obtain easily interpretable tissue separations.
We integrate key concepts from unsupervised deep spectral methods, which combine spectral graph theory with deep learning methods.
We utilize self-supervised transformer features for spectral clustering to generate meaningful segments based on ultrasound-specific metrics and shape and positional priors, ensuring semantic consistency across the dataset.
arXiv Detail & Related papers (2024-08-04T14:30:14Z) - Unsupervised denoising for sparse multi-spectral computed tomography [2.969056717104372]
We investigate the suitability of learning-based improvements to the challenging task of obtaining high-quality reconstructions from sparse measurements for a 64-channel PCD-CT.
We propose an unsupervised denoising and artefact removal approach by exploiting different filter functions in the reconstruction and an explicit coupling of spectral channels with the nuclear norm.
arXiv Detail & Related papers (2022-11-02T14:36:24Z) - OADAT: Experimental and Synthetic Clinical Optoacoustic Data for
Standardized Image Processing [62.993663757843464]
Optoacoustic (OA) imaging is based on excitation of biological tissues with nanosecond-duration laser pulses followed by detection of ultrasound waves generated via light-absorption-mediated thermoelastic expansion.
OA imaging features a powerful combination between rich optical contrast and high resolution in deep tissues.
No standardized datasets generated with different types of experimental set-up and associated processing methods are available to facilitate advances in broader applications of OA in clinical settings.
arXiv Detail & Related papers (2022-06-17T08:11:26Z) - Multi-scale reconstruction of undersampled spectral-spatial OCT data for
coronary imaging using deep learning [1.8359410255568984]
Intravascular optical coherence tomography (IV OCT) has been considered as an optimal imagining system for the diagnosis and treatment of coronary artery disease (CAD)
There is a trade-off between high spatial resolution and fast scanning rate for coronary imaging.
We propose a viable spectral-spatial acquisition method that down-scales the sampling process in both spectral and spatial domain.
arXiv Detail & Related papers (2022-04-25T16:37:25Z) - Sharp-GAN: Sharpness Loss Regularized GAN for Histopathology Image
Synthesis [65.47507533905188]
Conditional generative adversarial networks have been applied to generate synthetic histopathology images.
We propose a sharpness loss regularized generative adversarial network to synthesize realistic histopathology images.
arXiv Detail & Related papers (2021-10-27T18:54:25Z) - The Application of Convolutional Neural Networks for Tomographic
Reconstruction of Hyperspectral Images [0.0]
A novel method, utilizing convolutional neural networks (CNNs), is proposed to reconstruct hyperspectral cubes from computed imaging spectrometer (CTIS) images.
CNNs deliver higher precision and shorter reconstruction time than a standard expectation algorithm.
arXiv Detail & Related papers (2021-08-30T18:11:08Z) - SpectralFormer: Rethinking Hyperspectral Image Classification with
Transformers [91.09957836250209]
Hyperspectral (HS) images are characterized by approximately contiguous spectral information.
CNNs have been proven to be a powerful feature extractor in HS image classification.
We propose a novel backbone network called ulSpectralFormer for HS image classification.
arXiv Detail & Related papers (2021-07-07T02:59:21Z) - Adaptive Gradient Balancing for UndersampledMRI Reconstruction and
Image-to-Image Translation [60.663499381212425]
We enhance the image quality by using a Wasserstein Generative Adversarial Network combined with a novel Adaptive Gradient Balancing technique.
In MRI, our method minimizes artifacts, while maintaining a high-quality reconstruction that produces sharper images than other techniques.
arXiv Detail & Related papers (2021-04-05T13:05:22Z) - Neural network-based image reconstruction in swept-source optical
coherence tomography using undersampled spectral data [0.0]
This framework can generate swept-source OCT images using undersampled spectral data, without any spatial aliasing artifacts.
It can be easily integrated with existing swept-source or spectral domain OCT systems.
This deep learning-enabled image reconstruction approach can be broadly used in various forms of spectral domain OCT systems.
arXiv Detail & Related papers (2021-03-04T22:30:31Z) - Prediction of low-keV monochromatic images from polyenergetic CT scans
for improved automatic detection of pulmonary embolism [21.47219330040151]
We are training convolutional neural networks that can emulate the generation of monoE images from conventional single energy CT acquisitions.
We expand on these methods through the use of a multi-task optimization approach, under which the networks achieve improved classification as well as generation results.
arXiv Detail & Related papers (2021-02-02T11:42:31Z) - Spectral Analysis Network for Deep Representation Learning and Image
Clustering [53.415803942270685]
This paper proposes a new network structure for unsupervised deep representation learning based on spectral analysis.
It can identify the local similarities among images in patch level and thus more robust against occlusion.
It can learn more clustering-friendly representations and is capable to reveal the deep correlations among data samples.
arXiv Detail & Related papers (2020-09-11T05:07:15Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.