The hybrid approach -- Convolutional Neural Networks and Expectation Maximization Algorithm -- for Tomographic Reconstruction of Hyperspectral Images

• URL: http://arxiv.org/abs/2205.15772v1
• Date: Tue, 31 May 2022 13:22:02 GMT
• Title: The hybrid approach -- Convolutional Neural Networks and Expectation Maximization Algorithm -- for Tomographic Reconstruction of Hyperspectral Images
• Abstract summary: We present a simple but novel hybrid approach to hyperspectral data cube reconstruction from computed tomography imaging spectrometry (CTIS) images. We train and test the ability of the method to reconstruct data cubes of $100times100times25$ and $100times100times100$ voxels, corresponding to 25 and 100 spectral channels, from simulated CTIS images.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We present a simple but novel hybrid approach to hyperspectral data cube reconstruction from computed tomography imaging spectrometry (CTIS) images that sequentially combines neural networks and the iterative Expectation Maximization (EM) algorithm. We train and test the ability of the method to reconstruct data cubes of $100\times100\times25$ and $100\times100\times100$ voxels, corresponding to 25 and 100 spectral channels, from simulated CTIS images generated by our CTIS simulator. The hybrid approach utilizes the inherent strength of the Convolutional Neural Network (CNN) with regard to noise and its ability to yield consistent reconstructions and make use of the EM algorithm's ability to generalize to spectral images of any object without training. The hybrid approach achieves better performance than both the CNNs and EM alone for seen (included in CNN training) and unseen (excluded from CNN training) cubes for both the 25- and 100-channel cases. For the 25 spectral channels, the improvements from CNN to the hybrid model (CNN + EM) in terms of the mean-squared errors are between 14-26%. For 100 spectral channels, the improvements between 19-40% are attained with the largest improvement of 40% for the unseen data, to which the CNNs are not exposed during the training.

Related papers

• NeRF-based CBCT Reconstruction needs Normalization and Initialization [53.58395475423445]
  NeRF-based methods suffer from a local-global training mismatch between their two key components: the hash encoder and the neural network.<n>We introduce a Normalized Hash, which enhances feature consistency and mitigates the mismatch.<n>The neural network exhibits improved stability during early training, enabling faster convergence and enhanced reconstruction performance.
  arXiv  Detail & Related papers  (2025-06-24T16:01:45Z)
• HybridAugment++: Unified Frequency Spectra Perturbations for Model Robustness [9.62543698736491]
  Convolutional Neural Networks (CNN) are known to exhibit poor generalization performance under distribution shifts. We propose a simple yet effective data augmentation method HybridAugment that reduces the reliance of CNNs on high-frequency components. Second, we propose HybridAugment++, which is a hierarchical augmentation method that attempts to unify various frequency-spectrum augmentations.
  arXiv  Detail & Related papers  (2023-07-21T18:00:23Z)
• Attention-based Feature Compression for CNN Inference Offloading in Edge Computing [93.67044879636093]
  This paper studies the computational offloading of CNN inference in device-edge co-inference systems. We propose a novel autoencoder-based CNN architecture (AECNN) for effective feature extraction at end-device. Experiments show that AECNN can compress the intermediate data by more than 256x with only about 4% accuracy loss.
  arXiv  Detail & Related papers  (2022-11-24T18:10:01Z)
• Decoupled Mixup for Generalized Visual Recognition [71.13734761715472]
  We propose a novel "Decoupled-Mixup" method to train CNN models for visual recognition. Our method decouples each image into discriminative and noise-prone regions, and then heterogeneously combines these regions to train CNN models. Experiment results show the high generalization performance of our method on testing data that are composed of unseen contexts.
  arXiv  Detail & Related papers  (2022-10-26T15:21:39Z)
• A heterogeneous group CNN for image super-resolution [127.2132400582117]
  Convolutional neural networks (CNNs) have obtained remarkable performance via deep architectures. We present a heterogeneous group SR CNN (HGSRCNN) via leveraging structure information of different types to obtain a high-quality image.
  arXiv  Detail & Related papers  (2022-09-26T04:14:59Z)
• Stable Parallel Training of Wasserstein Conditional Generative Adversarial Neural Networks [0.0]
  We propose a stable, parallel approach to train Conditional Generative Adversarial Neural Networks (W-CGANs) under the constraint of a fixed computational budget. We illustrate the approach on the CIFAR10, CIFAR100, and ImageNet1k datasets. Performance is assessed in terms of scalability and final accuracy within a limited fixed computational time and computational resources.
  arXiv  Detail & Related papers  (2022-07-25T16:30:40Z)
• Automatic Machine Learning for Multi-Receiver CNN Technology Classifiers [16.244541005112747]
  Convolutional Neural Networks (CNNs) are one of the most studied family of deep learning models for signal classification. We focus on technology classification based on raw I/Q samples collected from multiple synchronized receivers.
  arXiv  Detail & Related papers  (2022-04-28T23:41:38Z)
• Transformed CNNs: recasting pre-trained convolutional layers with self-attention [17.96659165573821]
  Vision Transformers (ViT) have emerged as a powerful alternative to convolutional networks (CNNs) In this work, we explore the idea of reducing the time spent training these layers by initializing them as convolutional layers. With only 50 epochs of fine-tuning, the resulting T-CNNs demonstrate significant performance gains.
  arXiv  Detail & Related papers  (2021-06-10T14:56:10Z)
• Evolving Deep Convolutional Neural Network by Hybrid Sine-Cosine and Extreme Learning Machine for Real-time COVID19 Diagnosis from X-Ray Images [0.5249805590164902]
  Deep Convolutional Networks (CNNs) can be considered as applicable tools to diagnose COVID19 positive cases. This paper proposes using the Extreme Learning Machine (ELM) instead of the last fully connected layer to address this deficiency. The proposed approach outperforms comparative benchmarks with a final accuracy of 98.83% on the COVID-Xray-5k dataset.
  arXiv  Detail & Related papers  (2021-05-14T19:40:16Z)
• Fast and accurate learned multiresolution dynamical downscaling for precipitation [0.9786690381850356]
  We use combination of low- and high- resolution simulations to train a neural network to map from the former to the latter. We train each CNN type both with a conventional loss function, such as mean square error (MSE) and with a conditional generative adversarial network (CGAN) We compare the four new CNN-derived high-resolution precipitation results with precipitation generated from original high resolution simulations, a bilinear interpolater and the state-of-the-art CNN-based super-resolution (SR) technique.
  arXiv  Detail & Related papers  (2021-01-18T00:25:04Z)
• Exploring Deep Hybrid Tensor-to-Vector Network Architectures for Regression Based Speech Enhancement [53.47564132861866]
  We find that a hybrid architecture, namely CNN-TT, is capable of maintaining a good quality performance with a reduced model parameter size. CNN-TT is composed of several convolutional layers at the bottom for feature extraction to improve speech quality.
  arXiv  Detail & Related papers  (2020-07-25T22:21:05Z)
• Curriculum By Smoothing [52.08553521577014]
  Convolutional Neural Networks (CNNs) have shown impressive performance in computer vision tasks such as image classification, detection, and segmentation. We propose an elegant curriculum based scheme that smoothes the feature embedding of a CNN using anti-aliasing or low-pass filters. As the amount of information in the feature maps increases during training, the network is able to progressively learn better representations of the data.
  arXiv  Detail & Related papers  (2020-03-03T07:27:44Z)
• Model Fusion via Optimal Transport [64.13185244219353]
  We present a layer-wise model fusion algorithm for neural networks. We show that this can successfully yield "one-shot" knowledge transfer between neural networks trained on heterogeneous non-i.i.d. data.
  arXiv  Detail & Related papers  (2019-10-12T22:07:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.