Hyperspectral Image Segmentation: A Preliminary Study on the Oral and
Dental Spectral Image Database (ODSI-DB)
- URL: http://arxiv.org/abs/2303.08252v1
- Date: Tue, 14 Mar 2023 21:57:11 GMT
- Title: Hyperspectral Image Segmentation: A Preliminary Study on the Oral and
Dental Spectral Image Database (ODSI-DB)
- Authors: Luis C. Garcia-Peraza-Herrera, Conor Horgan, Sebastien Ourselin,
Michael Ebner, Tom Vercauteren
- Abstract summary: Hyperspectral imaging (HSI) is a promising technology providing rich spectral information.
Recent development of snapshot HSI cameras has made real-time clinical HSI a distinct possibility.
Our work highlights the relative importance of spectral resolution, spectral range, and spatial information to both guide the development of HSI cameras and inform future clinical HSI applications.
- Score: 3.1993890965689666
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Visual discrimination of clinical tissue types remains challenging, with
traditional RGB imaging providing limited contrast for such tasks.
Hyperspectral imaging (HSI) is a promising technology providing rich spectral
information that can extend far beyond three-channel RGB imaging. Moreover,
recently developed snapshot HSI cameras enable real-time imaging with
significant potential for clinical applications. Despite this, the
investigation into the relative performance of HSI over RGB imaging for
semantic segmentation purposes has been limited, particularly in the context of
medical imaging. Here we compare the performance of state-of-the-art deep
learning image segmentation methods when trained on hyperspectral images, RGB
images, hyperspectral pixels (minus spatial context), and RGB pixels
(disregarding spatial context). To achieve this, we employ the recently
released Oral and Dental Spectral Image Database (ODSI-DB), which consists of
215 manually segmented dental reflectance spectral images with 35 different
classes across 30 human subjects. The recent development of snapshot HSI
cameras has made real-time clinical HSI a distinct possibility, though
successful application requires a comprehensive understanding of the additional
information HSI offers. Our work highlights the relative importance of spectral
resolution, spectral range, and spatial information to both guide the
development of HSI cameras and inform future clinical HSI applications.
Related papers
- Hyperspectral Dataset and Deep Learning methods for Waste from Electric and Electronic Equipment Identification (WEEE) [0.0]
We evaluate the performance of diverse deep learning architectures for hyperspectral image segmentation.
Results show that incorporating spatial information alongside spectral data leads to improved segmentation results.
We contribute to the field by cleaning and publicly releasing the Tecnalia WEEE Hyperspectral dataset.
arXiv Detail & Related papers (2024-07-05T13:45:11Z) - Equivariant Imaging for Self-supervised Hyperspectral Image Inpainting [6.099927091387616]
We introduce a novel HSI inpainting algorithm called Hyperspectral Equivariant Imaging (Hyper-EI)
Results show that the proposed method achieves state-of-the-art inpainting performance compared to the existing methods.
arXiv Detail & Related papers (2024-04-19T19:55:15Z) - Object Detection in Hyperspectral Image via Unified Spectral-Spatial
Feature Aggregation [55.9217962930169]
We present S2ADet, an object detector that harnesses the rich spectral and spatial complementary information inherent in hyperspectral images.
S2ADet surpasses existing state-of-the-art methods, achieving robust and reliable results.
arXiv Detail & Related papers (2023-06-14T09:01:50Z) - OADAT: Experimental and Synthetic Clinical Optoacoustic Data for
Standardized Image Processing [62.993663757843464]
Optoacoustic (OA) imaging is based on excitation of biological tissues with nanosecond-duration laser pulses followed by detection of ultrasound waves generated via light-absorption-mediated thermoelastic expansion.
OA imaging features a powerful combination between rich optical contrast and high resolution in deep tissues.
No standardized datasets generated with different types of experimental set-up and associated processing methods are available to facilitate advances in broader applications of OA in clinical settings.
arXiv Detail & Related papers (2022-06-17T08:11:26Z) - Hyperspectral Image Segmentation based on Graph Processing over
Multilayer Networks [51.15952040322895]
One important task of hyperspectral image (HSI) processing is the extraction of spectral-spatial features.
We propose several approaches to HSI segmentation based on M-GSP feature extraction.
Our experimental results demonstrate the strength of M-GSP in HSI processing and spectral-spatial information extraction.
arXiv Detail & Related papers (2021-11-29T23:28:18Z) - Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image
Reconstruction [127.20208645280438]
Hyperspectral image (HSI) reconstruction aims to recover the 3D spatial-spectral signal from a 2D measurement.
Modeling the inter-spectra interactions is beneficial for HSI reconstruction.
Mask-guided Spectral-wise Transformer (MST) proposes a novel framework for HSI reconstruction.
arXiv Detail & Related papers (2021-11-15T16:59:48Z) - Robust deep learning-based semantic organ segmentation in hyperspectral
images [29.342448910787773]
Full-scene semantic segmentation based on spectral imaging data and obtained during open surgery has received almost no attention to date.
We are investigating the following research questions based on hyperspectral imaging (HSI) data of pigs acquired in an open surgery setting.
We conclude that HSI could become a powerful image modality for fully-automatic surgical scene understanding.
arXiv Detail & Related papers (2021-11-09T20:37:38Z) - Deep-learning-based Hyperspectral imaging through a RGB camera [6.931572045689959]
Hyperspectral image (HSI) contains both spatial pattern and spectral information which has been widely used in food safety, remote sensing, and medical detection.
Recently, it has been reported that HSI can be reconstructed from single RGB image using convolution neural network (CNN) algorithms.
In this study, we focused on the influence of the RGB camera spectral sensitivity (CSS) on the HSI.
arXiv Detail & Related papers (2021-07-12T04:23:25Z) - Hyperspectral Image Super-Resolution with Spectral Mixup and
Heterogeneous Datasets [99.92564298432387]
This work studies Hyperspectral image (HSI) super-resolution (SR)
HSI SR is characterized by high-dimensional data and a limited amount of training examples.
This exacerbates the undesirable behaviors of neural networks such as memorization and sensitivity to out-of-distribution samples.
arXiv Detail & Related papers (2021-01-19T12:19:53Z) - Fast Hyperspectral Image Recovery via Non-iterative Fusion of
Dual-Camera Compressive Hyperspectral Imaging [22.683482662362337]
Coded aperture snapshot spectral imaging (CASSI) is a promising technique to capture the three-dimensional hyperspectral image (HSI)
Various regularizers have been exploited to reconstruct the 3D data from the 2D measurement.
One feasible solution is to utilize additional information such as the RGB measurement in CASSI.
arXiv Detail & Related papers (2020-12-30T10:29:32Z) - Learning Spatial-Spectral Prior for Super-Resolution of Hyperspectral
Imagery [79.69449412334188]
In this paper, we investigate how to adapt state-of-the-art residual learning based single gray/RGB image super-resolution approaches.
We introduce a spatial-spectral prior network (SSPN) to fully exploit the spatial information and the correlation between the spectra of the hyperspectral data.
Experimental results on some hyperspectral images demonstrate that the proposed SSPSR method enhances the details of the recovered high-resolution hyperspectral images.
arXiv Detail & Related papers (2020-05-18T14:25:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.