Non-Photorealistic Rendering of Layered Materials: A Multispectral
Approach
- URL: http://arxiv.org/abs/2109.00780v1
- Date: Thu, 2 Sep 2021 08:40:05 GMT
- Title: Non-Photorealistic Rendering of Layered Materials: A Multispectral
Approach
- Authors: Corey Toler-Franklin and Shashank Ranjan
- Abstract summary: We present multispectral rendering techniques for visualizing layered materials found in biological specimens.
We are the first to use acquired data from the near-infrared and ultraviolet spectra for non-photorealistic rendering (NPR)
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We present multispectral rendering techniques for visualizing layered
materials found in biological specimens. We are the first to use acquired data
from the near-infrared and ultraviolet spectra for non-photorealistic rendering
(NPR). Several plant and animal species are more comprehensively understood by
multispectral analysis. However, traditional NPR techniques ignore unique
information outside the visible spectrum. We introduce algorithms and
principles for processing wavelength dependent surface normals and reflectance.
Our registration and feature detection methods are used to formulate
stylization effects not considered by current NPR methods including: Spectral
Band Shading which isolates and emphasizes shape features at specific
wavelengths at multiple scales. Experts in our user study demonstrate the
effectiveness of our system for applications in the biological sciences.
Related papers
- Hyperspectral Dataset and Deep Learning methods for Waste from Electric and Electronic Equipment Identification (WEEE) [0.0]
We evaluate the performance of diverse deep learning architectures for hyperspectral image segmentation.
Results show that incorporating spatial information alongside spectral data leads to improved segmentation results.
We contribute to the field by cleaning and publicly releasing the Tecnalia WEEE Hyperspectral dataset.
arXiv Detail & Related papers (2024-07-05T13:45:11Z) - SpectralNeRF: Physically Based Spectral Rendering with Neural Radiance
Field [70.15900280156262]
We propose an end-to-end Neural Radiance Field (NeRF)-based architecture for high-quality physically based rendering from a novel spectral perspective.
SpectralNeRF is superior to recent NeRF-based methods when synthesizing new views on synthetic and real datasets.
arXiv Detail & Related papers (2023-12-14T07:19:31Z) - Spec-NeRF: Multi-spectral Neural Radiance Fields [9.242830798112855]
We propose Multi-spectral Neural Radiance Fields(Spec-NeRF) for jointly reconstructing a multispectral radiance field and spectral sensitivity functions(SSFs) of the camera from a set of color images filtered by different filters.
Our experiments on both synthetic and real scenario datasets demonstrate that utilizing filtered RGB images with learnable NeRF and SSFs can achieve high fidelity and promising spectral reconstruction.
arXiv Detail & Related papers (2023-09-14T16:17:55Z) - NeuralMPS: Non-Lambertian Multispectral Photometric Stereo via Spectral
Reflectance Decomposition [47.5182946590776]
We propose a deep neural network named NeuralMPS to solve the MPS problem under general non-Lambertian spectral reflectances.
We show that the MPS problem for surfaces with a uniform material is equivalent to the conventional photometric stereo(CPS) with unknown light intensities.
arXiv Detail & Related papers (2022-11-28T13:46:17Z) - Toward deep-learning-assisted spectrally-resolved imaging of magnetic
noise [52.77024349608834]
We implement a deep neural network to efficiently reconstruct the spectral density of the underlying fluctuating magnetic field.
These results create opportunities for the application of machine-learning methods to color-center-based nanoscale sensing and imaging.
arXiv Detail & Related papers (2022-08-01T19:18:26Z) - Exploring the Asynchronous of the Frequency Spectra of GAN-generated
Facial Images [19.126496628073376]
We propose a new approach that explores the asynchronous frequency spectra of color channels, which is simple but effective for training both unsupervised and supervised learning models to distinguish GAN-based synthetic images.
Our experimental results show that the discrepancy of spectra in the frequency domain is a practical artifact to effectively detect various types of GAN-based generated images.
arXiv Detail & Related papers (2021-12-15T11:34:11Z) - Cross-Spectral Periocular Recognition with Conditional Adversarial
Networks [59.17685450892182]
We propose Conditional Generative Adversarial Networks, trained to con-vert periocular images between visible and near-infrared spectra.
We obtain a cross-spectral periocular performance of EER=1%, and GAR>99% @ FAR=1%, which is comparable to the state-of-the-art with the PolyU database.
arXiv Detail & Related papers (2020-08-26T15:02:04Z) - Data-Driven Discovery of Molecular Photoswitches with Multioutput
Gaussian Processes [51.17758371472664]
Photoswitchable molecules display two or more isomeric forms that may be accessed using light.
We present a data-driven discovery pipeline for molecular photoswitches underpinned by dataset curation and multitask learning.
We validate our proposed approach experimentally by screening a library of commercially available photoswitchable molecules.
arXiv Detail & Related papers (2020-06-28T20:59:03Z) - A Review of 1D Convolutional Neural Networks toward Unknown Substance
Identification in Portable Raman Spectrometer [0.0]
Raman spectroscopy is a powerful analytical tool with applications ranging from quality control to cutting edge biomedical research.
They have been adopted widely by first responders and law enforcement agencies for the field analysis of unknown substances.
Field detection and identification of unknown substances with Raman spectroscopy rely heavily on the spectral matching capability of the devices on hand.
arXiv Detail & Related papers (2020-06-18T14:28:00Z) - Hyperspectral-Multispectral Image Fusion with Weighted LASSO [68.04032419397677]
We propose an approach for fusing hyperspectral and multispectral images to provide high-quality hyperspectral output.
We demonstrate that the proposed sparse fusion and reconstruction provides quantitatively superior results when compared to existing methods on publicly available images.
arXiv Detail & Related papers (2020-03-15T23:07:56Z) - Hyperspectral Infrared Microscopy With Visible Light [0.4893345190925178]
We introduce a new approach to IR hyperspectral microscopy, where the IR spectral map of the sample is obtained with off-the-shelf components built for visible light.
The technique provides a wide field of view, fast readout, and negligible heat delivered to the sample, which makes it highly relevant to material and biological applications.
arXiv Detail & Related papers (2020-02-14T10:29:32Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.