Non-Photorealistic Rendering of Layered Materials: A Multispectral Approach

• URL: http://arxiv.org/abs/2109.00780v1
• Date: Thu, 2 Sep 2021 08:40:05 GMT
• Title: Non-Photorealistic Rendering of Layered Materials: A Multispectral Approach
• Authors: Corey Toler-Franklin and Shashank Ranjan
• Abstract summary: We present multispectral rendering techniques for visualizing layered materials found in biological specimens. We are the first to use acquired data from the near-infrared and ultraviolet spectra for non-photorealistic rendering (NPR)
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present multispectral rendering techniques for visualizing layered materials found in biological specimens. We are the first to use acquired data from the near-infrared and ultraviolet spectra for non-photorealistic rendering (NPR). Several plant and animal species are more comprehensively understood by multispectral analysis. However, traditional NPR techniques ignore unique information outside the visible spectrum. We introduce algorithms and principles for processing wavelength dependent surface normals and reflectance. Our registration and feature detection methods are used to formulate stylization effects not considered by current NPR methods including: Spectral Band Shading which isolates and emphasizes shape features at specific wavelengths at multiple scales. Experts in our user study demonstrate the effectiveness of our system for applications in the biological sciences.

Related papers

• Physics-Free Spectrally Multiplexed Photometric Stereo under Unknown Spectral Composition [10.620997969499205]
  We present a groundbreaking spectrally multiplexed photometric stereo approach for recovering surface normals without the need for calibrated lighting or sensors. By embracing spectral ambiguity as an advantage, our technique enables the generation of training data without specialized multispectral rendering frameworks. We introduce a unique, physics-free network architecture, SpectraM-PS, that effectively processes multiplexed images to determine surface normals.
  arXiv  Detail & Related papers  (2024-10-28T04:03:37Z)
• Deep Learning Based Speckle Filtering for Polarimetric SAR Images. Application to Sentinel-1 [51.404644401997736]
  We propose a complete framework to remove speckle in polarimetric SAR images using a convolutional neural network. Experiments show that the proposed approach offers exceptional results in both speckle reduction and resolution preservation.
  arXiv  Detail & Related papers  (2024-08-28T10:07:17Z)
• Hyperspectral Dataset and Deep Learning methods for Waste from Electric and Electronic Equipment Identification (WEEE) [0.0]
  We evaluate the performance of diverse deep learning architectures for hyperspectral image segmentation. Results show that incorporating spatial information alongside spectral data leads to improved segmentation results. We contribute to the field by cleaning and publicly releasing the Tecnalia WEEE Hyperspectral dataset.
  arXiv  Detail & Related papers  (2024-07-05T13:45:11Z)
• SpectralNeRF: Physically Based Spectral Rendering with Neural Radiance Field [70.15900280156262]
  We propose an end-to-end Neural Radiance Field (NeRF)-based architecture for high-quality physically based rendering from a novel spectral perspective. SpectralNeRF is superior to recent NeRF-based methods when synthesizing new views on synthetic and real datasets.
  arXiv  Detail & Related papers  (2023-12-14T07:19:31Z)
• Spec-NeRF: Multi-spectral Neural Radiance Fields [9.242830798112855]
  We propose Multi-spectral Neural Radiance Fields(Spec-NeRF) for jointly reconstructing a multispectral radiance field and spectral sensitivity functions(SSFs) of the camera from a set of color images filtered by different filters. Our experiments on both synthetic and real scenario datasets demonstrate that utilizing filtered RGB images with learnable NeRF and SSFs can achieve high fidelity and promising spectral reconstruction.
  arXiv  Detail & Related papers  (2023-09-14T16:17:55Z)
• NeuralMPS: Non-Lambertian Multispectral Photometric Stereo via Spectral Reflectance Decomposition [47.5182946590776]
  We propose a deep neural network named NeuralMPS to solve the MPS problem under general non-Lambertian spectral reflectances. We show that the MPS problem for surfaces with a uniform material is equivalent to the conventional photometric stereo(CPS) with unknown light intensities.
  arXiv  Detail & Related papers  (2022-11-28T13:46:17Z)
• Toward deep-learning-assisted spectrally-resolved imaging of magnetic noise [52.77024349608834]
  We implement a deep neural network to efficiently reconstruct the spectral density of the underlying fluctuating magnetic field. These results create opportunities for the application of machine-learning methods to color-center-based nanoscale sensing and imaging.
  arXiv  Detail & Related papers  (2022-08-01T19:18:26Z)
• Cross-Spectral Periocular Recognition with Conditional Adversarial Networks [59.17685450892182]
  We propose Conditional Generative Adversarial Networks, trained to con-vert periocular images between visible and near-infrared spectra. We obtain a cross-spectral periocular performance of EER=1%, and GAR>99% @ FAR=1%, which is comparable to the state-of-the-art with the PolyU database.
  arXiv  Detail & Related papers  (2020-08-26T15:02:04Z)
• A Review of 1D Convolutional Neural Networks toward Unknown Substance Identification in Portable Raman Spectrometer [0.0]
  Raman spectroscopy is a powerful analytical tool with applications ranging from quality control to cutting edge biomedical research. They have been adopted widely by first responders and law enforcement agencies for the field analysis of unknown substances. Field detection and identification of unknown substances with Raman spectroscopy rely heavily on the spectral matching capability of the devices on hand.
  arXiv  Detail & Related papers  (2020-06-18T14:28:00Z)
• Hyperspectral-Multispectral Image Fusion with Weighted LASSO [68.04032419397677]
  We propose an approach for fusing hyperspectral and multispectral images to provide high-quality hyperspectral output. We demonstrate that the proposed sparse fusion and reconstruction provides quantitatively superior results when compared to existing methods on publicly available images.
  arXiv  Detail & Related papers  (2020-03-15T23:07:56Z)
• Hyperspectral Infrared Microscopy With Visible Light [0.4893345190925178]
  We introduce a new approach to IR hyperspectral microscopy, where the IR spectral map of the sample is obtained with off-the-shelf components built for visible light. The technique provides a wide field of view, fast readout, and negligible heat delivered to the sample, which makes it highly relevant to material and biological applications.
  arXiv  Detail & Related papers  (2020-02-14T10:29:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.