Neural Field-Based 3D Surface Reconstruction of Microstructures from Multi-Detector Signals in Scanning Electron Microscopy

• URL: http://arxiv.org/abs/2508.04728v1
• Date: Tue, 05 Aug 2025 20:00:57 GMT
• Title: Neural Field-Based 3D Surface Reconstruction of Microstructures from Multi-Detector Signals in Scanning Electron Microscopy
• Authors: Shuo Chen, Yijin Li, Xi Zheng, Guofeng Zhang,
• Abstract summary: NFH-SEM takes multi-view, multi-detector 2D SEM images as input and fuses geometric and photometric information into a continuous neural field representation.<n> NFH-SEM eliminates the manual calibration procedures through end-to-end self-calibration and automatically disentangles shadows from SEM images during training.
• Score: 7.293073530041304
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The scanning electron microscope (SEM) is a widely used imaging device in scientific research and industrial applications. Conventional two-dimensional (2D) SEM images do not directly reveal the three-dimensional (3D) topography of micro samples, motivating the development of SEM 3D surface reconstruction methods. However, reconstruction of complex microstructures remains challenging for existing methods due to the limitations of discrete 3D representations, the need for calibration with reference samples, and shadow-induced gradient errors. Here, we introduce NFH-SEM, a neural field-based hybrid SEM 3D reconstruction method that takes multi-view, multi-detector 2D SEM images as input and fuses geometric and photometric information into a continuous neural field representation. NFH-SEM eliminates the manual calibration procedures through end-to-end self-calibration and automatically disentangles shadows from SEM images during training, enabling accurate reconstruction of intricate microstructures. We validate the effectiveness of NFH-SEM on real and simulated datasets. Our experiments show high-fidelity reconstructions of diverse, challenging samples, including two-photon lithography microstructures, peach pollen, and silicon carbide particle surfaces, demonstrating precise detail and broad applicability.

Related papers

• EMGauss: Continuous Slice-to-3D Reconstruction via Dynamic Gaussian Modeling in Volume Electron Microscopy [41.838228673736076]
  We present EMGauss, a general framework for 3D reconstruction from planar scanned 2D slices with applications in Volume electron microscopy.<n>Our key innovation is to reframe slice-to-3D reconstruction as a 3D dynamic scene rendering problem based on Gaussian splatting.<n>Compared with diffusion- and GAN-based reconstruction methods, EMGauss substantially improves quality, enables continuous slice synthesis, and eliminates the need for large-scale pretraining.
  arXiv  Detail & Related papers  (2025-12-07T06:39:57Z)
• Limited-Angle Tomography Reconstruction via Projector Guided 3D Diffusion [26.292892614609283]
  Limited-angle electron tomography aims to reconstruct 3D shapes from 2D projections of Transmission Electron Microscopy (TEM) within a restricted range and number of tilting angles.<n>Deep learning approaches have shown promising results in alleviating these artifacts.<n>We propose TEMDiff, a novel 3D diffusion-based iterative reconstruction framework.
  arXiv  Detail & Related papers  (2025-10-07T23:27:28Z)
• 3D Gaussian Flats: Hybrid 2D/3D Photometric Scene Reconstruction [62.84879632157956]
  We propose a novel hybrid 2D/3D representation that jointly optimize constrained planar (2D) Gaussians for modeling flat surfaces and freeform (3D) Gaussians for the rest of the scene.<n>Our end-to-end approach dynamically detects and refines planar regions, improving both visual fidelity and geometric accuracy.<n>It achieves state-of-the-art depth estimation on ScanNet++ and ScanNetv2, and excels at mesh extraction without overfitting to a specific camera model.
  arXiv  Detail & Related papers  (2025-09-19T21:04:36Z)
• GeoGS3D: Single-view 3D Reconstruction via Geometric-aware Diffusion Model and Gaussian Splatting [81.03553265684184]
  We introduce GeoGS3D, a framework for reconstructing detailed 3D objects from single-view images. We propose a novel metric, Gaussian Divergence Significance (GDS), to prune unnecessary operations during optimization. Experiments demonstrate that GeoGS3D generates images with high consistency across views and reconstructs high-quality 3D objects.
  arXiv  Detail & Related papers  (2024-03-15T12:24:36Z)
• Multi-View Neural 3D Reconstruction of Micro-/Nanostructures with Atomic Force Microscopy [34.22380991792944]
  We propose a multi-view neural-network-based framework with Atomic Force Microscopy (MVN-AFM) MVN-AFM uses an iterative method to align multi-view data and eliminate AFM artifacts simultaneously. Experiments show that MVN-AFM effectively eliminates artifacts present in raw AFM images and reconstructs various micro-/nanostructures.
  arXiv  Detail & Related papers  (2024-01-21T16:46:04Z)
• NeuSD: Surface Completion with Multi-View Text-to-Image Diffusion [56.98287481620215]
  We present a novel method for 3D surface reconstruction from multiple images where only a part of the object of interest is captured. Our approach builds on two recent developments: surface reconstruction using neural radiance fields for the reconstruction of the visible parts of the surface, and guidance of pre-trained 2D diffusion models in the form of Score Distillation Sampling (SDS) to complete the shape in unobserved regions in a plausible manner.
  arXiv  Detail & Related papers  (2023-12-07T19:30:55Z)
• Multi-plane denoising diffusion-based dimensionality expansion for 2D-to-3D reconstruction of microstructures with harmonized sampling [0.0]
  This study proposes a novel framework for 2D-to-3D reconstruction of microstructures called Micro3Diff. Specifically, this approach solely requires pre-trained DGMs for the generation of 2D samples. A harmonized sampling process is developed to address possible deviations from the reverse Markov chain of DGMs.
  arXiv  Detail & Related papers  (2023-08-27T07:57:25Z)
• Passive superresolution imaging of incoherent objects [63.942632088208505]
  Method consists of measuring the field's spatial mode components in the image plane in the overcomplete basis of Hermite-Gaussian modes and their superpositions. Deep neural network is used to reconstruct the object from these measurements.
  arXiv  Detail & Related papers  (2023-04-19T15:53:09Z)
• Neural 3D Reconstruction in the Wild [86.6264706256377]
  We introduce a new method that enables efficient and accurate surface reconstruction from Internet photo collections. We present a new benchmark and protocol for evaluating reconstruction performance on such in-the-wild scenes.
  arXiv  Detail & Related papers  (2022-05-25T17:59:53Z)
• 3D Reconstruction of Curvilinear Structures with Stereo Matching DeepConvolutional Neural Networks [52.710012864395246]
  We propose a fully automated pipeline for both detection and matching of curvilinear structures in stereo pairs. We mainly focus on 3D reconstruction of dislocations from stereo pairs of TEM images.
  arXiv  Detail & Related papers  (2021-10-14T23:05:47Z)
• Neural Radiance Fields Approach to Deep Multi-View Photometric Stereo [103.08512487830669]
  We present a modern solution to the multi-view photometric stereo problem (MVPS) We procure the surface orientation using a photometric stereo (PS) image formation model and blend it with a multi-view neural radiance field representation to recover the object's surface geometry. Our method performs neural rendering of multi-view images while utilizing surface normals estimated by a deep photometric stereo network.
  arXiv  Detail & Related papers  (2021-10-11T20:20:03Z)
• Accelerating 3D MULTIPLEX MRI Reconstruction with Deep Learning [7.85035197356331]
  Multi-flip-angle (FA) and multi-echoLEX GRE method (MULTIP MRI) has been developed to simultaneously acquire multiple parametric images with just one single scan. We propose a deep learning framework for undersampled 3D MRI data reconstruction. The proposed deep learning method shows good performance in image quality and reconstruction time.
  arXiv  Detail & Related papers  (2021-05-17T21:06:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.