From Stars to Molecules: AI Guided Device-Agnostic Super-Resolution Imaging
- URL: http://arxiv.org/abs/2502.18637v2
- Date: Thu, 20 Mar 2025 17:15:36 GMT
- Title: From Stars to Molecules: AI Guided Device-Agnostic Super-Resolution Imaging
- Authors: Dominik Vašinka, Filip Juráň, Jaromír Běhal, Miroslav Ježek,
- Abstract summary: Super-resolution imaging has revolutionized the study of systems ranging from molecular structures to distant galaxies.<n>Existing super-resolution methods require extensive calibration and retraining for each imaging setup, limiting their practical deployment.<n>We introduce a device-agnostic deep-learning framework for super-resolution imaging of point-like emitters that eliminates the need for calibration data or explicit knowledge of optical system parameters.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Super-resolution imaging has revolutionized the study of systems ranging from molecular structures to distant galaxies. However, existing super-resolution methods require extensive calibration and retraining for each imaging setup, limiting their practical deployment. We introduce a device-agnostic deep-learning framework for super-resolution imaging of point-like emitters that eliminates the need for calibration data or explicit knowledge of optical system parameters. Our model is trained on a diverse, numerically simulated dataset encompassing a broad range of imaging conditions, enabling generalization across different optical setups. Once trained, it reconstructs super-resolved images directly from a single resolution-limited camera frame with superior accuracy and computational efficiency compared to state-of-the-art methods. We experimentally validate our approach using a custom microscopy setup with ground-truth emitter positions. We also demonstrate its versatility on astronomical and single-molecule localization microscopy datasets, achieving unprecedented resolution without prior information. Our findings establish a pathway toward universal, calibration-free super-resolution imaging, expanding its applicability across scientific disciplines.
Related papers
- A Unified Model for Compressed Sensing MRI Across Undersampling Patterns [69.19631302047569]
We propose a unified MRI reconstruction model robust to various measurement undersampling patterns and image resolutions.
Our model improves SSIM by 11% and PSNR by 4 dB over a state-of-the-art CNN (End-to-End VarNet) with 600$times$ faster inference than diffusion methods.
arXiv Detail & Related papers (2024-10-05T20:03:57Z) - Deep 3D World Models for Multi-Image Super-Resolution Beyond Optical
Flow [27.31768206943397]
Multi-image super-resolution (MISR) allows to increase the spatial resolution of a low-resolution (LR) acquisition by combining multiple images.
Our proposed model, called EpiMISR, moves away from optical flow and explicitly uses the epipolar geometry of the acquisition process.
arXiv Detail & Related papers (2024-01-30T12:55:49Z) - Low-Light Image Enhancement with Illumination-Aware Gamma Correction and
Complete Image Modelling Network [69.96295927854042]
Low-light environments usually lead to less informative large-scale dark areas.
We propose to integrate the effectiveness of gamma correction with the strong modelling capacities of deep networks.
Because exponential operation introduces high computational complexity, we propose to use Taylor Series to approximate gamma correction.
arXiv Detail & Related papers (2023-08-16T08:46:51Z) - Passive superresolution imaging of incoherent objects [63.942632088208505]
Method consists of measuring the field's spatial mode components in the image plane in the overcomplete basis of Hermite-Gaussian modes and their superpositions.
Deep neural network is used to reconstruct the object from these measurements.
arXiv Detail & Related papers (2023-04-19T15:53:09Z) - Image-specific Convolutional Kernel Modulation for Single Image
Super-resolution [85.09413241502209]
In this issue, we propose a novel image-specific convolutional modulation kernel (IKM)
We exploit the global contextual information of image or feature to generate an attention weight for adaptively modulating the convolutional kernels.
Experiments on single image super-resolution show that the proposed methods achieve superior performances over state-of-the-art methods.
arXiv Detail & Related papers (2021-11-16T11:05:10Z) - Smart Quantum Statistical Imaging beyond the Abbe-Rayleigh Criterion [0.0]
We introduce a smart quantum camera for superresolving imaging.
This camera exploits the self-learning features of artificial intelligence to identify the statistical fluctuations of unknown mixtures of light sources.
Our work provides a new perspective in the field of imaging with important implications for microscopy, remote sensing, and astronomy.
arXiv Detail & Related papers (2021-10-11T17:33:51Z) - Identifying Objects at the Quantum Limit for Super-Resolution Imaging [1.2792576041526287]
We analytically compute quantum-limited error bounds for hypothesis tests on any database of incoherent, quasi-monochromatic objects.
We show that object-independent linear-optical spatial processing of the collected light exactly achieves these ultimate error rates.
arXiv Detail & Related papers (2021-07-01T18:00:43Z) - A parameter refinement method for Ptychography based on Deep Learning
concepts [55.41644538483948]
coarse parametrisation in propagation distance, position errors and partial coherence frequently menaces the experiment viability.
A modern Deep Learning framework is used to correct autonomously the setup incoherences, thus improving the quality of a ptychography reconstruction.
We tested our system on both synthetic datasets and also on real data acquired at the TwinMic beamline of the Elettra synchrotron facility.
arXiv Detail & Related papers (2021-05-18T10:15:17Z) - Deep learning-based super-resolution fluorescence microscopy on small
datasets [20.349746411933495]
Deep learning has shown the potentials to reduce the technical barrier and obtain super-resolution from diffraction-limited images.
We demonstrate a new convolutional neural network-based approach that is successfully trained with small datasets and super-resolution images.
This model can be applied to other biomedical imaging modalities such as MRI and X-ray imaging, where obtaining large training datasets is challenging.
arXiv Detail & Related papers (2021-03-07T03:17:47Z) - Exploiting Raw Images for Real-Scene Super-Resolution [105.18021110372133]
We study the problem of real-scene single image super-resolution to bridge the gap between synthetic data and real captured images.
We propose a method to generate more realistic training data by mimicking the imaging process of digital cameras.
We also develop a two-branch convolutional neural network to exploit the radiance information originally-recorded in raw images.
arXiv Detail & Related papers (2021-02-02T16:10:15Z) - Confocal super-resolution microscopy based on a spatial mode sorter [1.6950974360378377]
We generalize the Richardson-Lucy (RL) deconvolution algorithm to a general object consisting of many incoherent point sources.
We find that the resolution enhancement of sorter-based microscopy is on average over 30% higher than that of a conventional confocal microscope.
arXiv Detail & Related papers (2021-01-11T00:55:09Z) - Hyperspectral-Multispectral Image Fusion with Weighted LASSO [68.04032419397677]
We propose an approach for fusing hyperspectral and multispectral images to provide high-quality hyperspectral output.
We demonstrate that the proposed sparse fusion and reconstruction provides quantitatively superior results when compared to existing methods on publicly available images.
arXiv Detail & Related papers (2020-03-15T23:07:56Z) - PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of
Generative Models [77.32079593577821]
PULSE (Photo Upsampling via Latent Space Exploration) generates high-resolution, realistic images at resolutions previously unseen in the literature.
Our method outperforms state-of-the-art methods in perceptual quality at higher resolutions and scale factors than previously possible.
arXiv Detail & Related papers (2020-03-08T16:44:31Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.