Imaging through multimode fibres with physical prior

• URL: http://arxiv.org/abs/2311.03062v2
• Date: Tue, 14 Nov 2023 02:00:20 GMT
• Title: Imaging through multimode fibres with physical prior
• Authors: Chuncheng Zhang, Yingjie Shi, Zheyi Yao, Xiubao Sui, Qian Chen
• Abstract summary: We propose a physics-assisted, unsupervised, learning-based fibre imaging scheme. The reconstruction process of the online learning only requires a few speckle patterns and unpaired targets. Our scheme has the potential to extend the application of multimode fibre imaging.
• Score: 3.174639607243348
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Imaging through perturbed multimode fibres based on deep learning has been widely researched. However, existing methods mainly use target-speckle pairs in different configurations. It is challenging to reconstruct targets without trained networks. In this paper, we propose a physics-assisted, unsupervised, learning-based fibre imaging scheme. The role of the physical prior is to simplify the mapping relationship between the speckle pattern and the target image, thereby reducing the computational complexity. The unsupervised network learns target features according to the optimized direction provided by the physical prior. Therefore, the reconstruction process of the online learning only requires a few speckle patterns and unpaired targets. The proposed scheme also increases the generalization ability of the learning-based method in perturbed multimode fibres. Our scheme has the potential to extend the application of multimode fibre imaging.

Related papers

• Physically Interpretable Multi-Degradation Image Restoration via Deep Unfolding and Explainable Convolution [45.571542528079114]
  We propose a novel interpretability-driven approach for multi-degradation image restoration.<n>We employ an improved second-order semi-smooth Newton algorithm to ensure that each module maintains clear physical interpretability.<n>To further enhance interpretability and adaptability, we design an explainable convolution module inspired by the human brain's flexible information processing.
  arXiv  Detail & Related papers  (2025-11-13T10:27:41Z)
• Rotation Equivariant Proximal Operator for Deep Unfolding Methods in Image Restoration [62.41329042683779]
  We propose a high-accuracy rotation equivariant proximal network that embeds rotation symmetry priors into the deep unfolding framework. This study makes efforts to suggest a high-accuracy rotation equivariant proximal network that effectively embeds rotation symmetry priors into the deep unfolding framework.
  arXiv  Detail & Related papers  (2023-12-25T11:53:06Z)
• A Multi-scale Generalized Shrinkage Threshold Network for Image Blind Deblurring in Remote Sensing [5.957520165711732]
  We propose a new blind deblurring learning framework that utilizes alternating iterations of shrinkage thresholds. We also propose a deep proximal mapping module in the image domain, which combines a generalized shrinkage threshold with a multi-scale prior feature extraction block.
  arXiv  Detail & Related papers  (2023-09-14T08:48:44Z)
• Iterative Soft Shrinkage Learning for Efficient Image Super-Resolution [91.3781512926942]
  Image super-resolution (SR) has witnessed extensive neural network designs from CNN to transformer architectures. This work investigates the potential of network pruning for super-resolution iteration to take advantage of off-the-shelf network designs and reduce the underlying computational overhead. We propose a novel Iterative Soft Shrinkage-Percentage (ISS-P) method by optimizing the sparse structure of a randomly network at each and tweaking unimportant weights with a small amount proportional to the magnitude scale on-the-fly.
  arXiv  Detail & Related papers  (2023-03-16T21:06:13Z)
• FAS-UNet: A Novel FAS-driven Unet to Learn Variational Image Segmentation [3.741136641573471]
  We propose a novel variational-model-informed network (FAS-Unet) that exploits the model and algorithm priors to extract the multi-scale features. The proposed network integrates image data and mathematical models, and implements them through learning a few convolution kernels. Experimental results show that the proposed FAS-Unet is very competitive with other state-of-the-art methods in qualitative, quantitative and model complexity evaluations.
  arXiv  Detail & Related papers  (2022-10-27T04:15:16Z)
• Multi-mode fiber reservoir computing overcomes shallow neural networks classifiers [8.891157811906407]
  We recast multi-mode optical fibers into random hardware projectors, transforming an input dataset into a speckled image set. We find that the hardware operates in a flatter region of the loss landscape when trained on fiber data, which aligns with the current theory of deep neural networks.
  arXiv  Detail & Related papers  (2022-10-10T14:55:02Z)
• Emergence of hierarchical modes from deep learning [2.0711789781518752]
  We propose a mode decomposition learning that can interpret the weight matrices as a hierarchy of latent modes. The mode decomposition learning points to a cheap and interpretable route towards the magical deep learning.
  arXiv  Detail & Related papers  (2022-08-21T09:53:32Z)
• Low-light Image Enhancement by Retinex Based Algorithm Unrolling and Adjustment [50.13230641857892]
  We propose a new deep learning framework for the low-light image enhancement (LIE) problem. The proposed framework contains a decomposition network inspired by algorithm unrolling, and adjustment networks considering both global brightness and local brightness sensitivity. Experiments on a series of typical LIE datasets demonstrated the effectiveness of the proposed method, both quantitatively and visually, as compared with existing methods.
  arXiv  Detail & Related papers  (2022-02-12T03:59:38Z)
• Is Deep Image Prior in Need of a Good Education? [57.3399060347311]
  Deep image prior was introduced as an effective prior for image reconstruction. Despite its impressive reconstructive properties, the approach is slow when compared to learned or traditional reconstruction techniques. We develop a two-stage learning paradigm to address the computational challenge.
  arXiv  Detail & Related papers  (2021-11-23T15:08:26Z)
• An Optical physics inspired CNN approach for intrinsic image decomposition [0.0]
  Intrinsic Image Decomposition is an open problem of generating the constituents of an image. We propose a neural network architecture capable of this decomposition using physics-based parameters derived from the image.
  arXiv  Detail & Related papers  (2021-05-21T00:54:01Z)
• NAS-DIP: Learning Deep Image Prior with Neural Architecture Search [65.79109790446257]
  Recent work has shown that the structure of deep convolutional neural networks can be used as a structured image prior. We propose to search for neural architectures that capture stronger image priors. We search for an improved network by leveraging an existing neural architecture search algorithm.
  arXiv  Detail & Related papers  (2020-08-26T17:59:36Z)
• Single image reflection removal via learning with multi-image constraints [50.54095311597466]
  We propose a novel learning-based solution that combines the advantages of the aforementioned approaches and overcomes their drawbacks. Our algorithm works by learning a deep neural network to optimize the target with joint constraints enhanced among multiple input images. Our algorithm runs in real-time and state-of-the-art reflection removal performance on real images.
  arXiv  Detail & Related papers  (2019-12-08T06:10:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.