Regularization of Inverse Problems by Neural Networks
- URL: http://arxiv.org/abs/2006.03972v1
- Date: Sat, 6 Jun 2020 20:49:12 GMT
- Title: Regularization of Inverse Problems by Neural Networks
- Authors: Markus Haltmeier and Linh V. Nguyen
- Abstract summary: Inverse problems arise in a variety of imaging applications including computed tomography, non-destructive testing, and remote sensing.
The characteristic features of inverse problems are the non-uniqueness and instability of their solutions.
Deep learning techniques and neural networks demonstrated to significantly outperform classical solution methods for inverse problems.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Inverse problems arise in a variety of imaging applications including
computed tomography, non-destructive testing, and remote sensing. The
characteristic features of inverse problems are the non-uniqueness and
instability of their solutions. Therefore, any reasonable solution method
requires the use of regularization tools that select specific solutions and at
the same time stabilize the inversion process. Recently, data-driven methods
using deep learning techniques and neural networks demonstrated to
significantly outperform classical solution methods for inverse problems. In
this chapter, we give an overview of inverse problems and demonstrate the
necessity of regularization concepts for their solution. We show that neural
networks can be used for the data-driven solution of inverse problems and
review existing deep learning methods for inverse problems. In particular, we
view these deep learning methods from the perspective of regularization theory,
the mathematical foundation of stable solution methods for inverse problems.
This chapter is more than just a review as many of the presented theoretical
results extend existing ones.
Related papers
- A Survey on Diffusion Models for Inverse Problems [110.6628926886398]
We provide an overview of methods that utilize pre-trained diffusion models to solve inverse problems without requiring further training.
We discuss specific challenges and potential solutions associated with using latent diffusion models for inverse problems.
arXiv Detail & Related papers (2024-09-30T17:34:01Z) - A Guide to Stochastic Optimisation for Large-Scale Inverse Problems [4.926711494319977]
optimisation algorithms are the de facto standard for machine learning with large amounts of data.
We provide a comprehensive account of the state-of-the-art in optimisation from the viewpoint of inverse problems.
We focus on the challenges for optimisation that are unique and are not commonly encountered in machine learning.
arXiv Detail & Related papers (2024-06-10T15:02:30Z) - Robustness and Exploration of Variational and Machine Learning Approaches to Inverse Problems: An Overview [47.34359815600974]
This paper provides an overview of current approaches for solving inverse problems in imaging using variational methods and machine learning.
A special focus lies on point estimators and their robustness against adversarial perturbations.
arXiv Detail & Related papers (2024-02-19T11:48:11Z) - HomPINNs: homotopy physics-informed neural networks for solving the
inverse problems of nonlinear differential equations with multiple solutions [6.89453634946458]
We propose homotopy physics-informed neural networks (HomPINNs) to solve inverse problems of nonlinear differential equations (DEs)
The proposed framework begins with the use of NNs to simultaneously approximate unlabeled observations across diverse solutions while adhering to DE constraints.
Our findings demonstrate that the proposed method is scalable and adaptable, providing an effective solution for solving DEs with multiple solutions and unknown parameters.
arXiv Detail & Related papers (2023-04-06T01:20:23Z) - Exploring the solution space of linear inverse problems with GAN latent
geometry [23.779985842891705]
Inverse problems consist in reconstructing signals from incomplete sets of measurements.
We propose a method to generate multiple reconstructions that fit both the measurements and a data-driven prior learned by a generative adversarial network.
arXiv Detail & Related papers (2022-07-01T14:33:44Z) - Provably Convergent Algorithms for Solving Inverse Problems Using
Generative Models [47.208080968675574]
We study the use of generative models in inverse problems with more complete understanding.
We support our claims with experimental results for solving various inverse problems.
We propose an extension of our approach that can handle model mismatch (i.e., situations where the generative prior is not exactly applicable)
arXiv Detail & Related papers (2021-05-13T15:58:27Z) - Total Deep Variation: A Stable Regularizer for Inverse Problems [71.90933869570914]
We introduce the data-driven general-purpose total deep variation regularizer.
In its core, a convolutional neural network extracts local features on multiple scales and in successive blocks.
We achieve state-of-the-art results for numerous imaging tasks.
arXiv Detail & Related papers (2020-06-15T21:54:15Z) - Inverse Problems, Deep Learning, and Symmetry Breaking [6.54545059421233]
In many physical systems, inputs related by intrinsic system symmetries are mapped to the same output.
We show that careful symmetry breaking on the training data can help get rid of the difficulties and significantly improve the learning performance.
arXiv Detail & Related papers (2020-03-20T02:43:57Z) - Solving Inverse Problems with a Flow-based Noise Model [100.18560761392692]
We study image inverse problems with a normalizing flow prior.
Our formulation views the solution as the maximum a posteriori estimate of the image conditioned on the measurements.
We empirically validate the efficacy of our method on various inverse problems, including compressed sensing with quantized measurements and denoising with highly structured noise patterns.
arXiv Detail & Related papers (2020-03-18T08:33:49Z) - Total Deep Variation for Linear Inverse Problems [71.90933869570914]
We propose a novel learnable general-purpose regularizer exploiting recent architectural design patterns from deep learning.
We show state-of-the-art performance for classical image restoration and medical image reconstruction problems.
arXiv Detail & Related papers (2020-01-14T19:01:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.