Physics Embedded Machine Learning for Electromagnetic Data Imaging
- URL: http://arxiv.org/abs/2207.12607v1
- Date: Tue, 26 Jul 2022 02:10:15 GMT
- Title: Physics Embedded Machine Learning for Electromagnetic Data Imaging
- Authors: Rui Guo, Tianyao Huang, Maokun Li, Haiyang Zhang, Yonina C. Eldar
- Abstract summary: Electromagnetic (EM) imaging is widely applied in sensing for security, biomedicine, geophysics, and various industries.
It is an ill-posed inverse problem whose solution is usually computationally expensive. Machine learning (ML) techniques and especially deep learning (DL) show potential in fast and accurate imaging.
This article surveys various schemes to incorporate physics in learning-based EM imaging.
- Score: 83.27424953663986
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Electromagnetic (EM) imaging is widely applied in sensing for security,
biomedicine, geophysics, and various industries. It is an ill-posed inverse
problem whose solution is usually computationally expensive. Machine learning
(ML) techniques and especially deep learning (DL) show potential in fast and
accurate imaging. However, the high performance of purely data-driven
approaches relies on constructing a training set that is statistically
consistent with practical scenarios, which is often not possible in EM imaging
tasks. Consequently, generalizability becomes a major concern. On the other
hand, physical principles underlie EM phenomena and provide baselines for
current imaging techniques. To benefit from prior knowledge in big data and the
theoretical constraint of physical laws, physics embedded ML methods for EM
imaging have become the focus of a large body of recent work.
This article surveys various schemes to incorporate physics in learning-based
EM imaging. We first introduce background on EM imaging and basic formulations
of the inverse problem. We then focus on three types of strategies combining
physics and ML for linear and nonlinear imaging and discuss their advantages
and limitations. Finally, we conclude with open challenges and possible ways
forward in this fast-developing field. Our aim is to facilitate the study of
intelligent EM imaging methods that will be efficient, interpretable and
controllable.
Related papers
- Private, Efficient and Scalable Kernel Learning for Medical Image Analysis [1.7999333451993955]
OKRA (Orthonormal K-fRAmes) is a novel randomized encoding-based approach for kernel-based machine learning.
It significantly enhances scalability and speed compared to current state-of-the-art solutions.
arXiv Detail & Related papers (2024-10-21T10:03:03Z) - Guess What I Think: Streamlined EEG-to-Image Generation with Latent Diffusion Models [4.933734706786783]
EEG is a low-cost, non-invasive, and portable neuroimaging technique.
EEG presents inherent challenges due to its low spatial resolution and susceptibility to noise and artifacts.
We propose a framework based on the ControlNet adapter for conditioning a latent diffusion model through EEG signals.
arXiv Detail & Related papers (2024-09-17T19:07:13Z) - fMRI-PTE: A Large-scale fMRI Pretrained Transformer Encoder for
Multi-Subject Brain Activity Decoding [54.17776744076334]
We propose fMRI-PTE, an innovative auto-encoder approach for fMRI pre-training.
Our approach involves transforming fMRI signals into unified 2D representations, ensuring consistency in dimensions and preserving brain activity patterns.
Our contributions encompass introducing fMRI-PTE, innovative data transformation, efficient training, a novel learning strategy, and the universal applicability of our approach.
arXiv Detail & Related papers (2023-11-01T07:24:22Z) - Disruptive Autoencoders: Leveraging Low-level features for 3D Medical
Image Pre-training [51.16994853817024]
This work focuses on designing an effective pre-training framework for 3D radiology images.
We introduce Disruptive Autoencoders, a pre-training framework that attempts to reconstruct the original image from disruptions created by a combination of local masking and low-level perturbations.
The proposed pre-training framework is tested across multiple downstream tasks and achieves state-of-the-art performance.
arXiv Detail & Related papers (2023-07-31T17:59:42Z) - LVM-Med: Learning Large-Scale Self-Supervised Vision Models for Medical
Imaging via Second-order Graph Matching [59.01894976615714]
We introduce LVM-Med, the first family of deep networks trained on large-scale medical datasets.
We have collected approximately 1.3 million medical images from 55 publicly available datasets.
LVM-Med empirically outperforms a number of state-of-the-art supervised, self-supervised, and foundation models.
arXiv Detail & Related papers (2023-06-20T22:21:34Z) - Neural Operator: Is data all you need to model the world? An insight
into the impact of Physics Informed Machine Learning [13.050410285352605]
We provide an insight into how data-driven approaches can complement conventional techniques to solve engineering and physics problems.
We highlight a novel and fast machine learning-based approach to learning the solution operator of a PDE operator learning.
arXiv Detail & Related papers (2023-01-30T23:29:33Z) - Physics-Driven Deep Learning for Computational Magnetic Resonance
Imaging [7.404599356384102]
Physics-driven deep learning methods have emerged as a powerful tool for computational magnetic resonance imaging (MRI) problems.
This article provides an overview of the recent developments in incorporating physics information into learning-based MRI reconstruction.
arXiv Detail & Related papers (2022-03-23T06:04:11Z) - Which priors matter? Benchmarking models for learning latent dynamics [70.88999063639146]
Several methods have proposed to integrate priors from classical mechanics into machine learning models.
We take a sober look at the current capabilities of these models.
We find that the use of continuous and time-reversible dynamics benefits models of all classes.
arXiv Detail & Related papers (2021-11-09T23:48:21Z) - Light-Field Microscopy for optical imaging of neuronal activity: when
model-based methods meet data-driven approaches [28.872219458334587]
Understanding how networks of neurons process information is one of the key challenges in modern neuroscience.
Light-field microscopy (LFM), a type of scanless microscope, is a particularly attractive candidate for high-speed 3D imaging.
This paper is devoted to a comprehensive survey to state-of-the-art computational methods for LFM, with a focus on model-based and data-driven approaches.
arXiv Detail & Related papers (2021-10-24T20:58:51Z) - Fed-Sim: Federated Simulation for Medical Imaging [131.56325440976207]
We introduce a physics-driven generative approach that consists of two learnable neural modules.
We show that our data synthesis framework improves the downstream segmentation performance on several datasets.
arXiv Detail & Related papers (2020-09-01T19:17:46Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.