DiffPINN: Generative diffusion-initialized physics-informed neural networks for accelerating seismic wavefield representation

• URL: http://arxiv.org/abs/2506.00471v1
• Date: Sat, 31 May 2025 08:41:06 GMT
• Title: DiffPINN: Generative diffusion-initialized physics-informed neural networks for accelerating seismic wavefield representation
• Authors: Shijun Cheng, Tariq Alkhalifah,
• Abstract summary: Physics-informed neural networks (PINNs) offer a powerful framework for seismic wavefield modeling.<n>PINNs typically require time-consuming retraining when applied to different velocity models.<n>We introduce a latent diffusion-based strategy for rapid and effective PINN initialization.
• Score: 3.069335774032178
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Physics-informed neural networks (PINNs) offer a powerful framework for seismic wavefield modeling, yet they typically require time-consuming retraining when applied to different velocity models. Moreover, their training can suffer from slow convergence due to the complexity of of the wavefield solution. To address these challenges, we introduce a latent diffusion-based strategy for rapid and effective PINN initialization. First, we train multiple PINNs to represent frequency-domain scattered wavefields for various velocity models, then flatten each trained network's parameters into a one-dimensional vector, creating a comprehensive parameter dataset. Next, we employ an autoencoder to learn latent representations of these parameter vectors, capturing essential patterns across diverse PINN's parameters. We then train a conditional diffusion model to store the distribution of these latent vectors, with the corresponding velocity models serving as conditions. Once trained, this diffusion model can generate latent vectors corresponding to new velocity models, which are subsequently decoded by the autoencoder into complete PINN parameters. Experimental results indicate that our method significantly accelerates training and maintains high accuracy across in-distribution and out-of-distribution velocity scenarios.

Related papers

• Fractional Spike Differential Equations Neural Network with Efficient Adjoint Parameters Training [63.3991315762955]
  Spiking Neural Networks (SNNs) draw inspiration from biological neurons to create realistic models for brain-like computation.<n>Most existing SNNs assume a single time constant for neuronal membrane voltage dynamics, modeled by first-order ordinary differential equations (ODEs) with Markovian characteristics.<n>We propose the Fractional SPIKE Differential Equation neural network (fspikeDE), which captures long-term dependencies in membrane voltage and spike trains through fractional-order dynamics.
  arXiv  Detail & Related papers  (2025-07-22T18:20:56Z)
• Full waveform inversion with CNN-based velocity representation extension [4.255346660147713]
  Full waveform inversion (FWI) updates the velocity model by minimizing the discrepancy between observed and simulated data.<n>Discretization errors in numerical modeling and incomplete seismic data acquisition can introduce noise, which propagates through the adjoint operator.<n>We employ a convolutional neural network (CNN) to refine the velocity model before performing the forward simulation.<n>We use the same data misfit loss to update both the velocity and network parameters, thereby forming a self-supervised learning procedure.
  arXiv  Detail & Related papers  (2025-04-22T12:14:38Z)
• Gabor-Enhanced Physics-Informed Neural Networks for Fast Simulations of Acoustic Wavefields [2.8948274245812327]
  Physics-Informed Neural Networks (PINNs) have gained increasing attention for solving partial differential equations.<n>We propose a simplified PINN framework that incorporates Gabor functions.<n>We demonstrate its superior accuracy, faster convergence, and better robustness features compared to both traditional PINNs and earlier Gabor-based PINNs.
  arXiv  Detail & Related papers  (2025-02-24T13:25:40Z)
• Multi-frequency wavefield solutions for variable velocity models using meta-learning enhanced low-rank physics-informed neural network [3.069335774032178]
  Physics-informed neural networks (PINNs) face significant challenges in modeling multi-frequency wavefields in complex velocity models.<n>We propose Meta-LRPINN, a novel framework that combines low-rank parameterization with meta-learning and frequency embedding.<n> Numerical experiments show that Meta-LRPINN achieves much fast convergence speed and much high accuracy compared to baseline methods.
  arXiv  Detail & Related papers  (2025-02-02T20:12:39Z)
• MILP initialization for solving parabolic PDEs with PINNs [2.5932373010465364]
  Physics-Informed Neural Networks (PINNs) are a powerful deep learning method capable of providing solutions and parameter estimations of physical systems.<n>Given the complexity of their neural network structure, the convergence speed is still limited compared to numerical methods.
  arXiv  Detail & Related papers  (2025-01-27T15:46:38Z)
• Neural Network Diffusion [45.851945143942885]
  A diffusion model is trained to synthesize latent representations from random noise.<n>This model then generates new representations, which are passed through the autoencoder's decoder to produce new subsets of high-performing network parameters.
  arXiv  Detail & Related papers  (2024-02-20T16:59:03Z)
• Capturing dynamical correlations using implicit neural representations [85.66456606776552]
  We develop an artificial intelligence framework which combines a neural network trained to mimic simulated data from a model Hamiltonian with automatic differentiation to recover unknown parameters from experimental data. In doing so, we illustrate the ability to build and train a differentiable model only once, which then can be applied in real-time to multi-dimensional scattering data.
  arXiv  Detail & Related papers  (2023-04-08T07:55:36Z)
• A predictive physics-aware hybrid reduced order model for reacting flows [65.73506571113623]
  A new hybrid predictive Reduced Order Model (ROM) is proposed to solve reacting flow problems. The number of degrees of freedom is reduced from thousands of temporal points to a few POD modes with their corresponding temporal coefficients. Two different deep learning architectures have been tested to predict the temporal coefficients.
  arXiv  Detail & Related papers  (2023-01-24T08:39:20Z)
• Fast Sampling of Diffusion Models via Operator Learning [74.37531458470086]
  We use neural operators, an efficient method to solve the probability flow differential equations, to accelerate the sampling process of diffusion models. Compared to other fast sampling methods that have a sequential nature, we are the first to propose a parallel decoding method. We show our method achieves state-of-the-art FID of 3.78 for CIFAR-10 and 7.83 for ImageNet-64 in the one-model-evaluation setting.
  arXiv  Detail & Related papers  (2022-11-24T07:30:27Z)
• Learning to Learn with Generative Models of Neural Network Checkpoints [71.06722933442956]
  We construct a dataset of neural network checkpoints and train a generative model on the parameters. We find that our approach successfully generates parameters for a wide range of loss prompts. We apply our method to different neural network architectures and tasks in supervised and reinforcement learning.
  arXiv  Detail & Related papers  (2022-09-26T17:59:58Z)
• An advanced spatio-temporal convolutional recurrent neural network for storm surge predictions [73.4962254843935]
  We study the capability of artificial neural network models to emulate storm surge based on the storm track/size/intensity history. This study presents a neural network model that can predict storm surge, informed by a database of synthetic storm simulations.
  arXiv  Detail & Related papers  (2022-04-18T23:42:18Z)
• Incorporating Kinematic Wave Theory into a Deep Learning Method for High-Resolution Traffic Speed Estimation [3.0969191504482243]
  We propose a kinematic wave based Deep Convolutional Neural Network (Deep CNN) to estimate high resolution traffic speed dynamics from sparse probe vehicle trajectories. We introduce two key approaches that allow us to incorporate kinematic wave theory principles to improve the robustness of existing learning-based estimation methods.
  arXiv  Detail & Related papers  (2021-02-04T21:51:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.