Autoencoder-driven Spiral Representation Learning for Gravitational Wave Surrogate Modelling

• URL: http://arxiv.org/abs/2107.04312v1
• Date: Fri, 9 Jul 2021 09:03:08 GMT
• Title: Autoencoder-driven Spiral Representation Learning for Gravitational Wave Surrogate Modelling
• Authors: Paraskevi Nousi, Styliani-Christina Fragkouli, Nikolaos Passalis, Panagiotis Iosif, Theocharis Apostolatos, George Pappas, Nikolaos Stergioulas, Anastasios Tefas
• Abstract summary: We investigate the existence of underlying structures in the empirical coefficients using autoencoders. We design a spiral module with learnable parameters, that is used as the first layer in a neural network, which learns to map the input space to the coefficients. The spiral module is evaluated on multiple neural network architectures and consistently achieves better speed-accuracy trade-off than baseline models.
• Score: 47.081318079190595
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recently, artificial neural networks have been gaining momentum in the field of gravitational wave astronomy, for example in surrogate modelling of computationally expensive waveform models for binary black hole inspiral and merger. Surrogate modelling yields fast and accurate approximations of gravitational waves and neural networks have been used in the final step of interpolating the coefficients of the surrogate model for arbitrary waveforms outside the training sample. We investigate the existence of underlying structures in the empirical interpolation coefficients using autoencoders. We demonstrate that when the coefficient space is compressed to only two dimensions, a spiral structure appears, wherein the spiral angle is linearly related to the mass ratio. Based on this finding, we design a spiral module with learnable parameters, that is used as the first layer in a neural network, which learns to map the input space to the coefficients. The spiral module is evaluated on multiple neural network architectures and consistently achieves better speed-accuracy trade-off than baseline models. A thorough experimental study is conducted and the final result is a surrogate model which can evaluate millions of input parameters in a single forward pass in under 1ms on a desktop GPU, while the mismatch between the corresponding generated waveforms and the ground-truth waveforms is better than the compared baseline methods. We anticipate the existence of analogous underlying structures and corresponding computational gains also in the case of spinning black hole binaries.

Related papers

• Parametric Nonlinear Volterra Series via Machine Learning: Transonic Aerodynamics [0.0]
  This study introduces an approach for modeling unsteady transonic aerodynamics within a parametric space. The first- and second-order Volterra kernels are derived from indicial aerodynamic responses. Results underscore the benefit of including the second-order kernel to address strong nonlinearity.
  arXiv  Detail & Related papers  (2024-10-25T12:40:10Z)
• Capturing dynamical correlations using implicit neural representations [85.66456606776552]
  We develop an artificial intelligence framework which combines a neural network trained to mimic simulated data from a model Hamiltonian with automatic differentiation to recover unknown parameters from experimental data. In doing so, we illustrate the ability to build and train a differentiable model only once, which then can be applied in real-time to multi-dimensional scattering data.
  arXiv  Detail & Related papers  (2023-04-08T07:55:36Z)
• Towards a Foundation Model for Neural Network Wavefunctions [5.145741425164946]
  We propose a novel neural network ansatz, which maps uncorrelated, computationally cheap Hartree-Fock orbitals to correlated, high-accuracy neural network orbitals. This ansatz is inherently capable of learning a single wavefunction across multiple compounds and geometries.
  arXiv  Detail & Related papers  (2023-03-17T16:03:10Z)
• Modeling the space-time correlation of pulsed twin beams [68.8204255655161]
  Entangled twin-beams generated by parametric down-conversion are among the favorite sources for imaging-oriented applications. We propose a semi-analytic model which aims to bridge the gap between time-consuming numerical simulations and the unrealistic plane-wave pump theory.
  arXiv  Detail & Related papers  (2023-01-18T11:29:49Z)
• An advanced spatio-temporal convolutional recurrent neural network for storm surge predictions [73.4962254843935]
  We study the capability of artificial neural network models to emulate storm surge based on the storm track/size/intensity history. This study presents a neural network model that can predict storm surge, informed by a database of synthetic storm simulations.
  arXiv  Detail & Related papers  (2022-04-18T23:42:18Z)
• Dynamically-Scaled Deep Canonical Correlation Analysis [77.34726150561087]
  Canonical Correlation Analysis (CCA) is a method for feature extraction of two views by finding maximally correlated linear projections of them. We introduce a novel dynamic scaling method for training an input-dependent canonical correlation model.
  arXiv  Detail & Related papers  (2022-03-23T12:52:49Z)
• Deep Residual Error and Bag-of-Tricks Learning for Gravitational Wave Surrogate Modeling [32.15071712355222]
  We show how to reduce the maximum mismatch for waveforms in a validation set by 13.4 times. The most significant improvement comes from the addition of a second network that models the residual error.
  arXiv  Detail & Related papers  (2022-03-16T07:12:42Z)
• Lightning-Fast Gravitational Wave Parameter Inference through Neural Amortization [6.810835072367285]
  Latest advances in neural simulation-based inference can speed up the inference time by up to three orders of magnitude. We find that our model correctly estimates credible intervals for the parameters of simulated gravitational waves.
  arXiv  Detail & Related papers  (2020-10-24T16:48:24Z)
• Physics-inspired deep learning to characterize the signal manifold of quasi-circular, spinning, non-precessing binary black hole mergers [4.43457632632169]
  We introduce a modified version of WaveNet trained with a novel optimization scheme that incorporates general relativistic constraints of the spin properties of astrophysical black holes. We find that the convergence of high performance computing and physics-inspired optimization algorithms enable an accurate reconstruction of the mass-ratio and individual spins of binary black hole mergers.
  arXiv  Detail & Related papers  (2020-04-20T18:00:02Z)
• Hamiltonian Dynamics for Real-World Shape Interpolation [66.47407593823208]
  We revisit the classical problem of 3D shape and propose a novel, physically plausible approach based on Hamiltonian dynamics. Our method yields exactly volume preserving intermediate shapes, avoids self-intersections and is scalable to high resolution scans.
  arXiv  Detail & Related papers  (2020-04-10T18:38:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.