Spherinator and HiPSter: Representation Learning for Unbiased Knowledge Discovery from Simulations

• URL: http://arxiv.org/abs/2406.03810v1
• Date: Thu, 6 Jun 2024 07:34:58 GMT
• Title: Spherinator and HiPSter: Representation Learning for Unbiased Knowledge Discovery from Simulations
• Abstract summary: We describe a new, unbiased, and machine learning based approach to obtain useful scientific insights from a broad range of simulations. Our concept is based on applying nonlinear dimensionality reduction to learn compact representations of the data in a low-dimensional space. We present a prototype using a rotational invariant hyperspherical variational convolutional autoencoder, utilizing a power distribution in the latent space, and trained on galaxies from IllustrisTNG simulation.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Simulations are the best approximation to experimental laboratories in astrophysics and cosmology. However, the complexity, richness, and large size of their outputs severely limit the interpretability of their predictions. We describe a new, unbiased, and machine learning based approach to obtaining useful scientific insights from a broad range of simulations. The method can be used on today's largest simulations and will be essential to solve the extreme data exploration and analysis challenges posed by the Exascale era. Furthermore, this concept is so flexible, that it will also enable explorative access to observed data. Our concept is based on applying nonlinear dimensionality reduction to learn compact representations of the data in a low-dimensional space. The simulation data is projected onto this space for interactive inspection, visual interpretation, sample selection, and local analysis. We present a prototype using a rotational invariant hyperspherical variational convolutional autoencoder, utilizing a power distribution in the latent space, and trained on galaxies from IllustrisTNG simulation. Thereby, we obtain a natural Hubble tuning fork like similarity space that can be visualized interactively on the surface of a sphere by exploiting the power of HiPS tilings in Aladin Lite.

Related papers

• Bridging the Simulation-to-Experiment Gap with Generative Models using Adversarial Distribution Alignment [51.246114581338865]
  A fundamental challenge in science and engineering is the simulation-to-experiment gap.<n>We propose a data-driven distribution alignment framework that bridges this gap.<n>We prove that our method recovers the target observable distribution, even with multiple, potentially correlated observables.
  arXiv  Detail & Related papers  (2026-04-01T17:21:33Z)
• Deep Learning in Astrophysics [0.2700171473617699]
  Deep learning has generated diverse perspectives in astronomy, with ongoing discussions between proponents and skeptics motivating this review.<n>We examine how neural networks complement classical statistics, extending our data analytical toolkit for modern surveys.<n>This review demonstrates how deep learning incorporates domain knowledge through architectural design, with built-in assumptions guiding models toward physically meaningful solutions.
  arXiv  Detail & Related papers  (2025-10-12T17:31:46Z)
• Mind the Gap: Navigating Inference with Optimal Transport Maps [0.9242985360636449]
  We present a model calibration approach based on optimal transport, which we apply to high-dimensional simulations for the first time.<n>We demonstrate the performance of our approach through jet tagging, using a dataset inspired by the CMS experiment at the Large Hadron Collider.<n>This is a key step toward allowing the unbiased use of foundation models'' in particle physics.
  arXiv  Detail & Related papers  (2025-07-09T16:28:21Z)
• Spatial Knowledge Graph-Guided Multimodal Synthesis [78.11669780958657]
  We introduce a novel multimodal synthesis approach guided by spatial knowledge graphs, grounded in the concept of knowledge-to-data generation.<n>In experiments, data synthesized from diverse types of spatial knowledge, including direction and distance, enhance the spatial perception and reasoning abilities of MLLMs markedly.<n>We hope that the idea of knowledge-based data synthesis can advance the development of spatial intelligence.
  arXiv  Detail & Related papers  (2025-05-28T17:50:21Z)
• Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal Control [97.98560001760126]
  We introduce Cosmos-Transfer, a conditional world generation model that can generate world simulations based on multiple spatial control inputs. We conduct evaluations to analyze the proposed model and demonstrate its applications for Physical AI, including robotics2Real and autonomous vehicle data enrichment.
  arXiv  Detail & Related papers  (2025-03-18T17:57:54Z)
• Learning the Universe: Learning to Optimize Cosmic Initial Conditions with Non-Differentiable Structure Formation Models [0.0]
  We introduce Learning the Universe by Learning to Optimize (LULO) for reconstructing the 3D cosmic initial conditions. LULO is a gradient-free framework for reconstructing the 3D cosmic initial conditions. We demonstrate the method by accurately reconstructing initial conditions from $M_200mathrmc$ halos identified in a dark matter-only $N$-body simulation.
  arXiv  Detail & Related papers  (2025-02-18T19:17:01Z)
• GausSim: Foreseeing Reality by Gaussian Simulator for Elastic Objects [55.02281855589641]
  GausSim is a novel neural network-based simulator designed to capture the dynamic behaviors of real-world elastic objects represented through Gaussian kernels. We leverage continuum mechanics and treat each kernel as a Center of Mass System (CMS) that represents continuous piece of matter. In addition, GausSim incorporates explicit physics constraints, such as mass and momentum conservation, ensuring interpretable results and robust, physically plausible simulations.
  arXiv  Detail & Related papers  (2024-12-23T18:58:17Z)
• Efficient High-Resolution Visual Representation Learning with State Space Model for Human Pose Estimation [60.80423207808076]
  Capturing long-range dependencies while preserving high-resolution visual representations is crucial for dense prediction tasks such as human pose estimation.<n>We propose the Dynamic Visual State Space (DVSS) block, which augments visual state space models with multi-scale convolutional operations.<n>We build HRVMamba, a novel model for efficient high-resolution representation learning.
  arXiv  Detail & Related papers  (2024-10-04T06:19:29Z)
• CHARM: Creating Halos with Auto-Regressive Multi-stage networks [1.6987257996124416]
  CHARM is a novel method for creating mock halo catalogs. We show that the mock halo catalogs and painted galaxy catalogs have the same statistical properties as obtained from $N$-body simulations in both real space and redshift space.
  arXiv  Detail & Related papers  (2024-09-13T18:00:06Z)
• LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific Discovery [141.39722070734737]
  We propose to enhance the knowledge-driven, abstract reasoning abilities of Large Language Models with the computational strength of simulations. We introduce Scientific Generative Agent (SGA), a bilevel optimization framework. We conduct experiments to demonstrate our framework's efficacy in law discovery and molecular design.
  arXiv  Detail & Related papers  (2024-05-16T03:04:10Z)
• Diffusion posterior sampling for simulation-based inference in tall data settings [53.17563688225137]
  Simulation-based inference ( SBI) is capable of approximating the posterior distribution that relates input parameters to a given observation. In this work, we consider a tall data extension in which multiple observations are available to better infer the parameters of the model. We compare our method to recently proposed competing approaches on various numerical experiments and demonstrate its superiority in terms of numerical stability and computational cost.
  arXiv  Detail & Related papers  (2024-04-11T09:23:36Z)
• Towards a Machine Learning-Based Approach to Predict Space Object Density Distributions [0.7652747219811166]
  Current models for examining Anthropogenic Space Objects (ASOs) are computationally demanding. We propose a novel machine learning-based model, as an extension of the MIT Orbital Capacity Tool (MOCAT) We study how different deep learning-based solutions can potentially be good candidates for ASO propagation and manage the high-dimensionality of the data.
  arXiv  Detail & Related papers  (2024-01-08T19:43:30Z)
• Domain Adaptive Graph Neural Networks for Constraining Cosmological Parameters Across Multiple Data Sets [40.19690479537335]
  We show that DA-GNN achieves higher accuracy and robustness on cross-dataset tasks. This shows that DA-GNNs are a promising method for extracting domain-independent cosmological information.
  arXiv  Detail & Related papers  (2023-11-02T20:40:21Z)
• Simulation-based inference using surjective sequential neural likelihood estimation [50.24983453990065]
  Surjective Sequential Neural Likelihood estimation is a novel method for simulation-based inference. By embedding the data in a low-dimensional space, SSNL solves several issues previous likelihood-based methods had when applied to high-dimensional data sets.
  arXiv  Detail & Related papers  (2023-08-02T10:02:38Z)
• Towards Complex Dynamic Physics System Simulation with Graph Neural ODEs [75.7104463046767]
  This paper proposes a novel learning based simulation model that characterizes the varying spatial and temporal dependencies in particle systems. We empirically evaluate GNSTODE's simulation performance on two real-world particle systems, Gravity and Coulomb.
  arXiv  Detail & Related papers  (2023-05-21T03:51:03Z)
• ELSA -- Enhanced latent spaces for improved collider simulations [0.1450405446885067]
  Simulations play a key role for inference in collider physics. We explore various approaches for enhancing the precision of simulations using machine learning. We find that modified simulations can achieve sub-percent precision across a wide range of phase space.
  arXiv  Detail & Related papers  (2023-05-12T18:00:03Z)
• VTAE: Variational Transformer Autoencoder with Manifolds Learning [144.0546653941249]
  Deep generative models have demonstrated successful applications in learning non-linear data distributions through a number of latent variables. The nonlinearity of the generator implies that the latent space shows an unsatisfactory projection of the data space, which results in poor representation learning. We show that geodesics and accurate computation can substantially improve the performance of deep generative models.
  arXiv  Detail & Related papers  (2023-04-03T13:13:19Z)
• Bridging the Gap to Real-World Object-Centric Learning [66.55867830853803]
  We show that reconstructing features from models trained in a self-supervised manner is a sufficient training signal for object-centric representations to arise in a fully unsupervised way. Our approach, DINOSAUR, significantly out-performs existing object-centric learning models on simulated data.
  arXiv  Detail & Related papers  (2022-09-29T15:24:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.