A Deep Learning Approach for Characterizing Major Galaxy Mergers
- URL: http://arxiv.org/abs/2102.05182v1
- Date: Tue, 9 Feb 2021 23:30:15 GMT
- Title: A Deep Learning Approach for Characterizing Major Galaxy Mergers
- Abstract summary: We demonstrate a CNN-based regression model that is able to predict, for the first time, the merger stage relative to the first perigee passage with a median error of 38.3 million years (Myrs) over a period of 400 Myrs.
We show that our model provides reasonable estimates on real observations, approximately matching prior estimates provided by detailed dynamical modeling.
- Score: 45.620634536466845
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Fine-grained estimation of galaxy merger stages from observations is a key
problem useful for validation of our current theoretical understanding of
galaxy formation. To this end, we demonstrate a CNN-based regression model that
is able to predict, for the first time, using a single image, the merger stage
relative to the first perigee passage with a median error of 38.3 million years
(Myrs) over a period of 400 Myrs. This model uses no specific dynamical
modeling and learns only from simulated merger events. We show that our model
provides reasonable estimates on real observations, approximately matching
prior estimates provided by detailed dynamical modeling. We provide a
preliminary interpretability analysis of our models, and demonstrate first
steps toward calibrated uncertainty estimation.
Related papers
- On the Asymptotics of Self-Supervised Pre-training: Two-Stage M-Estimation and Representation Symmetry [8.92071749364712]
Self-supervised pre-training has become a cornerstone of modern machine learning.<n>Existing bounds leave open the question of how sharp the current rates are.<n>We develop an intrinsic theory of pre-training via two-stage M-estimation.
arXiv Detail & Related papers (2026-03-29T11:04:03Z) - Agentic World Modeling for 6G: Near-Real-Time Generative State-Space Reasoning [70.56067503630486]
We argue that sixth-generation (6G) intelligence is not fluent token prediction but calibrated the capacity to imagine and choose.<n>We show that WM-MS3M cuts mean absolute error (MAE) by 1.69% versus MS3M with 32% fewer parameters and similar latency, and achieves 35-80% lower root mean squared error (RMSE) than attention/hybrid baselines with 2.3-4.1x faster inference.
arXiv Detail & Related papers (2025-11-04T17:22:22Z) - Lost in Retraining: Roaming the Parameter Space of Exponential Families Under Closed-Loop Learning [0.0]
We study closed-loop learning for models that belong to exponential families.<n>We show that maximum likelihood of the parameters endows sufficient statistics with the martingale property.<n>We show that this outcome may be prevented if the data contains at least one data point generated from a ground truth model.
arXiv Detail & Related papers (2025-06-25T17:12:22Z) - A Probabilistic Perspective on Model Collapse [9.087950471621653]
This paper aims to characterize the conditions under which model collapse occurs and, crucially, how it can be mitigated.<n>Under mild conditions, we rigorously show that progressively increasing the sample size at each training step is necessary to prevent model collapse.<n>We also investigate the probability that training on synthetic data yields models that outperform those trained solely on real data.
arXiv Detail & Related papers (2025-05-20T05:25:29Z) - Model-free Methods for Event History Analysis and Efficient Adjustment (PhD Thesis) [55.2480439325792]
This thesis is a series of independent contributions to statistics unified by a model-free perspective.
The first chapter elaborates on how a model-free perspective can be used to formulate flexible methods that leverage prediction techniques from machine learning.
The second chapter studies the concept of local independence, which describes whether the evolution of one process is directly influenced by another.
arXiv Detail & Related papers (2025-02-11T19:24:09Z) - SMILE: Zero-Shot Sparse Mixture of Low-Rank Experts Construction From Pre-Trained Foundation Models [85.67096251281191]
We present an innovative approach to model fusion called zero-shot Sparse MIxture of Low-rank Experts (SMILE) construction.
SMILE allows for the upscaling of source models into an MoE model without extra data or further training.
We conduct extensive experiments across diverse scenarios, such as image classification and text generation tasks, using full fine-tuning and LoRA fine-tuning.
arXiv Detail & Related papers (2024-08-19T17:32:15Z) - Predictive Churn with the Set of Good Models [64.05949860750235]
We study the effect of conflicting predictions over the set of near-optimal machine learning models.
We present theoretical results on the expected churn between models within the Rashomon set.
We show how our approach can be used to better anticipate, reduce, and avoid churn in consumer-facing applications.
arXiv Detail & Related papers (2024-02-12T16:15:25Z) - Likelihood-Based Methods Improve Parameter Estimation in Opinion
Dynamics Models [6.138671548064356]
We show that a maximum likelihood approach for parameter estimation in agent-based models (ABMs) of opinion dynamics outperforms the typical simulation-based approach.
In contrast, likelihood-based approaches derive a likelihood function that connects the unknown parameters to the observed data in a statistically principled way.
Our experimental results show that the maximum likelihood estimates are up to 4x more accurate and require up to 200x less computational time.
arXiv Detail & Related papers (2023-10-04T12:29:37Z) - Surrogate Model for Geological CO2 Storage and Its Use in Hierarchical
MCMC History Matching [0.0]
We extend the recently introduced recurrent R-U-Net surrogate model to treat geomodel realizations drawn from a wide range of geological scenarios.
We show that, using observed data from monitoring wells in synthetic true' models, geological uncertainty is reduced substantially.
arXiv Detail & Related papers (2023-08-11T18:29:28Z) - Learning Sample Difficulty from Pre-trained Models for Reliable
Prediction [55.77136037458667]
We propose to utilize large-scale pre-trained models to guide downstream model training with sample difficulty-aware entropy regularization.
We simultaneously improve accuracy and uncertainty calibration across challenging benchmarks.
arXiv Detail & Related papers (2023-04-20T07:29:23Z) - Bayesian Neural Network Inference via Implicit Models and the Posterior
Predictive Distribution [0.8122270502556371]
We propose a novel approach to perform approximate Bayesian inference in complex models such as Bayesian neural networks.
The approach is more scalable to large data than Markov Chain Monte Carlo.
We see this being useful in applications such as surrogate and physics-based models.
arXiv Detail & Related papers (2022-09-06T02:43:19Z) - Posterior Coreset Construction with Kernelized Stein Discrepancy for
Model-Based Reinforcement Learning [78.30395044401321]
We develop a novel model-based approach to reinforcement learning (MBRL)
It relaxes the assumptions on the target transition model to belong to a generic family of mixture models.
It can achieve up-to 50 percent reduction in wall clock time in some continuous control environments.
arXiv Detail & Related papers (2022-06-02T17:27:49Z) - HYPER: Learned Hybrid Trajectory Prediction via Factored Inference and
Adaptive Sampling [27.194900145235007]
We introduce HYPER, a general and expressive hybrid prediction framework.
By modeling traffic agents as a hybrid discrete-continuous system, our approach is capable of predicting discrete intent changes over time.
We train and validate our model on the Argoverse dataset, and demonstrate its effectiveness through comprehensive ablation studies and comparisons with state-of-the-art models.
arXiv Detail & Related papers (2021-10-05T20:20:10Z) - Predicting nucleation near the spinodal in the Ising model using machine
learning [3.5056930099070853]
We use a Convolutional Neural Network (CNN) and two logistic regression models to predict the probability of nucleation in the two-dimensional Ising model.
The CNN outperforms the logistic regression models near the spinodal of the Long Range Ising model, but the accuracy of its predictions decreases as the quenches approach the spinodal.
arXiv Detail & Related papers (2020-04-20T19:04:38Z) - Value-driven Hindsight Modelling [68.658900923595]
Value estimation is a critical component of the reinforcement learning (RL) paradigm.
Model learning can make use of the rich transition structure present in sequences of observations, but this approach is usually not sensitive to the reward function.
We develop an approach for representation learning in RL that sits in between these two extremes.
This provides tractable prediction targets that are directly relevant for a task, and can thus accelerate learning the value function.
arXiv Detail & Related papers (2020-02-19T18:10:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.