Towards detailed and interpretable hybrid modeling of continental-scale bird migration

• URL: http://arxiv.org/abs/2407.10259v1
• Date: Sun, 14 Jul 2024 15:52:19 GMT
• Title: Towards detailed and interpretable hybrid modeling of continental-scale bird migration
• Authors: Fiona Lippert, Bart Kranstauber, Patrick Forré, E. Emiel van Loon,
• Abstract summary: We build on a recently developed hybrid model of continental-scale bird migration, which combines a movement model inspired by fluid dynamics with recurrent neural networks. F FluxRGNN has been shown to successfully predict key migration patterns, but its spatial resolution is constrained by the typically sparse observations obtained from weather radars. We propose two major modifications that allow for more detailed predictions on any desired tessellation while providing control over the interpretability of model components.
• Score: 9.887133861477231
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Hybrid modeling aims to augment traditional theory-driven models with machine learning components that learn unknown parameters, sub-models or correction terms from data. In this work, we build on FluxRGNN, a recently developed hybrid model of continental-scale bird migration, which combines a movement model inspired by fluid dynamics with recurrent neural networks that capture the complex decision-making processes of birds. While FluxRGNN has been shown to successfully predict key migration patterns, its spatial resolution is constrained by the typically sparse observations obtained from weather radars. Additionally, its trainable components lack explicit incentives to adequately predict take-off and landing events. Both aspects limit our ability to interpret model results ecologically. To address this, we propose two major modifications that allow for more detailed predictions on any desired tessellation while providing control over the interpretability of model components. In experiments on the U.S. weather radar network, the enhanced model effectively leverages the underlying movement model, resulting in strong extrapolation capabilities to unobserved locations.

Related papers

• Towards Generalizable and Interpretable Motion Prediction: A Deep Variational Bayes Approach [54.429396802848224]
  This paper proposes an interpretable generative model for motion prediction with robust generalizability to out-of-distribution cases. For interpretability, the model achieves the target-driven motion prediction by estimating the spatial distribution of long-term destinations. Experiments on motion prediction datasets validate that the fitted model can be interpretable and generalizable.
  arXiv  Detail & Related papers  (2024-03-10T04:16:04Z)
• Weather Prediction with Diffusion Guided by Realistic Forecast Processes [49.07556359513563]
  We introduce a novel method that applies diffusion models (DM) for weather forecasting. Our method can achieve both direct and iterative forecasting with the same modeling framework. The flexibility and controllability of our model empowers a more trustworthy DL system for the general weather community.
  arXiv  Detail & Related papers  (2024-02-06T21:28:42Z)
• Interpretable Water Level Forecaster with Spatiotemporal Causal Attention Mechanisms [0.0]
  This work proposes a neuraltemporal model with a transformer exploiting a causal relationship based on prior knowledge. We use the Han River dataset from 2016 to compare 2021, and confirm that our model provides an interpretable and consistent model with prior knowledge.
  arXiv  Detail & Related papers  (2023-02-28T04:37:26Z)
• Hyper-Representations for Pre-Training and Transfer Learning [2.9678808525128813]
  We extend hyper-representations for generative use to sample new model weights as pre-training. Our results indicate the potential of knowledge aggregation from model zoos to new models via hyper-representations.
  arXiv  Detail & Related papers  (2022-07-22T09:01:21Z)
• Physics-Inspired Temporal Learning of Quadrotor Dynamics for Accurate Model Predictive Trajectory Tracking [76.27433308688592]
  Accurately modeling quadrotor's system dynamics is critical for guaranteeing agile, safe, and stable navigation. We present a novel Physics-Inspired Temporal Convolutional Network (PI-TCN) approach to learning quadrotor's system dynamics purely from robot experience. Our approach combines the expressive power of sparse temporal convolutions and dense feed-forward connections to make accurate system predictions.
  arXiv  Detail & Related papers  (2022-06-07T13:51:35Z)
• End-to-End Learning of Hybrid Inverse Dynamics Models for Precise and Compliant Impedance Control [16.88250694156719]
  We present a novel hybrid model formulation that enables us to identify fully physically consistent inertial parameters of a rigid body dynamics model. We compare our approach against state-of-the-art inverse dynamics models on a 7 degree of freedom manipulator.
  arXiv  Detail & Related papers  (2022-05-27T07:39:28Z)
• Harnessing expressive capacity of Machine Learning modeling to represent complex coupling of Earth's auroral space weather regimes [0.0]
  We develop multiple Deep Learning (DL) models that advance predictions of the global auroral particle precipitation. We use observations from low Earth orbiting spacecraft of electron energy flux to develop a model that improves global nowcasts. Notably, the ML models improve prediction of the extreme events, historically to accurate specification and indicate that increased capacity provided by ML innovation can address grand challenges in science of space weather.
  arXiv  Detail & Related papers  (2021-11-29T22:35:09Z)
• Deep learning for improved global precipitation in numerical weather prediction systems [1.721029532201972]
  We use the UNET architecture of a deep convolutional neural network with residual learning as a proof of concept to learn global data-driven models of precipitation. The results are compared with the operational dynamical model used by the India Meteorological Department. This study is a proof-of-concept showing that residual learning-based UNET can unravel physical relationships to target precipitation.
  arXiv  Detail & Related papers  (2021-06-20T05:10:42Z)
• Churn Reduction via Distillation [54.5952282395487]
  We show an equivalence between training with distillation using the base model as the teacher and training with an explicit constraint on the predictive churn. We then show that distillation performs strongly for low churn training against a number of recent baselines.
  arXiv  Detail & Related papers  (2021-06-04T18:03:31Z)
• Hybrid Physics and Deep Learning Model for Interpretable Vehicle State Prediction [75.1213178617367]
  We propose a hybrid approach combining deep learning and physical motion models. We achieve interpretability by restricting the output range of the deep neural network as part of the hybrid model. The results show that our hybrid model can improve model interpretability with no decrease in accuracy compared to existing deep learning approaches.
  arXiv  Detail & Related papers  (2021-03-11T15:21:08Z)
• Haar Wavelet based Block Autoregressive Flows for Trajectories [129.37479472754083]
  Prediction of trajectories such as that of pedestrians is crucial to the performance of autonomous agents. We introduce a novel Haar wavelet based block autoregressive model leveraging split couplings. We illustrate the advantages of our approach for generating diverse and accurate trajectories on two real-world datasets.
  arXiv  Detail & Related papers  (2020-09-21T13:57:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.