Gradient Boosting for Spatial Panel Models with Random and Fixed Effects
- URL: http://arxiv.org/abs/2603.14543v1
- Date: Sun, 15 Mar 2026 18:33:56 GMT
- Title: Gradient Boosting for Spatial Panel Models with Random and Fixed Effects
- Abstract summary: This article proposes a model-based gradient boosting algorithm, which enables estimation with interpretable results in low- and high-dimensional settings.<n>Due to its modular nature, the flexible model-based gradient boosting algorithm is suitable for a variety of spatial panel models.<n>Real-world applications include non-life insurance in Italian districts, rice production in Indonesian farms and life expectancy in German districts.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Due to the increase in data availability in urban and regional studies, various spatial panel models have emerged to model spatial panel data, which exhibit spatial patterns and spatial dependencies between observations across time. Although estimation is usually based on maximum likelihood or generalized method of moments, these methods may fail to yield unique solutions if researchers are faced with high-dimensional settings. This article proposes a model-based gradient boosting algorithm, which enables estimation with interpretable results that is feasible in low- and high-dimensional settings. Due to its modular nature, the flexible model-based gradient boosting algorithm is suitable for a variety of spatial panel models, which can include random and fixed effects. The general framework also enables data-driven model and variable selection as well as implicit regularization where the bias-variance trade-off is controlled for, thereby enhancing accuracy of prediction on out-of-sample spatial panel data. Monte Carlo experiments concerned with the performance of estimation and variable selection confirm proper functionality in low- and high-dimensional settings while real-world applications including non-life insurance in Italian districts, rice production in Indonesian farms and life expectancy in German districts illustrate the potential application.
Related papers
- Demystifying Data-Driven Probabilistic Medium-Range Weather Forecasting [63.8116386935854]
We demonstrate that state-of-the-art probabilistic skill requires neither intricate architectural constraints nor specialized trainings.<n>We introduce a scalable framework for learning multi-scale atmospheric dynamics by combining a directly downsampled latent space with a history-conditioned local projector.<n>We find that our framework design is robust to the choice of probabilistic estimators, seamlessly supporting interpolants, diffusion models, and CRPS-based ensemble training.
arXiv Detail & Related papers (2026-01-26T03:52:16Z) - High-Resolution Probabilistic Data-Driven Weather Modeling with a Stretched-Grid [1.2136581144377903]
We present a data-driven weather model capable of providing an ensemble of high spatial resolution realizations of 87 variables at arbitrary forecast length and ensemble size.<n>The model is trained using a loss function based on the Continuous Ranked Probability Score (CRPS) evaluated point-wise in real and spectral space.
arXiv Detail & Related papers (2025-11-28T10:08:03Z) - Nonparametric Data Attribution for Diffusion Models [57.820618036556084]
Data attribution for generative models seeks to quantify the influence of individual training examples on model outputs.<n>We propose a nonparametric attribution method that operates entirely on data, measuring influence via patch-level similarity between generated and training images.
arXiv Detail & Related papers (2025-10-16T03:37:16Z) - Gradient Boosting for Spatial Regression Models with Autoregressive Disturbances [0.0]
A novel model-based gradient boosting algorithm is proposed for spatial regression models with autoregressive disturbances.<n>The algorithm provides an alternative estimation procedure which is feasible even in high-dimensional settings.<n>A case study is presented where the life expectancy in German districts is modeled incorporating a potential spatial dependence structure.
arXiv Detail & Related papers (2025-06-16T16:40:47Z) - Influence Functions for Scalable Data Attribution in Diffusion Models [52.92223039302037]
Diffusion models have led to significant advancements in generative modelling.<n>Yet their widespread adoption poses challenges regarding data attribution and interpretability.<n>We develop an influence functions framework to address these challenges.
arXiv Detail & Related papers (2024-10-17T17:59:02Z) - Efficient modeling of sub-kilometer surface wind with Gaussian processes and neural networks [0.0]
Wind represents a particularly challenging variable to model due to its high spatial and temporal variability.
This paper presents a novel approach that integrates Gaussian processes and neural networks to model surface wind gusts at sub-kilometer resolution.
arXiv Detail & Related papers (2024-05-21T09:07:47Z) - Reconstructing Spatiotemporal Data with C-VAEs [49.1574468325115]
Conditional continuous representation of moving regions is commonly used.
In this work, we explore the capabilities of Conditional Varitemporal Autoencoder (C-VAE) models to generate realistic representations of regions' evolution.
arXiv Detail & Related papers (2023-07-12T15:34:10Z) - Spatial machine-learning model diagnostics: a model-agnostic
distance-based approach [91.62936410696409]
This contribution proposes spatial prediction error profiles (SPEPs) and spatial variable importance profiles (SVIPs) as novel model-agnostic assessment and interpretation tools.
The SPEPs and SVIPs of geostatistical methods, linear models, random forest, and hybrid algorithms show striking differences and also relevant similarities.
The novel diagnostic tools enrich the toolkit of spatial data science, and may improve ML model interpretation, selection, and design.
arXiv Detail & Related papers (2021-11-13T01:50:36Z) - A Clustering-aided Ensemble Method for Predicting Ridesourcing Demand in
Chicago [0.0]
This study proposes a Clustering-aided Ensemble Method (CEM) to forecast the zone-to-zone travel demand for ridesourcing services.
We implement and test the proposed methodology by using the ridesourcing-trip data in Chicago.
arXiv Detail & Related papers (2021-09-08T04:58:29Z) - Characterizing Fairness Over the Set of Good Models Under Selective
Labels [69.64662540443162]
We develop a framework for characterizing predictive fairness properties over the set of models that deliver similar overall performance.
We provide tractable algorithms to compute the range of attainable group-level predictive disparities.
We extend our framework to address the empirically relevant challenge of selectively labelled data.
arXiv Detail & Related papers (2021-01-02T02:11:37Z) - Prediction with Spatio-temporal Point Processes with Self Organizing
Decision Trees [0.0]
We introduce a novel approach to this problem.
Our approach is based on the Hawkes process, which is a non-stationary and self-exciting process.
We provide experimental results on real-life data.
arXiv Detail & Related papers (2020-03-07T20:39:31Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.