Feature-free regression kriging

• URL: http://arxiv.org/abs/2507.07382v1
• Date: Thu, 10 Jul 2025 02:34:07 GMT
• Title: Feature-free regression kriging
• Authors: Peng Luo, Yilong Wu, Yongze Song,
• Abstract summary: This study proposes a Feature-Free Regression Kriging (FFRK) method to construct a regression-based trend surface without requiring external explanatory variables.<n>We conducted experiments on the spatial distribution prediction of three heavy metals in a mining area in Australia.<n>This approach effectively addresses spatial nonstationarity while reducing the cost of acquiring explanatory variables, improving both prediction accuracy and ability.
• Score: 4.270650728191168
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Spatial interpolation is a crucial task in geography. As perhaps the most widely used interpolation methods, geostatistical models -- such as Ordinary Kriging (OK) -- assume spatial stationarity, which makes it difficult to capture the nonstationary characteristics of geographic variables. A common solution is trend surface modeling (e.g., Regression Kriging, RK), which relies on external explanatory variables to model the trend and then applies geostatistical interpolation to the residuals. However, this approach requires high-quality and readily available explanatory variables, which are often lacking in many spatial interpolation scenarios -- such as estimating heavy metal concentrations underground. This study proposes a Feature-Free Regression Kriging (FFRK) method, which automatically extracts geospatial features -- including local dependence, local heterogeneity, and geosimilarity -- to construct a regression-based trend surface without requiring external explanatory variables. We conducted experiments on the spatial distribution prediction of three heavy metals in a mining area in Australia. In comparison with 17 classical interpolation methods, the results indicate that FFRK, which does not incorporate any explanatory variables and relies solely on extracted geospatial features, consistently outperforms both conventional Kriging techniques and machine learning models that depend on explanatory variables. This approach effectively addresses spatial nonstationarity while reducing the cost of acquiring explanatory variables, improving both prediction accuracy and generalization ability. This finding suggests that an accurate characterization of geospatial features based on domain knowledge can significantly enhance spatial prediction performance -- potentially yielding greater improvements than merely adopting more advanced statistical models.

Related papers

• Gradient Boosting for Spatial Regression Models with Autoregressive Disturbances [0.0]
  A novel model-based gradient boosting algorithm is proposed for spatial regression models with autoregressive disturbances.<n>The algorithm provides an alternative estimation procedure which is feasible even in high-dimensional settings.<n>A case study is presented where the life expectancy in German districts is modeled incorporating a potential spatial dependence structure.
  arXiv  Detail & Related papers  (2025-06-16T16:40:47Z)
• Geometric Regularity in Deterministic Sampling of Diffusion-based Generative Models [39.94246633953425]
  We reveal a striking geometric regularity in the deterministic sampling dynamics.<n>All trajectories exhibit an almost identical ''boomerang'' shape, regardless of the model architecture, applied conditions, or generated content.<n>We propose a dynamic programming-based scheme to better align the sampling time schedule with the underlying trajectory structure.
  arXiv  Detail & Related papers  (2025-06-11T21:09:09Z)
• An Interpretable Implicit-Based Approach for Modeling Local Spatial Effects: A Case Study of Global Gross Primary Productivity [9.352810748734157]
  In Earth sciences, unobserved factors exhibit non-stationary distributions, causing the relationships between features and targets to display spatial heterogeneity.<n>In geographic machine learning tasks, conventional statistical learning methods often struggle to capture spatial heterogeneity.<n>We propose a novel perspective - that is, simultaneously modeling common features across different locations alongside spatial differences using deep neural networks.
  arXiv  Detail & Related papers  (2025-02-10T05:44:54Z)
• Time Series Analysis by State Space Learning [44.99833362998488]
  Time series analysis by state-space models is widely used in forecasting and extracting unobservable components like level slope, and seasonality, along with explanatory variables. Our research introduces the State Space Learning (SSL), a novel framework and paradigm that leverages the capabilities of statistical learning to construct a comprehensive framework for time series modeling and forecasting.
  arXiv  Detail & Related papers  (2024-08-17T07:04:26Z)
• Trivialized Momentum Facilitates Diffusion Generative Modeling on Lie Groups [37.78638937228254]
  This article demonstrates how a technique called trivialization' can transfer the effectiveness of diffusion models in Euclidean spaces to Lie groups.<n>It achieves state-of-the-art performance on protein and RNA torsion angle generation and sophisticated torus datasets.
  arXiv  Detail & Related papers  (2024-05-25T23:53:07Z)
• Dynamic Kernel-Based Adaptive Spatial Aggregation for Learned Image Compression [63.56922682378755]
  We focus on extending spatial aggregation capability and propose a dynamic kernel-based transform coding. The proposed adaptive aggregation generates kernel offsets to capture valid information in the content-conditioned range to help transform. Experimental results demonstrate that our method achieves superior rate-distortion performance on three benchmarks compared to the state-of-the-art learning-based methods.
  arXiv  Detail & Related papers  (2023-08-17T01:34:51Z)
• GWRBoost:A geographically weighted gradient boosting method for explainable quantification of spatially-varying relationships [11.025779617297946]
  We propose a geographically gradient boosting weighted regression model, GWRBoost, to alleviate underfitting problems. Our proposed model can reduce the RMSE by 18.3% in parameter estimation accuracy and AICc by 67.3% in the goodness of fit.
  arXiv  Detail & Related papers  (2022-12-12T10:24:47Z)
• Mitigation of Spatial Nonstationarity with Vision Transformers [1.690637178959708]
  We show the impact of two common types of geostatistical spatial nonstationarity on deep learning model prediction performance. We propose the mitigation of such impacts using self-attention (vision transformer) models.
  arXiv  Detail & Related papers  (2022-12-09T02:16:05Z)
• RbX: Region-based explanations of prediction models [69.3939291118954]
  Region-based explanations (RbX) is a model-agnostic method to generate local explanations of scalar outputs from a black-box prediction model. RbX is guaranteed to satisfy a "sparsity axiom," which requires that features which do not enter into the prediction model are assigned zero importance.
  arXiv  Detail & Related papers  (2022-10-17T03:38:06Z)
• Adaptive LASSO estimation for functional hidden dynamic geostatistical model [69.10717733870575]
  We propose a novel model selection algorithm based on a penalized maximum likelihood estimator (PMLE) for functional hiddenstatistical models (f-HD) The algorithm is based on iterative optimisation and uses an adaptive least absolute shrinkage and selector operator (GMSOLAS) penalty function, wherein the weights are obtained by the unpenalised f-HD maximum-likelihood estimators.
  arXiv  Detail & Related papers  (2022-08-10T19:17:45Z)
• Variational Inference with Locally Enhanced Bounds for Hierarchical Models [38.73307745906571]
  We propose a new family of variational bounds for hierarchical models based on the application of tightening methods. We show that our approach naturally allows the use of subsampling to get unbiased gradients, and that it fully leverages the power of methods that build tighter lower bounds.
  arXiv  Detail & Related papers  (2022-03-08T22:53:43Z)
• Which Invariance Should We Transfer? A Causal Minimax Learning Approach [18.71316951734806]
  We present a comprehensive minimax analysis from a causal perspective. We propose an efficient algorithm to search for the subset with minimal worst-case risk. The effectiveness and efficiency of our methods are demonstrated on synthetic data and the diagnosis of Alzheimer's disease.
  arXiv  Detail & Related papers  (2021-07-05T09:07:29Z)
• Geostatistical Learning: Challenges and Opportunities [0.0]
  We introduce the geostatistical (transfer) learning problem, and illustrate the challenges of learning from geospatial data. Experiments with synthetic Gaussian process data as well as with real data from geophysical surveys in New Zealand indicate that none of the methods are adequate for model selection in a geospatial context.
  arXiv  Detail & Related papers  (2021-02-17T14:33:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.