Revealing hidden correlations from complex spatial distributions: Adjacent Correlation Analysis

• URL: http://arxiv.org/abs/2506.05759v1
• Date: Fri, 06 Jun 2025 05:31:29 GMT
• Title: Revealing hidden correlations from complex spatial distributions: Adjacent Correlation Analysis
• Authors: Guang-Xing Li,
• Abstract summary: Correlations between quantities are the most reliable approach to describe relationships between different variables.<n>For complex patterns, directly searching for correlations is often impractical, as complexity and spatial inhomogeneity can obscure correlations.<n>We develop a new method, adjacent correlation analysis, to extract such correlations and represent them in phase space.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Physics has been transforming our view of nature for centuries. While combining physical knowledge with computational approaches has enabled detailed modeling of physical systems' evolution, understanding the emergence of patterns and structures remains limited. Correlations between quantities are the most reliable approach to describe relationships between different variables. However, for complex patterns, directly searching for correlations is often impractical, as complexity and spatial inhomogeneity can obscure correlations. We discovered that the key is to search for correlations in local regions and developed a new method, adjacent correlation analysis, to extract such correlations and represent them in phase space. When multiple observations are available, a useful way to study a system is to analyze distributions in phase space using the Probability Density Function (PDF). Adjacent correlation analysis evaluates vectors representing local correlations, which can be overlaid on the PDF plot to form the adjacent correlation plot. These correlation vectors often exhibit remarkably regular patterns and may lead to the discovery of new laws. The vectors we derive are equivalent to the vector field in dynamical systems on the attracting manifold. By efficiently representing spatial patterns as correlation vectors in phase space, our approach opens avenues for classification, prediction, parameter fitting, and forecasting.

Related papers

• Mapping correlations and coherence: adjacency-based approach to data visualization and regularity discovery [0.0]
  Correlation is a most commonly-used and effective approach to describe regularities in data.<n>We present an algorithm to derive maps representing the type and degree of correlations.<n>The method should facilitate the development of new computational approaches to regularity discovery.
  arXiv  Detail & Related papers  (2025-06-06T05:31:16Z)
• Correlating Variational Autoencoders Natively For Multi-View Imputation [2.9551363292600086]
  Multi-view data from the same source often exhibit correlation. This is mirrored in correlation between the latent spaces of separate variational autoencoders (VAEs) trained on each data-view. A multi-view VAE approach is proposed that incorporates a joint prior with a non-zero correlation structure between the latent spaces of the VAEs.
  arXiv  Detail & Related papers  (2024-11-05T13:43:37Z)
• Towards Statistically Significant Taxonomy Aware Co-location Pattern Detection [4.095979270829907]
  The goal is to find subsets of feature types or their parents whose spatial interaction is statistically significant. The problem is computationally challenging due to the exponential number of candidate co-location patterns generated by the taxonomy. This paper introduces two methods for incorporating and assessing the statistical significance of co-location patterns.
  arXiv  Detail & Related papers  (2024-06-29T04:48:39Z)
• Learning Divergence Fields for Shift-Robust Graph Representations [73.11818515795761]
  In this work, we propose a geometric diffusion model with learnable divergence fields for the challenging problem with interdependent data. We derive a new learning objective through causal inference, which can guide the model to learn generalizable patterns of interdependence that are insensitive across domains.
  arXiv  Detail & Related papers  (2024-06-07T14:29:21Z)
• Learning Complete Topology-Aware Correlations Between Relations for Inductive Link Prediction [121.65152276851619]
  We show that semantic correlations between relations are inherently edge-level and entity-independent. We propose a novel subgraph-based method, namely TACO, to model Topology-Aware COrrelations between relations. To further exploit the potential of RCN, we propose Complete Common Neighbor induced subgraph.
  arXiv  Detail & Related papers  (2023-09-20T08:11:58Z)
• Understanding and Mitigating Spurious Correlations in Text Classification with Neighborhood Analysis [69.07674653828565]
  Machine learning models have a tendency to leverage spurious correlations that exist in the training set but may not hold true in general circumstances. In this paper, we examine the implications of spurious correlations through a novel perspective called neighborhood analysis. We propose a family of regularization methods, NFL (doN't Forget your Language) to mitigate spurious correlations in text classification.
  arXiv  Detail & Related papers  (2023-05-23T03:55:50Z)
• Initial Correlations in Open Quantum Systems: Constructing Linear Dynamical Maps and Master Equations [62.997667081978825]
  We show that, for any predetermined initial correlations, one can introduce a linear dynamical map on the space of operators of the open system. We demonstrate that this construction leads to a linear, time-local quantum master equation with generalized Lindblad structure.
  arXiv  Detail & Related papers  (2022-10-24T13:43:04Z)
• Amortized Inference for Causal Structure Learning [72.84105256353801]
  Learning causal structure poses a search problem that typically involves evaluating structures using a score or independence test. We train a variational inference model to predict the causal structure from observational/interventional data. Our models exhibit robust generalization capabilities under substantial distribution shift.
  arXiv  Detail & Related papers  (2022-05-25T17:37:08Z)
• On the Kullback-Leibler divergence between pairwise isotropic Gaussian-Markov random fields [93.35534658875731]
  We derive expressions for the Kullback-Leibler divergence between two pairwise isotropic Gaussian-Markov random fields. The proposed equation allows the development of novel similarity measures in image processing and machine learning applications.
  arXiv  Detail & Related papers  (2022-03-24T16:37:24Z)
• Path Signature Area-Based Causal Discovery in Coupled Time Series [0.0]
  We propose the application of confidence sequences to analyze the significance of the magnitude of the signed area between two variables. This approach provides a new way to define the confidence of a causal link existing between two time series.
  arXiv  Detail & Related papers  (2021-10-23T19:57:22Z)
• On Disentangled Representations Learned From Correlated Data [59.41587388303554]
  We bridge the gap to real-world scenarios by analyzing the behavior of the most prominent disentanglement approaches on correlated data. We show that systematically induced correlations in the dataset are being learned and reflected in the latent representations. We also demonstrate how to resolve these latent correlations, either using weak supervision during training or by post-hoc correcting a pre-trained model with a small number of labels.
  arXiv  Detail & Related papers  (2020-06-14T12:47:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.