Gramian Angular Fields for leveraging pretrained computer vision models with anomalous diffusion trajectories

• URL: http://arxiv.org/abs/2310.01416v1
• Date: Sat, 2 Sep 2023 17:22:45 GMT
• Title: Gramian Angular Fields for leveraging pretrained computer vision models with anomalous diffusion trajectories
• Authors: \`Oscar Garibo-i-Orts and Nicol\'as Firbas and Laura Sebasti\'a and J. Alberto Conejero
• Abstract summary: We present a new data-driven method for working with diffusive trajectories. This method utilizes Gramian Angular Fields (GAF) to encode one-dimensional trajectories as images. We leverage two well-established pre-trained computer-vision models, ResNet and MobileNet, to characterize the underlying diffusive regime.
• Score: 0.9012198585960443
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Anomalous diffusion is present at all scales, from atomic to large scales. Some exemplary systems are; ultra-cold atoms, telomeres in the nucleus of cells, moisture transport in cement-based materials, the free movement of arthropods, and the migration patterns of birds. The characterization of the diffusion gives critical information about the dynamics of these systems and provides an interdisciplinary framework with which to study diffusive transport. Thus, the problem of identifying underlying diffusive regimes and inferring the anomalous diffusion exponent {$\alpha$} with high confidence is critical to physics, chemistry, biology, and ecology. Classification and analysis of raw trajectories combining machine learning techniques with statistics extracted from them have widely been studied in the Anomalous Diffusion Challenge ge (Munoz-Gil et al., 2021). Here we present a new data-driven method for working with diffusive trajectories. This method utilizes Gramian Angular Fields (GAF) to encode one-dimensional trajectories as images (Gramian Matrices), while preserving their spatiotemporal structure for input to computer-vision models. This allows us to leverage two well-established pre-trained computer-vision models, ResNet and MobileNet, to characterize the underlying diffusive regime, and infer the anomalous diffusion exponent {$\alpha$}. Short raw trajectories, of lengths between 10 and 50, are commonly encountered in single-particle tracking experiments and are the most difficult to characterize. We show that by using GAF images, we can outperform the current state-of-the-art while increasing accessibility to machine learning methods in an applied setting.

Related papers

• Neural Message Passing Induced by Energy-Constrained Diffusion [79.9193447649011]
  We propose an energy-constrained diffusion model as a principled interpretable framework for understanding the mechanism of MPNNs. We show that the new model can yield promising performance for cases where the data structures are observed (as a graph), partially observed or completely unobserved.
  arXiv  Detail & Related papers  (2024-09-13T17:54:41Z)
• Learning to Approximate Particle Smoothing Trajectories via Diffusion Generative Models [16.196738720721417]
  Learning systems from sparse observations is critical in numerous fields, including biology, finance, and physics. We introduce a method that integrates conditional particle filtering with ancestral sampling and diffusion models. We demonstrate the approach in time-series generation and tasks, including vehicle tracking and single-cell RNA sequencing data.
  arXiv  Detail & Related papers  (2024-06-01T21:54:01Z)
• Theoretical Insights for Diffusion Guidance: A Case Study for Gaussian Mixture Models [59.331993845831946]
  Diffusion models benefit from instillation of task-specific information into the score function to steer the sample generation towards desired properties. This paper provides the first theoretical study towards understanding the influence of guidance on diffusion models in the context of Gaussian mixture models.
  arXiv  Detail & Related papers  (2024-03-03T23:15:48Z)
• Advective Diffusion Transformers for Topological Generalization in Graph Learning [69.2894350228753]
  We show how graph diffusion equations extrapolate and generalize in the presence of varying graph topologies. We propose a novel graph encoder backbone, Advective Diffusion Transformer (ADiT), inspired by advective graph diffusion equations.
  arXiv  Detail & Related papers  (2023-10-10T08:40:47Z)
• Directional diffusion models for graph representation learning [9.457273750874357]
  We propose a new class of models called it directional diffusion models These models incorporate data-dependent, anisotropic, and directional noises in the forward diffusion process. We conduct extensive experiments on 12 publicly available datasets, focusing on two distinct graph representation learning tasks.
  arXiv  Detail & Related papers  (2023-06-22T21:27:48Z)
• Eliminating Lipschitz Singularities in Diffusion Models [51.806899946775076]
  We show that diffusion models frequently exhibit the infinite Lipschitz near the zero point of timesteps. This poses a threat to the stability and accuracy of the diffusion process, which relies on integral operations. We propose a novel approach, dubbed E-TSDM, which eliminates the Lipschitz of the diffusion model near zero.
  arXiv  Detail & Related papers  (2023-06-20T03:05:28Z)
• Graph Neural Network-based surrogate model for granular flows [2.153852088624324]
  Granular flow dynamics is crucial for assessing various geotechnical risks, including landslides and debris flows. Traditional continuum and discrete numerical methods are limited by their computational cost in simulating large-scale systems. We develop a graph neural network-based simulator (GNS) that takes the current state of granular flow and predicts the next state using explicit integration by learning the local interaction laws.
  arXiv  Detail & Related papers  (2023-05-09T07:28:12Z)
• A Survey on Generative Diffusion Model [75.93774014861978]
  Diffusion models are an emerging class of deep generative models. They have certain limitations, including a time-consuming iterative generation process and confinement to high-dimensional Euclidean space. This survey presents a plethora of advanced techniques aimed at enhancing diffusion models.
  arXiv  Detail & Related papers  (2022-09-06T16:56:21Z)
• Efficient recurrent neural network methods for anomalously diffusing single particle short and noisy trajectories [0.08594140167290096]
  We present a data-driven method able to infer the anomalous exponent and to identify the type of anomalous diffusion process behind single, noisy and short trajectories. A combination of convolutional and recurrent neural networks were used to achieve state-of-the-art results.
  arXiv  Detail & Related papers  (2021-08-05T20:04:37Z)
• Extreme Learning Machine for the Characterization of Anomalous Diffusion from Single Trajectories [0.0]
  I describe a simple approach to tackle the tasks of the AnDi challenge by combining extreme learning machine and feature engineering (AnDi-ELM) The method reaches satisfactory performance while offering a straightforward implementation and fast training time with limited computing resources.
  arXiv  Detail & Related papers  (2021-05-06T11:56:27Z)
• Focus of Attention Improves Information Transfer in Visual Features [80.22965663534556]
  This paper focuses on unsupervised learning for transferring visual information in a truly online setting. The computation of the entropy terms is carried out by a temporal process which yields online estimation of the entropy terms. In order to better structure the input probability distribution, we use a human-like focus of attention model.
  arXiv  Detail & Related papers  (2020-06-16T15:07:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.