Geometric Prediction: Moving Beyond Scalars

• URL: http://arxiv.org/abs/2006.14163v1
• Date: Thu, 25 Jun 2020 04:12:57 GMT
• Title: Geometric Prediction: Moving Beyond Scalars
• Abstract summary: We show that equivariant networks have the capability to predict real-world geometric tensors without the need for such approximations. We propose a novel formulation of an important task, biomolecular structure refinement, as a geometric prediction problem. In both settings, we find that our equivariant network is able to generalize to unseen systems, despite having been trained on small sets of examples.
• Score: 4.702729080310267
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Many quantities we are interested in predicting are geometric tensors; we refer to this class of problems as geometric prediction. Attempts to perform geometric prediction in real-world scenarios have been limited to approximating them through scalar predictions, leading to losses in data efficiency. In this work, we demonstrate that equivariant networks have the capability to predict real-world geometric tensors without the need for such approximations. We show the applicability of this method to the prediction of force fields and then propose a novel formulation of an important task, biomolecular structure refinement, as a geometric prediction problem, improving state-of-the-art structural candidates. In both settings, we find that our equivariant network is able to generalize to unseen systems, despite having been trained on small sets of examples. This novel and data-efficient ability to predict real-world geometric tensors opens the door to addressing many problems through the lens of geometric prediction, in areas such as 3D vision, robotics, and molecular and structural biology.

Related papers

• Learning Point Cloud Geometry as a Statistical Manifold: Theory and Practice [11.695017334165287]
  LiDAR-acquired point clouds are inherently sparse and non-uniform.<n>Existing approaches attempt to compensate for these limitations by estimating local geometry.<n>We introduce Point-to-Ellipsoid (POLI), a deep neural estimator that predicts per-point Gaussian geometry.
  arXiv  Detail & Related papers  (2026-05-11T12:27:25Z)
• Grid-World Representations in Transformers Reflect Predictive Geometry [0.0]
  Next-token predictors often appear to develop internal representations of the latent world and its rules.<n>We train decoder-only transformers on vectors sampled from the exact distribution of random walks.<n>Across models and layers, the learned representations align strongly with the ground-truth predictive vectors and are often low-dimensional.<n>Although demonstrated in a simplified toy system, the analysis suggests that prefixes representations supporting optimal prediction may provide a useful lens for studying how neural networks internalize grammatical and other structural constraints.
  arXiv  Detail & Related papers  (2026-03-17T15:47:33Z)
• CP$^2$: Leveraging Geometry for Conformal Prediction via Canonicalization [51.716834831684004]
  We study the problem of conformal prediction (CP) under geometric data shifts.<n>We propose integrating geometric information--such as geometric pose--into the conformal procedure to reinstate its guarantees.
  arXiv  Detail & Related papers  (2025-06-19T10:12:02Z)
• Constrained belief updates explain geometric structures in transformer representations [0.0]
  We integrate the model-agnostic theory of optimal prediction with mechanistic interpretability to analyze transformers trained on a tractable family of hidden Markov models. We find that attention heads carry out an algorithm with a natural interpretation in the probability simplex, and create representations with distinctive geometric structure.
  arXiv  Detail & Related papers  (2025-02-04T03:03:54Z)
• Geometry Distributions [51.4061133324376]
  We propose a novel geometric data representation that models geometry as distributions. Our approach uses diffusion models with a novel network architecture to learn surface point distributions. We evaluate our representation qualitatively and quantitatively across various object types, demonstrating its effectiveness in achieving high geometric fidelity.
  arXiv  Detail & Related papers  (2024-11-25T04:06:48Z)
• Bridging Geometric States via Geometric Diffusion Bridge [79.60212414973002]
  We introduce the Geometric Diffusion Bridge (GDB), a novel generative modeling framework that accurately bridges initial and target geometric states. GDB employs an equivariant diffusion bridge derived by a modified version of Doob's $h$-transform for connecting geometric states. We show that GDB surpasses existing state-of-the-art approaches, opening up a new pathway for accurately bridging geometric states.
  arXiv  Detail & Related papers  (2024-10-31T17:59:53Z)
• Geometric Inductive Biases of Deep Networks: The Role of Data and Architecture [22.225213114532533]
  We argue that when training a neural network, the input space curvature remains invariant under transformation determined by its architecture. We show that in cases where the average geometry is low-rank (such as in a ResNet), the geometry only changes in a subset of the input space.
  arXiv  Detail & Related papers  (2024-10-15T19:46:09Z)
• A Survey of Geometric Graph Neural Networks: Data Structures, Models and Applications [67.33002207179923]
  This paper presents a survey of data structures, models, and applications related to geometric GNNs. We provide a unified view of existing models from the geometric message passing perspective. We also summarize the applications as well as the related datasets to facilitate later research for methodology development and experimental evaluation.
  arXiv  Detail & Related papers  (2024-03-01T12:13:04Z)
• Adaptive Surface Normal Constraint for Geometric Estimation from Monocular Images [56.86175251327466]
  We introduce a novel approach to learn geometries such as depth and surface normal from images while incorporating geometric context. Our approach extracts geometric context that encodes the geometric variations present in the input image and correlates depth estimation with geometric constraints. Our method unifies depth and surface normal estimations within a cohesive framework, which enables the generation of high-quality 3D geometry from images.
  arXiv  Detail & Related papers  (2024-02-08T17:57:59Z)
• A quatum inspired neural network for geometric modeling [14.214656118952178]
  We introduce an innovative equivariant Matrix Product State (MPS)-based message-passing strategy. Our method effectively models complex many-body relationships, suppressing mean-field approximations. It seamlessly replaces the standard message-passing and layer-aggregation modules intrinsic to geometric GNNs.
  arXiv  Detail & Related papers  (2024-01-03T15:59:35Z)
• A Hitchhiker's Guide to Geometric GNNs for 3D Atomic Systems [87.30652640973317]
  Recent advances in computational modelling of atomic systems represent them as geometric graphs with atoms embedded as nodes in 3D Euclidean space. Geometric Graph Neural Networks have emerged as the preferred machine learning architecture powering applications ranging from protein structure prediction to molecular simulations and material generation. This paper provides a comprehensive and self-contained overview of the field of Geometric GNNs for 3D atomic systems.
  arXiv  Detail & Related papers  (2023-12-12T18:44:19Z)
• Revisiting Transformation Invariant Geometric Deep Learning: Are Initial Representations All You Need? [80.86819657126041]
  We show that transformation-invariant and distance-preserving initial representations are sufficient to achieve transformation invariance. Specifically, we realize transformation-invariant and distance-preserving initial point representations by modifying multi-dimensional scaling. We prove that TinvNN can strictly guarantee transformation invariance, being general and flexible enough to be combined with the existing neural networks.
  arXiv  Detail & Related papers  (2021-12-23T03:52:33Z)
• Geometric Algebra Attention Networks for Small Point Clouds [0.0]
  Problems in the physical sciences deal with relatively small sets of points in two- or three-dimensional space. We present rotation- and permutation-equivariant architectures for deep learning on these small point clouds. We demonstrate the usefulness of these architectures by training models to solve sample problems relevant to physics, chemistry, and biology.
  arXiv  Detail & Related papers  (2021-10-05T22:52:12Z)
• Computational Analysis of Deformable Manifolds: from Geometric Modelling to Deep Learning [0.0]
  We will show that the diversity of non-flat spaces provides a rich area of study. We will explore geometric methods for shape processing and data analysis.
  arXiv  Detail & Related papers  (2020-09-03T16:50:48Z)
• Geometric Attention for Prediction of Differential Properties in 3D Point Clouds [32.68259334785767]
  In this study, we present a geometric attention mechanism that can provide such properties in a learnable fashion. We establish the usefulness of the proposed technique with several experiments on the prediction of normal vectors and the extraction of feature lines.
  arXiv  Detail & Related papers  (2020-07-06T07:40:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.