Generalizing Knowledge Graph Embedding with Universal Orthogonal Parameterization

• URL: http://arxiv.org/abs/2405.08540v1
• Date: Tue, 14 May 2024 12:26:19 GMT
• Title: Generalizing Knowledge Graph Embedding with Universal Orthogonal Parameterization
• Abstract summary: GoldE is a powerful framework for knowledge graph embedding. It features a universal orthogonal parameterization based on a generalized form of Householder reflection. It achieves state-of-the-art performance on three standard benchmarks.
• Score: 22.86465452511445
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent advances in knowledge graph embedding (KGE) rely on Euclidean/hyperbolic orthogonal relation transformations to model intrinsic logical patterns and topological structures. However, existing approaches are confined to rigid relational orthogonalization with restricted dimension and homogeneous geometry, leading to deficient modeling capability. In this work, we move beyond these approaches in terms of both dimension and geometry by introducing a powerful framework named GoldE, which features a universal orthogonal parameterization based on a generalized form of Householder reflection. Such parameterization can naturally achieve dimensional extension and geometric unification with theoretical guarantees, enabling our framework to simultaneously capture crucial logical patterns and inherent topological heterogeneity of knowledge graphs. Empirically, GoldE achieves state-of-the-art performance on three standard benchmarks. Codes are available at https://github.com/xxrep/GoldE.

Related papers

• General Covariant Action Modeling: Constructing Generalized Manifolds via Spatio-Temporal Decoupling [48.559681359374146]
  Generalized Action Manifold (GAM) framework enforces general covariance through structural disentanglement.<n>GAM enables superior transfer and robustness capabilities, outperforming geometry-agnostic baselines.
  arXiv  Detail & Related papers  (2026-05-27T03:38:15Z)
• HiDiGen: Hierarchical Diffusion for B-Rep Generation with Explicit Topological Constraints [11.721957326448162]
  Boundary representation (B-rep) is the standard 3D modeling format in CAD systems.<n>HiDiGen is a hierarchical generation framework that decouples geometry modeling into two stages.<n> Experimental results show that HiDiGen achieves strong performance, generating novel, diverse, and topologically sound CAD models.
  arXiv  Detail & Related papers  (2026-04-03T08:06:51Z)
• Structure-Preserving Learning Improves Geometry Generalization in Neural PDEs [7.60216127875876]
  We introduce General-Geometry Neural Whitney Forms (Geo-NeW): a data-driven finite element method.<n>We demonstrate state-of-the-art performance on several steady-state PDE benchmarks, and provide a significant improvement over conventional baselines on out-of-distribution geometries.
  arXiv  Detail & Related papers  (2026-02-02T20:45:07Z)
• Towards A Unified PAC-Bayesian Framework for Norm-based Generalization Bounds [63.47271262149291]
  We propose a unified framework for PAC-Bayesian norm-based generalization.<n>The key to our approach is a sensitivity matrix that quantifies the network outputs with respect to structured weight perturbations.<n>We derive a family of generalization bounds that recover several existing PAC-Bayesian results as special cases.
  arXiv  Detail & Related papers  (2026-01-13T00:42:22Z)
• ArtGen: Conditional Generative Modeling of Articulated Objects in Arbitrary Part-Level States [9.721009445297716]
  ArtGen is a conditional diffusion-based framework capable of generating articulated 3D objects with accurate geometry and coherent kinematics.<n>Specifically, ArtGen employs cross-state Monte Carlo sampling to explicitly enforce global kinematic consistency.<n>A compositional 3D-VAE latent prior enhanced with local-global attention effectively captures fine-grained geometry and global part-level relationships.
  arXiv  Detail & Related papers  (2025-12-13T17:00:03Z)
• SKGE: Spherical Knowledge Graph Embedding with Geometric Regularization [0.0]
  We propose Spherical Knowledge Graph Embedding (SKGE), a model that constrains entity representations to a compact manifold: a hypersphere.<n>We demonstrate that SKGE consistently and significantly outperforms its strong Euclidean counterpart, TransE.
  arXiv  Detail & Related papers  (2025-11-04T10:40:46Z)
• Learning Geometry: A Framework for Building Adaptive Manifold Models through Metric Optimization [8.201374511929538]
  This paper proposes a novel paradigm for machine learning that moves beyond traditional parameter optimization.<n>We optimize the metric tensor field on a manifold with a predefined topology, thereby dynamically shaping the geometric structure of the model space.<n>This work lays a solid foundation for constructing fully dynamic "meta-learners" capable of autonomously evolving their geometry and topology.
  arXiv  Detail & Related papers  (2025-10-30T01:53:32Z)
• Adaptive Riemannian Graph Neural Networks [29.859977834688625]
  We introduce a novel framework that learns a continuous and anisotropic metric tensor field over the graph.<n>It allows each node to determine its optimal local geometry, enabling the model to fluidly adapt to the graph's structural landscape.<n>Our method demonstrates superior performance on both homophilic and heterophilic benchmark geometries.
  arXiv  Detail & Related papers  (2025-08-04T16:55:02Z)
• SMART: Relation-Aware Learning of Geometric Representations for Knowledge Graphs [7.612535740166837]
  We propose a framework that evaluates how well each relation fits with different geometric transformations.<n>Based on this ranking, the model can: (1) assign the best-matching transformation to each relation, or (2) use majority voting to choose one transformation type to apply across all relations.
  arXiv  Detail & Related papers  (2025-07-17T11:18:08Z)
• UniGeo: Taming Video Diffusion for Unified Consistent Geometry Estimation [63.90470530428842]
  In this work, we demonstrate that, through appropriate design and fine-tuning, the intrinsic consistency of video generation models can be effectively harnessed for consistent geometric estimation.<n>Our results achieve superior performance in predicting global geometric attributes in videos and can be directly applied to reconstruction tasks.
  arXiv  Detail & Related papers  (2025-05-30T12:31:59Z)
• Position: Beyond Euclidean -- Foundation Models Should Embrace Non-Euclidean Geometries [42.83280708842304]
  Euclidean space has been the de facto geometric setting for machine learning architectures. At a large scale, real-world data often exhibit inherently non-Euclidean structures, such as multi-way relationships, hierarchies, symmetries, and non-isotropic scaling. This paper argues that moving beyond Euclidean geometry is not merely an optional enhancement but a necessity to maintain the scaling law for the next-generation of foundation models.
  arXiv  Detail & Related papers  (2025-04-11T18:07:33Z)
• DTGBrepGen: A Novel B-rep Generative Model through Decoupling Topology and Geometry [3.859930277034918]
  Boundary representation (B-rep) of geometric models is a fundamental format in Computer-Aided Design (CAD) We propose DTGBrepGen, a novel topology-geometry decoupled framework for B-rep generation.
  arXiv  Detail & Related papers  (2025-03-17T12:34:14Z)
• Bridging Geometric States via Geometric Diffusion Bridge [79.60212414973002]
  We introduce the Geometric Diffusion Bridge (GDB), a novel generative modeling framework that accurately bridges initial and target geometric states. GDB employs an equivariant diffusion bridge derived by a modified version of Doob's $h$-transform for connecting geometric states. We show that GDB surpasses existing state-of-the-art approaches, opening up a new pathway for accurately bridging geometric states.
  arXiv  Detail & Related papers  (2024-10-31T17:59:53Z)
• (Deep) Generative Geodesics [57.635187092922976]
  We introduce a newian metric to assess the similarity between any two data points. Our metric leads to the conceptual definition of generative distances and generative geodesics. Their approximations are proven to converge to their true values under mild conditions.
  arXiv  Detail & Related papers  (2024-07-15T21:14:02Z)
• On the Completeness of Invariant Geometric Deep Learning Models [22.43250261702209]
  Invariant models are capable of generating meaningful geometric representations by leveraging informative geometric features in point clouds. We show that GeoNGNN, the geometric counterpart of one of the simplest subgraph graph neural networks (subgraph GNNs), can effectively break these corner cases' symmetry. By leveraging GeoNGNN as a theoretical tool, we further prove that: 1) most subgraph GNNs developed in traditional graph learning can be seamlessly extended to geometric scenarios with E(3)-completeness.
  arXiv  Detail & Related papers  (2024-02-07T13:32:53Z)
• Block-Diagonal Orthogonal Relation and Matrix Entity for Knowledge Graph Embedding [5.463034010805521]
  A Knowledge Graph embeddings (KGE) is to learn low-dimensional representations of entities and relations for predicting missing facts. We introduce OrthogonalE, a novel KGE model employing matrices for entities and block-diagonal matrices for relations. The experimental results indicate that our new KGE model, OrthogonalE, is both general and flexible, significantly outperforming state-of-the-art KGE models.
  arXiv  Detail & Related papers  (2024-01-11T15:13:00Z)
• A Hitchhiker's Guide to Geometric GNNs for 3D Atomic Systems [87.30652640973317]
  Recent advances in computational modelling of atomic systems represent them as geometric graphs with atoms embedded as nodes in 3D Euclidean space. Geometric Graph Neural Networks have emerged as the preferred machine learning architecture powering applications ranging from protein structure prediction to molecular simulations and material generation. This paper provides a comprehensive and self-contained overview of the field of Geometric GNNs for 3D atomic systems.
  arXiv  Detail & Related papers  (2023-12-12T18:44:19Z)
• Curve Your Attention: Mixed-Curvature Transformers for Graph Representation Learning [77.1421343649344]
  We propose a generalization of Transformers towards operating entirely on the product of constant curvature spaces. We also provide a kernelized approach to non-Euclidean attention, which enables our model to run in time and memory cost linear to the number of nodes and edges.
  arXiv  Detail & Related papers  (2023-09-08T02:44:37Z)
• Renormalization approach to the analysis and design of Hermitian and non-Hermitian interfaces [0.0]
  I describe a real-space renormalization approach that provides a unifying perspective on interface states in a wide class of Hermitian and non-Hermitian models. The emerging interface physics are governed by a flow of microscopic interface parameters, and the properties of interface states become linked to the fixed-point topology of this flow.
  arXiv  Detail & Related papers  (2022-08-31T04:17:54Z)
• Dist2Cycle: A Simplicial Neural Network for Homology Localization [66.15805004725809]
  Simplicial complexes can be viewed as high dimensional generalizations of graphs that explicitly encode multi-way ordered relations. We propose a graph convolutional model for learning functions parametrized by the $k$-homological features of simplicial complexes.
  arXiv  Detail & Related papers  (2021-10-28T14:59:41Z)
• Knowledge Graph Embeddings in Geometric Algebras [14.269860621624392]
  We introduce a novel geometric algebra-based KG embedding framework, GeomE. Our framework subsumes several state-of-the-art KG embedding approaches and is advantageous with its ability of modeling various key relation patterns. Experimental results on multiple benchmark knowledge graphs show that theproposed approach outperforms existing state-of-the-art models for link prediction.
  arXiv  Detail & Related papers  (2020-10-02T13:36:24Z)
• DSG-Net: Learning Disentangled Structure and Geometry for 3D Shape Generation [98.96086261213578]
  We introduce DSG-Net, a deep neural network that learns a disentangled structured and geometric mesh representation for 3D shapes. This supports a range of novel shape generation applications with disentangled control, such as of structure (geometry) while keeping geometry (structure) unchanged. Our method not only supports controllable generation applications but also produces high-quality synthesized shapes, outperforming state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-08-12T17:06:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.