Vector Space Semantics for Lambek Calculus with Soft Subexponentials

• URL: http://arxiv.org/abs/2111.11331v3
• Date: Fri, 6 Oct 2023 13:41:19 GMT
• Title: Vector Space Semantics for Lambek Calculus with Soft Subexponentials
• Authors: Lachlan McPheat, Hadi Wazni, Mehrnoosh Sadrzadeh
• Abstract summary: We develop a vector space semantics for Lambek Calculus with Soft Subexponentials. We construct compositional vector interpretations for parasitic gap noun phrases and discourse units with anaphora and ellipsis.
• Score: 0.8287206589886879
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We develop a vector space semantics for Lambek Calculus with Soft Subexponentials, apply the calculus to construct compositional vector interpretations for parasitic gap noun phrases and discourse units with anaphora and ellipsis, and experiment with the constructions in a distributional sentence similarity task. As opposed to previous work, which used Lambek Calculus with a Relevant Modality the calculus used in this paper uses a bounded version of the modality and is decidable. The vector space semantics of this new modality allows us to meaningfully define contraction as projection and provide a linear theory behind what we could previously only achieve via nonlinear maps.

Related papers

• Refined Risk Bounds for Unbounded Losses via Transductive Priors [58.967816314671296]
  We revisit the sequential variants of linear regression with the squared loss, classification problems with hinge loss, and logistic regression. Our key tools are based on the exponential weights algorithm with carefully chosen transductive priors.
  arXiv  Detail & Related papers  (2024-10-29T00:01:04Z)
• Bridging Continuous and Discrete Spaces: Interpretable Sentence Representation Learning via Compositional Operations [80.45474362071236]
  It is unclear whether the compositional semantics of sentences can be directly reflected as compositional operations in the embedding space. We propose InterSent, an end-to-end framework for learning interpretable sentence embeddings.
  arXiv  Detail & Related papers  (2023-05-24T00:44:49Z)
• Linear Spaces of Meanings: Compositional Structures in Vision-Language Models [110.00434385712786]
  We investigate compositional structures in data embeddings from pre-trained vision-language models (VLMs) We first present a framework for understanding compositional structures from a geometric perspective. We then explain what these structures entail probabilistically in the case of VLM embeddings, providing intuitions for why they arise in practice.
  arXiv  Detail & Related papers  (2023-02-28T08:11:56Z)
• Relational Sentence Embedding for Flexible Semantic Matching [86.21393054423355]
  We present Sentence Embedding (RSE), a new paradigm to discover further the potential of sentence embeddings. RSE is effective and flexible in modeling sentence relations and outperforms a series of state-of-the-art embedding methods.
  arXiv  Detail & Related papers  (2022-12-17T05:25:17Z)
• Isotropic Gaussian Processes on Finite Spaces of Graphs [71.26737403006778]
  We propose a principled way to define Gaussian process priors on various sets of unweighted graphs. We go further to consider sets of equivalence classes of unweighted graphs and define the appropriate versions of priors thereon. Inspired by applications in chemistry, we illustrate the proposed techniques on a real molecular property prediction task in the small data regime.
  arXiv  Detail & Related papers  (2022-11-03T10:18:17Z)
• A Quantum Natural Language Processing Approach to Pronoun Resolution [1.5293427903448022]
  We use the Lambek Calculus to model and reason about discourse relations such as anaphora and ellipsis. A semantics for this logic is obtained by using truncated Fock spaces, developed in our previous work. We extend the existing translation to Fock spaces and develop quantum circuit semantics for discourse relations.
  arXiv  Detail & Related papers  (2022-08-10T15:22:58Z)
• The Many-Worlds Calculus [0.0]
  We propose a colored PROP to model computation in this framework. The model can support regular tests, probabilistic and non-deterministic branching, as well as quantum branching. We prove the language to be universal, and the equational theory to be complete with respect to this semantics.
  arXiv  Detail & Related papers  (2022-06-21T10:10:26Z)
• Fuzzy Generalised Quantifiers for Natural Language in Categorical Compositional Distributional Semantics [5.2424255020469595]
  We consider fuzzy versions of quantifiers along the lines of Zadeh. We show that this category is a concrete instantiation of the compositional distributional model.
  arXiv  Detail & Related papers  (2021-09-23T09:15:15Z)
• Categorical Vector Space Semantics for Lambek Calculus with a Relevant Modality [3.345437353879255]
  We develop a categorical distributional semantics for Lambek Calculus with a Relevantity!L*. We instantiate this category to finite dimensional vector spaces and linear maps via "quantisation" functors. We apply the model to construct categorical and concrete semantic interpretations for the motivating example of!L*: the derivation of a phrase with a parasitic gap.
  arXiv  Detail & Related papers  (2020-05-06T18:58:21Z)
• Putting a Spin on Language: A Quantum Interpretation of Unary Connectives for Linguistic Applications [0.0]
  Lambek Calculus relies on unary modalities to allow controlled application of structural rules. Proposals for compositional interpretation of Lambek Calculus in the compact closed category of FVect and linear maps have been made. Our aim is to turn the modalities into first-class citizens of the vectorial interpretation.
  arXiv  Detail & Related papers  (2020-04-08T17:25:11Z)
• Spatial Pyramid Based Graph Reasoning for Semantic Segmentation [67.47159595239798]
  We apply graph convolution into the semantic segmentation task and propose an improved Laplacian. The graph reasoning is directly performed in the original feature space organized as a spatial pyramid. We achieve comparable performance with advantages in computational and memory overhead.
  arXiv  Detail & Related papers  (2020-03-23T12:28:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.