Do language models capture implied discourse meanings? An investigation with exhaustivity implicatures of Korean morphology

• URL: http://arxiv.org/abs/2405.09293v1
• Date: Wed, 15 May 2024 12:34:40 GMT
• Title: Do language models capture implied discourse meanings? An investigation with exhaustivity implicatures of Korean morphology
• Abstract summary: We evaluate whether a set of large language models are capable of associating discourse meanings with different object markings in Korean. Results suggest that discourse meanings of a grammatical marker can be more challenging to encode than that of a discourse marker.
• Score: 2.900522306460408
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Markedness in natural language is often associated with non-literal meanings in discourse. Differential Object Marking (DOM) in Korean is one instance of this phenomenon, where post-positional markers are selected based on both the semantic features of the noun phrases and the discourse features that are orthogonal to the semantic features. Previous work has shown that distributional models of language recover certain semantic features of words -- do these models capture implied discourse-level meanings as well? We evaluate whether a set of large language models are capable of associating discourse meanings with different object markings in Korean. Results suggest that discourse meanings of a grammatical marker can be more challenging to encode than that of a discourse marker.

Related papers

• IDIOLEX: Unified and Continuous Representations for Idiolectal and Stylistic Variation [88.98544786373212]
  Existing sentence representations primarily encode what a sentence says, rather than how it is expressed.<n>We develop sentence representations that capture style and dialect, decoupled from semantic content.<n>We introduce IDIOLEX, a framework for training models that combines supervision from a sentence's provenance with linguistic features of a sentence's content.
  arXiv  Detail & Related papers  (2026-04-06T14:17:24Z)
• Towards a theory of morphology-driven marking in the lexicon: The case of the state [0.0]
  We propose a formal model termed morphology-driven marking.<n>Nouns are organised into modular cognitive sets, each with its own morphological template and unmarked form.<n>It is proposed that the concept of state be extended to all synthetic languages.
  arXiv  Detail & Related papers  (2026-04-03T19:35:41Z)
• Beyond bouba/kiki: Multidimensional semantic signals are deeply woven into the fabric of natural language [0.0]
  We show that individual letter-phonemes in English carry structured, multidimensional semantic signals.<n>Our findings indicate that sound-meaning iconicity is not an occasional curiosity but a pervasive, structured property of the phonological signal.
  arXiv  Detail & Related papers  (2026-03-18T03:02:10Z)
• A new kid on the block: Distributional semantics predicts the word-specific tone signatures of monosyllabic words in conversational Taiwan Mandarin [0.4078247440919472]
  We investigate how the pitch contours of monosyllabic words are realized in spontaneous conversational Mandarin.<n>We find that the effect of word remains a strong predictor of tonal realization.<n>For phonetics, distributional semantics is a new kid on the block.
  arXiv  Detail & Related papers  (2025-11-21T15:56:58Z)
• Emergent morpho-phonological representations in self-supervised speech models [3.9374885962486172]
  We study how S3M variants optimized for word recognition represent phonological and morphological phenomena.<n>We find that their representations exhibit a global linear geometry which can be used to link English nouns and verbs to their regular inflected forms.
  arXiv  Detail & Related papers  (2025-09-26T22:16:35Z)
• Tomato, Tomahto, Tomate: Measuring the Role of Shared Semantics among Subwords in Multilingual Language Models [88.07940818022468]
  We take an initial step on measuring the role of shared semantics among subwords in the encoder-only multilingual language models (mLMs) We form "semantic tokens" by merging the semantically similar subwords and their embeddings. inspections on the grouped subwords show that they exhibit a wide range of semantic similarities.
  arXiv  Detail & Related papers  (2024-11-07T08:38:32Z)
• Investigating Idiomaticity in Word Representations [9.208145117062339]
  We focus on noun compounds of varying levels of idiomaticity in two languages (English and Portuguese) We present a dataset of minimal pairs containing human idiomaticity judgments for each noun compound at both type and token levels. We define a set of fine-grained metrics of Affinity and Scaled Similarity to determine how sensitive the models are to perturbations that may lead to changes in idiomaticity.
  arXiv  Detail & Related papers  (2024-11-04T21:05:01Z)
• Using Model-Theoretic Approaches to Uncover Linguistic Organization [0.0]
  We consider pluractional markers in Kaqchikel, Karuk, and Yurok. Each of these languages marks one type of pluractionality via reduplication, and a different type of pluractionality via non-reduplicative affixation.
  arXiv  Detail & Related papers  (2024-05-13T09:58:59Z)
• Unsupervised Mapping of Arguments of Deverbal Nouns to Their Corresponding Verbal Labels [52.940886615390106]
  Deverbal nouns are verbs commonly used in written English texts to describe events or actions, as well as their arguments. The solutions that do exist for handling arguments of nominalized constructions are based on semantic annotation. We propose to adopt a more syntactic approach, which maps the arguments of deverbal nouns to the corresponding verbal construction.
  arXiv  Detail & Related papers  (2023-06-24T10:07:01Z)
• Distributed Marker Representation for Ambiguous Discourse Markers and Entangled Relations [50.31129784616845]
  We learn a Distributed Marker Representation (DMR) by utilizing the unlimited discourse marker data with a latent discourse sense. Our method also offers a valuable tool to understand complex ambiguity and entanglement among discourse markers and manually defined discourse relations.
  arXiv  Detail & Related papers  (2023-06-19T00:49:51Z)
• Transparency Helps Reveal When Language Models Learn Meaning [71.96920839263457]
  Our systematic experiments with synthetic data reveal that, with languages where all expressions have context-independent denotations, both autoregressive and masked language models learn to emulate semantic relations between expressions. Turning to natural language, our experiments with a specific phenomenon -- referential opacity -- add to the growing body of evidence that current language models do not well-represent natural language semantics.
  arXiv  Detail & Related papers  (2022-10-14T02:35:19Z)
• Zero-shot Cross-Linguistic Learning of Event Semantics [27.997873309702225]
  We look at captions of images across Arabic, Chinese, Farsi, German, Russian, and Turkish. We show that lexical aspects can be predicted for a given language despite not having observed any annotated data for this language at all.
  arXiv  Detail & Related papers  (2022-07-05T23:18:36Z)
• What Drives the Use of Metaphorical Language? Negative Insights from Abstractness, Affect, Discourse Coherence and Contextualized Word Representations [13.622570558506265]
  Given a specific discourse, which discourse properties trigger the use of metaphorical language, rather than using literal alternatives? Many NLP approaches to metaphorical language rely on cognitive and (psycho-)linguistic insights and have successfully defined models of discourse coherence, abstractness and affect. In this work, we build five simple models relying on established cognitive and linguistic properties to predict the use of a metaphorical vs. synonymous literal expression in context.
  arXiv  Detail & Related papers  (2022-05-23T08:08:53Z)
• Testing the Ability of Language Models to Interpret Figurative Language [69.59943454934799]
  Figurative and metaphorical language are commonplace in discourse. It remains an open question to what extent modern language models can interpret nonliteral phrases. We introduce Fig-QA, a Winograd-style nonliteral language understanding task.
  arXiv  Detail & Related papers  (2022-04-26T23:42:22Z)
• Investigating Cross-Linguistic Adjective Ordering Tendencies with a Latent-Variable Model [66.84264870118723]
  We present the first purely corpus-driven model of multi-lingual adjective ordering in the form of a latent-variable model. We provide strong converging evidence for the existence of universal, cross-linguistic, hierarchical adjective ordering tendencies.
  arXiv  Detail & Related papers  (2020-10-09T18:27:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.