Related papers: Using Model-Theoretic Approaches to Uncover Linguistic Organization

Related papers

IDIOLEX: Unified and Continuous Representations for Idiolectal and Stylistic Variation [88.98544786373212]
Existing sentence representations primarily encode what a sentence says, rather than how it is expressed.<n>We develop sentence representations that capture style and dialect, decoupled from semantic content.<n>We introduce IDIOLEX, a framework for training models that combines supervision from a sentence's provenance with linguistic features of a sentence's content.
arXiv Detail & Related papers (2026-04-06T14:17:24Z)
Towards a theory of morphology-driven marking in the lexicon: The case of the state [0.0]
We propose a formal model termed morphology-driven marking.<n>Nouns are organised into modular cognitive sets, each with its own morphological template and unmarked form.<n>It is proposed that the concept of state be extended to all synthetic languages.
arXiv Detail & Related papers (2026-04-03T19:35:41Z)
Differences in Typological Alignment in Language Models' Treatment of Differential Argument Marking [1.9371675344367494]
differential argument marking (DAM) is a semantic licensing system in which morphological marking depends on semantic prominence.<n>We train GPT-2 models on 18 corpora implementing distinct DAM systems and evaluate their generalization using minimal pairs.<n>Our results reveal a dissociation between two typological dimensions of DAM.
arXiv Detail & Related papers (2026-02-19T18:56:34Z)
False Friends Are Not Foes: Investigating Vocabulary Overlap in Multilingual Language Models [53.01170039144264]
Subword tokenizers trained on multilingual corpora naturally produce overlapping tokens across languages.<n>Does token overlap facilitate cross-lingual transfer or instead introduce interference between languages?<n>We find that models with overlap outperform models with disjoint vocabularies.
arXiv Detail & Related papers (2025-09-23T07:47:54Z)
Could the Road to Grounded, Neuro-symbolic AI be Paved with Words-as-Classifiers? [16.12935949253909]
We make the case that one potential path forward in unifying all three semantic fields is paved with the words-as-classifier model.<n>We review that literature, motivate the words-as-classifiers model with an appeal to recent work in cognitive science, and describe a small experiment.
arXiv Detail & Related papers (2025-07-08T18:44:34Z)
Bias Attribution in Filipino Language Models: Extending a Bias Interpretability Metric for Application on Agglutinative Languages [8.58480189544444]
We adapt the information-theoretic bias attribution score metric for implementation on language models.<n>We show that Filipino models are driven towards bias by words pertaining to people, objects, and relationships.<n>These findings point to differences in how English and non-English models process inputs linked to sociodemographic groups and bias.
arXiv Detail & Related papers (2025-06-08T18:13:18Z)
Analyzing The Language of Visual Tokens [48.62180485759458]
We take a natural-language-centric approach to analyzing discrete visual languages. We show that higher token innovation drives greater entropy and lower compression, with tokens predominantly representing object parts. We also show that visual languages lack cohesive grammatical structures, leading to higher perplexity and weaker hierarchical organization compared to natural languages.
arXiv Detail & Related papers (2024-11-07T18:59:28Z)
Examining Language Modeling Assumptions Using an Annotated Literary Dialect Corpus [0.0]
We present a dataset of 19th century American literary orthovariant tokens with a novel layer of human-annotated dialect group tags. We find indications that the "dialect effect" produced by intentional orthographic variation employs multiple linguistic channels.
arXiv Detail & Related papers (2024-10-03T16:58:21Z)
FUSE-ing Language Models: Zero-Shot Adapter Discovery for Prompt Optimization Across Tokenizers [55.2480439325792]
We propose FUSE, an approach to approximating an adapter layer that maps from one model's textual embedding space to another, even across different tokenizers. We show the efficacy of our approach via multi-objective optimization over vision-language and causal language models for image captioning and sentiment-based image captioning.
arXiv Detail & Related papers (2024-08-09T02:16:37Z)
Do language models capture implied discourse meanings? An investigation with exhaustivity implicatures of Korean morphology [2.900522306460408]
We evaluate whether a set of large language models are capable of associating discourse meanings with different object markings in Korean. Results suggest that discourse meanings of a grammatical marker can be more challenging to encode than that of a discourse marker.
arXiv Detail & Related papers (2024-05-15T12:34:40Z)
Understanding Cross-Lingual Alignment -- A Survey [52.572071017877704]
Cross-lingual alignment is the meaningful similarity of representations across languages in multilingual language models. We survey the literature of techniques to improve cross-lingual alignment, providing a taxonomy of methods and summarising insights from throughout the field.
arXiv Detail & Related papers (2024-04-09T11:39:53Z)
Multi-Dialectal Representation Learning of Sinitic Phonology [0.0]
In Sinitic Historical Phonology, notable tasks that could benefit from machine learning include the comparison of dialects and reconstruction of proto-languages systems. Motivated by this, this paper provides an approach for obtaining multi-dialectal representations of Sinitic syllables.
arXiv Detail & Related papers (2023-06-30T02:37:25Z)
Feature Interactions Reveal Linguistic Structure in Language Models [2.0178765779788495]
We study feature interactions in the context of feature attribution methods for post-hoc interpretability. We work out a grey box methodology, in which we train models to perfection on a formal language classification task. We show that under specific configurations, some methods are indeed able to uncover the grammatical rules acquired by a model.
arXiv Detail & Related papers (2023-06-21T11:24:41Z)
Zero-shot Cross-Linguistic Learning of Event Semantics [27.997873309702225]
We look at captions of images across Arabic, Chinese, Farsi, German, Russian, and Turkish. We show that lexical aspects can be predicted for a given language despite not having observed any annotated data for this language at all.
arXiv Detail & Related papers (2022-07-05T23:18:36Z)
Testing the Ability of Language Models to Interpret Figurative Language [69.59943454934799]
Figurative and metaphorical language are commonplace in discourse. It remains an open question to what extent modern language models can interpret nonliteral phrases. We introduce Fig-QA, a Winograd-style nonliteral language understanding task.
arXiv Detail & Related papers (2022-04-26T23:42:22Z)
Leveraging Adversarial Training in Self-Learning for Cross-Lingual Text Classification [52.69730591919885]
We present a semi-supervised adversarial training process that minimizes the maximal loss for label-preserving input perturbations. We observe significant gains in effectiveness on document and intent classification for a diverse set of languages.
arXiv Detail & Related papers (2020-07-29T19:38:35Z)
Constructing a Family Tree of Ten Indo-European Languages with Delexicalized Cross-linguistic Transfer Patterns [57.86480614673034]
We formalize the delexicalized transfer as interpretable tree-to-string and tree-to-tree patterns. This allows us to quantitatively probe cross-linguistic transfer and extend inquiries of Second Language Acquisition.
arXiv Detail & Related papers (2020-07-17T15:56:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.