SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detection

• URL: http://arxiv.org/abs/2007.11464v2
• Date: Fri, 28 Aug 2020 23:06:23 GMT
• Title: SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detection
• Authors: Dominik Schlechtweg, Barbara McGillivray, Simon Hengchen, Haim Dubossarsky, Nina Tahmasebi
• Abstract summary: Evaluation is currently the most pressing problem in Lexical Semantic Change detection. No gold standards are available to the community, which hinders progress. We present the results of the first shared task that addresses this gap.
• Score: 10.606357227329822
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Lexical Semantic Change detection, i.e., the task of identifying words that change meaning over time, is a very active research area, with applications in NLP, lexicography, and linguistics. Evaluation is currently the most pressing problem in Lexical Semantic Change detection, as no gold standards are available to the community, which hinders progress. We present the results of the first shared task that addresses this gap by providing researchers with an evaluation framework and manually annotated, high-quality datasets for English, German, Latin, and Swedish. 33 teams submitted 186 systems, which were evaluated on two subtasks.

Related papers

• The Lou Dataset -- Exploring the Impact of Gender-Fair Language in German Text Classification [57.06913662622832]
  Gender-fair language fosters inclusion by addressing all genders or using neutral forms. Gender-fair language substantially impacts predictions by flipping labels, reducing certainty, and altering attention patterns. While we offer initial insights on the effect on German text classification, the findings likely apply to other languages.
  arXiv  Detail & Related papers  (2024-09-26T15:08:17Z)
• Semantic change detection for Slovene language: a novel dataset and an approach based on optimal transport [0.0]
  We focus on the detection of semantic changes in Slovene, a less resourced Slavic language with two million speakers. We present the first Slovene dataset for evaluating semantic change detection systems.
  arXiv  Detail & Related papers  (2024-02-26T14:27:06Z)
• SOUL: Towards Sentiment and Opinion Understanding of Language [96.74878032417054]
  We propose a new task called Sentiment and Opinion Understanding of Language (SOUL) SOUL aims to evaluate sentiment understanding through two subtasks: Review (RC) and Justification Generation (JG)
  arXiv  Detail & Related papers  (2023-10-27T06:48:48Z)
• Lexical Semantic Change Discovery [22.934650688233734]
  We propose a shift from change detection to change discovery, i.e., discovering novel word senses over time from the full corpus vocabulary. By heavily fine-tuning a type-based and a token-based approach on recently published German data, we demonstrate that both models can successfully be applied to discover new words undergoing meaning change.
  arXiv  Detail & Related papers  (2021-06-06T13:02:38Z)
• Fake it Till You Make it: Self-Supervised Semantic Shifts for Monolingual Word Embedding Tasks [58.87961226278285]
  We propose a self-supervised approach to model lexical semantic change. We show that our method can be used for the detection of semantic change with any alignment method. We illustrate the utility of our techniques using experimental results on three different datasets.
  arXiv  Detail & Related papers  (2021-01-30T18:59:43Z)
• Curious Case of Language Generation Evaluation Metrics: A Cautionary Tale [52.663117551150954]
  A few popular metrics remain as the de facto metrics to evaluate tasks such as image captioning and machine translation. This is partly due to ease of use, and partly because researchers expect to see them and know how to interpret them. In this paper, we urge the community for more careful consideration of how they automatically evaluate their models.
  arXiv  Detail & Related papers  (2020-10-26T13:57:20Z)
• RUSSE'2020: Findings of the First Taxonomy Enrichment Task for the Russian language [70.27072729280528]
  This paper describes the results of the first shared task on taxonomy enrichment for the Russian language. 16 teams participated in the task demonstrating high results with more than half of them outperforming the provided baseline.
  arXiv  Detail & Related papers  (2020-05-22T13:30:37Z)
• Unsupervised Embedding-based Detection of Lexical Semantic Changes [1.7403133838762452]
  This paper describes EmbLexChange, a system introduced by the "Life-Language" team for SemEval-2020 Task 1. EmmLexChange is defined as the divergence between the embedding based profiles of word w in the source and the target domains. We show that using a resampling framework for the selection of reference words, we can reliably detect lexical-semantic changes in English, German, Swedish, and Latin.
  arXiv  Detail & Related papers  (2020-05-16T13:05:47Z)
• UiO-UvA at SemEval-2020 Task 1: Contextualised Embeddings for Lexical Semantic Change Detection [5.099262949886174]
  This paper focuses on Subtask 2, ranking words by the degree of their semantic drift over time. We find that the most effective algorithms rely on the cosine similarity between averaged token embeddings and the pairwise distances between token embeddings.
  arXiv  Detail & Related papers  (2020-04-30T18:43:57Z)
• On the Importance of Word Order Information in Cross-lingual Sequence Labeling [80.65425412067464]
  Cross-lingual models that fit into the word order of the source language might fail to handle target languages. We investigate whether making models insensitive to the word order of the source language can improve the adaptation performance in target languages.
  arXiv  Detail & Related papers  (2020-01-30T03:35:44Z)
• Shared task: Lexical semantic change detection in German (Student Project Report) [6.971891445484366]
  We present the results of the first shared task on unsupervised lexical semantic change detection (LSCD) in German based on the evaluation framework proposed by Schlechtweg et al.
  arXiv  Detail & Related papers  (2020-01-21T21:47:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.