ÚFAL CorPipe at CRAC 2023: Larger Context Improves Multilingual Coreference Resolution

• URL: http://arxiv.org/abs/2311.14391v3
• Date: Wed, 16 Oct 2024 17:01:16 GMT
• Title: ÚFAL CorPipe at CRAC 2023: Larger Context Improves Multilingual Coreference Resolution
• Abstract summary: We present CorPipe, the winning entry in the CRAC 2023 Shared Task on Multilingual Coreference Resolution. Our system is an improved version of our earlier multilingual coreference pipeline, and it surpasses other participants by a large margin of 4.5 percent points.
• Score: 1.2772632966631616
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present CorPipe, the winning entry to the CRAC 2023 Shared Task on Multilingual Coreference Resolution. Our system is an improved version of our earlier multilingual coreference pipeline, and it surpasses other participants by a large margin of 4.5 percent points. CorPipe first performs mention detection, followed by coreference linking via an antecedent-maximization approach on the retrieved spans. Both tasks are trained jointly on all available corpora using a shared pretrained language model. Our main improvements comprise inputs larger than 512 subwords and changing the mention decoding to support ensembling. The source code is available at https://github.com/ufal/crac2023-corpipe.

Related papers

• CorPipe at CRAC 2026: Empty Nodes and Cross-Lingual Transfer in Multilingual Coreference Resolution [0.6671865055671308]
  CorPipe 26 is an improved version of CorPipe 25, with a new variant predicting empty nodes together with mentions and coreference links in a single model.<n>Our system outperforms all other submissions in the LLM track by 2.8 percent points and all submissions in the unconstrained track by 9.5 percent points.
  arXiv  Detail & Related papers  (2026-05-28T16:01:03Z)
• OSGNet with MLLM Reranking @ Ego4D Episodic Memory Challenge 2026 [75.6762616797288]
  We present our champion solutions for the Natural Language Queries and GoalStep tracks of the Ego4D Episodic Memory Challenge at CVPR 2026.<n>We propose a reranking-based framework that effectively leverages the strong video-language reasoning capability of multimodal large language model (MLLM)<n>Our method achieved first place in both the Natural Language Queries and GoalStep tracks.
  arXiv  Detail & Related papers  (2026-05-20T07:14:11Z)
• CorPipe at CRAC 2025: Evaluating Multilingual Encoders for Multilingual Coreference Resolution [0.6671865055671308]
  CorPipe 25 is the winning entry in the CRAC 2025 Shared Task on Multilingual Coreference Resolution.<n>Our system significantly outperforms all other submissions in both the LLM and unconstrained tracks by a substantial margin of 8 percentage points.
  arXiv  Detail & Related papers  (2025-09-22T14:51:37Z)
• CorPipe at CRAC 2024: Predicting Zero Mentions from Raw Text [1.2772632966631616]
  We present CorPipe 24, the winning entry to the CRAC 2024 Shared Task on Multilingual Coreference Resolution. In this third iteration of the task, a novel objective is to also predict empty nodes needed for zero coreference mentions. In both settings, CorPipe surpasses other participants by a large margin of 3.9 and 2.8 percent points, respectively.
  arXiv  Detail & Related papers  (2024-10-03T17:58:55Z)
• Multilingual Contrastive Decoding via Language-Agnostic Layers Skipping [60.458273797431836]
  Decoding by contrasting layers (DoLa) is designed to improve the generation quality of large language models. We find that this approach does not work well on non-English tasks. Inspired by previous interpretability work on language transition during the model's forward pass, we propose an improved contrastive decoding algorithm.
  arXiv  Detail & Related papers  (2024-07-15T15:14:01Z)
• Breaking the Script Barrier in Multilingual Pre-Trained Language Models with Transliteration-Based Post-Training Alignment [50.27950279695363]
  The transfer performance is often hindered when a low-resource target language is written in a different script than the high-resource source language. Inspired by recent work that uses transliteration to address this problem, our paper proposes a transliteration-based post-pretraining alignment (PPA) method.
  arXiv  Detail & Related papers  (2024-06-28T08:59:24Z)
• The First Place Solution of WSDM Cup 2024: Leveraging Large Language Models for Conversational Multi-Doc QA [15.405052113769164]
  We introduce our winning approach for the "Conversational Multi-Doc QA" challenge in WSDM Cup 2024. We first adapt Large Language Models to the task, then devise a hybrid training strategy to make the most of in-domain unlabeled data. Our solution ranked 1st place in WSDM Cup 2024, surpassing its rivals to a large extent.
  arXiv  Detail & Related papers  (2024-02-28T15:05:43Z)
• Multilingual Coreference Resolution in Low-resource South Asian Languages [36.31301773167754]
  We introduce a Translated dataset for Multilingual Coreference Resolution (TransMuCoRes) in 31 South Asian languages. Nearly all of the predicted translations successfully pass a sanity check, and 75% of English references align with their predicted translations. This study is the first to evaluate an end-to-end coreference resolution model on a Hindi golden set.
  arXiv  Detail & Related papers  (2024-02-21T07:05:51Z)
• ÚFAL CorPipe at CRAC 2022: Effectivity of Multilingual Models for Coreference Resolution [1.7871207544302354]
  We describe the winning submission to the CRAC 2022 Shared Task on Multilingual Coreference Resolution. Our system first solves mention detection and then coreference linking on the retrieved spans with an antecedent-maximization approach.
  arXiv  Detail & Related papers  (2022-09-15T13:11:39Z)
• ESPnet-ST IWSLT 2021 Offline Speech Translation System [56.83606198051871]
  This paper describes the ESPnet-ST group's IWSLT 2021 submission in the offline speech translation track. This year we made various efforts on training data, architecture, and audio segmentation. Our best E2E system combined all the techniques with model ensembling and achieved 31.4 BLEU.
  arXiv  Detail & Related papers  (2021-07-01T17:49:43Z)
• CoSQA: 20,000+ Web Queries for Code Search and Question Answering [63.92224685262063]
  CoSQA dataset includes 20,604 labels for pairs of natural language queries and codes. We introduce a contrastive learning method dubbed CoCLR to enhance query-code matching. We show that evaluated on CodeXGLUE with the same CodeBERT model, training on CoSQA improves the accuracy of code question answering by 5.1%.
  arXiv  Detail & Related papers  (2021-05-27T15:37:21Z)
• Multi-view Subword Regularization [111.04350390045705]
  Multi-view Subword Regularization (MVR) is a method that enforces the consistency between predictions of using inputs tokenized by the standard and probabilistic segmentations. Results on the XTREME multilingual benchmark show that MVR brings consistent improvements of up to 2.5 points over using standard segmentation algorithms.
  arXiv  Detail & Related papers  (2021-03-15T16:07:42Z)
• El Volumen Louder Por Favor: Code-switching in Task-oriented Semantic Parsing [7.153795286069918]
  We focus on Spanglish (Spanish+English) and release a dataset, CSTOP, containing 5800 CS utterances alongside their semantic parses. We examine the CS generalizability of various Cross-lingual (XL) models and exhibit the advantage of pre-trained XL language models when data for only one language is present.
  arXiv  Detail & Related papers  (2021-01-26T02:40:44Z)
• Explicit Alignment Objectives for Multilingual Bidirectional Encoders [111.65322283420805]
  We present a new method for learning multilingual encoders, AMBER (Aligned Multilingual Bi-directional EncodeR) AMBER is trained on additional parallel data using two explicit alignment objectives that align the multilingual representations at different granularities. Experimental results show that AMBER obtains gains of up to 1.1 average F1 score on sequence tagging and up to 27.3 average accuracy on retrieval over the XLMR-large model.
  arXiv  Detail & Related papers  (2020-10-15T18:34:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.