Defining Boundaries: The Impact of Domain Specification on Cross-Language and Cross-Domain Transfer in Machine Translation

• URL: http://arxiv.org/abs/2408.11926v2
• Date: Sat, 21 Sep 2024 12:39:56 GMT
• Title: Defining Boundaries: The Impact of Domain Specification on Cross-Language and Cross-Domain Transfer in Machine Translation
• Authors: Lia Shahnazaryan, Meriem Beloucif,
• Abstract summary: Cross-lingual transfer learning offers a promising solution for neural machine translation (NMT) This paper focuses on the impact of domain specification and linguistic factors on transfer effectiveness. We evaluate multiple target languages, including Portuguese, Italian, French, Czech, Polish, and Greek.
• Score: 0.44601285466405083
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent advancements in neural machine translation (NMT) have revolutionized the field, yet the dependency on extensive parallel corpora limits progress for low-resource languages and domains. Cross-lingual transfer learning offers a promising solution by utilizing data from high-resource languages but often struggles with in-domain NMT. This paper investigates zero-shot cross-lingual domain adaptation for NMT, focusing on the impact of domain specification and linguistic factors on transfer effectiveness. Using English as the source language and Spanish for fine-tuning, we evaluate multiple target languages, including Portuguese, Italian, French, Czech, Polish, and Greek. We demonstrate that both language-specific and domain-specific factors influence transfer effectiveness, with domain characteristics playing a crucial role in determining cross-domain transfer potential. We also explore the feasibility of zero-shot cross-lingual cross-domain transfer, providing insights into which domains are more responsive to transfer and why. Our results show the importance of well-defined domain boundaries and transparency in experimental setups for in-domain transfer learning.

Related papers

• Large Language Model for Multi-Domain Translation: Benchmarking and Domain CoT Fine-tuning [55.107329995417786]
  Large language models (LLMs) have demonstrated impressive general understanding and generation abilities. We establish a benchmark for multi-domain translation, featuring 25 German$Leftrightarrow$English and 22 Chinese$Leftrightarrow$English test sets. We propose a domain Chain of Thought (CoT) fine-tuning technique that utilizes the intrinsic multi-domain intelligence of LLMs to improve translation performance.
  arXiv  Detail & Related papers  (2024-10-03T16:15:04Z)
• On the Transferability of Visually Grounded PCFGs [35.64371385720051]
  Visually-grounded Compound PCFGcitepzhao-titov-2020-visually. We consider a zero-shot transfer learning setting where a model is trained on the source domain and is directly applied to target domains, without any further training. Our experimental results suggest that: the benefits from using visual groundings transfer to text in a domain similar to the training domain but fail to transfer to remote domains.
  arXiv  Detail & Related papers  (2023-10-21T20:19:51Z)
• Domain Mismatch Doesn't Always Prevent Cross-Lingual Transfer Learning [51.232774288403114]
  Cross-lingual transfer learning has been surprisingly effective in zero-shot cross-lingual classification. We show that a simple regimen can overcome much of the effect of domain mismatch in cross-lingual transfer.
  arXiv  Detail & Related papers  (2022-11-30T01:24:33Z)
• Can Domains Be Transferred Across Languages in Multi-Domain Multilingual Neural Machine Translation? [52.27798071809941]
  This paper investigates whether the domain information can be transferred across languages on the composition of multi-domain and multilingual NMT. We find that multi-domain multilingual (MDML) NMT can boost zero-shot translation performance up to +10 gains on BLEU.
  arXiv  Detail & Related papers  (2022-10-20T23:13:54Z)
• Characterization of effects of transfer learning across domains and languages [0.0]
  Transfer learning (TL) from pre-trained neural language models has emerged as a powerful technique over the years. We investigate how TL affects the performance of popular pre-trained models over three natural language processing (NLP) tasks.
  arXiv  Detail & Related papers  (2022-10-03T17:17:07Z)
• Learning Domain-Specialised Representations for Cross-Lingual Biomedical Entity Linking [66.76141128555099]
  We propose a novel cross-lingual biomedical entity linking task (XL-BEL) We first investigate the ability of standard knowledge-agnostic as well as knowledge-enhanced monolingual and multilingual LMs beyond the standard monolingual English BEL task. We then address the challenge of transferring domain-specific knowledge in resource-rich languages to resource-poor ones.
  arXiv  Detail & Related papers  (2021-05-30T00:50:00Z)
• Continuous and Diverse Image-to-Image Translation via Signed Attribute Vectors [120.13149176992896]
  We present an effectively signed attribute vector, which enables continuous translation on diverse mapping paths across various domains. To enhance the visual quality of continuous translation results, we generate a trajectory between two sign-symmetrical attribute vectors.
  arXiv  Detail & Related papers  (2020-11-02T18:59:03Z)
• From Zero to Hero: On the Limitations of Zero-Shot Cross-Lingual Transfer with Multilingual Transformers [62.637055980148816]
  Massively multilingual transformers pretrained with language modeling objectives have become a de facto default transfer paradigm for NLP. We show that cross-lingual transfer via massively multilingual transformers is substantially less effective in resource-lean scenarios and for distant languages.
  arXiv  Detail & Related papers  (2020-05-01T22:04:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.