Terminology-Aware Translation with Constrained Decoding and Large Language Model Prompting

• URL: http://arxiv.org/abs/2310.05824v1
• Date: Mon, 9 Oct 2023 16:08:23 GMT
• Title: Terminology-Aware Translation with Constrained Decoding and Large Language Model Prompting
• Authors: Nikolay Bogoychev and Pinzhen Chen
• Abstract summary: We submit to the WMT 2023 terminology translation task. We adopt a translate-then-refine approach which can be domain-independent and requires minimal manual efforts. Results show that our terminology-aware model learns to incorporate terminologies effectively.
• Score: 11.264272119913311
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Terminology correctness is important in the downstream application of machine translation, and a prevalent way to ensure this is to inject terminology constraints into a translation system. In our submission to the WMT 2023 terminology translation task, we adopt a translate-then-refine approach which can be domain-independent and requires minimal manual efforts. We annotate random source words with pseudo-terminology translations obtained from word alignment to first train a terminology-aware model. Further, we explore two post-processing methods. First, we use an alignment process to discover whether a terminology constraint has been violated, and if so, we re-decode with the violating word negatively constrained. Alternatively, we leverage a large language model to refine a hypothesis by providing it with terminology constraints. Results show that our terminology-aware model learns to incorporate terminologies effectively, and the large language model refinement process can further improve terminology recall.

Related papers

• Efficient Technical Term Translation: A Knowledge Distillation Approach for Parenthetical Terminology Translation [0.0]
  This paper addresses the challenge of accurately translating technical terms, which are crucial for clear communication in specialized fields. We introduce the Parenthetical Terminology Translation (PTT) task, designed to mitigate potential inaccuracies by displaying the original term in parentheses alongside its translation. We developed a novel evaluation metric to assess both overall translation accuracy and the correct parenthetical presentation of terms.
  arXiv  Detail & Related papers  (2024-10-01T13:40:28Z)
• An Analysis of BPE Vocabulary Trimming in Neural Machine Translation [56.383793805299234]
  vocabulary trimming is a postprocessing step that replaces rare subwords with their component subwords. We show that vocabulary trimming fails to improve performance and is even prone to incurring heavy degradation.
  arXiv  Detail & Related papers  (2024-03-30T15:29:49Z)
• Towards Effective Disambiguation for Machine Translation with Large Language Models [65.80775710657672]
  We study the capabilities of large language models to translate "ambiguous sentences" Experiments show that our methods can match or outperform state-of-the-art systems such as DeepL and NLLB in four out of five language directions.
  arXiv  Detail & Related papers  (2023-09-20T22:22:52Z)
• Cascaded Beam Search: Plug-and-Play Terminology-Forcing For Neural Machine Translation [11.902884131696783]
  This paper presents a plug-and-play approach for translation with terminology constraints. We propose Cascade Beam Search, a terminology-forcing approach that requires no training. We evaluate the performance of our approach by competing against the top submissions of the WMT21 terminology translation task.
  arXiv  Detail & Related papers  (2023-05-23T21:48:02Z)
• Biomedical Named Entity Recognition via Dictionary-based Synonym Generalization [51.89486520806639]
  We propose a novel Synonym Generalization (SynGen) framework that recognizes the biomedical concepts contained in the input text using span-based predictions. We extensively evaluate our approach on a wide range of benchmarks and the results verify that SynGen outperforms previous dictionary-based models by notable margins.
  arXiv  Detail & Related papers  (2023-05-22T14:36:32Z)
• Modeling Target-Side Morphology in Neural Machine Translation: A Comparison of Strategies [72.56158036639707]
  Morphologically rich languages pose difficulties to machine translation. A large amount of differently inflected word surface forms entails a larger vocabulary. Some inflected forms of infrequent terms typically do not appear in the training corpus. Linguistic agreement requires the system to correctly match the grammatical categories between inflected word forms in the output sentence.
  arXiv  Detail & Related papers  (2022-03-25T10:13:20Z)
• DEEP: DEnoising Entity Pre-training for Neural Machine Translation [123.6686940355937]
  It has been shown that machine translation models usually generate poor translations for named entities that are infrequent in the training corpus. We propose DEEP, a DEnoising Entity Pre-training method that leverages large amounts of monolingual data and a knowledge base to improve named entity translation accuracy within sentences.
  arXiv  Detail & Related papers  (2021-11-14T17:28:09Z)
• Lingua Custodia's participation at the WMT 2021 Machine Translation using Terminologies shared task [3.3108924994485096]
  We consider three directions, namely English to French, Russian, and Chinese. We introduce two main changes to the standard procedure to handle terminologies. Our method satisfies most terminology constraints while maintaining high translation quality.
  arXiv  Detail & Related papers  (2021-11-03T10:36:32Z)
• Improving Lexically Constrained Neural Machine Translation with Source-Conditioned Masked Span Prediction [6.46964825569749]
  In this paper, we tackle a more challenging setup consisting of domain-specific corpora with much longer n-gram and highly specialized terms. To encourage span-level representations in generation, we additionally impose a source-sentence conditioned masked span prediction loss in the decoder. Experimental results on three domain-specific corpora in two language pairs demonstrate that the proposed training scheme can improve the performance of existing lexically constrained methods.
  arXiv  Detail & Related papers  (2021-05-12T08:11:33Z)
• Fake it Till You Make it: Self-Supervised Semantic Shifts for Monolingual Word Embedding Tasks [58.87961226278285]
  We propose a self-supervised approach to model lexical semantic change. We show that our method can be used for the detection of semantic change with any alignment method. We illustrate the utility of our techniques using experimental results on three different datasets.
  arXiv  Detail & Related papers  (2021-01-30T18:59:43Z)
• Incorporating Terminology Constraints in Automatic Post-Editing [23.304864678067865]
  We present both autoregressive and non-autoregressive models for lexically constrained APE. Our approach enables preservation of 95% of the terminologies and also improves translation quality on English-German benchmarks.
  arXiv  Detail & Related papers  (2020-10-19T15:44:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.