Vega-MT: The JD Explore Academy Translation System for WMT22

• URL: http://arxiv.org/abs/2209.09444v4
• Date: Sat, 6 May 2023 08:11:17 GMT
• Title: Vega-MT: The JD Explore Academy Translation System for WMT22
• Abstract summary: We push the limit of our previous work by scaling up two main factors, i.e. language pairs and model sizes. We get the 1st place on Zh-En (45.1), En-Zh (61.7), De-En (58.0), En-De (63.2), Cs-En (74.7), Ru-En (64.9), En-Ru (69.6), and En-Ja (65.1), 2nd place on En-Cs (95.3) and Ja-En (40.6), respectively.
• Score: 67.71016343958556
• License: http://creativecommons.org/publicdomain/zero/1.0/
• Abstract: We describe the JD Explore Academy's submission of the WMT 2022 shared general translation task. We participated in all high-resource tracks and one medium-resource track, including Chinese-English, German-English, Czech-English, Russian-English, and Japanese-English. We push the limit of our previous work -- bidirectional training for translation by scaling up two main factors, i.e. language pairs and model sizes, namely the \textbf{Vega-MT} system. As for language pairs, we scale the "bidirectional" up to the "multidirectional" settings, covering all participating languages, to exploit the common knowledge across languages, and transfer them to the downstream bilingual tasks. As for model sizes, we scale the Transformer-Big up to the extremely large model that owns nearly 4.7 Billion parameters, to fully enhance the model capacity for our Vega-MT. Also, we adopt the data augmentation strategies, e.g. cycle translation for monolingual data, and bidirectional self-training for bilingual and monolingual data, to comprehensively exploit the bilingual and monolingual data. To adapt our Vega-MT to the general domain test set, generalization tuning is designed. Based on the official automatic scores of constrained systems, in terms of the sacreBLEU shown in Figure-1, we got the 1st place on {Zh-En (33.5), En-Zh (49.7), De-En (33.7), En-De (37.8), Cs-En (54.9), En-Cs (41.4) and En-Ru (32.7)}, 2nd place on {Ru-En (45.1) and Ja-En (25.6)}, and 3rd place on {En-Ja(41.5)}, respectively; W.R.T the COMET, we got the 1st place on {Zh-En (45.1), En-Zh (61.7), De-En (58.0), En-De (63.2), Cs-En (74.7), Ru-En (64.9), En-Ru (69.6) and En-Ja (65.1)}, 2nd place on {En-Cs (95.3) and Ja-En (40.6)}, respectively.

Related papers

• Hy-MT2: A Family of Fast, Efficient and Powerful Multilingual Translation Models in the Wild [28.747270164782673]
  Hy-MT2 delivers outstanding performance across general, real-world business, domain-specific, and instruction-following translation tasks.<n>The 7B and 30B models outperform open-source models such as DeepSeek-V4-Pro and Kimi K2.6 in fast-thinking mode.<n>The lightweight 1.8B model requires only 440 MB of storage and achieves a 1.5x inference speedup.
  arXiv  Detail & Related papers  (2026-05-21T07:00:06Z)
• Omnilingual MT: Machine Translation for 1,600 Languages [58.66170104105936]
  We present Omnilingual Machine Translation (OMT), the first machine translation system supporting more than 1,600 languages.<n>This scale is enabled by a comprehensive data strategy that integrates large public multilingual corpora with newly created datasets.<n>OMT models improve in cross-lingual transfer, being close to solving the "understanding" part of the puzzle in MT for the 1,600 evaluated.
  arXiv  Detail & Related papers  (2026-03-17T09:43:42Z)
• HY-MT1.5 Technical Report [24.77479897240016]
  HY-MT1.5-1.8B and HY-MT1.5-7B are a new family of machine translation models developed through a holistic training framework tailored for high-performance translation.<n>Our methodology orchestrates a multi-stage pipeline that integrates general and MT-oriented pre-training, supervised fine-tuning, on-policy distillation, and reinforcement learning.
  arXiv  Detail & Related papers  (2025-12-30T09:06:37Z)
• Beyond English: Toward Inclusive and Scalable Multilingual Machine Translation with LLMs [41.53385639669034]
  Large language models have significantly advanced Multilingual Machine Translation (MMT), yet the broad language coverage, consistent translation quality, and English-centric bias remain open challenges.<n>We introduce textbfLMT, a suite of textbfLarge-scale textbfMultilingual textbfTranslation models centered on both Chinese and English.<n>LMT achieves SOTA performance among models of comparable language coverage, with our 4B model surpassing the much larger Aya-13B and NLLB-54B models by a substantial margin.
  arXiv  Detail & Related papers  (2025-11-10T11:54:53Z)
• Seed-X: Building Strong Multilingual Translation LLM with 7B Parameters [53.59868121093848]
  We introduce Seed-X, a family of open-source language models (LLMs) with 7B parameter size.<n>The base model is pre-trained on a diverse, high-quality dataset encompassing both monolingual and bilingual content across 28 languages.<n>The instruct model is then finetuned to translate by Chain-of-Thought (CoT) reasoning and further enhanced through reinforcement learning (RL) to achieve better generalization across diverse language pairs.
  arXiv  Detail & Related papers  (2025-07-18T03:19:43Z)
• NLIP_Lab-IITH Low-Resource MT System for WMT24 Indic MT Shared Task [9.476463361600826]
  We describe our system for the WMT 24 shared task of Low-Resource Indic Language Translation. Our primary system is based on language-specific finetuning on a pre-trained model. We achieve chrF2 scores of 50.6, 42.3, 54.9, and 66.3 on the official public test set for eng$rightarrow$as, eng$rightarrow$kha, eng$rightarrow$lus, eng$rightarrow$mni respectively.
  arXiv  Detail & Related papers  (2024-10-04T08:02:43Z)
• Qwen2 Technical Report [141.0766756297144]
  This report introduces the Qwen2 series, the latest addition to our large language models and large multimodal models. Qwen2 surpasses most prior open-weight models, including its predecessor Qwen1.5, and exhibits competitive performance relative to proprietary models. Qwen2 demonstrates robust multilingual capabilities, proficient in approximately 30 languages, spanning English, Chinese, Spanish, French, German, Arabic, Russian, Korean, Japanese, Thai, Vietnamese, and more.
  arXiv  Detail & Related papers  (2024-07-15T12:35:42Z)
• Machine Translation for Ge'ez Language [0.0]
  Machine translation for low-resource languages such as Ge'ez faces challenges such as out-of-vocabulary words, domain mismatches, and lack of labeled training data. We develop a multilingual neural machine translation (MNMT) model based on languages relatedness. We also experiment with using GPT-3.5, a state-of-the-art LLM, for few-shot translation with fuzzy matches.
  arXiv  Detail & Related papers  (2023-11-24T14:55:23Z)
• Tencent AI Lab - Shanghai Jiao Tong University Low-Resource Translation System for the WMT22 Translation Task [49.916963624249355]
  This paper describes Tencent AI Lab - Shanghai Jiao Tong University (TAL-SJTU) Low-Resource Translation systems for the WMT22 shared task. We participate in the general translation task on English$Leftrightarrow$Livonian. Our system is based on M2M100 with novel techniques that adapt it to the target language pair.
  arXiv  Detail & Related papers  (2022-10-17T04:34:09Z)
• The YiTrans End-to-End Speech Translation System for IWSLT 2022 Offline Shared Task [92.5087402621697]
  This paper describes the submission of our end-to-end YiTrans speech translation system for the IWSLT 2022 offline task. The YiTrans system is built on large-scale pre-trained encoder-decoder models. Our final submissions rank first on English-German and English-Chinese end-to-end systems in terms of the automatic evaluation metric.
  arXiv  Detail & Related papers  (2022-06-12T16:13:01Z)
• Few-shot Learning with Multilingual Language Models [66.49496434282564]
  We train multilingual autoregressive language models on a balanced corpus covering a diverse set of languages. Our largest model sets new state of the art in few-shot learning in more than 20 representative languages. We present a detailed analysis of where the model succeeds and fails, showing in particular that it enables cross-lingual in-context learning.
  arXiv  Detail & Related papers  (2021-12-20T16:52:35Z)
• Towards Making the Most of Multilingual Pretraining for Zero-Shot Neural Machine Translation [74.158365847236]
  SixT++ is a strong many-to-English NMT model that supports 100 source languages but is trained once with a parallel dataset from only six source languages. It significantly outperforms CRISS and m2m-100, two strong multilingual NMT systems, with an average gain of 7.2 and 5.0 BLEU respectively.
  arXiv  Detail & Related papers  (2021-10-16T10:59:39Z)
• Facebook AI WMT21 News Translation Task Submission [23.69817809546458]
  We describe Facebook's multilingual model submission to the WMT2021 shared task on news translation. We participate in 14 language directions: English to and from Czech, German, Hausa, Icelandic, Japanese, Russian, and Chinese. We utilize data from all available sources to create high quality bilingual and multilingual baselines.
  arXiv  Detail & Related papers  (2021-08-06T18:26:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.