NAVER LABS System Re-implementation for the IWSLT 2026 Instruction-Following Task

• URL: http://arxiv.org/abs/2607.05623v3
• Date: Wed, 15 Jul 2026 07:17:15 GMT
• Title: NAVER LABS System Re-implementation for the IWSLT 2026 Instruction-Following Task
• Abstract summary: We re-implement the NAVER LABS IWSLT 2025 instruction-following pipeline for the IWSLT 2026 Shared Task.<n>The three-stage approach projector alignment, text-only LoRA pre-training, and multimodal merging is preserved from the original design.<n>We construct 100k synthetic instruction-following examples across ten speech-centric task types (10k per task) from the provided corpora, suitable for further Stage 3 fine-tuning.
• Score: 0.09558392439655013
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We re-implement the NAVER LABS IWSLT 2025 instruction-following pipeline for the IWSLT 2026 Shared Task (constrained condition, short audio track), adapting it to the mandated components: SeamlessM4T-v2-large as the speech encoder and Qwen3-4B-Instruct as the LLM backbone. The three-stage approach projector alignment, text-only LoRA pre-training, and multimodal merging is preserved from the original design. We additionally construct 100k synthetic instruction-following examples across ten speech-centric task types (10k per task) from the provided corpora, suitable for further Stage 3 fine-tuning. Our primary model achieves COMET 0.781 on EN-ZH speech translation and BERTScore-F1 0.346 on English SQA on the MCIF benchmark.

Related papers

• NAVER LABS Europe Submission to the Instruction-following 2026 Short Track [12.471740115082126]
  We describe NAVER LABS Europe's submission to the instruction-following speech processing short track at IWSLT 2026.<n>We develop systems capable of jointly performing ASR, ST, and SQA from English speech into Chinese, Italian, and German.<n>This year's results place our system tied for first place in the overall short track ranking.
  arXiv  Detail & Related papers  (2026-07-02T09:52:08Z)
• Multilingual Long-Form Speech Instruction Following: KIT's Submission to IWSLT 2026 [57.48615919717867]
  We present KIT's submission to the Long and Short Instruction Following tracks in the unconstrained setting.<n>Our approach combines a general data augmentation pipeline that converts short-form corpora into long-form training data.<n>We show that likelihood-based re-ranking, while highly effective for ASR, systematically degrades semantic tasks.
  arXiv  Detail & Related papers  (2026-06-03T11:13:37Z)
• LLM-INSTRUCT at UZH Shared Task 2026: Constraint-Aware Retrieval and Selective Debate for Paragraph-Level Argument Mining [0.7899707459486233]
  We present LLM-INSTRUCT, the winning system for the UZH Shared Task at ArgMining 2026.<n>The task requires paragraph-type classification, prediction of a subset of 141 official tags, and directed relation prediction under a strict schema setting.<n>On the official leaderboard, LLM-INSTRUCT ranked 1st overall, with 1st in F1 and 5th in LLM-as-a-Judge.
  arXiv  Detail & Related papers  (2026-05-10T05:08:59Z)
• AzeroS: Extending LLM to Speech with Self-Generated Instruction-Free Tuning [49.68129589035101]
  We introduce AZeroS (Auden Zero-instruction-tuned Speech-LLM), which is trained on speech-text pairs derived from publicly available corpora.<n>AZeroS achieves state-of-the-art performance on both semantic and paralinguistic benchmarks.
  arXiv  Detail & Related papers  (2025-12-31T04:05:04Z)
• MLLP-VRAIN UPV system for the IWSLT 2025 Simultaneous Speech Translation Translation task [7.247809853198223]
  This work describes the participation of the MLLP-VRAIN research group in the shared task of the IWSLT 2025 Simultaneous Speech Translation track.<n>Our submission addresses the unique challenges of real-time translation of long-form speech by developing a modular cascade system.
  arXiv  Detail & Related papers  (2025-06-23T16:44:01Z)
• KIT's Offline Speech Translation and Instruction Following Submission for IWSLT 2025 [56.61209412965054]
  We present the Karlsruhe Institute of Technology's submissions for the Offline ST and Instruction Following (IF) tracks.<n>We propose a pipeline that employs multiple automatic speech recognition systems, whose outputs are fused using an LLM with document-level context.<n>For the IF track, we develop an end-to-end model that integrates a speech encoder with an LLM to perform a wide range of instruction-following tasks.
  arXiv  Detail & Related papers  (2025-05-19T12:21:29Z)
• CMU's IWSLT 2024 Simultaneous Speech Translation System [80.15755988907506]
  This paper describes CMU's submission to the IWSLT 2024 Simultaneous Speech Translation (SST) task for translating English speech to German text in a streaming manner. Our end-to-end speech-to-text (ST) system integrates the WavLM speech encoder, a modality adapter, and the Llama2-7B-Base model as the decoder.
  arXiv  Detail & Related papers  (2024-08-14T10:44:51Z)
• Blending LLMs into Cascaded Speech Translation: KIT's Offline Speech Translation System for IWSLT 2024 [61.189875635090225]
  Large Language Models (LLMs) are currently under exploration for various tasks, including Automatic Speech Recognition (ASR), Machine Translation (MT), and even End-to-End Speech Translation (ST)
  arXiv  Detail & Related papers  (2024-06-24T16:38:17Z)
• Direct Models for Simultaneous Translation and Automatic Subtitling: FBK@IWSLT2023 [26.001878009713597]
  This paper describes the FBK's participation in the Simultaneous Translation and Automatic Subtitling tracks of the IWSLT 2023 Evaluation Campaign. Our submission focused on the use of direct architectures to perform both tasks. Our English-German SimulST system shows a reduced computational-aware latency compared to the one achieved by the top-ranked systems in the 2021 and 2022 rounds of the task.
  arXiv  Detail & Related papers  (2023-09-27T10:24:42Z)
• Speech Translation with Foundation Models and Optimal Transport: UPC at IWSLT23 [0.0]
  This paper describes the submission of the UPC Machine Translation group to the IWSLT 2023 Offline Speech Translation task. Our Speech Translation systems utilize foundation models for speech (wav2vec 2.0) and text (mBART50) We incorporate a Siamese pretraining step of the speech and text encoders with CTC and Optimal Transport, to adapt the speech representations to the space of the text model.
  arXiv  Detail & Related papers  (2023-06-02T07:48:37Z)
• Guiding Large Language Models via Directional Stimulus Prompting [114.84930073977672]
  We introduce Directional Stimulus Prompting, a novel framework for guiding black-box large language models (LLMs) toward specific desired outputs. Instead of directly adjusting LLMs, our method employs a small tunable policy model to generate an auxiliary directional stimulus prompt for each input instance.
  arXiv  Detail & Related papers  (2023-02-22T17:44:15Z)
• Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task [95.06453182273027]
  This report describes Microsoft's machine translation systems for the WMT21 shared task on large-scale multilingual machine translation. Our model submissions to the shared task were with DeltaLMnotefooturlhttps://aka.ms/deltalm, a generic pre-trained multilingual-decoder model. Our final submissions ranked first on three tracks in terms of the automatic evaluation metric.
  arXiv  Detail & Related papers  (2021-11-03T09:16:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.