ICDAR 2025 Competition on End-to-End Document Image Machine Translation Towards Complex Layouts

• URL: http://arxiv.org/abs/2603.09392v1
• Date: Tue, 10 Mar 2026 09:04:38 GMT
• Title: ICDAR 2025 Competition on End-to-End Document Image Machine Translation Towards Complex Layouts
• Abstract summary: Document Image Machine Translation (DIMT) seeks to translate text embedded in document images from one language to another.<n>The DIMT 2025 Challenge advances research on end-to-end document image translation.<n>The competition features two tracks, OCR-free and OCR-based, each with two subtasks for small (less than 1B parameters) and large (greater than 1B parameters) models.
• Score: 47.61983500021015
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Document Image Machine Translation (DIMT) seeks to translate text embedded in document images from one language to another by jointly modeling both textual content and page layout, bridging optical character recognition (OCR) and natural language processing (NLP). The DIMT 2025 Challenge advances research on end-to-end document image translation, a rapidly evolving area within multimodal document understanding. The competition features two tracks, OCR-free and OCR-based, each with two subtasks for small (less than 1B parameters) and large (greater than 1B parameters) models. Participants submit a single unified DIMT system, with the option to incorporate provided OCR transcripts. Running from December 10, 2024 to April 20, 2025, the competition attracted 69 teams and 27 valid submissions in total. Track 1 had 34 teams and 13 valid submissions, while Track 2 had 35 teams and 14 valid submissions. In this report, we present the challenge motivation, dataset construction, task definitions, evaluation protocol, and a summary of results. Our analysis shows that large-model approaches establish a promising new paradigm for translating complex-layout document images and highlight substantial opportunities for future research.

Related papers

• MonkeyOCRv2: A Visual-Text Foundation Model for Document AI [71.06391669976786]
  MonkeyOCRv2 is a visual-text pretrained model for document AI.<n> MonkeyDoc v2 is the largest document-image pretraining corpus, comprising 113 million images spanning 17 languages.
  arXiv  Detail & Related papers  (2026-07-13T13:43:39Z)
• Overview of the EReL@MIR 2025 Multimodal Document Retrieval Challenge (Track 1) [4.198923768732269]
  The MIR Challenge was held at the first EReL@MIR workshop, co-located with The Web Conference 2025.<n>It asked participants to build a emphsingle retrieval system that handles two complementary regimes.<n>This report describes the challenge design, datasets, and evaluation protocol; reports the final standings; and analyses the three winning teams' systems.
  arXiv  Detail & Related papers  (2026-06-02T21:39:32Z)
• DocPTBench: Benchmarking End-to-End Photographed Document Parsing and Translation [18.531174868051558]
  We introduce DocPTBench, a benchmark specifically designed for Photographed Document Parsing and Translation.<n>Our experiments demonstrate that transitioning from digital-born to photographed documents results in a substantial performance decline.<n>This substantial performance gap underscores the unique challenges posed by documents captured in real-world conditions.
  arXiv  Detail & Related papers  (2025-11-23T13:02:11Z)
• PRIM: Towards Practical In-Image Multilingual Machine Translation [48.357528732061105]
  In-Image Machine Translation (IIMT) aims to translate images containing texts from one language to another.<n>Current research of end-to-end IIMT conducts on synthetic data, with simple background, single font, fixed text position, and bilingual translation.<n>We propose an end-to-end model VisTrans to handle the challenge of practical conditions in PRIM.
  arXiv  Detail & Related papers  (2025-09-05T14:38:07Z)
• NTIRE 2025 challenge on Text to Image Generation Model Quality Assessment [146.76913448156176]
  This paper reports on the NTIRE 2025 challenge on Text to Image (T2I) generation model quality assessment.<n>The aim of this challenge is to address the fine-grained quality assessment of text-to-image generation models.
  arXiv  Detail & Related papers  (2025-05-22T07:12:36Z)
• DIMT25@ICDAR2025: HW-TSC's End-to-End Document Image Machine Translation System Leveraging Large Vision-Language Model [26.977174272835995]
  This paper presents the technical solution proposed by Huawei Translation Service Center (HW-TSC) for the "End-to-End Document Image Machine Translation for Complex Layouts" competition.<n>We introduce a training framework that combines multi-task learning with perceptual chain-of-thought to develop a comprehensive end-to-end document translation system.<n>Our solution uniquely addresses both OCR-based and OCR-free document image translation tasks within a unified framework.
  arXiv  Detail & Related papers  (2025-04-24T07:17:59Z)
• PDF-WuKong: A Large Multimodal Model for Efficient Long PDF Reading with End-to-End Sparse Sampling [63.93112754821312]
  Multimodal document understanding is a challenging task to process and comprehend large amounts of textual and visual information.<n>Recent advances in Large Language Models (LLMs) have significantly improved the performance of this task.<n>We introduce PDF-WuKong, a multimodal large language model (MLLM) which is designed to enhance multimodal question-answering (QA) for long PDF documents.
  arXiv  Detail & Related papers  (2024-10-08T12:17:42Z)
• DOCCI: Descriptions of Connected and Contrasting Images [58.377060316967864]
  Descriptions of Connected and Contrasting Images (DOCCI) is a dataset with long, human-annotated English descriptions for 15k images. We instruct human annotators to create comprehensive descriptions for each image. We show that DOCCI is a useful testbed for text-to-image generation.
  arXiv  Detail & Related papers  (2024-04-30T17:56:24Z)
• ICDAR 2023 Competition on Structured Text Extraction from Visually-Rich Document Images [198.35937007558078]
  The competition opened on 30th December, 2022 and closed on 24th March, 2023. There are 35 participants and 91 valid submissions received for Track 1, and 15 participants and 26 valid submissions received for Track 2. According to the performance of the submissions, we believe there is still a large gap on the expected information extraction performance for complex and zero-shot scenarios.
  arXiv  Detail & Related papers  (2023-06-05T22:20:52Z)
• Exploring Better Text Image Translation with Multimodal Codebook [39.12169843196739]
  Text image translation (TIT) aims to translate the source texts embedded in the image to target translations. In this work, we first annotate a Chinese-English TIT dataset named OCRMT30K, providing convenience for subsequent studies. Then, we propose a TIT model with a multimodal codebook, which is able to associate the image with relevant texts. We present a multi-stage training framework involving text machine translation, image-text alignment, and TIT tasks, which fully exploits additional bilingual texts.
  arXiv  Detail & Related papers  (2023-05-27T08:41:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.