Transcription and Recognition of Italian Parliamentary Speeches Using Vision-Language Models

• URL: http://arxiv.org/abs/2603.28103v1
• Date: Mon, 30 Mar 2026 07:06:49 GMT
• Title: Transcription and Recognition of Italian Parliamentary Speeches Using Vision-Language Models
• Abstract summary: Existing efforts to transcribe Italian parliamentary speeches have relied on traditional Optical Character Recognition pipelines.<n>We propose a pipeline based on Vision-Language Models for the automatic transcription, semantic segmentation, and entity linking of Italian parliamentary speeches.
• Score: 2.8348950186890467
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Parliamentary proceedings represent a rich yet challenging resource for computational analysis, particularly when preserved only as scanned historical documents. Existing efforts to transcribe Italian parliamentary speeches have relied on traditional Optical Character Recognition pipelines, resulting in transcription errors and limited semantic annotation. In this paper, we propose a pipeline based on Vision-Language Models for the automatic transcription, semantic segmentation, and entity linking of Italian parliamentary speeches. The pipeline employs a specialised OCR model to extract text while preserving reading order, followed by a large-scale Vision-Language Model that performs transcription refinement, element classification, and speaker identification by jointly reasoning over visual layout and textual content. Extracted speakers are then linked to the Chamber of Deputies knowledge base through SPARQL queries and a multi-strategy fuzzy matching procedure. Evaluation against an established benchmark demonstrates substantial improvements both in transcription quality and speaker tagging.

Related papers

• Saar-Voice: A Multi-Speaker Saarbrücken Dialect Speech Corpus [21.010357388387842]
  Saar-Voice is a six-hour speech corpus for the Saarbrcken dialect of German.<n>A subset of this text was recorded by nine speakers.<n>We discuss methodological challenges related to orthographic and speaker variation.
  arXiv  Detail & Related papers  (2026-04-13T17:59:11Z)
• Beyond Transcripts: A Renewed Perspective on Audio Chaptering [66.61445564139052]
  We show that a novel audio-only architecture (AudioSeg) outperforms text-based approaches for segmenting long-form audio into coherent sections.<n>Our experiments on YTSeg reveal that AudioSeg substantially outperforms text-based approaches, pauses provide the largest acoustic gains, and MLLMs remain limited by context length and weak instruction following.
  arXiv  Detail & Related papers  (2026-02-09T18:28:10Z)
• PRiSM: Benchmarking Phone Realization in Speech Models [70.82595415252682]
  Phone recognition (PR) serves as the atomic interface for language-agnostic modeling for cross-lingual speech processing and phonetic analysis.<n>We introduce PRiSM, the first open-source benchmark designed to expose blind spots in phonetic perception.
  arXiv  Detail & Related papers  (2026-01-20T15:00:36Z)
• Seeing Justice Clearly: Handwritten Legal Document Translation with OCR and Vision-Language Models [8.62418063092899]
  Handwritten text recognition (HTR) and machine translation continue to pose significant challenges.<n>Traditional OCR system extracts text from handwritten images, which is then translated into the target language using a machine translation model.<n>In this work, we compare the performance of traditional OCR-MT pipelines with Vision Large Language Models that aim to unify these stages.<n>Our motivation is grounded in the urgent need for scalable, accurate translation systems to digitize legal records in India's district and high courts.
  arXiv  Detail & Related papers  (2025-12-19T19:06:14Z)
• Preservation of Language Understanding Capabilities in Speech-aware Large Language Models [3.770636357625305]
  The benchmark utilizes textual tasks and a voice cloning text-to-speech model to quantify the extent to which language understanding capabilities are preserved when the model is accessed via speech input.<n>C3T quantifies the fairness of the model for different categories of speakers and its robustness across text and speech modalities.
  arXiv  Detail & Related papers  (2025-09-15T17:34:45Z)
• Languages in Multilingual Speech Foundation Models Align Both Phonetically and Semantically [58.019484208091534]
  Cross-lingual alignment in pretrained language models (LMs) has enabled efficient transfer in text-based LMs.<n>It remains an open question whether findings and methods from text-based cross-lingual alignment apply to speech.
  arXiv  Detail & Related papers  (2025-05-26T07:21:20Z)
• TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation [97.54885207518946]
  We introduce a novel model framework TransVIP that leverages diverse datasets in a cascade fashion. We propose two separated encoders to preserve the speaker's voice characteristics and isochrony from the source speech during the translation process. Our experiments on the French-English language pair demonstrate that our model outperforms the current state-of-the-art speech-to-speech translation model.
  arXiv  Detail & Related papers  (2024-05-28T04:11:37Z)
• Label Aware Speech Representation Learning For Language Identification [49.197215416945596]
  We propose a novel framework of combining self-supervised representation learning with the language label information for the pre-training task. This framework, termed as Label Aware Speech Representation (LASR) learning, uses a triplet based objective function to incorporate language labels along with the self-supervised loss function.
  arXiv  Detail & Related papers  (2023-06-07T12:14:16Z)
• Political corpus creation through automatic speech recognition on EU debates [4.670305538969914]
  We present a transcribed corpus of the LIBE committee of the EU parliament, totalling 3.6 Million running words. The meetings of parliamentary committees of the EU are a potentially valuable source of information for political scientists but the data is not readily available because only disclosed as speech recordings together with limited metadata. We investigated the most appropriate Automatic Speech Recognition (ASR) model to create an accurate text transcription of the audio recordings of the meetings in order to make their content available for research and analysis.
  arXiv  Detail & Related papers  (2023-04-17T10:41:59Z)
• VQMIVC: Vector Quantization and Mutual Information-Based Unsupervised Speech Representation Disentanglement for One-shot Voice Conversion [54.29557210925752]
  One-shot voice conversion can be effectively achieved by speech representation disentanglement. We employ vector quantization (VQ) for content encoding and introduce mutual information (MI) as the correlation metric during training. Experimental results reflect the superiority of the proposed method in learning effective disentangled speech representations.
  arXiv  Detail & Related papers  (2021-06-18T13:50:38Z)
• Text-Free Image-to-Speech Synthesis Using Learned Segmental Units [24.657722909094662]
  We present the first model for directly fluent, natural-sounding spoken audio captions for images. We connect the image captioning module and the speech synthesis module with a set of discrete, sub-word speech units. We conduct experiments on the Flickr8k spoken caption dataset and a novel corpus of spoken audio captions collected for the popular MSCOCO dataset.
  arXiv  Detail & Related papers  (2020-12-31T05:28:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.