Multi-Dialect Vietnamese: Task, Dataset, Baseline Models and Challenges

• URL: http://arxiv.org/abs/2410.03458v1
• Date: Fri, 4 Oct 2024 14:17:56 GMT
• Title: Multi-Dialect Vietnamese: Task, Dataset, Baseline Models and Challenges
• Abstract summary: We introduce Vietnamese Multi-Dialect dataset, a novel comprehensive dataset capturing the rich diversity of 63 provincial dialects spoken across Vietnam. Our dataset comprises 102.56 hours of audio, consisting of approximately 19,000 utterances, and the associated transcripts contain over 1.2 million words.
• Score: 0.964547614383472
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Vietnamese, a low-resource language, is typically categorized into three primary dialect groups that belong to Northern, Central, and Southern Vietnam. However, each province within these regions exhibits its own distinct pronunciation variations. Despite the existence of various speech recognition datasets, none of them has provided a fine-grained classification of the 63 dialects specific to individual provinces of Vietnam. To address this gap, we introduce Vietnamese Multi-Dialect (ViMD) dataset, a novel comprehensive dataset capturing the rich diversity of 63 provincial dialects spoken across Vietnam. Our dataset comprises 102.56 hours of audio, consisting of approximately 19,000 utterances, and the associated transcripts contain over 1.2 million words. To provide benchmarks and simultaneously demonstrate the challenges of our dataset, we fine-tune state-of-the-art pre-trained models for two downstream tasks: (1) Dialect identification and (2) Speech recognition. The empirical results suggest two implications including the influence of geographical factors on dialects, and the constraints of current approaches in speech recognition tasks involving multi-dialect speech data. Our dataset is available for research purposes.

Related papers

• Dial HEALTHDIAL for Advice: A Multilingual and Multi-Parallel Spoken Dialogue Dataset for Knowledge-Grounded Information Seeking [72.66384771245389]
  This work introduces HEALTHDIAL, a large-scale, multilingual, and multi-parallel dataset for developing and evaluating retrieval-augmented generation (RAG)-based spoken dialogue systems.<n>The dataset comprises 6,000 information-seeking dialogues (1,500 per language) grounded in trusted content from the World Health Organization (WHO) and 163 hours of user speech recorded from native speakers of diverse dialects.
  arXiv  Detail & Related papers  (2026-05-28T15:47:09Z)
• Phonetic Modeling of Dialectal Variation in Vietnamese Speech [8.447993256993428]
  Vietnamese exhibits substantial dialectal phonetic variation across Northern, Central, and Southern regions.<n>We propose a dialect-aware phonetic framework that explicitly models Vietnamese phonological structure and dialectal variation at both the vocabulary and decoding levels.
  arXiv  Detail & Related papers  (2026-05-23T08:00:26Z)
• ViDia2Std: A Parallel Corpus and Methods for Low-Resource Vietnamese Dialect-to-Standard Translation [5.3220011447194215]
  We introduce ViDia2Std, the first manually annotated parallel corpus for dialect-to-standard Vietnamese translation.<n>Unlike prior datasets, ViDia2Std includes diverse dialects from Central, Southern, and non-standard Northern regions.<n>We report agreement rates of 86% (North), 82% (Central), and 85% (South) for ViDia2Std.
  arXiv  Detail & Related papers  (2026-03-10T20:24:38Z)
• ARCADE: A City-Scale Corpus for Fine-Grained Arabic Dialect Tagging [4.23980289430769]
  We present ARCADE, the first Arabic speech dataset designed explicitly with city-level dialect granularity.<n>The corpus comprises Arabic radio speech collected from streaming services across the Arab world.<n>The resulting corpus comprises 6,907 annotations and 3,790 unique audio segments spanning 58 cities across 19 countries.
  arXiv  Detail & Related papers  (2026-01-05T15:32:17Z)
• VoxVietnam: a Large-Scale Multi-Genre Dataset for Vietnamese Speaker Recognition [0.0]
  This paper introduces VoxVietnam, the first multi-genre dataset for Vietnamese speaker recognition with over 187,000 utterances from 1,406 speakers. Our experiments are conducted to study the challenges of the multi-genre phenomenon in speaker recognition and the performance gain when the proposed dataset is used for multi-genre training.
  arXiv  Detail & Related papers  (2024-12-31T07:57:29Z)
• MulliVC: Multi-lingual Voice Conversion With Cycle Consistency [75.59590240034261]
  MulliVC is a novel voice conversion system that only converts timbre and keeps original content and source language prosody without multi-lingual paired data. Both objective and subjective results indicate that MulliVC significantly surpasses other methods in both monolingual and cross-lingual contexts.
  arXiv  Detail & Related papers  (2024-08-08T18:12:51Z)
• Exploring Diachronic and Diatopic Changes in Dialect Continua: Tasks, Datasets and Challenges [2.572144535177391]
  We critically assess nine tasks and datasets across five dialects from three language families (Slavic, Romance, and Germanic) We outline five open challenges regarding changes in dialect use over time, the reliability of dialect datasets, the importance of speaker characteristics, limited coverage of dialects, and ethical considerations in data collection. We hope that our work sheds light on future research towards inclusive computational methods and datasets for language varieties and dialects.
  arXiv  Detail & Related papers  (2024-07-04T15:38:38Z)
• Voices Unheard: NLP Resources and Models for Yorùbá Regional Dialects [72.18753241750964]
  Yorub'a is an African language with roughly 47 million speakers. Recent efforts to develop NLP technologies for African languages have focused on their standard dialects. We take steps towards bridging this gap by introducing a new high-quality parallel text and speech corpus.
  arXiv  Detail & Related papers  (2024-06-27T22:38:04Z)
• Mavericks at NADI 2023 Shared Task: Unravelling Regional Nuances through Dialect Identification using Transformer-based Approach [0.0]
  We highlight our methodology for subtask 1 which deals with country-level dialect identification. The task uses the Twitter dataset (TWT-2023) that encompasses 18 dialects for the multi-class classification problem. We achieved an F1-score of 76.65 (11th rank on the leaderboard) on the test dataset.
  arXiv  Detail & Related papers  (2023-11-30T17:37:56Z)
• Quantifying the Dialect Gap and its Correlates Across Languages [69.18461982439031]
  This work will lay the foundation for furthering the field of dialectal NLP by laying out evident disparities and identifying possible pathways for addressing them through mindful data collection.
  arXiv  Detail & Related papers  (2023-10-23T17:42:01Z)
• Multimodal Modeling For Spoken Language Identification [57.94119986116947]
  Spoken language identification refers to the task of automatically predicting the spoken language in a given utterance. We propose MuSeLI, a Multimodal Spoken Language Identification method, which delves into the use of various metadata sources to enhance language identification.
  arXiv  Detail & Related papers  (2023-09-19T12:21:39Z)
• A Highly Adaptive Acoustic Model for Accurate Multi-Dialect Speech Recognition [80.87085897419982]
  We propose a novel acoustic modeling technique for accurate multi-dialect speech recognition with a single AM. Our proposed AM is dynamically adapted based on both dialect information and its internal representation, which results in a highly adaptive AM for handling multiple dialects simultaneously. The experimental results on large scale speech datasets show that the proposed AM outperforms all the previous ones, reducing word error rates (WERs) by 8.11% relative compared to a single all-dialects AM and by 7.31% relative compared to dialect-specific AMs.
  arXiv  Detail & Related papers  (2022-05-06T06:07:09Z)
• Quantifying Language Variation Acoustically with Few Resources [4.162663632560141]
  Deep acoustic models might have learned linguistic information that transfers to low-resource languages. We compute pairwise pronunciation differences averaged over 10 words for over 100 individual dialects from four (regional) languages. Our results show that acoustic models outperform the (traditional) transcription-based approach without requiring phonetic transcriptions.
  arXiv  Detail & Related papers  (2022-05-05T15:00:56Z)
• Finnish Dialect Identification: The Effect of Audio and Text [1.0896567381206714]
  We present the first approach to automatically detect the dialect of a speaker based on a dialect transcript and transcript with audio recording. Our results show that the best accuracy is received by combining both of the modalities.
  arXiv  Detail & Related papers  (2021-11-06T04:25:53Z)
• Phoneme Recognition through Fine Tuning of Phonetic Representations: a Case Study on Luhya Language Varieties [77.2347265289855]
  We focus on phoneme recognition using Allosaurus, a method for multilingual recognition based on phonetic annotation. To evaluate in a challenging real-world scenario, we curate phone recognition datasets for Bukusu and Saamia, two varieties of the Luhya language cluster of western Kenya and eastern Uganda. We find that fine-tuning of Allosaurus, even with just 100 utterances, leads to significant improvements in phone error rates.
  arXiv  Detail & Related papers  (2021-04-04T15:07:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.