A Corpus-Aligned Uthmani-to-Standard Quranic Word Mapping and a Deterministic Recitation Validator
- URL: http://arxiv.org/abs/2609.14967v1
- Date: Mon, 14 Sep 2026 03:20:42 GMT
- Title: A Corpus-Aligned Uthmani-to-Standard Quranic Word Mapping and a Deterministic Recitation Validator
- Abstract summary: Quranic text is distributed in two orthographic forms: the Uthmani script used in every printed mushaf, and the Standard (Imla'i) Arabic form that every mainstream Arabic NLP tool is built for.<n>We create a 2,290-pair, corpus-aligned Uthmani-to-Standard word mapping constructed by aligning the complete 6,236-verse Quran across both orthographic forms.<n>We build a deterministic, LLM-free Quranic recitation validator using a four-layer verse-matching search and word-error-rate-graded feedback.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Quranic text is distributed in two orthographic forms that are byte-level distinct: the Uthmani script used in every printed mushaf, and the Standard (Imla'i) Arabic form that every mainstream Arabic NLP tool is built for. The gap is concentrated in one Unicode character, U+0670 (superscript alef), which appears in some of the most frequently recited words in the Quran and is silently mishandled by general-purpose Arabic normalizers. We release a 2,290-pair, corpus-aligned Uthmani-to-Standard word mapping constructed by aligning the complete 6,236-verse Quran across both orthographic forms, together with a seven-step text normalization pipeline built on it. Normalizing both forms of all 6,236 verses through that pipeline yields identical strings for 90.9% of verses, and we characterize the residual divergence rather than assert that it is closed. On top of the normalized text, we build a deterministic, LLM-free Quranic recitation validator using a four-layer verse-matching search (exact, morphological, relaxed, fuzzy) and word-error-rate-graded feedback across five severity tiers. The validator scores 98.4% (122/124) on a 124-case suite emitted by the released test harness, and both failures share one mechanism: a single substitution error can make a different verse an exact match. A full-corpus census additionally quantifies an inherent text-only ambiguity affecting 16.5% of verses, and on 34 recitation transcripts drawn from a deployed Arabic ASR system the validator identifies the correct verse in every case. We release the mapping, the script that builds it, the validator, and the evaluation harness under open licenses; every number in this paper except the deployment measurement, whose transcripts are not ours to publish, is reproduced by running them.
Related papers
- RefLAM: A Reference-Grounded Line Annotation Pipeline for Historical Arabic Manuscripts [1.583691353033079]
RefLAM is a pipeline converting manuscript page images and clean transcriptions into validated, line-level ground truth.<n>RefLAM couples a deep-learning page-segmentation model with a multimodal large language model (MLLM) for structured OCR.<n>We release AraMS-28k: 14 historical Arabic manuscript books, 3,043 pages, and 27,971 main-text and 629 margin-line annotations.
arXiv Detail & Related papers (2026-08-25T20:46:11Z) - Scaling Unsupervised Word Alignment to Documents via Structural Constraints [38.797311337915175]
We introduce CTFAlign, a lightweight, training-free approach for document-level word alignment.<n>We also introduce MDPAlign, a simpler alternative that constrains alignments by position with a main diagonal prior.<n>Averaged over three models, CTFAlign reduces word alignment error rate from 0.412 to 0.326.
arXiv Detail & Related papers (2026-08-21T12:13:21Z) - A Glyph Is Not a Letter, a Token Is Not a Word, a Space Is Not a Space: What the Units of Voynichese Are Not [45.88028371034407]
We analyse the Voynich manuscript (Beinecke MS 408) with matched prose, cipher, and pseudo-text controls and quire-level resampling.<n>None holds, and the failures share a shape: the order in Voynichese sits at the edges of tokens and at graded boundaries between them.<n>A published Voynich-imitating cipher and a self-citation text generator both reproduce the low entropy, the unit scale, the weak token order, and the null result of a calibrated substitution attack.
arXiv Detail & Related papers (2026-08-17T20:05:12Z) - IndicQE-APE: A Benchmark for Quality Estimation and Automatic Post-Editing for Indic Languages [77.88427845181154]
We consolidate the WMT 2020--2024 shared-task lineage with an extended English--Malayalam resource into indicqe: $126,754$ instances over nine directional pairs.<n>We benchmark six prompted LLMs and three COMET metrics on segment-level QE, and three systems on APE.
arXiv Detail & Related papers (2026-08-17T09:50:52Z) - When AI Writes, Who Gets Cited? Evidence of Citation Monoculture Across Language Models [45.91367912142692]
We show that different models may still select the same narrow subset, producing citation monoculture without any single citation being wrong.<n>Eleven models from three vendors choose at most ten papers from uniformly random panels of thirty, with real titles and abstracts but fabricated authors, reassigned years, and hidden venues and citation counts.
arXiv Detail & Related papers (2026-08-03T14:27:46Z) - Different Strokes for Different Folks: Writer Identification for Historical Arabic Manuscripts [0.5599792629509229]
Handwritten Arabic manuscripts preserve the Arab world's intellectual and cultural heritage.<n>Using the Muharaf dataset of historical Arabic manuscripts, we evaluate writer identification from individual line images.<n>We propose a Convolutional Neural Network (CNN)-based model with attention mechanisms for closed-set writer identification.
arXiv Detail & Related papers (2026-04-24T12:55:16Z) - Automatic Pronunciation Error Detection and Correction of the Holy Quran's Learners Using Deep Learning [0.0]
We build a 98% automated pipeline to produce high-quality Quranic datasets.<n>We use our custom Quran Phonetic Script to encode Tajweed rules.<n>We release all code, data, and models as open-source.
arXiv Detail & Related papers (2025-08-27T15:28:46Z) - Invizo: Arabic Handwritten Document Optical Character Recognition Solution [2.5819726282014654]
This work proposes an end-to-end solution for recognizing Arabic handwritten, printed, and Arabic numbers.<n>We reached 81.66% precision, 78.82% Recall, and 79.07% F-measure on a Text Detection task that powers the proposed solution.
arXiv Detail & Related papers (2025-02-07T19:25:33Z) - Tibyan Corpus: Balanced and Comprehensive Error Coverage Corpus Using ChatGPT for Arabic Grammatical Error Correction [0.32885740436059047]
This study aims to develop an Arabic corpus called "Tibyan" for grammatical error correction using ChatGPT.
ChatGPT is used as a data augmenter tool based on a pair of Arabic sentences containing grammatical errors matched with a sentence free of errors extracted from Arabic books.
Our corpus contained 49 of errors, including seven types: orthography, syntax, semantics, punctuation, morphology, and split.
arXiv Detail & Related papers (2024-11-07T10:17:40Z) - Localizing Factual Inconsistencies in Attributable Text Generation [74.11403803488643]
We introduce QASemConsistency, a new formalism for localizing factual inconsistencies in attributable text generation.<n>We show that QASemConsistency yields factual consistency scores that correlate well with human judgments.
arXiv Detail & Related papers (2024-10-09T22:53:48Z) - DPIC: Decoupling Prompt and Intrinsic Characteristics for LLM Generated Text Detection [56.513637720967566]
Large language models (LLMs) can generate texts that pose risks of misuse, such as plagiarism, planting fake reviews on e-commerce platforms, or creating inflammatory false tweets.
Existing high-quality detection methods usually require access to the interior of the model to extract the intrinsic characteristics.
We propose to extract deep intrinsic characteristics of the black-box model generated texts.
arXiv Detail & Related papers (2023-05-21T17:26:16Z) - Graphemic Normalization of the Perso-Arabic Script [47.429213930688086]
This paper documents the challenges that Perso-Arabic presents beyond the best-documented languages.
We focus on the situation in natural language processing (NLP), which is affected by multiple, often neglected, issues.
We evaluate the effects of script normalization on eight languages from diverse language families in the Perso-Arabic script diaspora on machine translation and statistical language modeling tasks.
arXiv Detail & Related papers (2022-10-21T21:59:44Z) - A New Approach for Texture based Script Identification At Block Level
using Quad Tree Decomposition [38.20489458130109]
In a country like India, where multi-script scenario is prevalent, identifying scripts beforehand becomes obligatory.
We present the significance of Gabor wavelets filters in extracting directional energy and entropy distributions for 11 official handwritten scripts.
arXiv Detail & Related papers (2020-09-16T02:50:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.