A Rhythm-Aware Phrase Insertion for Classical Arabic Poetry Composition

• URL: http://arxiv.org/abs/2509.18514v1
• Date: Tue, 23 Sep 2025 01:22:15 GMT
• Title: A Rhythm-Aware Phrase Insertion for Classical Arabic Poetry Composition
• Abstract summary: We present a methodology for inserting phrases in Arabic poems to conform to a specific rhythm using ByT5, a byte-level multilingual transformer-based model.<n>Our approach employs a conditional denoising objective to fine-tune ByT5, where the model reconstructs masked words to match a target rhythm.<n> Experimental results demonstrate that our models achieve high rhythmic alignment while maintaining semantic coherence.
• Score: 1.439518478021091
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This paper presents a methodology for inserting phrases in Arabic poems to conform to a specific rhythm using ByT5, a byte-level multilingual transformer-based model. Our work discusses a rule-based grapheme-to-beat transformation tailored for extracting the rhythm from fully diacritized Arabic script. Our approach employs a conditional denoising objective to fine-tune ByT5, where the model reconstructs masked words to match a target rhythm. We adopt a curriculum learning strategy, pre-training on a general Arabic dataset before fine-tuning on poetic dataset, and explore cross-lingual transfer from English to Arabic. Experimental results demonstrate that our models achieve high rhythmic alignment while maintaining semantic coherence. The proposed model has the potential to be used in co-creative applications in the process of composing classical Arabic poems.

Related papers

• Instruction-Guided Poetry Generation in Arabic and Its Dialects [44.29808445432812]
  We present a large-scale, carefully curated instruction-based dataset in Modern Standard Arabic (MSA) and various Arabic dialects.<n>This dataset enables tasks such as writing, revising, and continuing poems based on predefined criteria, including style and rhyme.<n>Experiments show that fine-tuning LLMs on this dataset yields models that can effectively generate poetry that is aligned with user requirements.
  arXiv  Detail & Related papers  (2026-04-30T11:58:13Z)
• Enhanced Arabic Text Retrieval with Attentive Relevance Scoring [12.053940320312355]
  Arabic poses a particular challenge for natural language processing and information retrieval.<n>Despite the growing global significance of Arabic, it is still underrepresented in NLP research and benchmark resources.<n>We present an enhanced Dense Passage Retrieval framework developed specifically for Arabic.
  arXiv  Detail & Related papers  (2025-07-31T10:18:28Z)
• Second Language (Arabic) Acquisition of LLMs via Progressive Vocabulary Expansion [55.27025066199226]
  This paper addresses the need for democratizing large language models (LLM) in the Arab world.<n>One practical objective for an Arabic LLM is to utilize an Arabic-specific vocabulary for the tokenizer that could speed up decoding.<n>Inspired by the vocabulary learning during Second Language (Arabic) Acquisition for humans, the released AraLLaMA employs progressive vocabulary expansion.
  arXiv  Detail & Related papers  (2024-12-16T19:29:06Z)
• Bilingual Adaptation of Monolingual Foundation Models [48.859227944759986]
  We present an efficient method for adapting a monolingual Large Language Model (LLM) to another language. Our two-stage approach begins with expanding the vocabulary and training only the embeddings matrix. By continually pre-training on a mix of Arabic and English corpora, the model retains its proficiency in English while acquiring capabilities in Arabic.
  arXiv  Detail & Related papers  (2024-07-13T21:09:38Z)
• Exploiting Dialect Identification in Automatic Dialectal Text Normalization [9.320305816520422]
  We aim to normalize Dialectal Arabic into the Conventional Orthography for Dialectal Arabic (CODA) We benchmark newly developed sequence-to-sequence models on the task of CODAfication. We show that using dialect identification information improves the performance across all dialects.
  arXiv  Detail & Related papers  (2024-07-03T11:30:03Z)
• AceGPT, Localizing Large Language Models in Arabic [73.39989503874634]
  The paper proposes a comprehensive solution that includes pre-training with Arabic texts, Supervised Fine-Tuning (SFT) utilizing native Arabic instructions, and GPT-4 responses in Arabic. The goal is to cultivate culturally cognizant and value-aligned Arabic LLMs capable of accommodating the diverse, application-specific needs of Arabic-speaking communities.
  arXiv  Detail & Related papers  (2023-09-21T13:20:13Z)
• Fine-Tashkeel: Finetuning Byte-Level Models for Accurate Arabic Text Diacritization [10.342180619706724]
  We finetune token-free pre-trained multilingual models to learn to predict and insert missing diacritics in Arabic text. We show that we can achieve state-of-the-art on the diacritization task with minimal amount of training and no feature engineering.
  arXiv  Detail & Related papers  (2023-03-25T23:41:33Z)
• Beyond Contrastive Learning: A Variational Generative Model for Multilingual Retrieval [109.62363167257664]
  We propose a generative model for learning multilingual text embeddings. Our model operates on parallel data in $N$ languages. We evaluate this method on a suite of tasks including semantic similarity, bitext mining, and cross-lingual question retrieval.
  arXiv  Detail & Related papers  (2022-12-21T02:41:40Z)
• Supporting Undotted Arabic with Pre-trained Language Models [0.0]
  We study the effect of applying pre-trained Arabic language models on "undotted" Arabic texts. We suggest several ways of supporting undotted texts with pre-trained models, without additional training, and measure their performance on two Arabic natural-language-processing tasks.
  arXiv  Detail & Related papers  (2021-11-18T16:47:56Z)
• Consistency Regularization for Cross-Lingual Fine-Tuning [61.08704789561351]
  We propose to improve cross-lingual fine-tuning with consistency regularization. Specifically, we use example consistency regularization to penalize the prediction sensitivity to four types of data augmentations. Experimental results on the XTREME benchmark show that our method significantly improves cross-lingual fine-tuning across various tasks.
  arXiv  Detail & Related papers  (2021-06-15T15:35:44Z)
• Exemplar-Controllable Paraphrasing and Translation using Bitext [57.92051459102902]
  We adapt models from prior work to be able to learn solely from bilingual text (bitext) Our single proposed model can perform four tasks: controlled paraphrase generation in both languages and controlled machine translation in both language directions.
  arXiv  Detail & Related papers  (2020-10-12T17:02:50Z)
• BERT Fine-tuning For Arabic Text Summarization [0.0]
  Our model works with multilingual BERT (as Arabic language does not have a pretrained BERT of its own) We show its performance in English corpus first before applying it to Arabic corpora in both extractive and abstractive tasks.
  arXiv  Detail & Related papers  (2020-03-29T20:23:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.