Digital Harf: A Clinically Integrated Multimodal AI System for Pervasive Arabic Speech and Language Therapy

• URL: http://arxiv.org/abs/2607.27212v1
• Date: Mon, 18 May 2026 09:04:47 GMT
• Title: Digital Harf: A Clinically Integrated Multimodal AI System for Pervasive Arabic Speech and Language Therapy
• Abstract summary: Children with Autism Spectrum Disorder in Arabic-speaking countries face compounded barriers to effective speech and language therapy.<n>We present Digital Harf, a pervasive, multimodal AI platform that extends clinician-led speech and language therapy into the home.
• Score: 1.0898519359579681
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Children with Autism Spectrum Disorder in Arabic-speaking countries face compounded barriers to effective speech and language therapy: a shortage of qualified specialists, limited service reach beyond urban centers, and a near-total absence of culturally grounded digital therapy materials. We present Digital Harf, a pervasive, multimodal AI platform that extends clinician-led speech and language therapy into the home. The system integrates three therapeutic modules - language therapy, speech intelligibility, and picture description - within a unified workflow that adapts to each child's performance over time. To address the critical shortage of Arabic therapy content, we introduce an Agentic Synthetic Data Engine (ASDE) that automatically generates culturally relevant images, prompts, and language tasks guided by explicit therapeutic and cultural criteria. Expert evaluation with 13 licensed Speech-Language Pathologists yielded a 90.1% clinical acceptance rate for ASDE-generated content without any manual curation or selection, and strong ratings for cultural and linguistic alignment across the full platform. Digital Harf demonstrates that AI-driven therapeutic systems can be built from the ground up for underrepresented linguistic settings, treating cultural grounding as core infrastructure rather than an adaptation afterthought.

Related papers

• Adapting Self-Supervised Speech Representations for Cross-lingual Dysarthria Detection in Parkinson's Disease [72.0406069194794]
  Speech representations often encode language-dependent structure that can confound dysarthria detection.<n>We propose a representation-level language shift that aligns source-language self-supervised speech representations with the target-language distribution.<n>We evaluate the approach on oral DDK recordings from Parkinson's disease speech datasets in Czech, German, and Spanish.
  arXiv  Detail & Related papers  (2026-03-23T17:23:39Z)
• Multilingual Hate Speech Detection and Counterspeech Generation: A Comprehensive Survey and Practical Guide [0.07646713951724012]
  This paper presents a comprehensive survey and practical guide to multilingual hate speech detection and counterspeech generation.<n>We analyze why monolingual systems often fail in non-English and code-mixed contexts, missing implicit hate and culturally specific expressions.
  arXiv  Detail & Related papers  (2026-03-01T21:26:53Z)
• An Ubuntu-Guided Large Language Model Framework for Cognitive Behavioral Mental Health Dialogue [0.5449798184075946]
  This study introduces a proof-of-concept framework that integrates cognitive behavioral therapy with the African philosophy of Ubuntu.<n>Key CBT techniques, including behavioral activation and cognitive restructuring, were reinterpreted through Ubuntu principles.<n>Results demonstrate that the model effectively engages in empathetic, context-aware dialogue aligned with both therapeutic and cultural objectives.
  arXiv  Detail & Related papers  (2026-01-11T11:50:18Z)
• Tell Me: An LLM-powered Mental Well-being Assistant with RAG, Synthetic Dialogue Generation, and Agentic Planning [0.0]
  Tell Me is a mental well-being system that leverages advances in large language models to provide accessible, context-aware support for users and researchers.<n>The system integrates three components: (i) a retrieval-augmented generation (RAG) assistant for personalized, knowledge-grounded dialogue; (ii) a synthetic client-therapist dialogue generator conditioned on client profiles to facilitate research on therapeutic language and data augmentation; and (iii) a Well-being AI crew, implemented with CrewAI, that produces weekly self-care plans and guided meditation audio.
  arXiv  Detail & Related papers  (2025-11-18T12:43:04Z)
• MMA-ASIA: A Multilingual and Multimodal Alignment Framework for Culturally-Grounded Evaluation [91.22008265721952]
  MMA-ASIA centers on a human-curated, multilingual, and multimodally aligned benchmark covering 8 Asian countries and 10 languages.<n>This is the first dataset aligned at the input level across three modalities: text, image (visual question answering), and speech.<n>We propose a five-dimensional evaluation protocol that measures: (i) cultural-awareness disparities across countries, (ii) cross-lingual consistency, (iii) cross-modal consistency, (iv) cultural knowledge generalization, and (v) grounding validity.
  arXiv  Detail & Related papers  (2025-10-07T14:12:12Z)
• Cross-Lingual Mental Health Ontologies for Indian Languages: Bridging Patient Expression and Clinical Understanding through Explainable AI and Human-in-the-Loop Validation [0.2555114504478013]
  Mental health communication in India is linguistically fragmented, culturally diverse, and often underrepresented in clinical communication.<n>We propose a framework for cross-lingual building of mental health representations through graph-based methods that capture culturally embedded expressions of distress, align them across languages, and link them with clinical terminology.
  arXiv  Detail & Related papers  (2025-10-06T21:27:37Z)
• Towards Inclusive Communication: A Unified Framework for Generating Spoken Language from Sign, Lip, and Audio [52.859261069569165]
  We propose the first unified framework capable of handling diverse combinations of sign language, lip movements, and audio for spoken-language text generation.<n>We focus on three main objectives: (i) designing a unified, modality-agnostic architecture capable of effectively processing heterogeneous inputs; (ii) exploring the underexamined synergy among modalities, particularly the role of lip movements as non-manual cues in sign language comprehension; and (iii) achieving performance on par with or better than state-of-the-art models specialized for individual tasks.
  arXiv  Detail & Related papers  (2025-08-28T06:51:42Z)
• Beyond Empathy: Integrating Diagnostic and Therapeutic Reasoning with Large Language Models for Mental Health Counseling [50.83055329849865]
  PsyLLM is a large language model designed to integrate diagnostic and therapeutic reasoning for mental health counseling.<n>It processes real-world mental health posts from Reddit and generates multi-turn dialogue structures.<n>Our experiments demonstrate that PsyLLM significantly outperforms state-of-the-art baseline models.
  arXiv  Detail & Related papers  (2025-05-21T16:24:49Z)
• HamRaz: A Culture-Based Persian Conversation Dataset for Person-Centered Therapy Using LLM Agents [4.192622517351801]
  HamRaz is a dataset for AI-assisted mental health support grounded in Person-Centered Therapy (PCT)<n>We combine script-based dialogue with adaptive large language models (LLM) role-playing, capturing the ambiguity and emotional nuance of Persian-speaking clients.<n>Human evaluations show HamRaz outperforms existing baselines in empathy, coherence, and realism.
  arXiv  Detail & Related papers  (2025-02-09T18:23:34Z)
• Lens: Rethinking Multilingual Enhancement for Large Language Models [70.85065197789639]
  We propose Lens, a novel approach to enhance multilingual capabilities in large language models (LLMs)<n>Lens operates on two subspaces: the language-agnostic subspace, where it aligns target languages with the central language to inherit strong semantic representations, and the language-specific subspace, where it separates target and central languages to preserve linguistic specificity.<n>Lens significantly improves multilingual performance while maintaining the model's English proficiency, achieving better results with less computational cost compared to existing post-training approaches.
  arXiv  Detail & Related papers  (2024-10-06T08:51:30Z)
• Benchmarking Automated Clinical Language Simplification: Dataset, Algorithm, and Evaluation [48.87254340298189]
  We construct a new dataset named MedLane to support the development and evaluation of automated clinical language simplification approaches. We propose a new model called DECLARE that follows the human annotation procedure and achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2020-12-04T06:09:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.