A Severity-Based Curriculum Learning Strategy for Arabic Medical Text Generation
- URL: http://arxiv.org/abs/2604.06365v1
- Date: Tue, 07 Apr 2026 18:41:53 GMT
- Title: A Severity-Based Curriculum Learning Strategy for Arabic Medical Text Generation
- Abstract summary: This work introduces a Severity-based Curriculum Learning Strategy for Arabic Medical Text Generation.<n>The training process is structured to move gradually from less severe to more critical medical conditions.<n>The proposed method is evaluated on a subset of the Medical Arabic Question Answering dataset.
- Score: 0.25489046505746704
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: Arabic medical text generation is increasingly needed to help users interpret symptoms and access general health guidance in their native language. Nevertheless, many existing methods assume uniform importance across training samples, overlooking differences in clinical severity. This simplification can hinder the model's ability to properly capture complex or high-risk cases. To overcome this issue, this work introduces a Severity-based Curriculum Learning Strategy for Arabic Medical Text Generation, where the training process is structured to move gradually from less severe to more critical medical conditions. The approach divides the dataset into ordered stages based on severity and incrementally exposes the model to more challenging cases during fine-tuning, allowing it to first learn basic medical patterns before addressing more complex scenarios. The proposed method is evaluated on a subset of the Medical Arabic Question Answering (MAQA) dataset, which includes Arabic medical questions describing symptoms alongside corresponding responses. In addition, the dataset is annotated with three severity levels (Mild, Moderate, and Critical) using a rule-based method developed in this study. The results demonstrate that incorporating severity-aware curriculum learning leads to consistent performance improvements across all tested models, with gains of around +4% to +7% over baseline models and +3% to +6% compared with conventional fine-tuning approaches.
Related papers
- Severity-Aware Curriculum Learning with Multi-Model Response Selection for Medical Text Generation [0.25489046505746704]
Existing large language models often struggle to provide consistent and contextually appropriate medical responses across varying levels of case severity.<n>We introduce a severity-aware multi-model framework that integrates curriculum training strategy with relevance-based response selection.
arXiv Detail & Related papers (2026-06-03T23:28:34Z) - MedForget: Hierarchy-Aware Multimodal Unlearning Testbed for Medical AI [66.0701326117134]
MedForget is a hierarchy-aware multimodal unlearning testbed for building compliant medical AI systems.<n>We show that existing methods struggle to achieve complete, hierarchy-aware forgetting without reducing diagnostic performance.<n>We introduce a reconstruction attack that progressively adds hierarchical level context to prompts.
arXiv Detail & Related papers (2025-12-10T17:55:06Z) - TACL: Threshold-Adaptive Curriculum Learning Strategy for Enhancing Medical Text Understanding [8.188646882370792]
We present TACL (Threshold-Adaptive Curriculum Learning), a novel framework designed to rethink how models interact with medical texts during training.<n>By categorizing data into difficulty levels and prioritizing simpler cases early in training, TACL builds a strong foundation before tackling more complex records.<n>We observe significant improvements across diverse clinical tasks, including automatic ICD coding, readmission prediction and TCM syndrome differentiation.
arXiv Detail & Related papers (2025-10-17T03:16:51Z) - An Ensemble Classification Approach in A Multi-Layered Large Language Model Framework for Disease Prediction [0.4666493857924357]
Social telehealth has made remarkable progress in healthcare by allowing patients to post symptoms and participate in medical consultations remotely.<n>Users frequently post symptoms on social media and online health platforms, creating a huge repository of medical data.<n>Large language models (LLMs) have demonstrated strong capabilities in processing complex medical text.
arXiv Detail & Related papers (2025-09-02T15:53:51Z) - Leveraging Language Models and Machine Learning in Verbal Autopsy Analysis [0.0]
In countries without civil registration and vital statistics, verbal autopsy (VA) is a critical tool for estimating cause of death (COD)<n>Existing automated VA cause classification algorithms only use the questions and ignore the information in the narratives.<n>We investigate how the VA narrative can be used for automated COD classification using pretrained language models (PLMs) and machine learning (ML) techniques.
arXiv Detail & Related papers (2025-08-22T21:40:54Z) - Adapting Mental Health Prediction Tasks for Cross-lingual Learning via Meta-Training and In-context Learning with Large Language Model [3.3590922002216193]
We use model-agnostic meta-learning and leveraging large language models (LLMs) to address this gap.
We first apply a meta-learning model with self-supervision, which results in improved model initialisation for rapid adaptation and cross-lingual transfer.
In parallel, we use LLMs' in-context learning capabilities to assess their performance accuracy across the Swahili mental health prediction tasks.
arXiv Detail & Related papers (2024-04-13T17:11:35Z) - Optimizing Skin Lesion Classification via Multimodal Data and Auxiliary
Task Integration [54.76511683427566]
This research introduces a novel multimodal method for classifying skin lesions, integrating smartphone-captured images with essential clinical and demographic information.
A distinctive aspect of this method is the integration of an auxiliary task focused on super-resolution image prediction.
The experimental evaluations have been conducted using the PAD-UFES20 dataset, applying various deep-learning architectures.
arXiv Detail & Related papers (2024-02-16T05:16:20Z) - Improving Imbalanced Text Classification with Dynamic Curriculum
Learning [32.731900584216724]
We propose a novel self-paced dynamic curriculum learning method for imbalanced text classification.
Our SPDCL can reorder and resample training data by difficulty criterion with an adaptive from easy to hard pace.
The experiments on several classification tasks show the effectiveness of SPDCL strategy, especially for the imbalanced dataset.
arXiv Detail & Related papers (2022-10-25T07:57:59Z) - LifeLonger: A Benchmark for Continual Disease Classification [59.13735398630546]
We introduce LifeLonger, a benchmark for continual disease classification on the MedMNIST collection.
Task and class incremental learning of diseases address the issue of classifying new samples without re-training the models from scratch.
Cross-domain incremental learning addresses the issue of dealing with datasets originating from different institutions while retaining the previously obtained knowledge.
arXiv Detail & Related papers (2022-04-12T12:25:05Z) - Towards Lifelong Learning of Multilingual Text-To-Speech Synthesis [87.75833205560406]
This work presents a lifelong learning approach to train a multilingual Text-To-Speech (TTS) system.
It does not require pooled data from all languages altogether, and thus alleviates the storage and computation burden.
arXiv Detail & Related papers (2021-10-09T07:00:38Z) - Self Context and Shape Prior for Sensorless Freehand 3D Ultrasound
Reconstruction [61.62191904755521]
3D freehand US reconstruction is promising in addressing the problem by providing broad range and freeform scan.
Existing deep learning based methods only focus on the basic cases of skill sequences.
We propose a novel approach to sensorless freehand 3D US reconstruction considering the complex skill sequences.
arXiv Detail & Related papers (2021-07-31T16:06:50Z) - Benchmarking Automated Clinical Language Simplification: Dataset,
Algorithm, and Evaluation [48.87254340298189]
We construct a new dataset named MedLane to support the development and evaluation of automated clinical language simplification approaches.
We propose a new model called DECLARE that follows the human annotation procedure and achieves state-of-the-art performance.
arXiv Detail & Related papers (2020-12-04T06:09:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.