Who Wrote This? Identifying Machine vs Human-Generated Text in Hausa

• URL: http://arxiv.org/abs/2503.13101v1
• Date: Mon, 17 Mar 2025 12:13:37 GMT
• Title: Who Wrote This? Identifying Machine vs Human-Generated Text in Hausa
• Abstract summary: We develop the first large-scale detector that can distinguish between human- and machine-generated content in Hausa.<n>AfriXLMR achieved the highest performance with an accuracy of 99.23% and an F1 score of 99.21%.
• Score: 2.303135660004888
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The advancement of large language models (LLMs) has allowed them to be proficient in various tasks, including content generation. However, their unregulated usage can lead to malicious activities such as plagiarism and generating and spreading fake news, especially for low-resource languages. Most existing machine-generated text detectors are trained on high-resource languages like English, French, etc. In this study, we developed the first large-scale detector that can distinguish between human- and machine-generated content in Hausa. We scrapped seven Hausa-language media outlets for the human-generated text and the Gemini-2.0 flash model to automatically generate the corresponding Hausa-language articles based on the human-generated article headlines. We fine-tuned four pre-trained Afri-centric models (AfriTeVa, AfriBERTa, AfroXLMR, and AfroXLMR-76L) on the resulting dataset and assessed their performance using accuracy and F1-score metrics. AfroXLMR achieved the highest performance with an accuracy of 99.23% and an F1 score of 99.21%, demonstrating its effectiveness for Hausa text detection. Our dataset is made publicly available to enable further research.

Related papers

• AI-Generated Text Detection in Low-Resource Languages: A Case Study on Urdu [0.0]
  Large Language Models (LLMs) are now capable of generating text that closely resembles human writing.<n>This makes it harder to tell whether a piece of text was written by a human or by a machine.<n>We propose a novel AI-generated text detection framework tailored for the Urdu language.
  arXiv  Detail & Related papers  (2025-10-18T16:45:25Z)
• AI-generated Text Detection with a GLTR-based Approach [0.5524804393257919]
  Giant Language Model Test Room is a visual tool designed to help detect machine-generated texts based on GPT-2.<n>One limitation of GLTR is that the results it returns can sometimes be ambiguous and lead to confusion.<n>This study aims to explore various ways to improve GLTR's effectiveness for detecting AI-generated texts within the context of the IberLef-AuTexTification 2023 shared task.
  arXiv  Detail & Related papers  (2025-02-17T17:32:55Z)
• NusaWrites: Constructing High-Quality Corpora for Underrepresented and Extremely Low-Resource Languages [54.808217147579036]
  We conduct a case study on Indonesian local languages. We compare the effectiveness of online scraping, human translation, and paragraph writing by native speakers in constructing datasets. Our findings demonstrate that datasets generated through paragraph writing by native speakers exhibit superior quality in terms of lexical diversity and cultural content.
  arXiv  Detail & Related papers  (2023-09-19T14:42:33Z)
• Generative AI Text Classification using Ensemble LLM Approaches [0.12483023446237698]
  Large Language Models (LLMs) have shown impressive performance across a variety of AI and natural language processing tasks. We propose an ensemble neural model that generates probabilities from different pre-trained LLMs. For the first task of distinguishing between AI and human generated text, our model ranked in fifth and thirteenth place.
  arXiv  Detail & Related papers  (2023-09-14T14:41:46Z)
• Ngambay-French Neural Machine Translation (sba-Fr) [16.55378462843573]
  In Africa, and the world at large, there is an increasing focus on developing Neural Machine Translation (NMT) systems to overcome language barriers. In this project, we created the first sba-Fr dataset, which is a corpus of Ngambay-to-French translations. Our experiments show that the M2M100 model outperforms other models with high BLEU scores on both original and original+synthetic data.
  arXiv  Detail & Related papers  (2023-08-25T17:13:20Z)
• CBBQ: A Chinese Bias Benchmark Dataset Curated with Human-AI Collaboration for Large Language Models [52.25049362267279]
  We present a Chinese Bias Benchmark dataset that consists of over 100K questions jointly constructed by human experts and generative language models. The testing instances in the dataset are automatically derived from 3K+ high-quality templates manually authored with stringent quality control. Extensive experiments demonstrate the effectiveness of the dataset in detecting model bias, with all 10 publicly available Chinese large language models exhibiting strong bias in certain categories.
  arXiv  Detail & Related papers  (2023-06-28T14:14:44Z)
• Smaller Language Models are Better Black-box Machine-Generated Text Detectors [56.36291277897995]
  Small and partially-trained models are better universal text detectors. We find that whether the detector and generator were trained on the same data is not critically important to the detection success. For instance, the OPT-125M model has an AUC of 0.81 in detecting ChatGPT generations, whereas a larger model from the GPT family, GPTJ-6B, has AUC of 0.45.
  arXiv  Detail & Related papers  (2023-05-17T00:09:08Z)
• The Effect of Normalization for Bi-directional Amharic-English Neural Machine Translation [53.907805815477126]
  This paper presents the first relatively large-scale Amharic-English parallel sentence dataset. We build bi-directional Amharic-English translation models by fine-tuning the existing Facebook M2M100 pre-trained model. The results show that the normalization of Amharic homophone characters increases the performance of Amharic-English machine translation in both directions.
  arXiv  Detail & Related papers  (2022-10-27T07:18:53Z)
• No Language Left Behind: Scaling Human-Centered Machine Translation [69.28110770760506]
  We create datasets and models aimed at narrowing the performance gap between low and high-resource languages. We propose multiple architectural and training improvements to counteract overfitting while training on thousands of tasks. Our model achieves an improvement of 44% BLEU relative to the previous state-of-the-art.
  arXiv  Detail & Related papers  (2022-07-11T07:33:36Z)
• Hausa Visual Genome: A Dataset for Multi-Modal English to Hausa Machine Translation [0.7536909803290599]
  This work presents the Hausa Visual Genome (HaVG), a dataset that contains the description of an image or a section within the image in Hausa and its equivalent in English. The dataset comprises 32,923 images and their descriptions that are divided into training, development, test, and challenge test set. HaVG is the first dataset of its kind and can be used for Hausa-English machine translation, multi-modal research, and image description.
  arXiv  Detail & Related papers  (2022-05-02T18:05:35Z)
• AfroMT: Pretraining Strategies and Reproducible Benchmarks for Translation of 8 African Languages [94.75849612191546]
  AfroMT is a standardized, clean, and reproducible machine translation benchmark for eight widely spoken African languages. We develop a suite of analysis tools for system diagnosis taking into account the unique properties of these languages. We demonstrate significant improvements when pretraining on 11 languages, with gains of up to 2 BLEU points over strong baselines.
  arXiv  Detail & Related papers  (2021-09-10T07:45:21Z)
• AraGPT2: Pre-Trained Transformer for Arabic Language Generation [0.0]
  We develop the first advanced Arabic language generation model, AraGPT2, trained from scratch on a large Arabic corpus of internet text and news articles. Our largest model, AraGPT2-mega, has 1.46 billion parameters, which makes it the largest Arabic language model available. For text generation, our best model achieves a perplexity of 29.8 on held-out Wikipedia articles.
  arXiv  Detail & Related papers  (2020-12-31T09:48:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.