SinaTools: Open Source Toolkit for Arabic Natural Language Processing

• URL: http://arxiv.org/abs/2411.01523v1
• Date: Sun, 03 Nov 2024 11:03:52 GMT
• Title: SinaTools: Open Source Toolkit for Arabic Natural Language Processing
• Abstract summary: We introduce SinaTools, an open-source Python package for Arabic natural language processing and understanding. This paper presents SinaTools and its benchmarking results, demonstrating that SinaTools outperforms all similar tools on the aforementioned tasks.
• Score: 0.5461938536945721
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We introduce SinaTools, an open-source Python package for Arabic natural language processing and understanding. SinaTools is a unified package allowing people to integrate it into their system workflow, offering solutions for various tasks such as flat and nested Named Entity Recognition (NER), fully-flagged Word Sense Disambiguation (WSD), Semantic Relatedness, Synonymy Extractions and Evaluation, Lemmatization, Part-of-speech Tagging, Root Tagging, and additional helper utilities such as corpus processing, text stripping methods, and diacritic-aware word matching. This paper presents SinaTools and its benchmarking results, demonstrating that SinaTools outperforms all similar tools on the aforementioned tasks, such as Flat NER (87.33%), Nested NER (89.42%), WSD (82.63%), Semantic Relatedness (0.49 Spearman rank), Lemmatization (90.5%), POS tagging (97.5%), among others. SinaTools can be downloaded from (https://sina.birzeit.edu/sinatools).

Related papers

• string2string Studio: An Interactive, In-Browser Platform for String-to-String Algorithms [53.57099780847477]
  string2string Studio is an interactive in-browser platform for string-to-string analysis.<n>System integrates six main modules, operating at character, word, token, line, and residue levels.<n>Core operations run locally by default without any installation or data upload.
  arXiv  Detail & Related papers  (2026-08-04T17:48:15Z)
• L3Cube-MahaPOS: A Marathi Part-of-Speech Tagging Dataset and BERT Models [2.584263027095689]
  Part-of-Speech (POS) tagging is a foundational NLP task underpinning machine translation, information extraction, and syntactic parsing.<n>Marathi is spoken by over 83 million people and ranks among the top twenty most spoken languages worldwide.<n>We benchmark the dataset across six model families spanning HMM, CRF, BiLSTM, BiLSTM+CharCNN, MuRIL, and the Marathi-specific transformer MahaBERT-v2.<n>The best system achieves 88.67% token-level accuracy and a macro-F1 of 81.67% over 15 evaluated tag classes.
  arXiv  Detail & Related papers  (2026-06-23T17:10:46Z)
• SING: Synthetic Intention Graph for Scalable Active Tool Discovery in LLM Agents [64.59100414726556]
  Large language model (LLM) agents increasingly rely on harnesses that manage context, tools, and multi-turn execution.<n>Retrieval-augmented tool selection offers a natural alternative, but existing one-shot retrieval methods fail to align isolated tool descriptions with the agent's true task intention.<n>We propose SING, an intention-aware active tool discovery framework that builds an intention-tool graph linking user intentions, tool capabilities, and tool collaboration patterns.
  arXiv  Detail & Related papers  (2026-06-15T11:37:37Z)
• Taggus: An Automated Pipeline for the Extraction of Characters' Social Networks from Portuguese Fiction Literature [1.0049627844029956]
  We propose a pipeline, which we call Taggus, to extract social networks from literary fiction works in Portuguese.<n>Our results show that compared to readily available State-of-the-Art tools, the pipeline achieves satisfying results.
  arXiv  Detail & Related papers  (2025-08-05T12:03:03Z)
• Re-Initialization Token Learning for Tool-Augmented Large Language Models [49.91503552002649]
  Large language models have demonstrated exceptional performance, yet struggle with complex tasks such as numerical reasoning, plan generation.<n>We propose a novel token learning method that aligns tool tokens with the existing word embedding space.<n>We evaluate the method on tasks such as numerical reasoning, knowledge-based question answering, and embodied plan generation using GSM8K-XL, FuncQA, KAMEL, and VirtualHome datasets.
  arXiv  Detail & Related papers  (2025-06-17T07:11:00Z)
• "I've Heard of You!": Generate Spoken Named Entity Recognition Data for Unseen Entities [59.22329574700317]
  Spoken named entity recognition (NER) aims to identify named entities from speech. New named entities appear every day, however, annotating their Spoken NER data is costly. We propose a method for generating Spoken NER data based on a named entity dictionary (NED) to reduce costs.
  arXiv  Detail & Related papers  (2024-12-26T07:43:18Z)
• Symbolic Learning Enables Self-Evolving Agents [55.625275970720374]
  We introduce agent symbolic learning, a systematic framework that enables language agents to optimize themselves on their own. Agent symbolic learning is designed to optimize the symbolic network within language agents by mimicking two fundamental algorithms in connectionist learning. We conduct proof-of-concept experiments on both standard benchmarks and complex real-world tasks.
  arXiv  Detail & Related papers  (2024-06-26T17:59:18Z)
• A General and Flexible Multi-concept Parsing Framework for Multilingual Semantic Matching [60.51839859852572]
  We propose to resolve the text into multi concepts for multilingual semantic matching to liberate the model from the reliance on NER models. We conduct comprehensive experiments on English datasets QQP and MRPC, and Chinese dataset Medical-SM.
  arXiv  Detail & Related papers  (2024-03-05T13:55:16Z)
• Unsupervised Sentiment Analysis of Plastic Surgery Social Media Posts [91.3755431537592]
  The massive collection of user posts across social media platforms is primarily untapped for artificial intelligence (AI) use cases. Natural language processing (NLP) is a subfield of AI that leverages bodies of documents, known as corpora, to train computers in human-like language understanding. This study demonstrates that the applied results of unsupervised analysis allow a computer to predict either negative, positive, or neutral user sentiment towards plastic surgery.
  arXiv  Detail & Related papers  (2023-07-05T20:16:20Z)
• Syntax and Semantics Meet in the "Middle": Probing the Syntax-Semantics Interface of LMs Through Agentivity [68.8204255655161]
  We present the semantic notion of agentivity as a case study for probing such interactions. This suggests LMs may potentially serve as more useful tools for linguistic annotation, theory testing, and discovery.
  arXiv  Detail & Related papers  (2023-05-29T16:24:01Z)
• SanskritShala: A Neural Sanskrit NLP Toolkit with Web-Based Interface for Pedagogical and Annotation Purposes [13.585440544031584]
  We present a neural Sanskrit Natural Language Processing (NLP) toolkit named SanskritShala. Our systems report state-of-the-art performance on available benchmark datasets for all tasks. SanskritShala is deployed as a web-based application, which allows a user to get real-time analysis for the given input.
  arXiv  Detail & Related papers  (2023-02-19T09:58:55Z)
• SciAnnotate: A Tool for Integrating Weak Labeling Sources for Sequence Labeling [55.71459234749639]
  SciAnnotate is a web-based tool for text annotation called SciAnnotate, which stands for scientific annotation tool. Our tool provides users with multiple user-friendly interfaces for creating weak labels. In this study, we take multi-source weak label denoising as an example, we utilized a Bertifying Conditional Hidden Markov Model to denoise the weak label generated by our tool.
  arXiv  Detail & Related papers  (2022-08-07T19:18:13Z)
• TArC: Tunisian Arabish Corpus First complete release [0.0]
  We present the final result of a project on Tunisian Arabic encoded in Arabizi. The project led to the creation of two integrated and independent resources.
  arXiv  Detail & Related papers  (2022-07-11T11:46:59Z)
• An Ensemble Approach to Acronym Extraction using Transformers [7.88595796865485]
  Acronyms are abbreviated units of a phrase constructed by using initial components of the phrase in a text. This paper discusses an ensemble approach for the task of Acronym Extraction.
  arXiv  Detail & Related papers  (2022-01-09T14:49:46Z)
• C1 at SemEval-2020 Task 9: SentiMix: Sentiment Analysis for Code-Mixed Social Media Text using Feature Engineering [0.9646922337783134]
  This paper describes our feature engineering approach to sentiment analysis in code-mixed social media text for SemEval-2020 Task 9: SentiMix. We are able to obtain a weighted F1 score of 0.65 for the "Hinglish" task and 0.63 for the "Spanglish" tasks.
  arXiv  Detail & Related papers  (2020-08-09T00:46:26Z)
• IUST at SemEval-2020 Task 9: Sentiment Analysis for Code-Mixed Social Media Text using Deep Neural Networks and Linear Baselines [6.866104126509981]
  We develop a system to predict the sentiment of a given code-mixed tweet. Our best performing method obtains an F1 score of 0.751 for the Spanish-English sub-task and 0.706 over the Hindi-English sub-task.
  arXiv  Detail & Related papers  (2020-07-24T18:48:37Z)
• ESPnet-ST: All-in-One Speech Translation Toolkit [57.76342114226599]
  ESPnet-ST is a new project inside end-to-end speech processing toolkit, ESPnet. It implements automatic speech recognition, machine translation, and text-to-speech functions for speech translation. We provide all-in-one recipes including data pre-processing, feature extraction, training, and decoding pipelines.
  arXiv  Detail & Related papers  (2020-04-21T18:38:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.