ACAT: A Collaborative Platform for Efficient Aspect-Based Sentiment Dataset Annotation

• URL: http://arxiv.org/abs/2606.04189v1
• Date: Tue, 02 Jun 2026 20:16:54 GMT
• Title: ACAT: A Collaborative Platform for Efficient Aspect-Based Sentiment Dataset Annotation
• Abstract summary: ACAT (Aspect-based sentiment analysis Collaborative Tool) is a web-based platform supporting four ABSA scenarios.<n>Its core contribution is an automated Extract, Transform, Load (ETL) pipeline that aligns collaborative annotations.<n>ACAT achieves a median annotation time of 31.58 seconds and a raw IAA ranging from 0.78 to 0.86 across all tasks.
• Score: 2.2798212772395616
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Aspect-Based Sentiment Analysis (ABSA) requires high-quality datasets to train reliable models. However, existing annotation tools treat output as flat files, leaving researchers to manually consolidate multi-annotator data, reconstruct relational structures, and compute reliability metrics through custom scripts. This paper introduces ACAT (Aspect-based sentiment analysis Collaborative Annotation Tool), a web-based platform natively supporting four ABSA workflows: (1) Aspect-Category Sentiment Analysis, (2) Clause-Level Segmentation, (3) Aspect-Term Sentiment Analysis with character-level position tracking, and (4) Aspect Sentiment Triplet Extraction with dual span offset preservation. Its core contribution is an automated Extract, Transform, Load (ETL) pipeline that aligns collaborative annotations and computes Inter-Annotator Agreement (IAA) metrics directly at export, yielding training-ready datasets. In a preliminary validation on 1,002 restaurant reviews with two annotators of differing expertise, ACAT achieves a median annotation time of 31.58 seconds and a raw IAA ranging from 0.78 to 0.86 across all tasks.

Related papers

• SmartIterator: Visual Analytics Workflows for Supervising Unsupervised Data Grouping [0.0]
  emphSmartIterator(SI) is a visual analytics approach that treats the full sequence of grouping results as a first-class analytical object.<n>emphIteraScope(IS) is a coordinated visual display combining quality-metric charts with color encoding, a 1D group embedding with Sankey-style transition flows, and a 2D group embedding with HDBSCAN-detected recurrent archetypes.
  arXiv  Detail & Related papers  (2026-05-27T09:35:32Z)
• SSP-based construction of evaluation-annotated data for fine-grained aspect-based sentiment analysis [0.0]
  We report the construction of a Korean evaluation-annotated corpus.<n>We use it to cover e-commerce reviews containing sentiment and non-sentiment linguistic patterns.<n>For evaluation, the KoBERT and KcBERT models are trained on the annotated dataset, showing robust performances of F1 0.88 and F1 0.90.
  arXiv  Detail & Related papers  (2026-05-08T08:52:37Z)
• SemEval-2026 Task 3: Dimensional Aspect-Based Sentiment Analysis (DimABSA) [86.42477627274019]
  We present the SemEval-2026 shared task on Dimensional Aspect-Based Sentiment Analysis (DimABSA)<n>DimABSA improves traditional ABSA by modeling sentiment along valence-arousal (VA) dimensions rather than using categorical polarity labels.<n>To extend ABSA beyond consumer reviews to public-issue discourse, we introduce an additional task, Dimensional Stance Analysis (DimStance)<n>DimStance treats stance targets as aspects and reformulates stance detection as regression in the VA space.
  arXiv  Detail & Related papers  (2026-04-08T13:15:48Z)
• COVTrack++: Learning Open-Vocabulary Multi-Object Tracking from Continuous Videos via a Synergistic Paradigm [59.26203051651017]
  C-TAO is the first continuously annotated training set for Open-Vocabulary Multi-Object Tracking (OVMOT)<n>For the framework bottleneck, we propose COVTrack++, a synergistic framework that achieves a bidirectional reciprocal mechanism between detection and association through three modules.<n>Experiments on TAO demonstrate state-of-the-art performance, with novel TETA reaching 35.4% and 30.5% on validation and test sets, improving novel AssocA by 4.8% and novel LocA by 5.8% over previous methods.
  arXiv  Detail & Related papers  (2026-03-25T07:20:27Z)
• A2P-Vis: an Analyzer-to-Presenter Agentic Pipeline for Visual Insights Generation and Reporting [18.60614431401904]
  A2P-Vis is a two-part, multi-agent pipeline that turns raw datasets into a high-quality data-visualization report.<n>The Data Analyzer orchestrates profiling, proposes diverse visualization directions, generates and executes plotting code, filters low-quality figures with a checker, and elicits candidate insights.<n>The Presenter then orders topics, composes chart-grounded narratives from the top-ranked insights, writes justified transitions, and revises the document for clarity and consistency.
  arXiv  Detail & Related papers  (2025-12-26T18:02:12Z)
• ABCD-LINK: Annotation Bootstrapping for Cross-Document Fine-Grained Links [57.514511353084565]
  We introduce a new domain-agnostic framework for selecting a best-performing approach and annotating cross-document links.<n>We apply our framework in two distinct domains -- peer review and news.<n>The resulting novel datasets lay foundation for numerous cross-document tasks like media framing and peer review.
  arXiv  Detail & Related papers  (2025-09-01T11:32:24Z)
• Czech Dataset for Complex Aspect-Based Sentiment Analysis Tasks [0.7874708385247352]
  This paper introduces a novel dataset for aspect-based sentiment analysis (ABSA)<n>It consists of 3.1K manually annotated reviews from the restaurant domain.<n>We provide 24M reviews without annotations suitable for unsupervised learning.
  arXiv  Detail & Related papers  (2025-08-11T16:03:28Z)
• AIR: A Systematic Analysis of Annotations, Instructions, and Response Pairs in Preference Dataset [89.37514696019484]
  Preference learning is critical for aligning large language models with human values.<n>Our work shifts preference dataset design from ad hoc scaling to component-aware optimization.
  arXiv  Detail & Related papers  (2025-04-04T17:33:07Z)
• Deep Content Understanding Toward Entity and Aspect Target Sentiment Analysis on Foundation Models [0.8602553195689513]
  Entity-Aspect Sentiment Triplet Extraction (EASTE) is a novel Aspect-Based Sentiment Analysis task. Our research aims to achieve high performance on the EASTE task and investigates the impact of model size, type, and adaptation techniques on task performance. Ultimately, we provide detailed insights and achieving state-of-the-art results in complex sentiment analysis.
  arXiv  Detail & Related papers  (2024-07-04T16:48:14Z)
• MSeg: A Composite Dataset for Multi-domain Semantic Segmentation [100.17755160696939]
  We present MSeg, a composite dataset that unifies semantic segmentation datasets from different domains. We reconcile the generalization and bring the pixel-level annotations into alignment by relabeling more than 220,000 object masks in more than 80,000 images. A model trained on MSeg ranks first on the WildDash-v1 leaderboard for robust semantic segmentation, with no exposure to WildDash data during training.
  arXiv  Detail & Related papers  (2021-12-27T16:16:35Z)
• Exploring and Evaluating Attributes, Values, and Structures for Entity Alignment [100.19568734815732]
  Entity alignment (EA) aims at building a unified Knowledge Graph (KG) of rich content by linking the equivalent entities from various KGs. attribute triples can also provide crucial alignment signal but have not been well explored yet. We propose to utilize an attributed value encoder and partition the KG into subgraphs to model the various types of attribute triples efficiently.
  arXiv  Detail & Related papers  (2020-10-07T08:03:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.