Prompted Aspect Key Point Analysis for Quantitative Review Summarization

• URL: http://arxiv.org/abs/2407.14049v1
• Date: Fri, 19 Jul 2024 06:07:32 GMT
• Title: Prompted Aspect Key Point Analysis for Quantitative Review Summarization
• Authors: An Quang Tang, Xiuzhen Zhang, Minh Ngoc Dinh, Erik Cambria,
• Abstract summary: Key Point Analysis aims for quantitative summarization that provides key points (KPs) as succinct textual summaries and quantities measuring their prevalence. Recent abstractive approaches still generate KPs based on sentences, often leading to KPs with overlapping and hallucinated opinions. We propose Prompted Aspect Key Point Analysis (PAKPA) for quantitative review summarization.
• Score: 27.691150599517364
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Key Point Analysis (KPA) aims for quantitative summarization that provides key points (KPs) as succinct textual summaries and quantities measuring their prevalence. KPA studies for arguments and reviews have been reported in the literature. A majority of KPA studies for reviews adopt supervised learning to extract short sentences as KPs before matching KPs to review comments for quantification of KP prevalence. Recent abstractive approaches still generate KPs based on sentences, often leading to KPs with overlapping and hallucinated opinions, and inaccurate quantification. In this paper, we propose Prompted Aspect Key Point Analysis (PAKPA) for quantitative review summarization. PAKPA employs aspect sentiment analysis and prompted in-context learning with Large Language Models (LLMs) to generate and quantify KPs grounded in aspects for business entities, which achieves faithful KPs with accurate quantification, and removes the need for large amounts of annotated data for supervised training. Experiments on the popular review dataset Yelp and the aspect-oriented review summarization dataset SPACE show that our framework achieves state-of-the-art performance. Source code and data are available at: https://github.com/antangrocket1312/PAKPA

Related papers

• Pre-Trained Language Models for Keyphrase Prediction: A Review [2.7869482272876622]
  Keyphrase Prediction (KP) is essential for identifying keyphrases in a document that can summarize its content. Recent Natural Language Processing advances have developed more efficient KP models using deep learning techniques. This paper extensively examines the topic of pre-trained language models for keyphrase prediction (PLM-KP)
  arXiv  Detail & Related papers  (2024-09-02T09:15:44Z)
• Query Performance Prediction using Relevance Judgments Generated by Large Language Models [53.97064615557883]
  We propose a QPP framework using automatically generated relevance judgments (QPP-GenRE) QPP-GenRE decomposes QPP into independent subtasks of predicting relevance of each item in a ranked list to a given query. This allows us to predict any IR evaluation measure using the generated relevance judgments as pseudo-labels.
  arXiv  Detail & Related papers  (2024-04-01T09:33:05Z)
• Anchoring Path for Inductive Relation Prediction in Knowledge Graphs [69.81600732388182]
  APST takes both APs and CPs as the inputs of a unified Sentence Transformer architecture. We evaluate APST on three public datasets and achieve state-of-the-art (SOTA) performance in 30 of 36 transductive, inductive, and few-shot experimental settings.
  arXiv  Detail & Related papers  (2023-12-21T06:02:25Z)
• From Chaos to Clarity: Claim Normalization to Empower Fact-Checking [57.024192702939736]
  Claim Normalization (aka ClaimNorm) aims to decompose complex and noisy social media posts into more straightforward and understandable forms. We propose CACN, a pioneering approach that leverages chain-of-thought and claim check-worthiness estimation. Our experiments demonstrate that CACN outperforms several baselines across various evaluation measures.
  arXiv  Detail & Related papers  (2023-10-22T16:07:06Z)
• Do You Hear The People Sing? Key Point Analysis via Iterative Clustering and Abstractive Summarisation [12.548947151123555]
  Argument summarisation is a promising but currently under-explored field. One of the main challenges in Key Point Analysis is finding high-quality key point candidates. evaluating key points is crucial in ensuring that the automatically generated summaries are useful.
  arXiv  Detail & Related papers  (2023-05-25T12:43:29Z)
• From Judgement's Premises Towards Key Points [1.648438955311779]
  Key Point Analysis is a relatively new task in NLP that combines summarization and classification. We focus on the legal domain and develop methods that identify and extract KPs from premises derived from texts of judgments.
  arXiv  Detail & Related papers  (2022-12-23T10:20:58Z)
• Object Localization under Single Coarse Point Supervision [107.46800858130658]
  We propose a POL method using coarse point annotations, relaxing the supervision signals from accurate key points to freely spotted points. CPR constructs point bags, selects semantic-correlated points, and produces semantic center points through multiple instance learning (MIL) In this way, CPR defines a weakly supervised evolution procedure, which ensures training high-performance object localizer under coarse point supervision.
  arXiv  Detail & Related papers  (2022-03-17T14:14:11Z)
• Ranking Scientific Papers Using Preference Learning [48.78161994501516]
  We cast it as a paper ranking problem based on peer review texts and reviewer scores. We introduce a novel, multi-faceted generic evaluation framework for making final decisions based on peer reviews.
  arXiv  Detail & Related papers  (2021-09-02T19:41:47Z)
• Every Bite Is an Experience: Key Point Analysis of Business Reviews [12.364867281334096]
  Key Point Analysis (KPA) has been proposed as a summarization framework that provides both textual and quantitative summary of the main points in the data. We show empirically that these novel extensions of KPA substantially improve its performance.
  arXiv  Detail & Related papers  (2021-06-12T12:22:12Z)
• Weakly-Supervised Aspect-Based Sentiment Analysis via Joint Aspect-Sentiment Topic Embedding [71.2260967797055]
  We propose a weakly-supervised approach for aspect-based sentiment analysis. We learn sentiment, aspect> joint topic embeddings in the word embedding space. We then use neural models to generalize the word-level discriminative information.
  arXiv  Detail & Related papers  (2020-10-13T21:33:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.