A Context-based Disambiguation Model for Sentiment Concepts Using a
Bag-of-concepts Approach
- URL: http://arxiv.org/abs/2008.03020v1
- Date: Fri, 7 Aug 2020 07:16:40 GMT
- Title: A Context-based Disambiguation Model for Sentiment Concepts Using a
Bag-of-concepts Approach
- Authors: Zeinab Rajabi, MohammadReza Valavi, Maryam Hourali
- Abstract summary: This study presents a context-based model to solve ambiguous polarity concepts using commonsense knowledge.
The proposed model is evaluated by applying a corpus of product reviews, called Semeval.
The experimental results revealed an accuracy rate of 82.07%, representing the effectiveness of the proposed model.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: With the widespread dissemination of user-generated content on different
social networks, and online consumer systems such as Amazon, the quantity of
opinionated information available on the Internet has been increased. One of
the main tasks of the sentiment analysis is to detect polarity within a text.
The existing polarity detection methods mainly focus on keywords and their
naive frequency counts; however, they less regard the meanings and implicit
dimensions of the natural concepts. Although background knowledge plays a
critical role in determining the polarity of concepts, it has been disregarded
in polarity detection methods. This study presents a context-based model to
solve ambiguous polarity concepts using commonsense knowledge. First, a model
is presented to generate a source of ambiguous sentiment concepts based on
SenticNet by computing the probability distribution. Then the model uses a
bag-of-concepts approach to remove ambiguities and semantic augmentation with
the ConceptNet handling to overcome lost knowledge. ConceptNet is a large-scale
semantic network with a large number of commonsense concepts. In this paper,
the point mutual information (PMI) measure is used to select the contextual
concepts having strong relationships with ambiguous concepts. The polarity of
the ambiguous concepts is precisely detected using positive/negative contextual
concepts and the relationship of the concepts in the semantic knowledge base.
The text representation scheme is semantically enriched using Numberbatch,
which is a word embedding model based on the concepts from the ConceptNet
semantic network. The proposed model is evaluated by applying a corpus of
product reviews, called Semeval. The experimental results revealed an accuracy
rate of 82.07%, representing the effectiveness of the proposed model.
Related papers
- Concept-Based Explainable Artificial Intelligence: Metrics and Benchmarks [0.0]
Concept-based explanation methods aim to improve the interpretability of machine learning models.
We propose three metrics: the concept global importance metric, the concept existence metric, and the concept location metric.
We demonstrate that, in many cases, even the most important concepts determined by post-hoc CBMs are not present in input images.
arXiv Detail & Related papers (2025-01-31T16:32:36Z) - OmniPrism: Learning Disentangled Visual Concept for Image Generation [57.21097864811521]
Creative visual concept generation often draws inspiration from specific concepts in a reference image to produce relevant outcomes.
We propose OmniPrism, a visual concept disentangling approach for creative image generation.
Our method learns disentangled concept representations guided by natural language and trains a diffusion model to incorporate these concepts.
arXiv Detail & Related papers (2024-12-16T18:59:52Z) - On the Fairness, Diversity and Reliability of Text-to-Image Generative Models [49.60774626839712]
multimodal generative models have sparked critical discussions on their fairness, reliability, and potential for misuse.
We propose an evaluation framework designed to assess model reliability through their responses to perturbations in the embedding space.
Our method lays the groundwork for detecting unreliable, bias-injected models and retrieval of bias provenance.
arXiv Detail & Related papers (2024-11-21T09:46:55Z) - Discover-then-Name: Task-Agnostic Concept Bottlenecks via Automated Concept Discovery [52.498055901649025]
Concept Bottleneck Models (CBMs) have been proposed to address the 'black-box' problem of deep neural networks.
We propose a novel CBM approach -- called Discover-then-Name-CBM (DN-CBM) -- that inverts the typical paradigm.
Our concept extraction strategy is efficient, since it is agnostic to the downstream task, and uses concepts already known to the model.
arXiv Detail & Related papers (2024-07-19T17:50:11Z) - Evaluating Readability and Faithfulness of Concept-based Explanations [35.48852504832633]
Concept-based explanations arise as a promising avenue for explaining high-level patterns learned by Large Language Models.
Current methods approach concepts from different perspectives, lacking a unified formalization.
This makes evaluating the core measures of concepts, namely faithfulness or readability, challenging.
arXiv Detail & Related papers (2024-04-29T09:20:25Z) - A survey on Concept-based Approaches For Model Improvement [2.1516043775965565]
Concepts are known to be the thinking ground of humans.
We provide a systematic review and taxonomy of various concept representations and their discovery algorithms in Deep Neural Networks (DNNs)
We also provide details on concept-based model improvement literature marking the first comprehensive survey of these methods.
arXiv Detail & Related papers (2024-03-21T17:09:20Z) - Implicit Concept Removal of Diffusion Models [92.55152501707995]
Text-to-image (T2I) diffusion models often inadvertently generate unwanted concepts such as watermarks and unsafe images.
We present the Geom-Erasing, a novel concept removal method based on the geometric-driven control.
arXiv Detail & Related papers (2023-10-09T17:13:10Z) - Interpretable Neural-Symbolic Concept Reasoning [7.1904050674791185]
Concept-based models aim to address this issue by learning tasks based on a set of human-understandable concepts.
We propose the Deep Concept Reasoner (DCR), the first interpretable concept-based model that builds upon concept embeddings.
arXiv Detail & Related papers (2023-04-27T09:58:15Z) - Concept Gradient: Concept-based Interpretation Without Linear Assumption [77.96338722483226]
Concept Activation Vector (CAV) relies on learning a linear relation between some latent representation of a given model and concepts.
We proposed Concept Gradient (CG), extending concept-based interpretation beyond linear concept functions.
We demonstrated CG outperforms CAV in both toy examples and real world datasets.
arXiv Detail & Related papers (2022-08-31T17:06:46Z) - Human-Centered Concept Explanations for Neural Networks [47.71169918421306]
We introduce concept explanations including the class of Concept Activation Vectors (CAV)
We then discuss approaches to automatically extract concepts, and approaches to address some of their caveats.
Finally, we discuss some case studies that showcase the utility of such concept-based explanations in synthetic settings and real world applications.
arXiv Detail & Related papers (2022-02-25T01:27:31Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.