A Context-based Disambiguation Model for Sentiment Concepts Using a
Bag-of-concepts Approach
- URL: http://arxiv.org/abs/2008.03020v1
- Date: Fri, 7 Aug 2020 07:16:40 GMT
- Title: A Context-based Disambiguation Model for Sentiment Concepts Using a
Bag-of-concepts Approach
- Authors: Zeinab Rajabi, MohammadReza Valavi, Maryam Hourali
- Abstract summary: This study presents a context-based model to solve ambiguous polarity concepts using commonsense knowledge.
The proposed model is evaluated by applying a corpus of product reviews, called Semeval.
The experimental results revealed an accuracy rate of 82.07%, representing the effectiveness of the proposed model.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: With the widespread dissemination of user-generated content on different
social networks, and online consumer systems such as Amazon, the quantity of
opinionated information available on the Internet has been increased. One of
the main tasks of the sentiment analysis is to detect polarity within a text.
The existing polarity detection methods mainly focus on keywords and their
naive frequency counts; however, they less regard the meanings and implicit
dimensions of the natural concepts. Although background knowledge plays a
critical role in determining the polarity of concepts, it has been disregarded
in polarity detection methods. This study presents a context-based model to
solve ambiguous polarity concepts using commonsense knowledge. First, a model
is presented to generate a source of ambiguous sentiment concepts based on
SenticNet by computing the probability distribution. Then the model uses a
bag-of-concepts approach to remove ambiguities and semantic augmentation with
the ConceptNet handling to overcome lost knowledge. ConceptNet is a large-scale
semantic network with a large number of commonsense concepts. In this paper,
the point mutual information (PMI) measure is used to select the contextual
concepts having strong relationships with ambiguous concepts. The polarity of
the ambiguous concepts is precisely detected using positive/negative contextual
concepts and the relationship of the concepts in the semantic knowledge base.
The text representation scheme is semantically enriched using Numberbatch,
which is a word embedding model based on the concepts from the ConceptNet
semantic network. The proposed model is evaluated by applying a corpus of
product reviews, called Semeval. The experimental results revealed an accuracy
rate of 82.07%, representing the effectiveness of the proposed model.
Related papers
- On the Fairness, Diversity and Reliability of Text-to-Image Generative Models [49.60774626839712]
multimodal generative models have sparked critical discussions on their fairness, reliability, and potential for misuse.
We propose an evaluation framework designed to assess model reliability through their responses to perturbations in the embedding space.
Our method lays the groundwork for detecting unreliable, bias-injected models and retrieval of bias provenance.
arXiv Detail & Related papers (2024-11-21T09:46:55Z) - Discover-then-Name: Task-Agnostic Concept Bottlenecks via Automated Concept Discovery [52.498055901649025]
Concept Bottleneck Models (CBMs) have been proposed to address the 'black-box' problem of deep neural networks.
We propose a novel CBM approach -- called Discover-then-Name-CBM (DN-CBM) -- that inverts the typical paradigm.
Our concept extraction strategy is efficient, since it is agnostic to the downstream task, and uses concepts already known to the model.
arXiv Detail & Related papers (2024-07-19T17:50:11Z) - Evaluating Readability and Faithfulness of Concept-based Explanations [35.48852504832633]
Concept-based explanations arise as a promising avenue for explaining high-level patterns learned by Large Language Models.
Current methods approach concepts from different perspectives, lacking a unified formalization.
This makes evaluating the core measures of concepts, namely faithfulness or readability, challenging.
arXiv Detail & Related papers (2024-04-29T09:20:25Z) - A survey on Concept-based Approaches For Model Improvement [2.1516043775965565]
Concepts are known to be the thinking ground of humans.
We provide a systematic review and taxonomy of various concept representations and their discovery algorithms in Deep Neural Networks (DNNs)
We also provide details on concept-based model improvement literature marking the first comprehensive survey of these methods.
arXiv Detail & Related papers (2024-03-21T17:09:20Z) - Implicit Concept Removal of Diffusion Models [92.55152501707995]
Text-to-image (T2I) diffusion models often inadvertently generate unwanted concepts such as watermarks and unsafe images.
We present the Geom-Erasing, a novel concept removal method based on the geometric-driven control.
arXiv Detail & Related papers (2023-10-09T17:13:10Z) - Interpretable Neural-Symbolic Concept Reasoning [7.1904050674791185]
Concept-based models aim to address this issue by learning tasks based on a set of human-understandable concepts.
We propose the Deep Concept Reasoner (DCR), the first interpretable concept-based model that builds upon concept embeddings.
arXiv Detail & Related papers (2023-04-27T09:58:15Z) - Concept Gradient: Concept-based Interpretation Without Linear Assumption [77.96338722483226]
Concept Activation Vector (CAV) relies on learning a linear relation between some latent representation of a given model and concepts.
We proposed Concept Gradient (CG), extending concept-based interpretation beyond linear concept functions.
We demonstrated CG outperforms CAV in both toy examples and real world datasets.
arXiv Detail & Related papers (2022-08-31T17:06:46Z) - Human-Centered Concept Explanations for Neural Networks [47.71169918421306]
We introduce concept explanations including the class of Concept Activation Vectors (CAV)
We then discuss approaches to automatically extract concepts, and approaches to address some of their caveats.
Finally, we discuss some case studies that showcase the utility of such concept-based explanations in synthetic settings and real world applications.
arXiv Detail & Related papers (2022-02-25T01:27:31Z) - Translational Concept Embedding for Generalized Compositional Zero-shot
Learning [73.60639796305415]
Generalized compositional zero-shot learning means to learn composed concepts of attribute-object pairs in a zero-shot fashion.
This paper introduces a new approach, termed translational concept embedding, to solve these two difficulties in a unified framework.
arXiv Detail & Related papers (2021-12-20T21:27:51Z) - Cause and Effect: Concept-based Explanation of Neural Networks [3.883460584034766]
We take a step in the interpretability of neural networks by examining their internal representation or neuron's activations against concepts.
We propose a framework to check the existence of a causal relationship between a concept (or its negation) and task classes.
arXiv Detail & Related papers (2021-05-14T18:54:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.