Some Reflections on Drawing Causal Inference using Textual Data:
Parallels Between Human Subjects and Organized Texts
- URL: http://arxiv.org/abs/2202.00848v1
- Date: Wed, 2 Feb 2022 01:54:04 GMT
- Title: Some Reflections on Drawing Causal Inference using Textual Data:
Parallels Between Human Subjects and Organized Texts
- Authors: Bo Zhang and Jiayao Zhang
- Abstract summary: We examine the role of textual data as study units when conducting causal inference.
We elaborate on key causal concepts and principles, and expose some ambiguity and sometimes fallacies.
- Score: 5.28584552391588
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: We examine the role of textual data as study units when conducting causal
inference by drawing parallels between human subjects and organized texts. %in
human population research. We elaborate on key causal concepts and principles,
and expose some ambiguity and sometimes fallacies. To facilitate better framing
a causal query, we discuss two strategies: (i) shifting from immutable traits
to perceptions of them, and (ii) shifting from some abstract concept/property
to its constituent parts, i.e., adopting a constructivist perspective of an
abstract concept. We hope this article would raise the awareness of the
importance of articulating and clarifying fundamental concepts before delving
into developing methodologies when drawing causal inference using textual data.
Related papers
- Can Language Models Take A Hint? Prompting for Controllable Contextualized Commonsense Inference [12.941933077524919]
We introduce "hinting," a data augmentation technique that enhances contextualized commonsense inference.
"Hinting" employs a prefix prompting strategy using both hard and soft prompts to guide the inference process.
Our results show that "hinting" does not compromise the performance of contextual commonsense inference while offering improved controllability.
arXiv Detail & Related papers (2024-10-03T04:32:46Z) - DiPlomat: A Dialogue Dataset for Situated Pragmatic Reasoning [89.92601337474954]
Pragmatic reasoning plays a pivotal role in deciphering implicit meanings that frequently arise in real-life conversations.
We introduce a novel challenge, DiPlomat, aiming at benchmarking machines' capabilities on pragmatic reasoning and situated conversational understanding.
arXiv Detail & Related papers (2023-06-15T10:41:23Z) - Natural Language Decompositions of Implicit Content Enable Better Text
Representations [56.85319224208865]
We introduce a method for the analysis of text that takes implicitly communicated content explicitly into account.
We use a large language model to produce sets of propositions that are inferentially related to the text that has been observed.
Our results suggest that modeling the meanings behind observed language, rather than the literal text alone, is a valuable direction for NLP.
arXiv Detail & Related papers (2023-05-23T23:45:20Z) - An Inclusive Notion of Text [69.36678873492373]
We argue that clarity on the notion of text is crucial for reproducible and generalizable NLP.
We introduce a two-tier taxonomy of linguistic and non-linguistic elements that are available in textual sources and can be used in NLP modeling.
arXiv Detail & Related papers (2022-11-10T14:26:43Z) - Beyond Model Interpretability: On the Faithfulness and Adversarial
Robustness of Contrastive Textual Explanations [2.543865489517869]
This work motivates textual counterfactuals by laying the ground for a novel evaluation scheme inspired by the faithfulness of explanations.
Experiments on sentiment analysis data show that the connectedness of counterfactuals to their original counterparts is not obvious in both models.
arXiv Detail & Related papers (2022-10-17T09:50:02Z) - Multiview Contextual Commonsense Inference: A New Dataset and Task [40.566530682082714]
CICEROv2 is a dataset consisting of 8,351 instances from 2,379 dialogues.
It contains multiple human-written answers for each contextual commonsense inference question.
We show that the inferences in CICEROv2 are more semantically diverse than other contextual commonsense inference datasets.
arXiv Detail & Related papers (2022-10-06T13:08:41Z) - REX: Reasoning-aware and Grounded Explanation [30.392986232906107]
We develop a new type of multi-modal explanations that explain the decisions by traversing the reasoning process and grounding keywords in the images.
Second, we identify the critical need to tightly couple important components across the visual and textual modalities for explaining the decisions.
Third, we propose a novel explanation generation method that explicitly models the pairwise correspondence between words and regions of interest.
arXiv Detail & Related papers (2022-03-11T17:28:42Z) - Human Interpretation of Saliency-based Explanation Over Text [65.29015910991261]
We study saliency-based explanations over textual data.
We find that people often mis-interpret the explanations.
We propose a method to adjust saliencies based on model estimates of over- and under-perception.
arXiv Detail & Related papers (2022-01-27T15:20:32Z) - Exploring Discourse Structures for Argument Impact Classification [48.909640432326654]
This paper empirically shows that the discourse relations between two arguments along the context path are essential factors for identifying the persuasive power of an argument.
We propose DisCOC to inject and fuse the sentence-level structural information with contextualized features derived from large-scale language models.
arXiv Detail & Related papers (2021-06-02T06:49:19Z) - From the problem of Future Contingents to Peres-Mermin square
experiments: An introductory review to Contextuality [0.0]
We study the historical emergence of the concept from philosophical and logical issues.
We present and compare the main theoretical frameworks that have been derived.
We focus on the complex task of establishing experimental tests of contextuality.
arXiv Detail & Related papers (2021-05-28T13:33:39Z) - Survey on Visual Sentiment Analysis [87.20223213370004]
This paper reviews pertinent publications and tries to present an exhaustive overview of the field of Visual Sentiment Analysis.
The paper also describes principles of design of general Visual Sentiment Analysis systems from three main points of view.
A formalization of the problem is discussed, considering different levels of granularity, as well as the components that can affect the sentiment toward an image in different ways.
arXiv Detail & Related papers (2020-04-24T10:15:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.