CoRE: Condition-based Reasoning for Identifying Outcome Variance in Complex Events
- URL: http://arxiv.org/abs/2506.01253v1
- Date: Mon, 02 Jun 2025 02:09:20 GMT
- Title: CoRE: Condition-based Reasoning for Identifying Outcome Variance in Complex Events
- Authors: Sai Vallurupalli, Francis Ferraro,
- Abstract summary: Knowing which latent conditions lead to a particular outcome is useful for critically examining claims made about complex event outcomes.<n>We handle this by combining and augmenting annotations from two existing datasets consisting of goals and states.<n>We examine open and closed LLMs of varying sizes and intent-alignment on our reasoning tasks and find that conditions are useful when not all context is available.
- Score: 9.322509491069358
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: Knowing which latent conditions lead to a particular outcome is useful for critically examining claims made about complex event outcomes. Identifying implied conditions and examining their influence on an outcome is challenging. We handle this by combining and augmenting annotations from two existing datasets consisting of goals and states, and explore the influence of conditions through our research questions and Condition-based Reasoning tasks. We examine open and closed LLMs of varying sizes and intent-alignment on our reasoning tasks and find that conditions are useful when not all context is available. Models differ widely in their ability to generate and identify outcome-variant conditions which affects their performance on outcome validation when conditions are used to replace missing context. Larger models like GPT-4o, are more cautious in such less constrained situations.
Related papers
- A Sample Efficient Conditional Independence Test in the Presence of Discretization [54.047334792855345]
Conditional Independence (CI) tests directly to discretized data can lead to incorrect conclusions.<n>Recent advancements have sought to infer the correct CI relationship between the latent variables through binarizing observed data.<n>Motivated by this, this paper introduces a sample-efficient CI test that does not rely on the binarization process.
arXiv Detail & Related papers (2025-06-10T12:41:26Z) - Contexts Matter: An Empirical Study on Contextual Influence in Fairness Testing for Deep Learning Systems [3.077531983369872]
We aim to understand how varying contexts affect fairness testing outcomes.
Our results show that different context types and settings generally lead to a significant impact on the testing.
arXiv Detail & Related papers (2024-08-12T12:36:06Z) - Chain of Condition: Construct, Verify and Solve Conditions for Conditional Question Answering [34.599299893060895]
Conditional question answering (CQA) is an important task that aims to find probable answers and identify missing conditions.
Existing approaches struggle with CQA due to two challenges: (1) precisely identifying necessary conditions and the logical relationship, and (2) verifying conditions to detect any that are missing.
We propose a novel prompting approach, Chain of condition, by first identifying all conditions and constructing their logical relationships explicitly according to the document.
arXiv Detail & Related papers (2024-08-10T05:09:11Z) - Automated Discovery of Functional Actual Causes in Complex Environments [18.58053096534201]
Reinforcement learning algorithms often struggle to learn policies that generalize to novel situations.
This paper introduces functional actual cause (FAC), a framework that uses context-specific independencies in the environment to restrict the set of actual causes.
We additionally introduce Joint Optimization for Actual Cause Inference (JACI), an algorithm that learns from observational data to infer functional actual causes.
arXiv Detail & Related papers (2024-04-16T20:04:29Z) - Identifiable Latent Neural Causal Models [82.14087963690561]
Causal representation learning seeks to uncover latent, high-level causal representations from low-level observed data.
We determine the types of distribution shifts that do contribute to the identifiability of causal representations.
We translate our findings into a practical algorithm, allowing for the acquisition of reliable latent causal representations.
arXiv Detail & Related papers (2024-03-23T04:13:55Z) - Applying Bayesian Data Analysis for Causal Inference about Requirements Quality: A Controlled Experiment [4.6068376339651635]
It is commonly accepted that the quality of requirements specifications impacts subsequent software engineering activities.<n>We aim to contribute empirical evidence to the effect that requirements quality defects have on a software engineering activity.
arXiv Detail & Related papers (2024-01-02T11:08:39Z) - Differentiable Invariant Causal Discovery [106.87950048845308]
Learning causal structure from observational data is a fundamental challenge in machine learning.
This paper proposes Differentiable Invariant Causal Discovery (DICD) to avoid learning spurious edges and wrong causal directions.
Extensive experiments on synthetic and real-world datasets verify that DICD outperforms state-of-the-art causal discovery methods up to 36% in SHD.
arXiv Detail & Related papers (2022-05-31T09:29:07Z) - Comparing decision mining approaches with regard to the meaningfulness
of their results [0.0]
This paper compares three decision mining approaches, i.e., two existing ones and one newly described approach, with respect to the meaningfulness of their results.
The discovered decision rules are discussed with regards to their semantics and meaningfulness.
arXiv Detail & Related papers (2021-09-15T14:43:36Z) - Learning Causal Relationships from Conditional Moment Conditions by
Importance Weighting [11.326695040991192]
We consider learning causal relationships under conditional moment conditions.
conditional moment conditions pose serious challenges for causal inference in high-dimensional settings.
We propose a method that transforms conditional moment conditions to unconditional moment conditions.
arXiv Detail & Related papers (2021-08-03T06:07:07Z) - Nested Counterfactual Identification from Arbitrary Surrogate
Experiments [95.48089725859298]
We study the identification of nested counterfactuals from an arbitrary combination of observations and experiments.
Specifically, we prove the counterfactual unnesting theorem (CUT), which allows one to map arbitrary nested counterfactuals to unnested ones.
arXiv Detail & Related papers (2021-07-07T12:51:04Z) - COSMO: Conditional SEQ2SEQ-based Mixture Model for Zero-Shot Commonsense
Question Answering [50.65816570279115]
Identification of the implicit causes and effects of a social context is the driving capability which can enable machines to perform commonsense reasoning.
Current approaches in this realm lack the ability to perform commonsense reasoning upon facing an unseen situation.
We present Conditional SEQ2SEQ-based Mixture model (COSMO), which provides us with the capabilities of dynamic and diverse content generation.
arXiv Detail & Related papers (2020-11-02T07:08:19Z) - On conditional versus marginal bias in multi-armed bandits [105.07190334523304]
The bias of the sample means of the arms in multi-armed bandits is an important issue in adaptive data analysis.
We characterize the sign of the conditional bias of monotone functions of the rewards, including the sample mean.
Our results hold for arbitrary conditioning events and leverage natural monotonicity properties of the data collection policy.
arXiv Detail & Related papers (2020-02-19T20:16:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.