Visibility of Domain Elements in the Elicitation Process: A Family of Empirical Studies

• URL: http://arxiv.org/abs/2412.13691v1
• Date: Wed, 18 Dec 2024 10:28:51 GMT
• Title: Visibility of Domain Elements in the Elicitation Process: A Family of Empirical Studies
• Authors: Alejandrina Aranda, Oscar Dieste, Natalia Juristo,
• Abstract summary: We determine aspects that may have an influence on analysts' ability to identify certain elements of the problem domain. We conducted 14 quasi-experiments, inquiring 134 subjects about two problem domains.
• Score: 42.58275534105651
• License:
• Abstract: Background: Various factors determine analyst effectiveness during elicitation. While the literature suggests that elicitation technique and time are influential factors, other attributes could also play a role. Aim: Determine aspects that may have an influence on analysts' ability to identify certain elements of the problem domain. Methodology: We conducted 14 quasi-experiments, inquiring 134 subjects about two problem domains. For each problem domain, we calculated whether the experimental subjects identified the problem domain elements (concepts, processes, and requirements), i.e., the degree to which these domain elements were visible. Results: Domain element visibility does not appear to be related to either analyst experience or analyst-client interaction. Domain element visibility depends on how analysts provide the elicited information: when asked about the knowledge acquired during elicitation, domain element visibility dramatically increases compared to the information they provide using a written report. Conclusions: Further research is required to replicate our results. However, the finding that analysts have difficulty reporting the information they have acquired is useful for identifying alternatives for improving the documentation of elicitation results. We found evidence that other issues, like domain complexity, the relative importance of different elements within the domain, and the interview script, also seem influential.

Related papers

• On Correlating Factors for Domain Adaptation Performance [0.7305019142196582]
  We analyze the possible factors that lead to successful domain adaptation of dense retrievers. generated query type distribution is an important factor, and generating queries that share a similar domain to the test documents improves the performance of domain adaptation methods.
  arXiv  Detail & Related papers  (2025-01-24T12:55:42Z)
• Practical Guide for Causal Pathways and Sub-group Disparity Analysis [1.8974791957167259]
  We use causal disparity analysis to quantify and examine the causal interplay between sensitive attributes and outcomes. Our two-step investigation focuses on datasets where race serves as the sensitive attribute. We demonstrate that the sub-groups identified by our approach to be affected the most by disparities are the ones with the largest ML classification errors.
  arXiv  Detail & Related papers  (2024-07-02T22:51:01Z)
• DIGIC: Domain Generalizable Imitation Learning by Causal Discovery [69.13526582209165]
  Causality has been combined with machine learning to produce robust representations for domain generalization. We make a different attempt by leveraging the demonstration data distribution to discover causal features for a domain generalizable policy. We design a novel framework, called DIGIC, to identify the causal features by finding the direct cause of the expert action from the demonstration data distribution.
  arXiv  Detail & Related papers  (2024-02-29T07:09:01Z)
• Domain Generalization via Causal Adjustment for Cross-Domain Sentiment Analysis [59.73582306457387]
  We focus on the problem of domain generalization for cross-domain sentiment analysis. We propose a backdoor adjustment-based causal model to disentangle the domain-specific and domain-invariant representations. A series of experiments show the great performance and robustness of our model.
  arXiv  Detail & Related papers  (2024-02-22T13:26:56Z)
• Diversity of Expertise is Key to Scientific Impact: a Large-Scale Analysis in the Field of Computer Science [1.8794304012790348]
  We analysed how the diversity of research fields within a research team relates to the number of citations their papers received in the upcoming 5 years. This suggests that, at least in Computer Science, diversity of expertise is key to scientific impact.
  arXiv  Detail & Related papers  (2023-06-27T09:56:44Z)
• Understanding metric-related pitfalls in image analysis validation [59.15220116166561]
  This work provides the first comprehensive common point of access to information on pitfalls related to validation metrics in image analysis. Focusing on biomedical image analysis but with the potential of transfer to other fields, the addressed pitfalls generalize across application domains and are categorized according to a newly created, domain-agnostic taxonomy.
  arXiv  Detail & Related papers  (2023-02-03T14:57:40Z)
• Generalizing Fairness: Discovery and Mitigation of Unknown Sensitive Attributes [5.665283675533071]
  This paper investigates methods that separate out individual semantic sensitive factors from a given dataset to conduct this characterization. We also broaden remediation of fairness, which normally only addresses socially relevant factors, and widen it to deal with the desensitization of AI. In experiments using the road sign (GTSRB) and facial imagery (CelebA) datasets, we show the promise of using this scheme.
  arXiv  Detail & Related papers  (2021-07-28T20:18:08Z)
• Affect Analysis in-the-wild: Valence-Arousal, Expressions, Action Units and a Unified Framework [83.21732533130846]
  The paper focuses on large in-the-wild databases, i.e., Aff-Wild and Aff-Wild2. It presents the design of two classes of deep neural networks trained with these databases. A novel multi-task and holistic framework is presented which is able to jointly learn and effectively generalize and perform affect recognition.
  arXiv  Detail & Related papers  (2021-03-29T17:36:20Z)
• A Knowledge-Driven Approach to Classifying Object and Attribute Coreferences in Opinion Mining [20.49474483102625]
  This paper proposes an approach to automatically mine and leverage domain-specific knowledge for classifying objects and attribute coreferences. The approach extracts domain-specific knowledge from unlabeled review data and trains a knowledgeaware neural coreference classification model. Experimental evaluation on realworld datasets involving five domains (product types) shows the effectiveness of the approach.
  arXiv  Detail & Related papers  (2020-10-11T22:08:43Z)
• Survey on Visual Sentiment Analysis [87.20223213370004]
  This paper reviews pertinent publications and tries to present an exhaustive overview of the field of Visual Sentiment Analysis. The paper also describes principles of design of general Visual Sentiment Analysis systems from three main points of view. A formalization of the problem is discussed, considering different levels of granularity, as well as the components that can affect the sentiment toward an image in different ways.
  arXiv  Detail & Related papers  (2020-04-24T10:15:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.