Towards User-Focused Cross-Domain Testing: Disentangling Accessibility, Usability, and Fairness

• URL: http://arxiv.org/abs/2501.06424v2
• Date: Sat, 18 Jan 2025 01:47:20 GMT
• Title: Towards User-Focused Cross-Domain Testing: Disentangling Accessibility, Usability, and Fairness
• Authors: Matheus de Morais Leça, Ronnie de Souza Santos,
• Abstract summary: Fairness testing is increasingly recognized as fundamental in software engineering.<n>But its practical integration into software development may pose challenges, given its overlapping boundaries with usability and accessibility testing.<n>This study uses insights from 12 systematic reviews published in the past decade to shed light on the nuanced interactions among fairness, usability, and accessibility testing.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Fairness testing is increasingly recognized as fundamental in software engineering, especially in the domain of data-driven systems powered by artificial intelligence. However, its practical integration into software development may pose challenges, given its overlapping boundaries with usability and accessibility testing. In this tertiary study, we explore these complexities using insights from 12 systematic reviews published in the past decade, shedding light on the nuanced interactions among fairness, usability, and accessibility testing and how they intersect within contemporary software development practices.

Related papers

• From Technical Excellence to Practical Adoption: Lessons Learned Building an ML-Enhanced Trace Analysis Tool [14.908341749591594]
  We investigated barriers to trace analysis adoption in industrial settings.<n>We found that practitioners struggled with translating expert knowledge into actionable insights.<n> TMLL addresses this through adoption-focused design that embeds expert knowledge in interfaces.
  arXiv  Detail & Related papers  (2025-08-02T16:32:46Z)
• Software Fairness Testing in Practice [0.21427777919040417]
  This study investigates how software professionals test AI-powered systems for fairness through interviews with 22 practitioners working on AI and ML projects.<n>Our findings highlight a significant gap between theoretical fairness concepts and industry practice.<n>Key challenges include data quality and diversity, time constraints, defining effective metrics, and ensuring model interoperability.
  arXiv  Detail & Related papers  (2025-06-20T16:03:02Z)
• Automated Unit Test Case Generation: A Systematic Literature Review [2.273531916003657]
  This review aims to consolidate existing knowledge in regards to the evolutionary approaches as well as their improvements and resulting limitations. We will explore the main test criterion that are used in these algorithms alongside the challenges currently faced in the field related to readability, mocking and more.
  arXiv  Detail & Related papers  (2025-04-29T01:50:06Z)
• Systematic Literature Review of Automation and Artificial Intelligence in Usability Issue Detection [0.0]
  We offer a comprehensive overview of the current state of the art for automated usability issue detection. We analyze trends, paradigms, and the technical context in which they are applied.
  arXiv  Detail & Related papers  (2025-04-02T07:07:32Z)
• Human-AI Experience in Integrated Development Environments: A Systematic Literature Review [2.1749194587826026]
  In-IDE HAX explores the evolving dynamics of Human-Computer Interaction in AI-assisted coding environments. Our findings reveal that AI-assisted coding enhances developer productivity but also introduces challenges, such as verification overhead, automation bias, and over-reliance. Concerns about code correctness, security, and maintainability highlight the urgent need for explainability, verification mechanisms, and adaptive user control.
  arXiv  Detail & Related papers  (2025-03-08T12:40:18Z)
• How to Measure Performance in Agile Software Development? A Mixed-Method Study [2.477589198476322]
  The study aims to identify challenges that arise when using agile software development performance metrics in practice. Results show that while widely used performance metrics are widely used in practice, agile software development teams face challenges due to a lack of transparency and standardization as well as insufficient accuracy.
  arXiv  Detail & Related papers  (2024-07-08T19:53:01Z)
• The AffectToolbox: Affect Analysis for Everyone [10.526991118781913]
  AffectToolbox is a novel software system that aims to support researchers in developing affect-sensitive studies and prototypes. The proposed system addresses the challenges posed by existing frameworks, which often require profound programming knowledge and cater primarily to power-users or skilled developers. The architecture encompasses a variety of models for emotion recognition on multiple affective channels and modalities, as well as an elaborate fusion system to merge multi-modal assessments into a unified result.
  arXiv  Detail & Related papers  (2024-02-23T08:55:47Z)
• Exploring Federated Unlearning: Analysis, Comparison, and Insights [101.64910079905566]
  federated unlearning enables the selective removal of data from models trained in federated systems.<n>This paper examines existing federated unlearning approaches, examining their algorithmic efficiency, impact on model accuracy, and effectiveness in preserving privacy.<n>We propose the OpenFederatedUnlearning framework, a unified benchmark for evaluating federated unlearning methods.
  arXiv  Detail & Related papers  (2023-10-30T01:34:33Z)
• Software Testing of Generative AI Systems: Challenges and Opportunities [5.634825161148484]
  I will explore the challenges posed by generative AI systems and discuss potential opportunities for future research in the field of testing. I will touch on the specific characteristics of GenAI systems that make traditional testing techniques inadequate or insufficient.
  arXiv  Detail & Related papers  (2023-09-07T08:35:49Z)
• Machine Unlearning: A Survey [56.79152190680552]
  A special need has arisen where, due to privacy, usability, and/or the right to be forgotten, information about some specific samples needs to be removed from a model, called machine unlearning. This emerging technology has drawn significant interest from both academics and industry due to its innovation and practicality. No study has analyzed this complex topic or compared the feasibility of existing unlearning solutions in different kinds of scenarios. The survey concludes by highlighting some of the outstanding issues with unlearning techniques, along with some feasible directions for new research opportunities.
  arXiv  Detail & Related papers  (2023-06-06T10:18:36Z)
• Quiz-based Knowledge Tracing [61.9152637457605]
  Knowledge tracing aims to assess individuals' evolving knowledge states according to their learning interactions. QKT achieves state-of-the-art performance compared to existing methods.
  arXiv  Detail & Related papers  (2023-04-05T12:48:42Z)
• A Domain-Agnostic Approach for Characterization of Lifelong Learning Systems [128.63953314853327]
  "Lifelong Learning" systems are capable of 1) Continuous Learning, 2) Transfer and Adaptation, and 3) Scalability. We show that this suite of metrics can inform the development of varied and complex Lifelong Learning systems.
  arXiv  Detail & Related papers  (2023-01-18T21:58:54Z)
• Towards a Common Testing Terminology for Software Engineering and Artificial Intelligence Experts [0.9799637101641152]
  This paper contributes a mapping between the most important concepts from classical software testing and AI testing. In the mapping, we highlight differences in relevance and naming of the mapped concepts.
  arXiv  Detail & Related papers  (2021-08-31T13:50:15Z)
• A Brief Survey of Current Software Engineering Practices in Continuous Integration and Automated Accessibility Testing [0.0]
  This paper attempts to map the current scene of the software engineering effort spent on improving accessibility via continuous integration. We also try to explore steps that agile teams may take to train members on how to implement accessibility testing.
  arXiv  Detail & Related papers  (2021-02-27T01:13:43Z)
• Survey on the Analysis and Modeling of Visual Kinship: A Decade in the Making [66.72253432908693]
  Kinship recognition is a challenging problem with many practical applications. We review the public resources and data challenges that enabled and inspired many to hone-in on the views. For the tenth anniversary, the demo code is provided for the various kin-based tasks.
  arXiv  Detail & Related papers  (2020-06-29T13:25:45Z)
• Deep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunities [52.59080024266596]
  We present a survey of the state-of-the-art deep learning methods for sensor-based human activity recognition. We first introduce the multi-modality of the sensory data and provide information for public datasets. We then propose a new taxonomy to structure the deep methods by challenges.
  arXiv  Detail & Related papers  (2020-01-21T09:55:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.