From Literature to Practice: Exploring Fairness Testing Tools for the Software Industry Adoption

• URL: http://arxiv.org/abs/2409.02433v1
• Date: Wed, 4 Sep 2024 04:23:08 GMT
• Title: From Literature to Practice: Exploring Fairness Testing Tools for the Software Industry Adoption
• Authors: Thanh Nguyen, Luiz Fernando de Lima, Maria Teresa Badassarre, Ronnie de Souza Santos,
• Abstract summary: In today's world, we need to ensure that AI systems are fair and unbiased. Current fairness testing tools need significant improvements to better support software developers. New tools should be user-friendly, well-documented, and flexible enough to handle different kinds of data.
• Score: 5.901307724130718
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In today's world, we need to ensure that AI systems are fair and unbiased. Our study looked at tools designed to test the fairness of software to see if they are practical and easy for software developers to use. We found that while some tools are cost-effective and compatible with various programming environments, many are hard to use and lack detailed instructions. They also tend to focus on specific types of data, which limits their usefulness in real-world situations. Overall, current fairness testing tools need significant improvements to better support software developers in creating fair and equitable technology. We suggest that new tools should be user-friendly, well-documented, and flexible enough to handle different kinds of data, helping developers identify and fix biases early in the development process. This will lead to more trustworthy and fair software for everyone.

Related papers

• Codev-Bench: How Do LLMs Understand Developer-Centric Code Completion? [60.84912551069379]
  We present the Code-Development Benchmark (Codev-Bench), a fine-grained, real-world, repository-level, and developer-centric evaluation framework. Codev-Agent is an agent-based system that automates repository crawling, constructs execution environments, extracts dynamic calling chains from existing unit tests, and generates new test samples to avoid data leakage.
  arXiv  Detail & Related papers  (2024-10-02T09:11:10Z)
• Code Compass: A Study on the Challenges of Navigating Unfamiliar Codebases [2.808331566391181]
  We propose a novel tool, Code, to address these issues. Our study highlights a significant gap in current tools and methodologies. Our formative study demonstrates how effectively the tool reduces the time developers spend navigating documentation.
  arXiv  Detail & Related papers  (2024-05-10T06:58:31Z)
• Open Source Software Development Tool Installation: Challenges and Strategies For Novice Developers [7.69895999475301]
  This work aims to investigate the challenges novice developers face when installing software development tools. We conducted an analysis of 24 live software installation sessions to observe challenges and comprehend their actions. Our findings show that unclear documentation, such as installation instructions, and inadequate feedback during the installation process are common challenges faced by novice developers.
  arXiv  Detail & Related papers  (2024-04-23T00:25:57Z)
• Bridging Gaps, Building Futures: Advancing Software Developer Diversity and Inclusion Through Future-Oriented Research [50.545824691484796]
  We present insights from SE researchers and practitioners on challenges and solutions regarding diversity and inclusion in SE. We share potential utopian and dystopian visions of the future and provide future research directions and implications for academia and industry.
  arXiv  Detail & Related papers  (2024-04-10T16:18:11Z)
• Charting a Path to Efficient Onboarding: The Role of Software Visualization [49.1574468325115]
  The present study aims to explore the familiarity of managers, leaders, and developers with software visualization tools. This approach incorporated quantitative and qualitative analyses of data collected from practitioners using questionnaires and semi-structured interviews.
  arXiv  Detail & Related papers  (2024-01-17T21:30:45Z)
• Intelligent Software Tooling for Improving Software Development [3.1763879286782966]
  Deep Learning (DL) has shown huge advancements in automation across many domains, including Software Development processes. One of the main reasons behind this success is the availability of large datasets such as open-source code available through GitHub or image datasets of mobile Graphical User Interfaces (GUIs) with RICO and ReDRAW to be trained on.
  arXiv  Detail & Related papers  (2023-10-17T01:29:07Z)
• Generation Probabilities Are Not Enough: Uncertainty Highlighting in AI Code Completions [54.55334589363247]
  We study whether conveying information about uncertainty enables programmers to more quickly and accurately produce code. We find that highlighting tokens with the highest predicted likelihood of being edited leads to faster task completion and more targeted edits.
  arXiv  Detail & Related papers  (2023-02-14T18:43:34Z)
• Lessons from Formally Verified Deployed Software Systems (Extended version) [65.69802414600832]
  This article examines a range of projects, in various application areas, that have produced formally verified systems and deployed them for actual use. It considers the technologies used, the form of verification applied, the results obtained, and the lessons that the software industry should draw regarding its ability to benefit from formal verification techniques and tools.
  arXiv  Detail & Related papers  (2023-01-05T18:18:46Z)
• The Right Tool for the Job: Open-Source Auditing Tools in Machine Learning [0.0]
  In recent years, discussions about fairness in machine learning, AI ethics and algorithm audits have increased. Many open-source auditing tools are available, but users aren't always aware of the tools, what they are useful for, or how to access them. This paper aims to reinforce the urgent need to actually use these tools and provides motivations for doing so.
  arXiv  Detail & Related papers  (2022-06-20T15:20:26Z)
• Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkits [35.7895677378462]
  We investigate how industry practitioners (try to) work with existing fairness toolkits. We identify several opportunities for fairness toolkits to better address practitioner needs. We highlight implications for the design of future open-source fairness toolkits.
  arXiv  Detail & Related papers  (2022-05-13T23:07:46Z)
• Empowered and Embedded: Ethics and Agile Processes [60.63670249088117]
  We argue that ethical considerations need to be embedded into the (agile) software development process. We put emphasis on the possibility to implement ethical deliberations in already existing and well established agile software development processes.
  arXiv  Detail & Related papers  (2021-07-15T11:14:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.