Addressing Bias in Generative AI: Challenges and Research Opportunities in Information Management

• URL: http://arxiv.org/abs/2502.10407v1
• Date: Wed, 22 Jan 2025 10:14:31 GMT
• Title: Addressing Bias in Generative AI: Challenges and Research Opportunities in Information Management
• Authors: Xiahua Wei, Naveen Kumar, Han Zhang,
• Abstract summary: Generative AI technologies have transformed information management systems but introduced substantial biases that can compromise their effectiveness in informing business decision-making.<n>This challenge presents information management scholars with a unique opportunity to advance the field by identifying and addressing these biases across extensive applications of Large Language Models (LLMs)<n>By incorporating ethical considerations, policy implications, and sociotechnical perspectives, we focus on developing a framework that covers major stakeholders of Generative AI systems, proposing key research questions, and inspiring discussion.
• Score: 3.9775368901759207
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Generative AI technologies, particularly Large Language Models (LLMs), have transformed information management systems but introduced substantial biases that can compromise their effectiveness in informing business decision-making. This challenge presents information management scholars with a unique opportunity to advance the field by identifying and addressing these biases across extensive applications of LLMs. Building on the discussion on bias sources and current methods for detecting and mitigating bias, this paper seeks to identify gaps and opportunities for future research. By incorporating ethical considerations, policy implications, and sociotechnical perspectives, we focus on developing a framework that covers major stakeholders of Generative AI systems, proposing key research questions, and inspiring discussion. Our goal is to provide actionable pathways for researchers to address bias in LLM applications, thereby advancing research in information management that ultimately informs business practices. Our forward-looking framework and research agenda advocate interdisciplinary approaches, innovative methods, dynamic perspectives, and rigorous evaluation to ensure fairness and transparency in Generative AI-driven information systems. We expect this study to serve as a call to action for information management scholars to tackle this critical issue, guiding the improvement of fairness and effectiveness in LLM-based systems for business practice.

Related papers

• A Survey of Large Language Model Empowered Agents for Recommendation and Search: Towards Next-Generation Information Retrieval [26.797683195019246]
  Large language models (LLMs) have demonstrated capabilities that surpass human performance in various language-related tasks. This paper explores the transformative potential of LLM agents in enhancing recommender and search systems. We highlight the immense potential of LLM agents in addressing current challenges in recommendation and search.
  arXiv  Detail & Related papers  (2025-03-07T18:20:30Z)
• Generative Large Recommendation Models: Emerging Trends in LLMs for Recommendation [85.52251362906418]
  This tutorial explores two primary approaches for integrating large language models (LLMs)<n>It provides a comprehensive overview of generative large recommendation models, including their recent advancements, challenges, and potential research directions.<n>Key topics include data quality, scaling laws, user behavior mining, and efficiency in training and inference.
  arXiv  Detail & Related papers  (2025-02-19T14:48:25Z)
• Persuasion with Large Language Models: a Survey [49.86930318312291]
  Large Language Models (LLMs) have created new disruptive possibilities for persuasive communication. In areas such as politics, marketing, public health, e-commerce, and charitable giving, such LLM Systems have already achieved human-level or even super-human persuasiveness. Our survey suggests that the current and future potential of LLM-based persuasion poses profound ethical and societal risks.
  arXiv  Detail & Related papers  (2024-11-11T10:05:52Z)
• Deploying Large Language Models With Retrieval Augmented Generation [0.21485350418225244]
  Retrieval Augmented Generation has emerged as a key approach for integrating knowledge from data sources outside of the large language model's training set. We present insights from the development and field-testing of a pilot project that integrates LLMs with RAG for information retrieval.
  arXiv  Detail & Related papers  (2024-11-07T22:11:51Z)
• The Transformative Impact of AI and Deep Learning in Business: A Literature Review [0.0]
  This paper aims to review the radical role of AI and deep learning in various functional areas of the business. It covers material applications in the healthcare sector, the retail and manufacturing industry, agriculture and farming, and finance.
  arXiv  Detail & Related papers  (2024-10-30T20:35:03Z)
• Preliminary Insights on Industry Practices for Addressing Fairness Debt [4.546982900370235]
  This study explores how software professionals identify and address biases in AI systems within the software industry. Our paper presents initial evidence on addressing fairness debt and provides a foundation for developing structured guidelines to manage fairness-related issues in AI systems.
  arXiv  Detail & Related papers  (2024-09-04T04:18:42Z)
• Navigating LLM Ethics: Advancements, Challenges, and Future Directions [5.023563968303034]
  This study addresses ethical issues surrounding Large Language Models (LLMs) within the field of artificial intelligence. It explores the common ethical challenges posed by both LLMs and other AI systems. It highlights challenges such as hallucination, verifiable accountability, and decoding censorship complexity.
  arXiv  Detail & Related papers  (2024-05-14T15:03:05Z)
• A Survey on Large Language Models for Critical Societal Domains: Finance, Healthcare, and Law [65.87885628115946]
  Large language models (LLMs) are revolutionizing the landscapes of finance, healthcare, and law. We highlight the instrumental role of LLMs in enhancing diagnostic and treatment methodologies in healthcare, innovating financial analytics, and refining legal interpretation and compliance strategies. We critically examine the ethics for LLM applications in these fields, pointing out the existing ethical concerns and the need for transparent, fair, and robust AI systems.
  arXiv  Detail & Related papers  (2024-05-02T22:43:02Z)
• On the Risk of Misinformation Pollution with Large Language Models [127.1107824751703]
  We investigate the potential misuse of modern Large Language Models (LLMs) for generating credible-sounding misinformation. Our study reveals that LLMs can act as effective misinformation generators, leading to a significant degradation in the performance of Open-Domain Question Answering (ODQA) systems.
  arXiv  Detail & Related papers  (2023-05-23T04:10:26Z)
• Fairness in Recommender Systems: Research Landscape and Future Directions [119.67643184567623]
  We review the concepts and notions of fairness that were put forward in the area in the recent past. We present an overview of how research in this field is currently operationalized. Overall, our analysis of recent works points to certain research gaps.
  arXiv  Detail & Related papers  (2022-05-23T08:34:25Z)
• Artificial Intelligence for IT Operations (AIOPS) Workshop White Paper [50.25428141435537]
  Artificial Intelligence for IT Operations (AIOps) is an emerging interdisciplinary field arising in the intersection between machine learning, big data, streaming analytics, and the management of IT operations. Main aim of the AIOPS workshop is to bring together researchers from both academia and industry to present their experiences, results, and work in progress in this field.
  arXiv  Detail & Related papers  (2021-01-15T10:43:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.