Evaluating Intra-firm LLM Alignment Strategies in Business Contexts

• URL: http://arxiv.org/abs/2505.18779v1
• Date: Sat, 24 May 2025 16:30:53 GMT
• Title: Evaluating Intra-firm LLM Alignment Strategies in Business Contexts
• Authors: Noah Broestl, Benjamin Lange, Cristina Voinea, Geoff Keeling, Rachael Lam,
• Abstract summary: Large Language Models (LLMs) are increasingly deployed as AI Assistants in firms for support in cognitive tasks.<n>This paper argues that firms must align the perspectives of these AI Assistants intentionally with their objectives and values.
• Score: 0.11224172067715701
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Instruction-tuned Large Language Models (LLMs) are increasingly deployed as AI Assistants in firms for support in cognitive tasks. These AI assistants carry embedded perspectives which influence factors across the firm including decision-making, collaboration, and organizational culture. This paper argues that firms must align the perspectives of these AI Assistants intentionally with their objectives and values, framing alignment as a strategic and ethical imperative crucial for maintaining control over firm culture and intra-firm moral norms. The paper highlights how AI perspectives arise from biases in training data and the fine-tuning objectives of developers, and discusses their impact and ethical significance, foregrounding ethical concerns like automation bias and reduced critical thinking. Drawing on normative business ethics, particularly non-reductionist views of professional relationships, three distinct alignment strategies are proposed: supportive (reinforcing the firm's mission), adversarial (stress-testing ideas), and diverse (broadening moral horizons by incorporating multiple stakeholder views). The ethical trade-offs of each strategy and their implications for manager-employee and employee-employee relationships are analyzed, alongside the potential to shape the culture and moral fabric of the firm.

Related papers

• Bridging the Gap: Integrating Ethics and Environmental Sustainability in AI Research and Practice [57.94036023167952]
  We argue that the efforts aiming to study AI's ethical ramifications should be made in tandem with those evaluating its impacts on the environment.<n>We propose best practices to better integrate AI ethics and sustainability in AI research and practice.
  arXiv  Detail & Related papers  (2025-04-01T13:53:11Z)
• Technology as uncharted territory: Contextual integrity and the notion of AI as new ethical ground [55.2480439325792]
  I argue that efforts to promote responsible and ethical AI can inadvertently contribute to and seemingly legitimize this disregard for established contextual norms.<n>I question the current narrow prioritization in AI ethics of moral innovation over moral preservation.
  arXiv  Detail & Related papers  (2024-12-06T15:36:13Z)
• Towards an Ethical and Inclusive Implementation of Artificial Intelligence in Organizations: A Multidimensional Framework [0.0]
  This article analyzes the impact of artificial intelligence on contemporary society and the importance of adopting an ethical approach to its development and implementation within organizations. Various actors, such as governments, academics, and civil society, can play a role in shaping the development of AI aligned with human and social values.
  arXiv  Detail & Related papers  (2024-05-02T19:43:51Z)
• Hacia una implementación ética e inclusiva de la Inteligencia Artificial en las organizaciones: un marco multidimensional [0.0]
  The article analyzes the impact of artificial intelligence on contemporary society and the importance of adopting an ethical approach to its development and implementation within organizations. Various actors, such as governments, academics and civil society, can play a role in shaping the development of AI aligned with human and social values.
  arXiv  Detail & Related papers  (2024-04-30T22:11:05Z)
• Disciplining Deliberation: A Sociotechnical Perspective on Machine Learning Trade-offs [0.0]
  Two prominent trade-offs in artificial intelligence are between predictive accuracy and fairness, and between predictive accuracy and interpretability.<n> prevailing interpretation views these formal trade-offs as directly corresponding to tensions between underlying social values.<n>I introduce a sociotechnical approach to examining the value implications of trade-offs.
  arXiv  Detail & Related papers  (2024-03-07T05:03:18Z)
• Towards Responsible AI in Banking: Addressing Bias for Fair Decision-Making [69.44075077934914]
  "Responsible AI" emphasizes the critical nature of addressing biases within the development of a corporate culture. This thesis is structured around three fundamental pillars: understanding bias, mitigating bias, and accounting for bias. In line with open-source principles, we have released Bias On Demand and FairView as accessible Python packages.
  arXiv  Detail & Related papers  (2024-01-13T14:07:09Z)
• Unpacking the Ethical Value Alignment in Big Models [46.560886177083084]
  This paper provides an overview of the risks and challenges associated with big models, surveys existing AI ethics guidelines, and examines the ethical implications arising from the limitations of these models. We introduce a novel conceptual paradigm for aligning the ethical values of big models and discuss promising research directions for alignment criteria, evaluation, and method.
  arXiv  Detail & Related papers  (2023-10-26T16:45:40Z)
• The Ethics of AI Value Chains [0.6138671548064356]
  Researchers, practitioners, and policymakers with an interest in AI ethics need more integrative approaches for studying and intervening in AI systems. We review theories of value chains and AI value chains from the strategic management, service science, economic geography, industry, government, and applied research literature. We recommend three future directions that researchers, practitioners, and policymakers can take to advance more ethical practices across AI value chains.
  arXiv  Detail & Related papers  (2023-07-31T15:55:30Z)
• Walking the Walk of AI Ethics: Organizational Challenges and the Individualization of Risk among Ethics Entrepreneurs [0.0]
  We find that workers experience an environment where policies, practices, and outcomes are decoupled. We analyze AI ethics workers as ethics entrepreneurs who work to institutionalize new ethics-related practices within organizations.
  arXiv  Detail & Related papers  (2023-05-16T16:11:24Z)
• Fairness in Agreement With European Values: An Interdisciplinary Perspective on AI Regulation [61.77881142275982]
  This interdisciplinary position paper considers various concerns surrounding fairness and discrimination in AI, and discusses how AI regulations address them. We first look at AI and fairness through the lenses of law, (AI) industry, sociotechnology, and (moral) philosophy, and present various perspectives. We identify and propose the roles AI Regulation should take to make the endeavor of the AI Act a success in terms of AI fairness concerns.
  arXiv  Detail & Related papers  (2022-06-08T12:32:08Z)
• Building Bridges: Generative Artworks to Explore AI Ethics [56.058588908294446]
  In recent years, there has been an increased emphasis on understanding and mitigating adverse impacts of artificial intelligence (AI) technologies on society. A significant challenge in the design of ethical AI systems is that there are multiple stakeholders in the AI pipeline, each with their own set of constraints and interests. This position paper outlines some potential ways in which generative artworks can play this role by serving as accessible and powerful educational tools.
  arXiv  Detail & Related papers  (2021-06-25T22:31:55Z)
• Reconfiguring Diversity and Inclusion for AI Ethics [2.0625936401496237]
  We look at three companies that create application and services layer AI infrastructure: Google, Microsoft, and Salesforce. We find that as these documents make diversity and inclusion more tractable to engineers and technical clients, they reveal a drift away from civil rights justifications. The focus on technical artifacts, such as diverse and inclusive datasets, and the replacement of equity with fairness make ethical work more actionable for everyday practitioners.
  arXiv  Detail & Related papers  (2021-05-06T02:55:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.