Evaluating Moral Beliefs across LLMs through a Pluralistic Framework

• URL: http://arxiv.org/abs/2411.03665v1
• Date: Wed, 06 Nov 2024 04:52:38 GMT
• Title: Evaluating Moral Beliefs across LLMs through a Pluralistic Framework
• Authors: Xuelin Liu, Yanfei Zhu, Shucheng Zhu, Pengyuan Liu, Ying Liu, Dong Yu,
• Abstract summary: This study introduces a novel three-module framework to evaluate the moral beliefs of four prominent large language models. We constructed a dataset containing 472 moral choice scenarios in Chinese, derived from moral words. By ranking these moral choices, we discern the varying moral beliefs held by different language models.
• Score: 22.0799438612003
• License:
• Abstract: Proper moral beliefs are fundamental for language models, yet assessing these beliefs poses a significant challenge. This study introduces a novel three-module framework to evaluate the moral beliefs of four prominent large language models. Initially, we constructed a dataset containing 472 moral choice scenarios in Chinese, derived from moral words. The decision-making process of the models in these scenarios reveals their moral principle preferences. By ranking these moral choices, we discern the varying moral beliefs held by different language models. Additionally, through moral debates, we investigate the firmness of these models to their moral choices. Our findings indicate that English language models, namely ChatGPT and Gemini, closely mirror moral decisions of the sample of Chinese university students, demonstrating strong adherence to their choices and a preference for individualistic moral beliefs. In contrast, Chinese models such as Ernie and ChatGLM lean towards collectivist moral beliefs, exhibiting ambiguity in their moral choices and debates. This study also uncovers gender bias embedded within the moral beliefs of all examined language models. Our methodology offers an innovative means to assess moral beliefs in both artificial and human intelligence, facilitating a comparison of moral values across different cultures.

Related papers

• Language Model Alignment in Multilingual Trolley Problems [138.5684081822807]
  Building on the Moral Machine experiment, we develop a cross-lingual corpus of moral dilemma vignettes in over 100 languages called MultiTP. Our analysis explores the alignment of 19 different LLMs with human judgments, capturing preferences across six moral dimensions. We discover significant variance in alignment across languages, challenging the assumption of uniform moral reasoning in AI systems.
  arXiv  Detail & Related papers  (2024-07-02T14:02:53Z)
• Exploring and steering the moral compass of Large Language Models [55.2480439325792]
  Large Language Models (LLMs) have become central to advancing automation and decision-making across various sectors. This study proposes a comprehensive comparative analysis of the most advanced LLMs to assess their moral profiles.
  arXiv  Detail & Related papers  (2024-05-27T16:49:22Z)
• Morality is Non-Binary: Building a Pluralist Moral Sentence Embedding Space using Contrastive Learning [4.925187725973777]
  Pluralist moral philosophers argue that human morality can be deconstructed into a finite number of elements. We build a pluralist moral sentence embedding space via a state-of-the-art contrastive learning approach. Our results show that a pluralist approach to morality can be captured in an embedding space.
  arXiv  Detail & Related papers  (2024-01-30T18:15:25Z)
• Western, Religious or Spiritual: An Evaluation of Moral Justification in Large Language Models [5.257719744958368]
  This paper aims to find out which values and principles are embedded in Large Language Models (LLMs) in the process of moral justification. We come up with three different moral perspective categories: Western tradition perspective (WT), Abrahamic tradition perspective (AT), and Spiritualist/Mystic tradition perspective (SMT)
  arXiv  Detail & Related papers  (2023-11-13T23:01:19Z)
• Rethinking Machine Ethics -- Can LLMs Perform Moral Reasoning through the Lens of Moral Theories? [78.3738172874685]
  Making moral judgments is an essential step toward developing ethical AI systems. Prevalent approaches are mostly implemented in a bottom-up manner, which uses a large set of annotated data to train models based on crowd-sourced opinions about morality. This work proposes a flexible top-down framework to steer (Large) Language Models (LMs) to perform moral reasoning with well-established moral theories from interdisciplinary research.
  arXiv  Detail & Related papers  (2023-08-29T15:57:32Z)
• Knowledge of cultural moral norms in large language models [3.475552182166427]
  We investigate the extent to which monolingual English language models contain knowledge about moral norms in different countries. We perform our analyses with two public datasets from the World Values Survey and PEW global surveys on morality. We find that pre-trained English language models predict empirical moral norms across countries worse than the English moral norms reported previously.
  arXiv  Detail & Related papers  (2023-06-02T18:23:35Z)
• MoralDial: A Framework to Train and Evaluate Moral Dialogue Systems via Moral Discussions [71.25236662907056]
  A moral dialogue system aligned with users' values could enhance conversation engagement and user connections. We propose a framework, MoralDial, to train and evaluate moral dialogue systems.
  arXiv  Detail & Related papers  (2022-12-21T02:21:37Z)
• ClarifyDelphi: Reinforced Clarification Questions with Defeasibility Rewards for Social and Moral Situations [81.70195684646681]
  We present ClarifyDelphi, an interactive system that learns to ask clarification questions. We posit that questions whose potential answers lead to diverging moral judgments are the most informative. Our work is ultimately inspired by studies in cognitive science that have investigated the flexibility in moral cognition.
  arXiv  Detail & Related papers  (2022-12-20T16:33:09Z)
• Speaking Multiple Languages Affects the Moral Bias of Language Models [70.94372902010232]
  Pre-trained multilingual language models (PMLMs) are commonly used when dealing with data from multiple languages and cross-lingual transfer. Do the models capture moral norms from English and impose them on other languages? Our experiments demonstrate that, indeed, PMLMs encode differing moral biases, but these do not necessarily correspond to cultural differences or commonalities in human opinions.
  arXiv  Detail & Related papers  (2022-11-14T20:08:54Z)
• Moral Mimicry: Large Language Models Produce Moral Rationalizations Tailored to Political Identity [0.0]
  This study investigates whether Large Language Models reproduce the moral biases associated with political groups in the United States. Using tools from Moral Foundations Theory, it is shown that these LLMs are indeed moral mimics.
  arXiv  Detail & Related papers  (2022-09-24T23:55:53Z)
• Text-based inference of moral sentiment change [11.188112005462536]
  We present a text-based framework for investigating moral sentiment change of the public via longitudinal corpora. We build our methodology by exploring moral biases learned from diachronic word embeddings. Our work offers opportunities for applying natural language processing toward characterizing moral sentiment change in society.
  arXiv  Detail & Related papers  (2020-01-20T18:52:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.