Do Emotions Influence Moral Judgment in Large Language Models?

• URL: http://arxiv.org/abs/2604.19125v1
• Date: Tue, 21 Apr 2026 06:17:51 GMT
• Title: Do Emotions Influence Moral Judgment in Large Language Models?
• Abstract summary: We develop an emotion-induction pipeline that infuses emotion into moral situations.<n>We observe a directional pattern: positive emotions increase moral acceptability and negative emotions decrease it.
• Score: 2.4178976757695336
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Large language models have been extensively studied for emotion recognition and moral reasoning as distinct capabilities, yet the extent to which emotions influence moral judgment remains underexplored. In this work, we develop an emotion-induction pipeline that infuses emotion into moral situations and evaluate shifts in moral acceptability across multiple datasets and LLMs. We observe a directional pattern: positive emotions increase moral acceptability and negative emotions decrease it, with effects strong enough to reverse binary moral judgments in up to 20% of cases, and with susceptibility scaling inversely with model capability. Our analysis further reveals that specific emotions can sometimes behave contrary to what their valence would predict (e.g., remorse paradoxically increases acceptability). A complementary human annotation study shows humans do not exhibit these systematic shifts, indicating an alignment gap in current LLMs.

Related papers

• Can Induced Emotion Bias LLM Behaviors in Sequential Decision Making? [64.5408523407693]
  Large Language Models (LLMs) are increasingly deployed as autonomous agents in high-stakes domains.<n>We investigate whether induced emotion can influence their sequential decision-making using the Iowa Gambling Task.<n>We find that, different from humans, induced emotion does not significantly bias the decision dynamics of LLM agents on average.
  arXiv  Detail & Related papers  (2026-07-14T11:09:51Z)
• Emotion Concepts and their Function in a Large Language Model [7.456089071483512]
  Large language models (LLMs) sometimes appear to exhibit emotional reactions.<n>We investigate why this is the case in Claude Sonnet 4.5 and explore implications for alignment-relevant behavior.
  arXiv  Detail & Related papers  (2026-04-09T02:25:17Z)
• The Role of Emotional Stimuli and Intensity in Shaping Large Language Model Behavior [0.017499351967216335]
  We explore the effects of four distinct emotions - joy, encouragement, anger, and insecurity - in emotional prompting and evaluate them on accuracy, sycophancy, and toxicity.<n>We develop a prompt-generation pipeline with GPT-4o mini to create a suite of LLM and human-generated prompts with varying intensities across the four emotions.<n>Our empirical evaluation on LLM behavior suggests that positive emotional stimuli lead to more accurate and less toxic results, but also increase sycophantic behavior.
  arXiv  Detail & Related papers  (2026-04-07T05:29:13Z)
• Between Rules and Reality: On the Context Sensitivity of LLM Moral Judgment [0.6789370732159178]
  We introduce Contextual MoralChoice, a dataset of moral dilemmas with systematic contextual variations.<n>We find that nearly all models are context-sensitive, shifting their judgments toward rule-violating behavior.<n>This raises the question of controlling contextual sensitivity, which we address with an activation steering approach.
  arXiv  Detail & Related papers  (2026-03-24T12:08:16Z)
• Are Language Models Sensitive to Morally Irrelevant Distractors? [47.92026843851412]
  We show that moral distractors can shift the moral judgements of large language models by over 30% even in low-ambiguity scenarios.<n>This research challenges theories that assume the stability of human moral judgements.
  arXiv  Detail & Related papers  (2026-02-10T05:18:05Z)
• Conversations: Love Them, Hate Them, Steer Them [10.014248704653]
  Large Language Models (LLMs) demonstrate increasing conversational fluency, yet instilling them with nuanced, human-like emotional expression remains a significant challenge.<n>This paper demonstrates that targeted activation engineering can steer LLaMA 3.1-8B to exhibit more human-like emotional nuances.
  arXiv  Detail & Related papers  (2025-05-23T02:58:45Z)
• The Good, The Bad, and Why: Unveiling Emotions in Generative AI [73.94035652867618]
  We show that EmotionPrompt can boost the performance of AI models while EmotionAttack can hinder it. EmotionDecode reveals that AI models can comprehend emotional stimuli akin to the mechanism of dopamine in the human brain.
  arXiv  Detail & Related papers  (2023-12-18T11:19:45Z)
• Language Models (Mostly) Do Not Consider Emotion Triggers When Predicting Emotion [87.18073195745914]
  We investigate how well human-annotated emotion triggers correlate with features deemed salient in their prediction of emotions. Using EmoTrigger, we evaluate the ability of large language models to identify emotion triggers. Our analysis reveals that emotion triggers are largely not considered salient features for emotion prediction models, instead there is intricate interplay between various features and the task of emotion detection.
  arXiv  Detail & Related papers  (2023-11-16T06:20:13Z)
• Moral Sparks in Social Media Narratives [14.025768295979184]
  We examine interactions on social media to understand human moral judgments in real-life ethical scenarios. Specifically, we examine posts from a popular Reddit subreddit (i.e., a subcommunity) called r/AmITheAsshole.
  arXiv  Detail & Related papers  (2023-10-30T05:03:26Z)
• Enhancing Cognitive Models of Emotions with Representation Learning [58.2386408470585]
  We present a novel deep learning-based framework to generate embedding representations of fine-grained emotions. Our framework integrates a contextualized embedding encoder with a multi-head probing model. Our model is evaluated on the Empathetic Dialogue dataset and shows the state-of-the-art result for classifying 32 emotions.
  arXiv  Detail & Related papers  (2021-04-20T16:55:15Z)
• Modality-Transferable Emotion Embeddings for Low-Resource Multimodal Emotion Recognition [55.44502358463217]
  We propose a modality-transferable model with emotion embeddings to tackle the aforementioned issues. Our model achieves state-of-the-art performance on most of the emotion categories. Our model also outperforms existing baselines in the zero-shot and few-shot scenarios for unseen emotions.
  arXiv  Detail & Related papers  (2020-09-21T06:10:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.