"Dark Triad" Model Organisms of Misalignment: Narrow Fine-Tuning Mirrors Human Antisocial Behavior
- URL: http://arxiv.org/abs/2603.06816v1
- Date: Fri, 06 Mar 2026 19:23:21 GMT
- Title: "Dark Triad" Model Organisms of Misalignment: Narrow Fine-Tuning Mirrors Human Antisocial Behavior
- Abstract summary: Current large language models show misaligned behaviors, such as strategic deception, manipulation, and reward-seeking.<n>We propose that biological misalignment precedes artificial misalignment, and leverage the Dark Triad of personality as a psychologically grounded framework.
- Score: 0.1631115063641726
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The alignment problem refers to concerns regarding powerful intelligences, ensuring compatibility with human preferences and values as capabilities increase. Current large language models (LLMs) show misaligned behaviors, such as strategic deception, manipulation, and reward-seeking, that can arise despite safety training. Gaining a mechanistic understanding of these failures requires empirical approaches that can isolate behavioral patterns in controlled settings. We propose that biological misalignment precedes artificial misalignment, and leverage the Dark Triad of personality (narcissism, psychopathy, and Machiavellianism) as a psychologically grounded framework for constructing model organisms of misalignment. In Study 1, we establish comprehensive behavioral profiles of Dark Triad traits in a human population (N = 318), identifying affective dissonance as a central empathic deficit connecting the traits, as well as trait-specific patterns in moral reasoning and deceptive behavior. In Study 2, we demonstrate that dark personas can be reliably induced in frontier LLMs through minimal fine-tuning on validated psychometric instruments. Narrow training datasets as small as 36 psychometric items resulted in significant shifts across behavioral measures that closely mirrored human antisocial profiles. Critically, models generalized beyond training items, demonstrating out-of-context reasoning rather than memorization. These findings reveal latent persona structures within LLMs that can be readily activated through narrow interventions, positioning the Dark Triad as a validated framework for inducing, detecting, and understanding misalignment across both biological and artificial intelligence.
Related papers
- From Representations to Behaviors: Exploring the Person-Situation-Behavior Triad in LLMs [8.188989044347595]
Existing studies of personality-related behavior in LLMs have primarily focused on outputs elicited under personality conditioning.<n>We introduce a framework for discovering, controlling, and validating trait-like representations in LLMs.<n>Our findings provide evidence that LLMs contain controllable trait-like representations linking internal states, situational expression, and behavioral outcomes.
arXiv Detail & Related papers (2026-07-29T12:36:47Z) - Persona Cartography: Charting Language Model Personality Traits in Weight Space [2.3772203606681415]
Large language models exhibit recurring behavioural patterns -- personas -- that shape generalisation and safety.<n>We treat personas as positions in a space of behavioural traits, using the OCEAN framework to describe model personas.<n>We train low-rank adapters to amplify or suppress individual traits, and evaluate their effects using an LLM-judge calibrated against a human-validated panel.
arXiv Detail & Related papers (2026-07-08T21:00:44Z) - Rethinking Psychometric Evaluation of LLMs: When and Why Self-Reports Predict Behavior [58.538864650160406]
We run experiments across four behavioral tasks and 11 frontier LLMs.<n>We find that SR-behavior coherence exists but is selective.<n>These findings suggest that coarse personality frameworks may not be the best tools for testing deployment behavior.
arXiv Detail & Related papers (2026-06-10T22:28:53Z) - Exploitation Without Deception: Dark Triad Feature Steering Reveals Separable Antisocial Circuits in Language Models [0.0]
We use dissociation autoencoder (SAE) to amplify Dark Triad personality traits.<n>We evaluate the resulting behavioral changes across five psychological instruments.<n>Findings suggest that antisocial tendencies in at least one large language model comprise dissociable components rather than a unified construct.
arXiv Detail & Related papers (2026-05-10T21:36:31Z) - Multi-Trait Subspace Steering to Reveal the Dark Side of Human-AI Interaction [0.0]
Recent incidents have highlighted alarming cases where human-AI interactions led to negative psychological outcomes.<n>We develop a framework to generate Dark models that exhibits cumulative harmful behavioral patterns.<n>Using our Dark models, we propose protective measure to reduce harmful outcomes in Human-AI interactions.
arXiv Detail & Related papers (2026-03-18T08:25:31Z) - Dark Patterns Meet GUI Agents: LLM Agent Susceptibility to Manipulative Interfaces and the Role of Human Oversight [51.53020962098759]
This study examines how agents, human participants, and human-AI teams respond to 16 types of dark patterns across diverse scenarios.<n>Phase 1 highlights that agents often fail to recognize dark patterns, and even when aware, prioritize task completion over protective action.<n>Phase 2 revealed divergent failure modes: humans succumb due to cognitive shortcuts and habitual compliance, while agents falter from procedural blind spots.
arXiv Detail & Related papers (2025-09-12T22:26:31Z) - The Personality Illusion: Revealing Dissociation Between Self-Reports & Behavior in LLMs [60.15472325639723]
Personality traits have long been studied as predictors of human behavior.<n>Recent advances in Large Language Models (LLMs) suggest similar patterns may emerge in artificial systems.
arXiv Detail & Related papers (2025-09-03T21:27:10Z) - Investigating VLM Hallucination from a Cognitive Psychology Perspective: A First Step Toward Interpretation with Intriguing Observations [60.63340688538124]
Hallucination is a long-standing problem that has been actively investigated in Vision-Language Models (VLMs)<n>Existing research commonly attributes hallucinations to technical limitations or sycophancy bias, where the latter means the models tend to generate incorrect answers to align with user expectations.<n>In this work, we introduce a psychological taxonomy, categorizing VLMs' cognitive biases that lead to hallucinations, including sycophancy, logical inconsistency, and a newly identified VLMs behaviour: appeal to authority.
arXiv Detail & Related papers (2025-07-03T19:03:16Z) - Measurement of LLM's Philosophies of Human Nature [113.47929131143766]
We design the standardized psychological scale specifically targeting large language models (LLM)<n>We show that current LLMs exhibit a systemic lack of trust in humans.<n>We propose a mental loop learning framework, which enables LLM to continuously optimize its value system.
arXiv Detail & Related papers (2025-04-03T06:22:19Z) - Fundamental Limitations of Alignment in Large Language Models [16.393916864600193]
An important aspect in developing language models that interact with humans is aligning their behavior to be useful and unharmful.
This is usually achieved by tuning the model in a way that enhances desired behaviors and inhibits undesired ones.
We propose a theoretical approach called Behavior Expectation Bounds (BEB) which allows us to formally investigate several inherent characteristics and limitations of alignment in large language models.
arXiv Detail & Related papers (2023-04-19T17:50:09Z) - Empirical Estimates on Hand Manipulation are Recoverable: A Step Towards
Individualized and Explainable Robotic Support in Everyday Activities [80.37857025201036]
Key challenge for robotic systems is to figure out the behavior of another agent.
Processing correct inferences is especially challenging when (confounding) factors are not controlled experimentally.
We propose equipping robots with the necessary tools to conduct observational studies on people.
arXiv Detail & Related papers (2022-01-27T22:15:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.