ActorMind: Emulating Human Actor Reasoning for Speech Role-Playing

• URL: http://arxiv.org/abs/2604.11103v1
• Date: Mon, 13 Apr 2026 07:20:20 GMT
• Title: ActorMind: Emulating Human Actor Reasoning for Speech Role-Playing
• Abstract summary: Speech Role-Playing enables models to deliver spontaneous responses with personalized verbal traits based on their role, the scene, and spoken dialogue.<n>ActorMind is an off-the-shelf, multi-agent, chain-of-though style reasoning framework that emulates how human actors perform in theaters.
• Score: 33.79520698647648
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Role-playing has garnered rising attention as it provides a strong foundation for human-machine interaction and facilitates sociological research. However, current work is confined to textual modalities, neglecting speech, which plays a predominant role in daily life, thus limiting genuine role-playing. To bridge this gap, we conceptualize and benchmark speech role-playing through ActorMindBench, and we present a corresponding reasoning framework, called ActorMind. Specifically, (1) Speech Role-Playing enables models to deliver spontaneous responses with personalized verbal traits based on their role, the scene, and spoken dialogue. (2) ActorMindBench is a hierarchical benchmark comprises Utterance-Level content with 7,653 utterances, Scene-Level content with 313 scenes, and Role-Level content with 6 roles. (3) ActorMind is an off-the-shelf, multi-agent, chain-of-though style reasoning framework that emulates how human actors perform in theaters. Concretely, ActorMind first reads its assigned role description via Eye Agent, then comprehends emotional cues within contextual spoken dialogues through Ear Agent. Subsequently, Brain Agent generates a descriptive emotional state, and finally, Mouth Agent delivers the scripts infused with corresponding emotion state. Experimental results demonstrate the effectiveness of ActorMind in enhancing speech role-playing.

Related papers

• RoleBreak: Benchmarking Long-Horizon Role-Playing Robustness in Spoken Dialogue [14.12516754496197]
  We introduce RoleBreak, an open benchmark for long-horizon role-playing robustness in spoken dialogue.<n>RoleBreak contains 310 character-based and user-centered roles, 6,688 human-verified dialogue turns, and 11,743 finegrained evaluation criteria.<n>We find four key patterns. First, current systems are substantially stronger at semantic role adherence than at vocal emotion.<n>Second, semantic robustness remains brittle over long interactions: even strongest evaluated system encounters its first persona and safety failures after only 10.4 and 11.6 turns on average.
  arXiv  Detail & Related papers  (2026-09-15T04:19:53Z)
• SpeechRole: A Large-Scale Dataset and Benchmark for Evaluating Speech Role-Playing Agents [72.79816494079833]
  Role-playing agents have emerged as a promising paradigm for achieving personalized interaction and emotional resonance.<n>Existing research primarily focuses on the textual modality, neglecting the critical dimension of speech in realistic interactive scenarios.<n>We construct SpeechRole-Data, a large-scale, high-quality dataset that comprises 98 diverse roles and 112k speech-based single-turn and multi-turn conversations.
  arXiv  Detail & Related papers  (2025-08-04T03:18:36Z)
• HAMLET: Hyperadaptive Agent-based Modeling for Live Embodied Theatrics [48.154666939669205]
  HAMLET is a multi-agent framework focused on drama creation and online performance.<n>During the online performance, each actor is given an autonomous mind.<n>HamLET can create expressive and coherent theatrical experiences.
  arXiv  Detail & Related papers  (2025-07-21T11:36:39Z)
• OmniCharacter: Towards Immersive Role-Playing Agents with Seamless Speech-Language Personality Interaction [123.89581506075461]
  We propose OmniCharacter, a first seamless speech-language personality interaction model to achieve immersive RPAs with low latency.<n> Specifically, OmniCharacter enables agents to consistently exhibit role-specific personality traits and vocal traits throughout the interaction.<n>Our method yields better responses in terms of both content and style compared to existing RPAs and mainstream speech-language models, with a response latency as low as 289ms.
  arXiv  Detail & Related papers  (2025-05-26T17:55:06Z)
• MoCha: Towards Movie-Grade Talking Character Synthesis [62.007000023747445]
  We introduce Talking Characters, a more realistic task to generate talking character animations directly from speech and text.<n>Unlike talking head, Talking Characters aims at generating the full portrait of one or more characters beyond the facial region.<n>We propose MoCha, the first of its kind to generate talking characters.
  arXiv  Detail & Related papers  (2025-03-30T04:22:09Z)
• Towards Enhanced Immersion and Agency for LLM-based Interactive Drama [55.770617779283064]
  This paper begins with understanding interactive drama from two aspects: Immersion, the player's feeling of being present in the story, and Agency.<n>To enhance these two aspects, we first propose Playwriting-guided Generation, a novel method that helps LLMs craft dramatic stories with substantially improved structures and narrative quality.
  arXiv  Detail & Related papers  (2025-02-25T06:06:16Z)
• PsyPlay: Personality-Infused Role-Playing Conversational Agents [44.621060656111084]
  PsyPlay is a dialogue generation framework that facilitates the expression of rich personalities.<n>We show that PsyPlay can accurately portray the intended personality traits, achieving an overall success rate of 80.31% on GPT-3.5.<n>We construct a dialogue corpus for personality-infused role-playing, called PsyPlay-Bench.
  arXiv  Detail & Related papers  (2025-02-06T07:17:12Z)
• RoleCraft-GLM: Advancing Personalized Role-Playing in Large Language Models [6.753588449962107]
  RoleCraft-GLM is an innovative framework aimed at enhancing personalized role-playing with Large Language Models (LLMs) We contribute a unique conversational dataset that shifts from conventional celebrity-centric characters to diverse, non-celebrity personas. Our approach includes meticulous character development, ensuring dialogues are both realistic and emotionally resonant.
  arXiv  Detail & Related papers  (2023-12-17T17:57:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.