PsyDI: Towards a Personalized and Progressively In-depth Chatbot for Psychological Measurements

• URL: http://arxiv.org/abs/2408.03337v4
• Date: Thu, 16 Jan 2025 07:40:27 GMT
• Title: PsyDI: Towards a Personalized and Progressively In-depth Chatbot for Psychological Measurements
• Abstract summary: We introduce PsyDI, a personalized and progressively in-depth chatbots for psychological measurements.<n>PsyDI uses user-related multi-modal information and engages in customized, multi-turn interactions to provide personalized, easily accessible measurements.<n>We introduce a novel training paradigm that involves learning the ranking of proxy variables associated with psychological traits.<n>The score model enables PsyDI to conduct comprehensive and precise measurements through multi-turn interactions.
• Score: 4.215144489966779
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In the field of psychology, traditional assessment methods, such as standardized scales, are frequently critiqued for their static nature, lack of personalization, and reduced participant engagement, while comprehensive counseling evaluations are often inaccessible. The complexity of quantifying psychological traits further limits these methods. Despite advances with large language models (LLMs), many still depend on single-round Question-and-Answer interactions. To bridge this gap, we introduce PsyDI, a personalized and progressively in-depth chatbot designed for psychological measurements, exemplified by its application in the Myers-Briggs Type Indicator (MBTI) framework. PsyDI leverages user-related multi-modal information and engages in customized, multi-turn interactions to provide personalized, easily accessible measurements, while ensuring precise MBTI type determination. To address the challenge of unquantifiable psychological traits, we introduce a novel training paradigm that involves learning the ranking of proxy variables associated with these traits, culminating in a robust score model for MBTI measurements. The score model enables PsyDI to conduct comprehensive and precise measurements through multi-turn interactions within a unified estimation context. Through various experiments, we validate the efficacy of both the score model and the PsyDI pipeline, demonstrating its potential to serve as a general framework for psychological measurements. Furthermore, the online deployment of PsyDI has garnered substantial user engagement, with over 3,000 visits, resulting in the collection of numerous multi-turn dialogues annotated with MBTI types, which facilitates further research. The source code for the training and web service components is publicly available as a part of OpenDILab at: https://github.com/opendilab/PsyDI

Related papers

• PersonaKit (PK): A Plug-and-Play Platform for User Testing Diverse Roles in Full-Duplex Dialogue [8.78029839113787]
  We present PersonaKit, a low-source web platform for rapid prototyping and evaluation of conversational agents.<n>We show that PersonaKit provides an end-to-end framework for studying complex sociolinguistic behaviors in next-generation spoken agents.
  arXiv  Detail & Related papers  (2026-05-07T11:00:03Z)
• Generative Experiences for Digital Mental Health Interventions: Evidence from a Randomized Study [56.17549485306432]
  GUIDE is a system that generates personalized intervention content and multimodal interaction structure.<n>In a preregistered study with N = 237 participants, GUIDE significantly reduced stress and improved the user experience.<n>This work lays the foundation for interventions that dynamically shape how support is experienced and enacted in digital settings.
  arXiv  Detail & Related papers  (2026-04-08T19:59:28Z)
• From Classification to Ranking: Enhancing LLM Reasoning Capabilities for MBTI Personality Detection [25.825456002235967]
  Personality detection aims to measure an individual's corresponding personality traits through their social media posts.<n>Existing approaches enhance personality trait analysis by leveraging Large Language Models (LLMs)<n>We propose a corresponding reinforcement learning training paradigm for personality detection.
  arXiv  Detail & Related papers  (2026-01-26T15:28:43Z)
• Ask, Answer, and Detect: Role-Playing LLMs for Personality Detection with Question-Conditioned Mixture-of-Experts [4.618735978506653]
  ROME is a novel framework that explicitly injects psychological knowledge into personality detection.<n>We show that ROME consistently outperforms state-of-the-art baselines in experiments on two real-world datasets.
  arXiv  Detail & Related papers  (2025-12-09T17:07:54Z)
• A Computational Framework for Interpretable Text-Based Personality Assessment from Social Media [0.0]
  This thesis presents two datasets -- MBTI9k and PANDORA -- collected from Reddit.<n>The PANDORA dataset contains 17 million comments from over 10,000 users.<n>In response, the SIMPA framework was developed - a computational framework for interpretable personality assessment.
  arXiv  Detail & Related papers  (2025-10-03T08:36:36Z)
• Evaluating Cognitive-Behavioral Fixation via Multimodal User Viewing Patterns on Social Media [52.313084466769375]
  We propose a novel framework for assessing cognitive-behavioral fixation by analyzing users' multimodal social media engagement patterns.<n> Experiments on existing benchmarks and a newly curated multimodal dataset demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2025-09-05T05:50:00Z)
• HumAIne-Chatbot: Real-Time Personalized Conversational AI via Reinforcement Learning [0.4931504898146351]
  textbfHumAIne-chatbot is an AI-driven conversational agent that personalizes responses through a novel user profiling framework.<n>During live interactions, an online reinforcement learning agent refines per-user models by combining implicit signals.<n>Results show consistent improvements in user satisfaction, personalization accuracy, and task achievement when personalization features were enabled.
  arXiv  Detail & Related papers  (2025-09-04T15:16:38Z)
• Exploring a Gamified Personality Assessment Method through Interaction with Multi-Personality LLM Agents [40.48149639841564]
  This study explores an interactive approach for personality assessment, focusing on the multiplicity of personality representation.<n>We propose a framework of gamified personality assessment through multi-personality representations (Multi-PR GPA)
  arXiv  Detail & Related papers  (2025-07-05T11:17:20Z)
• TestAgent: An Adaptive and Intelligent Expert for Human Assessment [62.060118490577366]
  We propose TestAgent, a large language model (LLM)-powered agent designed to enhance adaptive testing through interactive engagement.<n>TestAgent supports personalized question selection, captures test-takers' responses and anomalies, and provides precise outcomes through dynamic, conversational interactions.
  arXiv  Detail & Related papers  (2025-06-03T16:07:54Z)
• SELF-PERCEPT: Introspection Improves Large Language Models' Detection of Multi-Person Mental Manipulation in Conversations [3.9207535345233873]
  Mental manipulation is a subtle yet pervasive form of abuse in interpersonal communication.<n>We introduce the MultiManip dataset, comprising 220 multi-turn, multi-person dialogues balanced between manipulative and non-manipulative interactions.<n>We propose SELF-PERCEPT, a novel, two-stage prompting framework inspired by Self-Perception Theory.
  arXiv  Detail & Related papers  (2025-05-27T03:51:25Z)
• Beyond Empathy: Integrating Diagnostic and Therapeutic Reasoning with Large Language Models for Mental Health Counseling [50.83055329849865]
  PsyLLM is a large language model designed to integrate diagnostic and therapeutic reasoning for mental health counseling.<n>It processes real-world mental health posts from Reddit and generates multi-turn dialogue structures.<n>Our experiments demonstrate that PsyLLM significantly outperforms state-of-the-art baseline models.
  arXiv  Detail & Related papers  (2025-05-21T16:24:49Z)
• MindScope: Exploring cognitive biases in large language models through Multi-Agent Systems [12.245537894266803]
  We introduce the 'MindScope' dataset, which distinctively integrates static and dynamic elements. The static component comprises 5,170 open-ended questions spanning 72 cognitive bias categories. The dynamic component leverages a rule-based, multi-agent communication framework to facilitate the generation of multi-round dialogues. In addition, we introduce a multi-agent detection method applicable to a wide range of detection tasks, which integrates Retrieval-Augmented Generation (RAG), competitive debate, and a reinforcement learning-based decision module.
  arXiv  Detail & Related papers  (2024-10-06T11:23:56Z)
• PersLLM: A Personified Training Approach for Large Language Models [66.16513246245401]
  We propose PersLLM, integrating psychology-grounded principles of personality: social practice, consistency, and dynamic development. We incorporate personality traits directly into the model parameters, enhancing the model's resistance to induction, promoting consistency, and supporting the dynamic evolution of personality.
  arXiv  Detail & Related papers  (2024-07-17T08:13:22Z)
• Evaluating Large Language Models with Psychometrics [59.821829073478376]
  This paper offers a comprehensive benchmark for quantifying psychological constructs of Large Language Models (LLMs)<n>Our work identifies five key psychological constructs -- personality, values, emotional intelligence, theory of mind, and self-efficacy -- assessed through a suite of 13 datasets.<n>We uncover significant discrepancies between LLMs' self-reported traits and their response patterns in real-world scenarios, revealing complexities in their behaviors.
  arXiv  Detail & Related papers  (2024-06-25T16:09:08Z)
• PsyCoT: Psychological Questionnaire as Powerful Chain-of-Thought for Personality Detection [50.66968526809069]
  We propose a novel personality detection method, called PsyCoT, which mimics the way individuals complete psychological questionnaires in a multi-turn dialogue manner. Our experiments demonstrate that PsyCoT significantly improves the performance and robustness of GPT-3.5 in personality detection.
  arXiv  Detail & Related papers  (2023-10-31T08:23:33Z)
• Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A Survey [71.43956423427397]
  We aim to identify the nonverbal cues and computational methodologies resulting in effective performance. This survey differs from its counterparts by involving the widest spectrum of social phenomena and interaction settings. Some major observations are: the most often used nonverbal cue, computational method, interaction environment, and sensing approach are speaking activity, support vector machines, and meetings composed of 3-4 persons equipped with microphones and cameras, respectively.
  arXiv  Detail & Related papers  (2022-07-20T13:37:57Z)
• Using Machine Learning Based Models for Personality Recognition [0.0]
  Personality can be defined as the combination of behavior, emotion, motivation, and thoughts. Deep learning based method for the task of personality recognition from text is proposed in this paper.
  arXiv  Detail & Related papers  (2022-01-17T07:20:51Z)
• Dyadformer: A Multi-modal Transformer for Long-Range Modeling of Dyadic Interactions [33.67477398036821]
  We present Dyadformer, a novel multi-modal multi-subject Transformer architecture to model individual and interpersonal features in dyadic interactions. Our proposed cross-subject layer allows the network to explicitly model interactions among subjects through attentional operations. This proof-of-concept approach shows how multi-modality and joint modeling of both interactants for longer periods of time helps to predict individual attributes.
  arXiv  Detail & Related papers  (2021-09-20T12:45:04Z)
• Towards Quantifiable Dialogue Coherence Evaluation [126.55560816209756]
  Quantifiable Dialogue Coherence Evaluation (QuantiDCE) is a novel framework aiming to train a quantifiable dialogue coherence metric. QuantiDCE includes two training stages, Multi-Level Ranking (MLR) pre-training and Knowledge Distillation (KD) fine-tuning. Experimental results show that the model trained by QuantiDCE presents stronger correlations with human judgements than the other state-of-the-art metrics.
  arXiv  Detail & Related papers  (2021-06-01T14:11:17Z)
• Towards Automatic Evaluation of Dialog Systems: A Model-Free Off-Policy Evaluation Approach [84.02388020258141]
  We propose a new framework named ENIGMA for estimating human evaluation scores based on off-policy evaluation in reinforcement learning. ENIGMA only requires a handful of pre-collected experience data, and therefore does not involve human interaction with the target policy during the evaluation. Our experiments show that ENIGMA significantly outperforms existing methods in terms of correlation with human evaluation scores.
  arXiv  Detail & Related papers  (2021-02-20T03:29:20Z)
• Multitask Learning for Emotion and Personality Detection [17.029426018676997]
  We build on the known correlation between personality traits and emotional behaviors, and propose a novel multitask learning framework, SoGMTL. Our more computationally efficient CNN-based multitask model achieves the state-of-the-art performance across multiple famous personality and emotion datasets.
  arXiv  Detail & Related papers  (2021-01-07T03:09:55Z)
• Vyaktitv: A Multimodal Peer-to-Peer Hindi Conversations based Dataset for Personality Assessment [50.15466026089435]
  We present a novel peer-to-peer Hindi conversation dataset- Vyaktitv. It consists of high-quality audio and video recordings of the participants, with Hinglish textual transcriptions for each conversation. The dataset also contains a rich set of socio-demographic features, like income, cultural orientation, amongst several others, for all the participants.
  arXiv  Detail & Related papers  (2020-08-31T17:44:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.