Detecting Conversational Mental Manipulation with Intent-Aware Prompting

• URL: http://arxiv.org/abs/2412.08414v1
• Date: Wed, 11 Dec 2024 14:31:39 GMT
• Title: Detecting Conversational Mental Manipulation with Intent-Aware Prompting
• Authors: Jiayuan Ma, Hongbin Na, Zimu Wang, Yining Hua, Yue Liu, Wei Wang, Ling Chen,
• Abstract summary: Mental manipulation severely undermines mental wellness by covertly and negatively distorting decision-making. We propose Intent-Aware Prompting (IAP), a novel approach for detecting mental manipulations using large language models (LLMs) Experimental results on the MentalManip dataset demonstrate superior effectiveness of IAP against other advanced prompting strategies.
• Score: 13.816802360228682
• License:
• Abstract: Mental manipulation severely undermines mental wellness by covertly and negatively distorting decision-making. While there is an increasing interest in mental health care within the natural language processing community, progress in tackling manipulation remains limited due to the complexity of detecting subtle, covert tactics in conversations. In this paper, we propose Intent-Aware Prompting (IAP), a novel approach for detecting mental manipulations using large language models (LLMs), providing a deeper understanding of manipulative tactics by capturing the underlying intents of participants. Experimental results on the MentalManip dataset demonstrate superior effectiveness of IAP against other advanced prompting strategies. Notably, our approach substantially reduces false negatives, helping detect more instances of mental manipulation with minimal misjudgment of positive cases. The code of this paper is available at https://github.com/Anton-Jiayuan-MA/Manip-IAP.

Related papers

• Mental-Perceiver: Audio-Textual Multi-Modal Learning for Estimating Mental Disorders [9.222458475626652]
  Mental disorders, such as anxiety and depression, have become a global concern that affects people of all ages. Although AI-based detection methods show promise, progress is hindered by the lack of publicly available large-scale datasets. We propose Mental-Perceiver, a deep learning model for estimating mental disorders from audio and textual data.
  arXiv  Detail & Related papers  (2024-08-22T02:54:52Z)
• Enhanced Detection of Conversational Mental Manipulation Through Advanced Prompting Techniques [23.710371961866198]
  We implement Chain-of-Thought prompting with Zero-Shot and Few-Shot settings on a binary mental manipulation detection task. Our primary objective is to decipher why certain prompting techniques display superior performance.
  arXiv  Detail & Related papers  (2024-08-14T17:23:12Z)
• MentalManip: A Dataset For Fine-grained Analysis of Mental Manipulation in Conversations [41.661208833153225]
  Mental manipulation is a significant form of abuse in interpersonal conversations. Our study introduces a new dataset, named $rm Msmall entalMsmall anip$, which consists of $4,000$ annotated movie dialogues. This dataset enables a comprehensive analysis of mental manipulation, pinpointing both the techniques utilized for manipulation and the vulnerabilities targeted in victims.
  arXiv  Detail & Related papers  (2024-05-26T14:27:48Z)
• AI-Enhanced Cognitive Behavioral Therapy: Deep Learning and Large Language Models for Extracting Cognitive Pathways from Social Media Texts [27.240795549935463]
  We gathered data from social media and established the task of extracting cognitive pathways. We structured a text summarization task to help psychotherapists quickly grasp the essential information. Our experiments evaluate the performance of deep learning and large language models.
  arXiv  Detail & Related papers  (2024-04-17T14:55:27Z)
• A New Benchmark and Reverse Validation Method for Passage-level Hallucination Detection [63.56136319976554]
  Large Language Models (LLMs) generate hallucinations, which can cause significant damage when deployed for mission-critical tasks. We propose a self-check approach based on reverse validation to detect factual errors automatically in a zero-resource fashion. We empirically evaluate our method and existing zero-resource detection methods on two datasets.
  arXiv  Detail & Related papers  (2023-10-10T10:14:59Z)
• Adversarial Attacks on the Interpretation of Neuron Activation Maximization [70.5472799454224]
  Activation-maximization approaches are used to interpret and analyze trained deep-learning models. In this work, we consider the concept of an adversary manipulating a model for the purpose of deceiving the interpretation.
  arXiv  Detail & Related papers  (2023-06-12T19:54:33Z)
• Semantic Similarity Models for Depression Severity Estimation [53.72188878602294]
  This paper presents an efficient semantic pipeline to study depression severity in individuals based on their social media writings. We use test user sentences for producing semantic rankings over an index of representative training sentences corresponding to depressive symptoms and severity levels. We evaluate our methods on two Reddit-based benchmarks, achieving 30% improvement over state of the art in terms of measuring depression severity.
  arXiv  Detail & Related papers  (2022-11-14T18:47:26Z)
• Watch Those Words: Video Falsification Detection Using Word-Conditioned Facial Motion [82.06128362686445]
  We propose a multi-modal semantic forensic approach to handle both cheapfakes and visually persuasive deepfakes. We leverage the idea of attribution to learn person-specific biometric patterns that distinguish a given speaker from others. Unlike existing person-specific approaches, our method is also effective against attacks that focus on lip manipulation.
  arXiv  Detail & Related papers  (2021-12-21T01:57:04Z)
• Offline Contextual Multi-armed Bandits for Mobile Health Interventions: A Case Study on Emotion Regulation [2.8680209551947473]
  We present the first development of a treatment recommender system for emotion regulation using real-world historical mobile digital data. Our experimentation shows that the proposed doubly robust offline learning algorithms performed significantly better than baseline approaches.
  arXiv  Detail & Related papers  (2020-08-21T13:41:24Z)
• Detecting Parkinsonian Tremor from IMU Data Collected In-The-Wild using Deep Multiple-Instance Learning [59.74684475991192]
  Parkinson's Disease (PD) is a slowly evolving neuro-logical disease that affects about 1% of the population above 60 years old. PD symptoms include tremor, rigidity and braykinesia. We present a method for automatically identifying tremorous episodes related to PD, based on IMU signals captured via a smartphone device.
  arXiv  Detail & Related papers  (2020-05-06T09:02:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.