Correct Yourself, Keep My Trust: How Self-Correction and Social Connection Shape Credibility in Social Chatbots
- URL: http://arxiv.org/abs/2606.19286v1
- Date: Wed, 17 Jun 2026 17:04:41 GMT
- Title: Correct Yourself, Keep My Trust: How Self-Correction and Social Connection Shape Credibility in Social Chatbots
- Abstract summary: We compare three error correction strategies.<n>Self-correction corrected the error equally well, but only self-correction did so.<n>Users rated self-correction significantly higher in both trustworthiness and perceived expertise.
- Score: 14.959942562632838
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: When social chatbots make mistakes, and they do, how they recover determines whether users trust them again. Social chatbots are increasingly integrated into everyday life, yet they remain prone to generating convincing but inaccurate information. The social connection they build with users makes such errors particularly consequential. We conducted a between-subjects experiment (N=120) comparing three error correction strategies: a webpage retraction, self-correction by the same social chatbot, and correction by an expert chatbot. Our results reveal two key findings. First, all three strategies corrected the error equally well, but only self-correction did so without damaging the chatbot's credibility: participants rated self-correcting chatbots significantly higher in both trustworthiness and perceived expertise than chatbots whose errors were corrected by external sources. Second, the strength of the user's social connection with the chatbot, measured through social attraction and self-disclosure, significantly predicted the magnitude of belief change, but only when the chatbot corrected itself. Outsourcing corrections to an external source severed this link entirely. These findings suggest that social chatbots should correct their own mistakes rather than outsource corrections, and that investing in social connection is a functional mechanism that amplifies correction effectiveness, not merely a design feature. We discuss implications for designing chatbots that maintain long-term credibility while effectively addressing their own errors.
Related papers
- A Model-based Testing Technique for Amazon Lex Task-based Chatbots [46.12795846459242]
LexTester is an automated model-based testing technique for Amazon Lex chatbots.<n>It generates a Dialog Graph of all possible interactions, from which an executable test suite is generated.
arXiv Detail & Related papers (2026-07-01T15:48:43Z) - Evaluating Commercial AI Chatbots as News Intermediaries [85.32040752972836]
Best systems achieve over 90% multiple-choice accuracy on questions about events reported hours earlier.<n>Every model achieves its lowest accuracy on Hindi.<n> retrieval, not reasoning, failures drive over 70% of all errors.
arXiv Detail & Related papers (2026-05-21T17:42:07Z) - LLMs in social services: How does chatbot accuracy affect human accuracy? [4.837450441799026]
We measure the potential effects of chatbots on caseworkers' ability to provide accurate guidance.<n>We conducted a randomized experiment with caseworkers recruited from nonprofit outreach organizations in Los Angeles.<n>High-quality chatbots (96-100% accurate) improved caseworker accuracy by 27 percentage points.
arXiv Detail & Related papers (2026-03-11T18:28:52Z) - The Impact of a Chatbot's Ephemerality-Framing on Self-Disclosure Perceptions [17.836384420199316]
We investigated how a chatbots's description of its relationship with users affects self-disclosure.<n>We compared Familiar and Stranger, which presented themselves as unacquainted entities in each conversation.<n>When Emotional-disclosure was sought in the first chatting session, Stranger-condition participants felt more comfortable self-disclosing.<n>But when Factual-disclosure was sought first, these differences were replaced by more enjoyment among Familiar-condition participants.
arXiv Detail & Related papers (2025-05-26T19:00:49Z) - Exploring and Mitigating Adversarial Manipulation of Voting-Based Leaderboards [93.16294577018482]
Arena, the most popular benchmark of this type, ranks models by asking users to select the better response between two randomly selected models.<n>We show that an attacker can alter the leaderboard (to promote their favorite model or demote competitors) at the cost of roughly a thousand votes.<n>Our attack consists of two steps: first, we show how an attacker can determine which model was used to generate a given reply with more than $95%$ accuracy; and then, the attacker can use this information to consistently vote against a target model.
arXiv Detail & Related papers (2025-01-13T17:12:38Z) - Measuring and Controlling Instruction (In)Stability in Language Model Dialogs [72.38330196290119]
System-prompting is a tool for customizing language-model chatbots, enabling them to follow a specific instruction.
We propose a benchmark to test the assumption, evaluating instruction stability via self-chats.
We reveal a significant instruction drift within eight rounds of conversations.
We propose a lightweight method called split-softmax, which compares favorably against two strong baselines.
arXiv Detail & Related papers (2024-02-13T20:10:29Z) - Exploring consumers response to text-based chatbots in e-commerce: The
moderating role of task complexity and chatbot disclosure [0.0]
This study aims to explore consumers trust and response to a text-based chatbots in ecommerce.
The consumers perception of both the empathy and friendliness of the chatbots positively impacts their trust in it.
The disclosure of the text based chatbots negatively moderates the relationship between empathy and consumers trust, while it positively moderates the relationship between friendliness and consumers trust.
arXiv Detail & Related papers (2024-01-20T15:17:50Z) - Evaluating Chatbots to Promote Users' Trust -- Practices and Open
Problems [11.427175278545517]
This paper reviews current practices for testing chatbots.
It identifies gaps as open problems in pursuit of user trust.
It outlines a path forward to mitigate issues of trust related to service or product performance, user satisfaction and long-term unintended consequences for society.
arXiv Detail & Related papers (2023-09-09T22:40:30Z) - Neural Generation Meets Real People: Building a Social, Informative
Open-Domain Dialogue Agent [65.68144111226626]
Chirpy Cardinal aims to be both informative and conversational.
We let both the user and bot take turns driving the conversation.
Chirpy Cardinal placed second out of nine bots in the Alexa Prize Socialbot Grand Challenge.
arXiv Detail & Related papers (2022-07-25T09:57:23Z) - CheerBots: Chatbots toward Empathy and Emotionusing Reinforcement
Learning [60.348822346249854]
This study presents a framework whereby several empathetic chatbots are based on understanding users' implied feelings and replying empathetically for multiple dialogue turns.
We call these chatbots CheerBots. CheerBots can be retrieval-based or generative-based and were finetuned by deep reinforcement learning.
To respond in an empathetic way, we develop a simulating agent, a Conceptual Human Model, as aids for CheerBots in training with considerations on changes in user's emotional states in the future to arouse sympathy.
arXiv Detail & Related papers (2021-10-08T07:44:47Z) - Put Chatbot into Its Interlocutor's Shoes: New Framework to Learn
Chatbot Responding with Intention [55.77218465471519]
This paper proposes an innovative framework to train chatbots to possess human-like intentions.
Our framework included a guiding robot and an interlocutor model that plays the role of humans.
We examined our framework using three experimental setups and evaluate the guiding robot with four different metrics to demonstrated flexibility and performance advantages.
arXiv Detail & Related papers (2021-03-30T15:24:37Z) - Personalized Chatbot Trustworthiness Ratings [19.537492400265577]
We envision a personalized rating methodology for chatbots that relies on separate rating modules for each issue.
The method is independent of the specific trust issues and is parametric to the aggregation procedure.
arXiv Detail & Related papers (2020-05-13T22:42:45Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.