Are Akpans Trick or Treat: Unveiling Helpful Biases in Assistant Systems

• URL: http://arxiv.org/abs/2205.12554v4
• Date: Sun, 02 Mar 2025 21:51:00 GMT
• Title: Are Akpans Trick or Treat: Unveiling Helpful Biases in Assistant Systems
• Authors: Jiao Sun, Yu Hou, Jiin Kim, Nanyun Peng,
• Abstract summary: Information-seeking AI assistant systems aim to answer users' queries about knowledge in a timely manner.<n>In this paper, we study computational measurements of helpfulness.<n> Experiments with state-of-the-art dialogue systems reveal that existing systems tend to be more helpful for questions regarding concepts from highly-developed countries.
• Score: 55.09907990139756
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Information-seeking AI assistant systems aim to answer users' queries about knowledge in a timely manner. However, both the human-perceived helpfulness of information-seeking assistant systems and its fairness implication are under-explored. In this paper, we study computational measurements of helpfulness. We collect human annotations on the helpfulness of dialogue responses, develop models for automatic helpfulness evaluation, and then propose to use the helpfulness level of a dialogue system towards different user queries to gauge the fairness of a dialogue system. Experiments with state-of-the-art dialogue systems, including ChatGPT, under three information-seeking scenarios reveal that existing systems tend to be more helpful for questions regarding concepts from highly-developed countries than less-developed countries, uncovering potential fairness concerns underlying the current information-seeking assistant systems.

Related papers

• Enhancing Discoverability in Enterprise Conversational Systems with Proactive Question Suggestions [5.356008176627551]
  This paper proposes a framework to enhance question suggestions in conversational enterprise AI systems. Our approach combines periodic user intent analysis at the population level with chat session-based question generation. We evaluate the framework using real-world data from the AI Assistant for Adobe Experience Platform.
  arXiv  Detail & Related papers  (2024-12-14T19:04:16Z)
• Rethinking the Evaluation of Dialogue Systems: Effects of User Feedback on Crowdworkers and LLMs [57.16442740983528]
  In ad-hoc retrieval, evaluation relies heavily on user actions, including implicit feedback. The role of user feedback in annotators' assessment of turns in a conversational perception has been little studied. We focus on how the evaluation of task-oriented dialogue systems ( TDSs) is affected by considering user feedback, explicit or implicit, as provided through the follow-up utterance of a turn being evaluated.
  arXiv  Detail & Related papers  (2024-04-19T16:45:50Z)
• K-ESConv: Knowledge Injection for Emotional Support Dialogue Systems via Prompt Learning [83.19215082550163]
  We propose K-ESConv, a novel prompt learning based knowledge injection method for emotional support dialogue system. We evaluate our model on an emotional support dataset ESConv, where the model retrieves and incorporates knowledge from external professional emotional Q&A forum.
  arXiv  Detail & Related papers  (2023-12-16T08:10:10Z)
• PK-Chat: Pointer Network Guided Knowledge Driven Generative Dialogue Model [79.64376762489164]
  PK-Chat is a Pointer network guided generative dialogue model, incorporating a unified pretrained language model and a pointer network over knowledge graphs. The words generated by PK-Chat in the dialogue are derived from the prediction of word lists and the direct prediction of the external knowledge graph knowledge. Based on the PK-Chat, a dialogue system is built for academic scenarios in the case of geosciences.
  arXiv  Detail & Related papers  (2023-04-02T18:23:13Z)
• PK-ICR: Persona-Knowledge Interactive Context Retrieval for Grounded Dialogue [21.266410719325208]
  Persona and Knowledge Dual Context Identification is a task to identify persona and knowledge jointly for a given dialogue. We develop a novel grounding retrieval method that utilizes all contexts of dialogue simultaneously.
  arXiv  Detail & Related papers  (2023-02-13T20:27:26Z)
• Are Current Task-oriented Dialogue Systems Able to Satisfy Impolite Users? [26.066439234012275]
  We constructed an impolite dialogue corpus and conducted experiments to evaluate the state-of-the-art TOD systems. Our experimental results show that existing TOD systems are unable to handle impolite user utterances. We also present a data augmentation method to improve TOD performance in impolite dialogues.
  arXiv  Detail & Related papers  (2022-10-24T04:11:52Z)
• Learning as Conversation: Dialogue Systems Reinforced for Information Acquisition [30.91417206129677]
  We propose novel AI-empowered chat bots for learning as conversation where a user does not read a passage but gains information and knowledge through conversation with a teacher bot. Our information-acquisition-oriented dialogue system employs a novel adaptation of reinforced self-play so that the system can be transferred to various domains without in-domain dialogue data.
  arXiv  Detail & Related papers  (2022-05-29T19:42:25Z)
• Target-Guided Dialogue Response Generation Using Commonsense and Data Augmentation [32.764356638437214]
  We introduce a new technique for target-guided response generation. We also propose techniques to re-purpose existing dialogue datasets for target-guided generation. Our work generally enables dialogue system designers to exercise more control over the conversations that their systems produce.
  arXiv  Detail & Related papers  (2022-05-19T04:01:40Z)
• Towards Large-Scale Interpretable Knowledge Graph Reasoning for Dialogue Systems [109.16553492049441]
  We propose a novel method to incorporate the knowledge reasoning capability into dialogue systems in a more scalable and generalizable manner. To the best of our knowledge, this is the first work to have transformer models generate responses by reasoning over differentiable knowledge graphs.
  arXiv  Detail & Related papers  (2022-03-20T17:51:49Z)
• Task-oriented Dialogue Systems: performance vs. quality-optima, a review [0.0]
  State-of-the-art task-oriented dialogue systems are not yet reaching their full potential. Other conversational quality attributes that may point to the success, or otherwise, of the dialogue, may be ignored. This paper explores the literature on evaluative frameworks of dialogue systems and the role of conversational quality attributes in dialogue systems.
  arXiv  Detail & Related papers  (2021-12-21T13:16:24Z)
• A Review of Dialogue Systems: From Trained Monkeys to Stochastic Parrots [0.0]
  We aim to deploy artificial intelligence to build automated dialogue agents that can converse with humans. We present a broad overview of methods developed to build dialogue systems over the years.
  arXiv  Detail & Related papers  (2021-11-02T08:07:55Z)
• CAiRE in DialDoc21: Data Augmentation for Information-Seeking Dialogue System [55.43871578056878]
  In DialDoc21 competition, our system achieved 74.95 F1 score and 60.74 Exact Match score in subtask 1, and 37.72 SacreBLEU score in subtask 2.
  arXiv  Detail & Related papers  (2021-06-07T11:40:55Z)
• Natural Language Understanding for Argumentative Dialogue Systems in the Opinion Building Domain [6.951113351928047]
  This paper introduces a framework for argumentative dialogue systems in the information-seeking domain. Our approach distinguishes multiple user intents and identifies system arguments the user refers to in his or her natural language utterances.
  arXiv  Detail & Related papers  (2021-03-03T21:17:24Z)
• A systematic review and taxonomy of explanations in decision support and recommender systems [13.224071661974596]
  We systematically review the literature on explanations in advice-giving systems. We derive a novel comprehensive taxonomy of aspects to be considered when designing explanation facilities.
  arXiv  Detail & Related papers  (2020-06-15T18:19:20Z)
• Rethinking Dialogue State Tracking with Reasoning [76.0991910623001]
  This paper proposes to track dialogue states gradually with reasoning over dialogue turns with the help of the back-end data. Empirical results demonstrate that our method significantly outperforms the state-of-the-art methods by 38.6% in terms of joint belief accuracy for MultiWOZ 2.1.
  arXiv  Detail & Related papers  (2020-05-27T02:05:33Z)
• You Impress Me: Dialogue Generation via Mutual Persona Perception [62.89449096369027]
  The research in cognitive science suggests that understanding is an essential signal for a high-quality chit-chat conversation. Motivated by this, we propose P2 Bot, a transmitter-receiver based framework with the aim of explicitly modeling understanding.
  arXiv  Detail & Related papers  (2020-04-11T12:51:07Z)
• A Survey on Conversational Recommender Systems [11.319431345375751]
  Conversational recommender systems (CRS) take a different approach and support a richer set of interactions. The interest in CRS has significantly increased in the past few years. This development is mainly due to the significant progress in the area of natural language processing.
  arXiv  Detail & Related papers  (2020-04-01T18:00:47Z)
• Recent Advances and Challenges in Task-oriented Dialog System [63.82055978899631]
  Task-oriented dialog systems are attracting more and more attention in academic and industrial communities. We discuss three critical topics for task-oriented dialog systems: (1) improving data efficiency to facilitate dialog modeling in low-resource settings, (2) modeling multi-turn dynamics for dialog policy learning, and (3) integrating domain knowledge into the dialog model.
  arXiv  Detail & Related papers  (2020-03-17T01:34:56Z)
• Attention over Parameters for Dialogue Systems [69.48852519856331]
  We learn a dialogue system that independently parameterizes different dialogue skills, and learns to select and combine each of them through Attention over Parameters (AoP) The experimental results show that this approach achieves competitive performance on a combined dataset of MultiWOZ, In-Car Assistant, and Persona-Chat.
  arXiv  Detail & Related papers  (2020-01-07T03:10:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.