Collecting Visually-Grounded Dialogue with A Game Of Sorts
- URL: http://arxiv.org/abs/2309.05162v1
- Date: Sun, 10 Sep 2023 23:00:35 GMT
- Title: Collecting Visually-Grounded Dialogue with A Game Of Sorts
- Authors: Bram Willemsen, Dmytro Kalpakchi, Gabriel Skantze
- Abstract summary: We introduce a collaborative image ranking task, a grounded agreement game we call "A Game Of Sorts"
In our game, players are tasked with reaching agreement on how to rank a set of images given some sorting criterion through a largely unrestricted, role-symmetric dialogue.
We describe results of a small-scale data collection experiment with the proposed task.
- Score: 5.478764356647438
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: An idealized, though simplistic, view of the referring expression production
and grounding process in (situated) dialogue assumes that a speaker must merely
appropriately specify their expression so that the target referent may be
successfully identified by the addressee. However, referring in conversation is
a collaborative process that cannot be aptly characterized as an exchange of
minimally-specified referring expressions. Concerns have been raised regarding
assumptions made by prior work on visually-grounded dialogue that reveal an
oversimplified view of conversation and the referential process. We address
these concerns by introducing a collaborative image ranking task, a grounded
agreement game we call "A Game Of Sorts". In our game, players are tasked with
reaching agreement on how to rank a set of images given some sorting criterion
through a largely unrestricted, role-symmetric dialogue. By putting emphasis on
the argumentation in this mixed-initiative interaction, we collect discussions
that involve the collaborative referential process. We describe results of a
small-scale data collection experiment with the proposed task. All discussed
materials, which includes the collected data, the codebase, and a containerized
version of the application, are publicly available.
Related papers
- Context Does Matter: Implications for Crowdsourced Evaluation Labels in Task-Oriented Dialogue Systems [57.16442740983528]
Crowdsourced labels play a crucial role in evaluating task-oriented dialogue systems.
Previous studies suggest using only a portion of the dialogue context in the annotation process.
This study investigates the influence of dialogue context on annotation quality.
arXiv Detail & Related papers (2024-04-15T17:56:39Z) - Unsupervised Dialogue Topic Segmentation with Topic-aware Utterance
Representation [51.22712675266523]
Dialogue Topic (DTS) plays an essential role in a variety of dialogue modeling tasks.
We propose a novel unsupervised DTS framework, which learns topic-aware utterance representations from unlabeled dialogue data.
arXiv Detail & Related papers (2023-05-04T11:35:23Z) - Context-Dependent Embedding Utterance Representations for Emotion
Recognition in Conversations [1.8126187844654875]
We approach Emotion Recognition in Conversations leveraging the conversational context.
We propose context-dependent embedding representations of each utterance.
The effectiveness of our approach is validated on the open-domain DailyDialog dataset and on the task-oriented EmoWOZ dataset.
arXiv Detail & Related papers (2023-04-17T12:37:57Z) - Question-Interlocutor Scope Realized Graph Modeling over Key Utterances
for Dialogue Reading Comprehension [61.55950233402972]
We propose a new key utterances extracting method for dialogue reading comprehension.
It performs prediction on the unit formed by several contiguous utterances, which can realize more answer-contained utterances.
As a graph constructed on the text of utterances, we then propose Question-Interlocutor Scope Realized Graph (QuISG) modeling.
arXiv Detail & Related papers (2022-10-26T04:00:42Z) - Target-Guided Dialogue Response Generation Using Commonsense and Data
Augmentation [32.764356638437214]
We introduce a new technique for target-guided response generation.
We also propose techniques to re-purpose existing dialogue datasets for target-guided generation.
Our work generally enables dialogue system designers to exercise more control over the conversations that their systems produce.
arXiv Detail & Related papers (2022-05-19T04:01:40Z) - Opponent Modeling in Negotiation Dialogues by Related Data Adaptation [20.505272677769355]
We propose a ranker for identifying priorities from negotiation dialogues.
The model takes in a partial dialogue as input and predicts the priority order of the opponent.
We show the utility of our proposed approach through extensive experiments based on two dialogue datasets.
arXiv Detail & Related papers (2022-04-30T21:11:41Z) - End-to-end Spoken Conversational Question Answering: Task, Dataset and
Model [92.18621726802726]
In spoken question answering, the systems are designed to answer questions from contiguous text spans within the related speech transcripts.
We propose a new Spoken Conversational Question Answering task (SCQA), aiming at enabling the systems to model complex dialogue flows.
Our main objective is to build the system to deal with conversational questions based on the audio recordings, and to explore the plausibility of providing more cues from different modalities with systems in information gathering.
arXiv Detail & Related papers (2022-04-29T17:56:59Z) - "How Robust r u?": Evaluating Task-Oriented Dialogue Systems on Spoken
Conversations [87.95711406978157]
This work presents a new benchmark on spoken task-oriented conversations.
We study multi-domain dialogue state tracking and knowledge-grounded dialogue modeling.
Our data set enables speech-based benchmarking of task-oriented dialogue systems.
arXiv Detail & Related papers (2021-09-28T04:51:04Z) - Dialogue History Matters! Personalized Response Selectionin Multi-turn
Retrieval-based Chatbots [62.295373408415365]
We propose a personalized hybrid matching network (PHMN) for context-response matching.
Our contributions are two-fold: 1) our model extracts personalized wording behaviors from user-specific dialogue history as extra matching information.
We evaluate our model on two large datasets with user identification, i.e., personalized dialogue Corpus Ubuntu (P- Ubuntu) and personalized Weibo dataset (P-Weibo)
arXiv Detail & Related papers (2021-03-17T09:42:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.