Improving Survey Participation in Low-Literacy Populations Through Value-Sensitive Conversational AI
- URL: http://arxiv.org/abs/2606.30660v1
- Date: Tue, 16 Jun 2026 17:06:51 GMT
- Title: Improving Survey Participation in Low-Literacy Populations Through Value-Sensitive Conversational AI
- Abstract summary: We show that convAI significantly improves survey completion rates relative to traditional modalities.<n>These results demonstrate the importance of human-centered and value-sensitive interaction design in enabling inclusive, ethical, and scalable data collection.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Collecting reliable social data from low-literacy populations remains a persistent challenge, particularly when surveys involve sensitive topics and marginalized communities. Traditional paper-based and web-based survey modalities often suffer from high attrition and incomplete responses due to literacy barriers, social pressure, and interactional discomfort. In this paper, we present findings from an initial field evaluation comparing multiple survey modalities paper-based interviews, digital web-based surveys, conversational AI (convAI) surveys, and convAI enhanced with layered value-sensitive design conducted with low-literacy women across India. Using data from 315 participants, we show that convAI significantly improves survey completion rates relative to traditional modalities, with the highest completion and lowest drop-off observed when value-sensitive and culturally aligned conversational design elements are fully integrated. These results demonstrate the importance of human-centered and value-sensitive interaction design in enabling inclusive, ethical, and scalable data collection; motivating more `AI for social good' applications.
Related papers
- Hybrid Panels: Toward Human-AI Collaboration in Survey Research [9.837591528122095]
Large-scale population surveys are essential for generating robust social and scientific insights.<n>Advances in artificial intelligence have opened up new opportunities for AI-supported survey infrastructures.<n>A promising AI-enabled survey infrastructure for which we build a first pilot is a hybrid panel.
arXiv Detail & Related papers (2026-08-23T20:27:48Z) - Intimate Strangers by Design: A Uses and Gratifications Analysis of AI Companionship [0.0]
Conversational AI companions have grown prominent in public discourse, yet scholarly understanding of user experiences remains limited.<n>This study offers three contributions: first, participants reported gratifications mapping onto established Uses and Gratifications (U&G) categories but qualitatively inflected by conversational AI's distinctive affordances.<n>Second, several gratifications, creative collaboration as relational co-production, relational simulation as interpersonal training, do not map onto existing typologies, instead emerging through interactive processes in which users actively simulate experiences with AI.<n>Third, gratifications shifted over time, moving from instrumental entry points toward emotional engagement and
arXiv Detail & Related papers (2026-04-07T19:53:58Z) - Leveraging the Power of AI and Social Interactions to Restore Trust in Public Polls [0.0]
Traditional polling methods have seen a notable decline in engagement over recent decades.<n>Social and peer-to-peer networks have become increasingly widespread, but data from these platforms can suffer from credibility issues.<n>We present an empirical study to detect ineligible participation in a polling task through AI-based graph analysis of social interactions.
arXiv Detail & Related papers (2025-11-10T20:06:32Z) - AI Feedback Enhances Community-Based Content Moderation through Engagement with Counterarguments [0.0]
This study explores an AI-assisted hybrid moderation framework in which participants receive AI-generated feedback on their notes.<n>The results show that incorporating feedback improves the quality of notes, with the most substantial gains resulting from argumentative feedback.<n>The research contributes to ongoing discussions about AI's role in political content moderation.
arXiv Detail & Related papers (2025-07-10T18:52:50Z) - Mind the Gap! Static and Interactive Evaluations of Large Audio Models [55.87220295533817]
Large Audio Models (LAMs) are designed to power voice-native experiences.<n>This study introduces an interactive approach to evaluate LAMs and collect 7,500 LAM interactions from 484 participants.
arXiv Detail & Related papers (2025-02-21T20:29:02Z) - Generative AI for Analyzing Participatory Rural Appraisal Data: An Exploratory Case Study in Gender Research [0.0]
This study explores the novel application of Generative Artificial Intelligence (GenAI) in analyzing unstructured visual data generated through Participatory Rural Appraisal (PRA)<n>Using the "Ideal Village" PRA activity as a case study, we evaluate three state-of-the-art Large Language Models (LLMs) in their ability to interpret hand-drawn artifacts containing multilingual content from various Indian states.<n>Our findings reveal significant challenges in AI's current capabilities to process such unstructured data, particularly in handling multilingual content, maintaining contextual accuracy, and avoiding hallucinations.
arXiv Detail & Related papers (2025-02-02T11:55:52Z) - Surveys Considered Harmful? Reflecting on the Use of Surveys in AI Research, Development, and Governance [21.430179253600308]
We find that public surveys on AI topics are vulnerable to specific Western knowledge, values, and assumptions in their design.
We distill provocations and questions for our community to recognize the limitations of surveys for meeting the goals of engagement.
arXiv Detail & Related papers (2024-07-26T22:10:49Z) - AntEval: Evaluation of Social Interaction Competencies in LLM-Driven
Agents [65.16893197330589]
Large Language Models (LLMs) have demonstrated their ability to replicate human behaviors across a wide range of scenarios.
However, their capability in handling complex, multi-character social interactions has yet to be fully explored.
We introduce the Multi-Agent Interaction Evaluation Framework (AntEval), encompassing a novel interaction framework and evaluation methods.
arXiv Detail & Related papers (2024-01-12T11:18:00Z) - DeSIQ: Towards an Unbiased, Challenging Benchmark for Social
Intelligence Understanding [60.84356161106069]
We study the soundness of Social-IQ, a dataset of multiple-choice questions on videos of complex social interactions.
Our analysis reveals that Social-IQ contains substantial biases, which can be exploited by a moderately strong language model.
We introduce DeSIQ, a new challenging dataset, constructed by applying simple perturbations to Social-IQ.
arXiv Detail & Related papers (2023-10-24T06:21:34Z) - Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A
Survey [71.43956423427397]
We aim to identify the nonverbal cues and computational methodologies resulting in effective performance.
This survey differs from its counterparts by involving the widest spectrum of social phenomena and interaction settings.
Some major observations are: the most often used nonverbal cue, computational method, interaction environment, and sensing approach are speaking activity, support vector machines, and meetings composed of 3-4 persons equipped with microphones and cameras, respectively.
arXiv Detail & Related papers (2022-07-20T13:37:57Z) - Automatic Evaluation and Moderation of Open-domain Dialogue Systems [59.305712262126264]
A long standing challenge that bothers the researchers is the lack of effective automatic evaluation metrics.
This paper describes the data, baselines and results obtained for the Track 5 at the Dialogue System Technology Challenge 10 (DSTC10)
arXiv Detail & Related papers (2021-11-03T10:08:05Z) - Towards Automatic Evaluation of Dialog Systems: A Model-Free Off-Policy
Evaluation Approach [84.02388020258141]
We propose a new framework named ENIGMA for estimating human evaluation scores based on off-policy evaluation in reinforcement learning.
ENIGMA only requires a handful of pre-collected experience data, and therefore does not involve human interaction with the target policy during the evaluation.
Our experiments show that ENIGMA significantly outperforms existing methods in terms of correlation with human evaluation scores.
arXiv Detail & Related papers (2021-02-20T03:29:20Z) - You Impress Me: Dialogue Generation via Mutual Persona Perception [62.89449096369027]
The research in cognitive science suggests that understanding is an essential signal for a high-quality chit-chat conversation.
Motivated by this, we propose P2 Bot, a transmitter-receiver based framework with the aim of explicitly modeling understanding.
arXiv Detail & Related papers (2020-04-11T12:51:07Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.