Related papers: SocializeChat: A GPT-Based AAC Tool Grounded in Personal Memories to Support Social Communication

SocializeChat: A GPT-Based AAC Tool Grounded in Personal Memories to Support Social Communication

URL: http://arxiv.org/abs/2510.19017v1
Date: Tue, 21 Oct 2025 18:59:38 GMT
Title: SocializeChat: A GPT-Based AAC Tool Grounded in Personal Memories to Support Social Communication
Authors: Wei Xiang, Yunkai Xu, Yuyang Fang, Zhuyu Teng, Zhaoqu Jiang, Beijia Hu, Jinguo Yang,
Abstract summary: SocializeChat generates sentence suggestions by drawing on users' personal memory records.<n>System reuses past experience and tailors suggestions to different social contexts.<n>A user study shows its potential to enhance the inclusivity and relevance of AAC-supported social interaction.
Score: 9.307700706169515
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Abstract: Elderly people with speech impairments often face challenges in engaging in meaningful social communication, particularly when using Augmentative and Alternative Communication (AAC) tools that primarily address basic needs. Moreover, effective chats often rely on personal memories, which is hard to extract and reuse. We introduce SocializeChat, an AAC tool that generates sentence suggestions by drawing on users' personal memory records. By incorporating topic preference and interpersonal closeness, the system reuses past experience and tailors suggestions to different social contexts and conversation partners. SocializeChat not only leverages past experiences to support interaction, but also treats conversations as opportunities to create new memories, fostering a dynamic cycle between memory and communication. A user study shows its potential to enhance the inclusivity and relevance of AAC-supported social interaction.

Related papers

OP-Bench: Benchmarking Over-Personalization for Memory-Augmented Personalized Conversational Agents [55.27061195244624]
We formalize over-personalization into three types: Irrelevance, Repetition, and Sycophancy.<n>Agents tend to retrieve and over-attend to user memories even when unnecessary.<n>Our work takes an initial step toward more controllable and appropriate personalization in memory-augmented dialogue systems.
arXiv Detail & Related papers (2026-01-20T08:27:13Z)
PaRT: Enhancing Proactive Social Chatbots with Personalized Real-Time Retrieval [31.567993758708393]
PaRT is a novel framework enabling context-aware proactive dialogues for social chatbots through personalized real-time retrieval and generation.<n>Our approach has been running stably in a real-world production environment for more than 30 days, achieving a 21.77% improvement in the average duration of dialogues.
arXiv Detail & Related papers (2025-04-29T10:51:58Z)
SocialMind: LLM-based Proactive AR Social Assistive System with Human-like Perception for In-situ Live Interactions [3.7400236988012105]
SocialMind is the first proactive AR social assistive system that provides users with in-situ social assistance.<n>SocialMind employs human-like perception leveraging multi-modal sensors to extract both verbal and nonverbal cues, social factors, and implicit personas.<n>We show that SocialMind achieves 38.3% higher engagement compared to baselines, and 95% of participants are willing to use SocialMind in their live social interactions.
arXiv Detail & Related papers (2024-12-05T10:19:36Z)
Introducing MeMo: A Multimodal Dataset for Memory Modelling in Multiparty Conversations [1.8896253910986929]
MeMo corpus is the first dataset annotated with participants' memory retention reports. It integrates validated behavioural and perceptual measures, audio, video, and multimodal annotations. This paper aims to pave the way for future research in conversational memory modelling for intelligent system development.
arXiv Detail & Related papers (2024-09-07T16:09:36Z)
From a Social Cognitive Perspective: Context-aware Visual Social Relationship Recognition [59.57095498284501]
We propose a novel approach that recognizes textbfContextual textbfSocial textbfRelationships (textbfConSoR) from a social cognitive perspective. We construct social-aware descriptive language prompts with social relationships for each image. Impressively, ConSoR outperforms previous methods with a 12.2% gain on the People-in-Social-Context (PISC) dataset and a 9.8% increase on the People-in-Photo-Album (PIPA) benchmark.
arXiv Detail & Related papers (2024-06-12T16:02:28Z)
Augmented Conversation with Embedded Speech-Driven On-the-Fly Referencing in AR [16.50212867051533]
This paper introduces the concept of augmented conversation. It aims to support co-located in-person conversations via embedded speech-driven on-the-fly referencing in augmented reality (AR)
arXiv Detail & Related papers (2024-05-28T19:10:47Z)
SpeakEasy: A Conversational Intelligence Chatbot for Enhancing College Students' Communication Skills [0.0]
SpeakEasy attempts to help college students improve their communication skills by engaging in a seven-minute spoken conversation with the user. SpeakEasy converses with the user on a wide assortment of topics that two people meeting for the first time might discuss: travel, sports, and entertainment. Unlike most other chatbots with the goal of improving conversation skills, SpeakEasy actually records the user speaking, transcribes the audio into tokens, and uses macros-e.g., sequences that calculate the pace of speech.
arXiv Detail & Related papers (2023-09-23T17:19:32Z)
CharacterChat: Learning towards Conversational AI with Personalized Social Support [61.20396854093821]
We introduce the Social Support Conversation (S2Conv) framework. It comprises a series of support agents and the interpersonal matching mechanism, linking individuals with persona-compatible virtual supporters. We present CharacterChat, a comprehensive S2Conv system, which includes a conversational model driven by personas and memories.
arXiv Detail & Related papers (2023-08-20T14:24:26Z)
Interactive Conversational Head Generation [68.76774230274076]
We introduce a new conversation head generation benchmark for synthesizing behaviors of a single interlocutor in a face-to-face conversation. The capability to automatically synthesize interlocutors which can participate in long and multi-turn conversations is vital and offer benefits for various applications.
arXiv Detail & Related papers (2023-07-05T08:06:26Z)
Let's Get Personal: Personal Questions Improve SocialBot Performance in the Alexa Prize [0.0]
There has been an increased focus on creating conversational open-domain dialogue systems in the spoken dialogue community. Unlike traditional dialogue systems, these conversational systems cannot assume any specific information need or domain restrictions. We developed a robust open-domain conversational system, Athena, that real Amazon Echo users access and evaluate at scale.
arXiv Detail & Related papers (2023-03-09T00:10:29Z)
FaceChat: An Emotion-Aware Face-to-face Dialogue Framework [58.67608580694849]
FaceChat is a web-based dialogue framework that enables emotionally-sensitive and face-to-face conversations. System has a wide range of potential applications, including counseling, emotional support, and personalized customer service.
arXiv Detail & Related papers (2023-03-08T20:45:37Z)
Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A Survey [71.43956423427397]
We aim to identify the nonverbal cues and computational methodologies resulting in effective performance. This survey differs from its counterparts by involving the widest spectrum of social phenomena and interaction settings. Some major observations are: the most often used nonverbal cue, computational method, interaction environment, and sensing approach are speaking activity, support vector machines, and meetings composed of 3-4 persons equipped with microphones and cameras, respectively.
arXiv Detail & Related papers (2022-07-20T13:37:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.