ELLA: Generative AI-Powered Social Robots for Early Language Development at Home

• URL: http://arxiv.org/abs/2603.12508v1
• Date: Thu, 12 Mar 2026 22:55:54 GMT
• Title: ELLA: Generative AI-Powered Social Robots for Early Language Development at Home
• Abstract summary: Early language development shapes children's later literacy and learning, yet many families have limited access to scalable, high-quality support at home.<n>Recent advances in generative AI make it possible for social robots to move beyond scripted interactions and engage children in adaptive, conversational activities.<n>We present ELLA, an autonomous, generative AI-powered social robot that supports early language development through interactive storytelling, parent-selected language targets, and scaffolded dialogue.
• Score: 3.9448539148953405
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Early language development shapes children's later literacy and learning, yet many families have limited access to scalable, high-quality support at home. Recent advances in generative AI make it possible for social robots to move beyond scripted interactions and engage children in adaptive, conversational activities, but it remains unclear how to design such systems for pre-schoolers and how children engage with them over time in the home. We present ELLA (Early Language Learning Agent), an autonomous, generative AI-powered social robot that supports early language development through interactive storytelling, parent-selected language targets, and scaffolded dialogue. Using a multi-phased, human-centered process, we interviewed parents (n=7) and educators (n=5) and iteratively refined ELLA through twelve in-home design workshops. We then deployed ELLA with ten children for eight days. We report design insights from in-home workshops, characterize children's engagement and behaviors during deployment, and distill design implications for generative AI-powered social robots supporting early language learning at home.

Related papers

• Leveraging Large Language Models for Robot-Assisted Learning of Morphological Structures in Preschool Children with Language Vulnerabilities [0.0]
  Speech-language therapists embed morphological structures into everyday interactions or game-based learning activities.<n>This approach demands precise linguistic knowledge and real-time production of various morphological forms.<n>In the TalBot project our multiprofessional team have developed an application in which the Furhat conversational robot plays the word retrieval game "Alias" with children to improve language skills.
  arXiv  Detail & Related papers  (2025-09-26T12:48:51Z)
• Robots and Children that Learn Together : Improving Knowledge Retention by Teaching Peer-Like Interactive Robots [41.94295877935867]
  This study introduces Interactive Reinforcement Learning as a cognitive model for teachable social robots.<n>Children in the LbT condition achieved significantly higher retention gains compared to those in the self-practice condition.<n>This work makes two contributions: (1) it introduces Interactive RL as a pedagogically effective and scalable model for peer-robot learning, and (2) it demonstrates, for the first time, the feasibility of deploying multiple autonomous robots simultaneously in real classrooms.
  arXiv  Detail & Related papers  (2025-06-23T07:51:04Z)
• Advancing Social Intelligence in AI Agents: Technical Challenges and Open Questions [67.60397632819202]
  Building socially-intelligent AI agents (Social-AI) is a multidisciplinary, multimodal research goal. We identify a set of underlying technical challenges and open questions for researchers across computing communities to advance Social-AI.
  arXiv  Detail & Related papers  (2024-04-17T02:57:42Z)
• Distributed agency in second language learning and teaching through generative AI [0.0]
  ChatGPT can provide informal second language practice through chats in written or voice forms. Instructors can use AI to build learning and assessment materials in a variety of media.
  arXiv  Detail & Related papers  (2024-03-29T14:55:40Z)
• Exploring Parent's Needs for Children-Centered AI to Support Preschoolers' Interactive Storytelling and Reading Activities [52.828843153565984]
  AI-based storytelling and reading technologies are becoming increasingly ubiquitous in preschoolers' lives. This paper investigates how they function in practical storytelling and reading scenarios and, how parents, the most critical stakeholders, experience and perceive them. Our findings suggest that even though AI-based storytelling and reading technologies provide more immersive and engaging interaction, they still cannot meet parents' expectations due to a series of interactive and algorithmic challenges.
  arXiv  Detail & Related papers  (2024-01-24T20:55:40Z)
• Developing Social Robots with Empathetic Non-Verbal Cues Using Large Language Models [2.5489046505746704]
  We design and label four types of empathetic non-verbal cues, abbreviated as SAFE: Speech, Action (gesture), Facial expression, and Emotion, in a social robot. Preliminary results show distinct patterns in the robot's responses, such as a preference for calm and positive social emotions like 'joy' and 'lively', and frequent nodding gestures. Our work lays the groundwork for future studies on human-robot interactions, emphasizing the essential role of both verbal and non-verbal cues in creating social and empathetic robots.
  arXiv  Detail & Related papers  (2023-08-31T08:20:04Z)
• WALL-E: Embodied Robotic WAiter Load Lifting with Large Language Model [92.90127398282209]
  This paper investigates the potential of integrating the most recent Large Language Models (LLMs) and existing visual grounding and robotic grasping system. We introduce the WALL-E (Embodied Robotic WAiter load lifting with Large Language model) as an example of this integration. We deploy this LLM-empowered system on the physical robot to provide a more user-friendly interface for the instruction-guided grasping task.
  arXiv  Detail & Related papers  (2023-08-30T11:35:21Z)
• Computational Language Acquisition with Theory of Mind [84.2267302901888]
  We build language-learning agents equipped with Theory of Mind (ToM) and measure its effects on the learning process. We find that training speakers with a highly weighted ToM listener component leads to performance gains in our image referential game setting.
  arXiv  Detail & Related papers  (2023-03-02T18:59:46Z)
• Social Assistive Robotics for Autistic Children [56.524774292536264]
  The goal of the project is testing autistic children's interactions with the social robot NAO. The innovative aspect of the project is that the children robot interaction will consider the children's emotions and specific features.
  arXiv  Detail & Related papers  (2022-09-25T18:28:19Z)
• SocialAI: Benchmarking Socio-Cognitive Abilities in Deep Reinforcement Learning Agents [23.719833581321033]
  Building embodied autonomous agents capable of participating in social interactions with humans is one of the main challenges in AI. We argue that aiming towards human-level AI requires a broader set of key social skills. We present SocialAI, a benchmark to assess the acquisition of social skills of DRL agents.
  arXiv  Detail & Related papers  (2021-07-02T10:39:18Z)
• Self-supervised reinforcement learning for speaker localisation with the iCub humanoid robot [58.2026611111328]
  Looking at a person's face is one of the mechanisms that humans rely on when it comes to filtering speech in noisy environments. Having a robot that can look toward a speaker could benefit ASR performance in challenging environments. We propose a self-supervised reinforcement learning-based framework inspired by the early development of humans.
  arXiv  Detail & Related papers  (2020-11-12T18:02:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.