Adaptive Multimodal and Multisensory Empathic Technologies for Enhanced Human Communication

• URL: http://arxiv.org/abs/2110.15054v1
• Date: Sun, 24 Oct 2021 16:50:37 GMT
• Title: Adaptive Multimodal and Multisensory Empathic Technologies for Enhanced Human Communication
• Authors: Roxana Girju
• Abstract summary: I believe developments must consider a principled framework that includes the human perceptual senses in the digital design process right from the start. I suggest features, identify some challenges that need to be addressed in the process, and propose some future research directions that I think should be part of the design and implementation.
• Score: 0.40611352512781856
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: As digital social platforms and mobile technologies are becoming more prevalent and robust, the use of Artificial Intelligence (AI) in facilitating human communication will grow. This, in turn, will pave the way for the development of intuitive, adaptive, and effective empathic AI interfaces that better address the needs of socially and culturally diverse communities. I believe such developments must consider a principled framework that includes the human perceptual senses in the digital design process right from the start, for a more accurate, as well as a more aesthetic, memorable, and soothing experience. In this position paper, I suggest features, identify some challenges that need to be addressed in the process, and propose some future research directions that I think should be part of the design and implementation. Such an approach will allow various communities of practice to investigate the areas of intersection between artificial intelligence, on one side, and human communication, perceptual needs and social and cultural values, on the other.

Related papers

• Multimodal Fusion with LLMs for Engagement Prediction in Natural Conversation [70.52558242336988]
  We focus on predicting engagement in dyadic interactions by scrutinizing verbal and non-verbal cues, aiming to detect signs of disinterest or confusion. In this work, we collect a dataset featuring 34 participants engaged in casual dyadic conversations, each providing self-reported engagement ratings at the end of each conversation. We introduce a novel fusion strategy using Large Language Models (LLMs) to integrate multiple behavior modalities into a multimodal transcript''
  arXiv  Detail & Related papers  (2024-09-13T18:28:12Z)
• Social Skill Training with Large Language Models [65.40795606463101]
  People rely on social skills like conflict resolution to communicate effectively and to thrive in both work and personal life. This perspective paper identifies social skill barriers to enter specialized fields. We present a solution that leverages large language models for social skill training via a generic framework.
  arXiv  Detail & Related papers  (2024-04-05T16:29:58Z)
• On the Emergence of Symmetrical Reality [51.21203247240322]
  We introduce the symmetrical reality framework, which offers a unified representation encompassing various forms of physical-virtual amalgamations. We propose an instance of an AI-driven active assistance service that illustrates the potential applications of symmetrical reality.
  arXiv  Detail & Related papers  (2024-01-26T16:09:39Z)
• Towards More Human-like AI Communication: A Review of Emergent Communication Research [0.0]
  Emergent communication (Emecom) is a field of research aiming to develop artificial agents capable of using natural language. In this review, we delineate all the common proprieties we find across the literature and how they relate to human interactions. We identify two subcategories and highlight their characteristics and open challenges.
  arXiv  Detail & Related papers  (2023-08-01T14:43:10Z)
• Human-AI Coevolution [48.74579595505374]
  Coevolution AI is a process in which humans and AI algorithms continuously influence each other. This paper introduces Coevolution AI as the cornerstone for a new field of study at the intersection between AI and complexity science.
  arXiv  Detail & Related papers  (2023-06-23T18:10:54Z)
• Toward Artificial Empathy for Human-Centered Design: A Framework [7.807713821263175]
  This paper provides insights from artificial intelligence research to indicate the future direction of AI-driven human-centered design. We discuss the role that artificial empathy can play in human-centered design and propose an artificial empathy framework for human-centered design.
  arXiv  Detail & Related papers  (2023-03-19T06:09:52Z)
• ERUDITE: Human-in-the-Loop IoT for an Adaptive Personalized Learning System [14.413929652259469]
  This paper proposes ERUDITE, a human-in-the-loop IoT system for the learning environment. By using the brain signals as a sensor modality to infer the human learning state, ERUDITE provides personalized adaptation to the learning environment.
  arXiv  Detail & Related papers  (2023-03-07T23:54:35Z)
• Mind the Gap! Bridging Explainable Artificial Intelligence and Human Understanding with Luhmann's Functional Theory of Communication [5.742215677251865]
  We apply social systems theory to highlight challenges in explainable artificial intelligence. We aim to reinvigorate the technical research in the direction of interactive and iterative explainers.
  arXiv  Detail & Related papers  (2023-02-07T13:31:02Z)
• Data-driven emotional body language generation for social robotics [58.88028813371423]
  In social robotics, endowing humanoid robots with the ability to generate bodily expressions of affect can improve human-robot interaction and collaboration. We implement a deep learning data-driven framework that learns from a few hand-designed robotic bodily expressions. The evaluation study found that the anthropomorphism and animacy of the generated expressions are not perceived differently from the hand-designed ones.
  arXiv  Detail & Related papers  (2022-05-02T09:21:39Z)
• Needs and Artificial Intelligence [0.0]
  We reflect on the relationship between needs and AI, and call for the realisation of needs-aware AI systems. We discuss some of the most critical gaps, barriers, enablers, and drivers of co-creating future AI-based socio-technical systems.
  arXiv  Detail & Related papers  (2022-02-18T15:16:22Z)
• Machine Common Sense [77.34726150561087]
  Machine common sense remains a broad, potentially unbounded problem in artificial intelligence (AI) This article deals with the aspects of modeling commonsense reasoning focusing on such domain as interpersonal interactions.
  arXiv  Detail & Related papers  (2020-06-15T13:59:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.