A wearable sensor vest for social humanoid robots with GPGPU, IoT, and modular software architecture

• URL: http://arxiv.org/abs/2201.02192v1
• Date: Thu, 6 Jan 2022 18:57:35 GMT
• Title: A wearable sensor vest for social humanoid robots with GPGPU, IoT, and modular software architecture
• Authors: Mohsen Jafarzadeh, Stephen Brooks, Shimeng Yu, Balakrishnan Prabhakaran, Yonas Tadesse
• Abstract summary: Currently, most social robots interact with their surroundings and humans through sensors that are integral parts of the robots. This article presents an affordable wearable sensor vest, and an open-source software architecture with the Internet of Things (IoT) for social humanoid robots. The vest consists of touch, temperature, gesture, distance, vision sensors, and a wireless communication module.
• Score: 6.494259505776372
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Currently, most social robots interact with their surroundings and humans through sensors that are integral parts of the robots, which limits the usability of the sensors, human-robot interaction, and interchangeability. A wearable sensor garment that fits many robots is needed in many applications. This article presents an affordable wearable sensor vest, and an open-source software architecture with the Internet of Things (IoT) for social humanoid robots. The vest consists of touch, temperature, gesture, distance, vision sensors, and a wireless communication module. The IoT feature allows the robot to interact with humans locally and over the Internet. The designed architecture works for any social robot that has a general-purpose graphics processing unit (GPGPU), I2C/SPI buses, Internet connection, and the Robotics Operating System (ROS). The modular design of this architecture enables developers to easily add/remove/update complex behaviors. The proposed software architecture provides IoT technology, GPGPU nodes, I2C and SPI bus mangers, audio-visual interaction nodes (speech to text, text to speech, and image understanding), and isolation between behavior nodes and other nodes. The proposed IoT solution consists of related nodes in the robot, a RESTful web service, and user interfaces. We used the HTTP protocol as a means of two-way communication with the social robot over the Internet. Developers can easily edit or add nodes in C, C++, and Python programming languages. Our architecture can be used for designing more sophisticated behaviors for social humanoid robots.

Related papers

• GRUtopia: Dream General Robots in a City at Scale [65.08318324604116]
  This paper introduces project GRUtopia, the first simulated interactive 3D society designed for various robots. GRScenes includes 100k interactive, finely annotated scenes, which can be freely combined into city-scale environments. GRResidents is a Large Language Model (LLM) driven Non-Player Character (NPC) system that is responsible for social interaction.
  arXiv  Detail & Related papers  (2024-07-15T17:40:46Z)
• Unifying 3D Representation and Control of Diverse Robots with a Single Camera [48.279199537720714]
  We introduce Neural Jacobian Fields, an architecture that autonomously learns to model and control robots from vision alone. Our approach achieves accurate closed-loop control and recovers the causal dynamic structure of each robot.
  arXiv  Detail & Related papers  (2024-07-11T17:55:49Z)
• RoboScript: Code Generation for Free-Form Manipulation Tasks across Real and Simulation [77.41969287400977]
  This paper presents textbfRobotScript, a platform for a deployable robot manipulation pipeline powered by code generation. We also present a benchmark for a code generation benchmark for robot manipulation tasks in free-form natural language. We demonstrate the adaptability of our code generation framework across multiple robot embodiments, including the Franka and UR5 robot arms.
  arXiv  Detail & Related papers  (2024-02-22T15:12:00Z)
• Cybersecurity and Embodiment Integrity for Modern Robots: A Conceptual Framework [3.29295880899738]
  We show how cyberattacks on different devices can have radically different consequences on the robot's ability to complete its tasks. We also claim that modern robots should have self-awareness for what it concerns such aspects. We show that achieving these propositions requires that robots possess at least three properties that conceptually link devices and tasks.
  arXiv  Detail & Related papers  (2024-01-15T15:46:38Z)
• Singing the Body Electric: The Impact of Robot Embodiment on User Expectations [7.408858358967414]
  Users develop mental models of robots to conceptualize what kind of interactions they can have with those robots. conceptualizations are often formed before interactions with the robot and are based only on observing the robot's physical design. We propose to use multimodal features of robot embodiments to predict what kinds of expectations users will have about a given robot's social and physical capabilities.
  arXiv  Detail & Related papers  (2024-01-13T04:42:48Z)
• Who's in Charge? Roles and Responsibilities of Decision-Making Components in Conversational Robots [3.7311680121118345]
  We reflect on the organization of decision modules in human-robot interaction platforms. We show that most practical HRI architectures tend to be either robot-centric or dialogue-centric. We contend that architectures placing action managers'' and interaction managers'' on an equal footing may provide the best path forward for future human-robot interaction systems.
  arXiv  Detail & Related papers  (2023-03-15T09:18:32Z)
• ROS-PyBullet Interface: A Framework for Reliable Contact Simulation and Human-Robot Interaction [17.093672006793984]
  We present the ROS-PyBullet Interface, a framework that provides a bridge between the reliable contact/impact simulator PyBullet and the Robot Operating System (ROS) Furthermore, we provide additional utilities for facilitating Human-Robot Interaction (HRI) in the simulated environment.
  arXiv  Detail & Related papers  (2022-10-13T10:31:36Z)
• Interaction Replica: Tracking Human-Object Interaction and Scene Changes From Human Motion [48.982957332374866]
  Modeling changes caused by humans is essential for building digital twins. Our method combines visual localization of humans in the scene with contact-based reasoning about human-scene interactions from IMU data. Our code, data and model are available on our project page at http://virtualhumans.mpi-inf.mpg.de/ireplica/.
  arXiv  Detail & Related papers  (2022-05-05T17:58:06Z)
• DEVI: Open-source Human-Robot Interface for Interactive Receptionist Systems [0.8972186395640678]
  "DEVI" is an open-source robot receptionist intelligence core. This paper presents details on a prototype implementation of a physical robot using DEVI. Experiments conducted with DEVI show the effectiveness of the proposed system.
  arXiv  Detail & Related papers  (2021-01-02T17:08:20Z)
• OpenBot: Turning Smartphones into Robots [95.94432031144716]
  Current robots are either expensive or make significant compromises on sensory richness, computational power, and communication capabilities. We propose to leverage smartphones to equip robots with extensive sensor suites, powerful computational abilities, state-of-the-art communication channels, and access to a thriving software ecosystem. We design a small electric vehicle that costs $50 and serves as a robot body for standard Android smartphones.
  arXiv  Detail & Related papers  (2020-08-24T18:04:50Z)
• Joint Mind Modeling for Explanation Generation in Complex Human-Robot Collaborative Tasks [83.37025218216888]
  We propose a novel explainable AI (XAI) framework for achieving human-like communication in human-robot collaborations. The robot builds a hierarchical mind model of the human user and generates explanations of its own mind as a form of communications. Results show that the generated explanations of our approach significantly improves the collaboration performance and user perception of the robot.
  arXiv  Detail & Related papers  (2020-07-24T23:35:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.