ROBUST: 221 Bugs in the Robot Operating System

• URL: http://arxiv.org/abs/2404.03629v1
• Date: Thu, 4 Apr 2024 17:49:38 GMT
• Title: ROBUST: 221 Bugs in the Robot Operating System
• Authors: Christopher S. Timperley, Gijs van der Hoorn, André Santos, Harshavardhan Deshpande, Andrzej Wąsowski,
• Abstract summary: We systematically curated a dataset of 221 bugs across 7 popular and diverse software systems. We produce historically accurate recreations of each of the 221 defective software versions in the form of Docker images. We use a grounded theory approach to examine and categorize their corresponding faults, failures, and fixes.
• Score: 0.256557617522405
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: As robotic systems such as autonomous cars and delivery drones assume greater roles and responsibilities within society, the likelihood and impact of catastrophic software failure within those systems is increased.To aid researchers in the development of new methods to measure and assure the safety and quality of robotics software, we systematically curated a dataset of 221 bugs across 7 popular and diverse software systems implemented via the Robot Operating System (ROS). We produce historically accurate recreations of each of the 221 defective software versions in the form of Docker images, and use a grounded theory approach to examine and categorize their corresponding faults, failures, and fixes. Finally, we reflect on the implications of our findings and outline future research directions for the community.

Related papers

• An Empirical Study of Interaction Bugs in ROS-based Software [27.942783950657166]
  This work presents an empirical study of interaction bugs (iBugs) within robotic systems built using the Robot Operating System (ROS)<n>The identified iBugs are categorized into three major types: intra-system iBugs, hardware iBugs, and environmental iBugs.<n>Several findingsa are derived that shed light on the nature of iBugs and suggest directions for improving their prevention and detection.
  arXiv  Detail & Related papers  (2025-07-14T12:56:24Z)
• Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Robotics [70.93622520400385]
  This paper systematically quantifies the robustness of VLA-based robotic systems. We introduce an untargeted position-aware attack objective that leverages spatial foundations to destabilize robotic actions. We also design an adversarial patch generation approach that places a small, colorful patch within the camera's view, effectively executing the attack in both digital and physical environments.
  arXiv  Detail & Related papers  (2024-11-18T01:52:20Z)
• A Retrospective on the Robot Air Hockey Challenge: Benchmarking Robust, Reliable, and Safe Learning Techniques for Real-world Robotics [53.33976793493801]
  We organized the Robot Air Hockey Challenge at the NeurIPS 2023 conference. We focus on practical challenges in robotics, such as the sim-to-real gap, low-level control issues, safety problems, real-time requirements, and the limited availability of real-world data. Results show that solutions combining learning-based approaches with prior knowledge outperform those relying solely on data when real-world deployment is challenging.
  arXiv  Detail & Related papers  (2024-11-08T17:20:47Z)
• Multi-Task Interactive Robot Fleet Learning with Visual World Models [25.001148860168477]
  Sirius-Fleet is a multi-task interactive robot fleet learning framework. It monitors robot performance during deployment and involves humans to correct the robot's actions when necessary. As the robot autonomy improves, anomaly predictors automatically adapt their prediction criteria.
  arXiv  Detail & Related papers  (2024-10-30T04:49:39Z)
• Commonsense Reasoning for Legged Robot Adaptation with Vision-Language Models [81.55156507635286]
  Legged robots are physically capable of navigating a diverse variety of environments and overcoming a wide range of obstructions. Current learning methods often struggle with generalization to the long tail of unexpected situations without heavy human supervision. We propose a system, VLM-Predictive Control (VLM-PC), combining two key components that we find to be crucial for eliciting on-the-fly, adaptive behavior selection.
  arXiv  Detail & Related papers  (2024-07-02T21:00:30Z)
• Runtime Verification and Field-based Testing for ROS-based Robotic Systems [8.675312581079039]
  No clear guidance exists for architecting ROS-based systems to enable runtime verification and field-based testing. This paper aims to fill this gap by providing guidelines to help developers and quality assurance (QA) teams develop, verify, or test their robots in the field.
  arXiv  Detail & Related papers  (2024-04-17T15:52:29Z)
• Highlighting the Safety Concerns of Deploying LLMs/VLMs in Robotics [54.57914943017522]
  We highlight the critical issues of robustness and safety associated with integrating large language models (LLMs) and vision-language models (VLMs) into robotics applications.
  arXiv  Detail & Related papers  (2024-02-15T22:01:45Z)
• Software Engineering for Robotics: Future Research Directions; Report from the 2023 Workshop on Software Engineering for Robotics [0.0]
  Software Engineering for Robotics was held in Detroit, Michigan in October 2023. The goal of the workshop was to bring together thought leaders across robotics and software engineering to coalesce a community. This report serves to summarize the motivation, activities, and findings of that workshop.
  arXiv  Detail & Related papers  (2024-01-22T19:21:44Z)
• Self-Recovery Prompting: Promptable General Purpose Service Robot System with Foundation Models and Self-Recovery [1.2900354046626057]
  A general-purpose service robot (GPSR) can execute diverse tasks in various environments. We first developed a top-level GPSR system for worldwide competition (RoboCup@Home 2023) based on multiple foundation models. We propose the self-recovery prompting pipeline, which explores the necessary information and modifies its prompts to recover from failure.
  arXiv  Detail & Related papers  (2023-09-25T18:00:03Z)
• Revisiting the Adversarial Robustness-Accuracy Tradeoff in Robot Learning [121.9708998627352]
  Recent work has shown that, in practical robot learning applications, the effects of adversarial training do not pose a fair trade-off. This work revisits the robustness-accuracy trade-off in robot learning by analyzing if recent advances in robust training methods and theory can make adversarial training suitable for real-world robot applications.
  arXiv  Detail & Related papers  (2022-04-15T08:12:15Z)
• Learning the Noise of Failure: Intelligent System Tests for Robots [1.713291434132985]
  We propose a simulated noise estimate for the detection of failures in automated system tests of robots. The technique may empower real-world automated system tests without human evaluation of success or failure.
  arXiv  Detail & Related papers  (2021-02-16T11:06:45Z)
• AURSAD: Universal Robot Screwdriving Anomaly Detection Dataset [80.6725125503521]
  This report describes a dataset created using a UR3e series robot and OnRobot Screwdriver. The resulting data contains 2042 samples of normal and anomalous robot operation. Brief ML benchmarks using this data are also provided, showcasing the data's suitability and potential for further analysis and experimentation.
  arXiv  Detail & Related papers  (2021-02-02T09:59:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.