Testing Real-World Healthcare IoT Application: Experiences and Lessons Learned

• URL: http://arxiv.org/abs/2309.04230v1
• Date: Fri, 8 Sep 2023 09:35:21 GMT
• Title: Testing Real-World Healthcare IoT Application: Experiences and Lessons Learned
• Authors: Hassan Sartaj, Shaukat Ali, Tao Yue, and Kjetil Moberg
• Abstract summary: We report an industrial evaluation of a state-of-the-art REST APIs testing approach (RESTest) on a real-world healthcare IoT application. We analyze the effectiveness of RESTest's testing strategies regarding REST API failures, faults in the application, and REST API coverage.
• Score: 5.126355491416586
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Healthcare Internet of Things (IoT) applications require rigorous testing to ensure their dependability. Such applications are typically integrated with various third-party healthcare applications and medical devices through REST APIs. This integrated network of healthcare IoT applications leads to REST APIs with complicated and interdependent structures, thus creating a major challenge for automated system-level testing. We report an industrial evaluation of a state-of-the-art REST APIs testing approach (RESTest) on a real-world healthcare IoT application. We analyze the effectiveness of RESTest's testing strategies regarding REST APIs failures, faults in the application, and REST API coverage, by experimenting with six REST APIs of 41 API endpoints of the healthcare IoT application. Results show that several failures are discovered in different REST APIs with ~56% coverage using RESTest. Moreover, nine potential faults are identified. Using the evidence collected from the experiments, we provide our experiences and lessons learned.

Related papers

• AutoPT: How Far Are We from the End2End Automated Web Penetration Testing? [54.65079443902714]
  We introduce AutoPT, an automated penetration testing agent based on the principle of PSM driven by LLMs. Our results show that AutoPT outperforms the baseline framework ReAct on the GPT-4o mini model.
  arXiv  Detail & Related papers  (2024-11-02T13:24:30Z)
• REST API Testing in DevOps: A Study on an Evolving Healthcare IoT Application [3.229371159969159]
  This paper evaluates state-of-the-art and well-established REST API testing tools. We conducted experiments using all accessible REST APIs with 120 endpoints. All tools generated tests leading to several failures, 18 potential faults, up to 84% coverage, 23 regressions, and over 80% cost overhead.
  arXiv  Detail & Related papers  (2024-10-16T13:24:42Z)
• Practical, Automated Scenario-based Mobile App Testing [13.52057950260007]
  Test scripts developed by human testers consider business logic by focusing on testing scenarios. Due to the GUI-intensive feature of mobile apps, human testers always understand app GUI to organize test scripts for scenarios. ScenTest tries to start automated testing by imitating human practices and integrating domain knowledge into scenario-based mobile app testing.
  arXiv  Detail & Related papers  (2024-06-12T15:48:39Z)
• COTS: Connected OpenAPI Test Synthesis for RESTful Applications [0.0]
  We introduce a (i) domain-specific language for OpenAPI specifications and (ii) a tool to support our methodology. Our tool, dubbed COTS, generates (randomised) model-based test executions and reports software defects.
  arXiv  Detail & Related papers  (2024-04-30T15:12:31Z)
• Observation-based unit test generation at Meta [52.4716552057909]
  TestGen automatically generates unit tests, carved from serialized observations of complex objects, observed during app execution. TestGen has landed 518 tests into production, which have been executed 9,617,349 times in continuous integration, finding 5,702 faults. Our evaluation reveals that, when carving its observations from 4,361 reliable end-to-end tests, TestGen was able to generate tests for at least 86% of the classes covered by end-to-end tests.
  arXiv  Detail & Related papers  (2024-02-09T00:34:39Z)
• Leveraging Large Language Models to Improve REST API Testing [51.284096009803406]
  RESTGPT takes as input an API specification, extracts machine-interpretable rules, and generates example parameter values from natural-language descriptions in the specification. Our evaluations indicate that RESTGPT outperforms existing techniques in both rule extraction and value generation.
  arXiv  Detail & Related papers  (2023-12-01T19:53:23Z)
• Exploring Behaviours of RESTful APIs in an Industrial Setting [0.43012765978447565]
  We propose a set of behavioural properties, common to REST APIs, which are used to generate examples of behaviours that these APIs exhibit. These examples can be used both (i) to further the understanding of the API and (ii) as a source of automatic test cases. Our approach can generate examples deemed relevant for understanding the system and for a source of test generation by practitioners.
  arXiv  Detail & Related papers  (2023-10-26T11:33:11Z)
• Adaptive REST API Testing with Reinforcement Learning [54.68542517176757]
  Current testing tools lack efficient exploration mechanisms, treating all operations and parameters equally. Current tools struggle when response schemas are absent in the specification or exhibit variants. We present an adaptive REST API testing technique incorporates reinforcement learning to prioritize operations during exploration.
  arXiv  Detail & Related papers  (2023-09-08T20:27:05Z)
• HITA: An Architecture for System-level Testing of Healthcare IoT Applications [5.126355491416586]
  This paper presents a real-world test infrastructure software architecture (HITA) designed for healthcare IoT applications. We evaluate HITA's digital twin (DT) generation component implemented using model-based and machine learning (ML) approaches.
  arXiv  Detail & Related papers  (2023-09-08T09:14:50Z)
• HINT: Hierarchical Interaction Network for Trial Outcome Prediction Leveraging Web Data [56.53715632642495]
  Clinical trials face uncertain outcomes due to issues with efficacy, safety, or problems with patient recruitment. In this paper, we propose Hierarchical INteraction Network (HINT) for more general, clinical trial outcome predictions.
  arXiv  Detail & Related papers  (2021-02-08T15:09:07Z)
• Dynamic Causal Effects Evaluation in A/B Testing with a Reinforcement Learning Framework [68.96770035057716]
  A/B testing is a business strategy to compare a new product with an old one in pharmaceutical, technological, and traditional industries. This paper introduces a reinforcement learning framework for carrying A/B testing in online experiments.
  arXiv  Detail & Related papers  (2020-02-05T10:25:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.