Healthcare Internet of Things (IoT) applications require rigorous testing to ensure their dependability. Such applications are typically integrated with various third-party healthcare applications and medical devices through REST APIs. This integrated network of healthcare IoT applications leads to REST APIs with complicated and interdependent structures, thus creating a major challenge for automated system-level testing. We report an industrial evaluation of a state-of-the-art REST APIs testing approach (RESTest) on a real-world healthcare IoT application. We analyze the effectiveness of RESTest's testing strategies regarding REST APIs failures, faults in the application, and REST API coverage, by experimenting with six REST APIs of 41 API endpoints of the healthcare IoT application. Results show that several failures are discovered in different REST APIs with ~56% coverage using RESTest. Moreover, nine potential faults are identified. Using the evidence collected from the experiments, we provide our experiences and lessons learned.
翻译:医疗物联网应用需要严格测试以确保其可靠性。此类应用通常通过REST API与各类第三方医疗应用及医疗设备集成。这种集成网络导致REST API具有复杂且相互依赖的结构,从而给自动化系统级测试带来了重大挑战。本文报告了一项针对真实世界医疗物联网应用中先进REST API测试方法(RESTest)的工业评估。我们通过实验分析了RESTest测试策略在REST API故障、应用缺陷以及REST API覆盖率方面的有效性,实验涉及该医疗物联网应用中六个包含41个API端点的REST API。结果表明,RESTest能以约56%的覆盖率检测到不同REST API中的多个故障。此外,还识别出九个潜在缺陷。基于实验收集的证据,我们总结了相关经验与教训。