We present a new model-based approach for testing systems that use sequences of actions and assertions as test vectors. Our solution includes a method for quantifying testing quality, a tool for generating high-quality test suites based on the coverage criteria we propose, and a framework for assessing risks. For testing quality, we propose a method that specifies generalized coverage criteria over sequences of actions, which extends previous approaches. Our publicly available tool demonstrates how to extract effective test suites from test plans based on these criteria. We also present a Bayesian approach for measuring the probabilities of bugs or risks, and show how this quantification can help achieve an informed balance between exploitation and exploration in testing. Finally, we provide an empirical evaluation demonstrating the effectiveness of our tool in finding bugs, assessing risks, and achieving coverage.

翻译：我们提出了一种基于模型的新方法，用于测试以动作序列和断言作为测试向量的系统。我们的解决方案包括一种量化测试质量的方法、基于我们提出的覆盖准则生成高质量测试套件的工具，以及一个风险评估框架。针对测试质量，我们提出了一种指定动作序列上广义覆盖准则的方法，该方法扩展了现有方案。我们公开可用的工具展示了如何基于这些准则从测试计划中提取有效的测试套件。此外，我们提出了一种用于度量缺陷或风险概率的贝叶斯方法，并展示了这种量化如何帮助在测试中的开发与探索之间实现合理平衡。最后，我们通过实证评估证明了该工具在发现缺陷、评估风险和实现覆盖方面的有效性。