This paper reports the results of the deployment of Rich-State Simulated Populations at Meta for both automated and manual testing. We use simulated users (aka test users) to mimic user interactions and acquire state in much the same way that real user accounts acquire state. For automated testing, we present empirical results from deployment on the Facebook, Messenger, and Instagram apps for iOS and Android Platforms. These apps consist of tens of millions of lines of code, communicating with hundreds of millions of lines of backend code, and are used by over 2 billion people every day. Our results reveal that rich state increases average code coverage by 38\%, and endpoint coverage by 61\%. More importantly, it also yields an average increase of 115\% in the faults found by automated testing. The rich-state test user populations are also deployed in a (continually evolving) Test Universe; a web-enabled simulation platform for privacy-safe manual testing, which has been used by over 21,000 Meta engineers since its deployment in November 2022.

翻译：本文报告了Meta公司在自动化测试和手动测试中部署富状态模拟群体的结果。我们使用模拟用户（即测试用户）来模拟用户交互并获取状态，其方式与真实用户账户获取状态基本相同。在自动化测试方面，我们展示了在Facebook、Messenger和Instagram应用的iOS与Android平台上部署的实证结果。这些应用包含数千万行代码，与数亿行后端代码通信，每天被超过20亿用户使用。我们的结果表明，富状态使平均代码覆盖率提高了38%，端点覆盖率提高了61%。更重要的是，它还使自动化测试发现的故障数量平均增加了115%。富状态测试用户群体还被部署在一个（持续演进的）测试宇宙平台中，这是一个支持隐私保护手动测试的Web模拟平台，自2022年11月部署以来已被超过21,000名Meta工程师使用。