Locating a specific mobile application screen from existing repositories is restricted to basic keyword searches, such as Google Image Search, or necessitates a complete query screen image, as in the case of Swire. However, interactive partial sketch-based solutions like PSDoodle have limitations, including inaccuracy and an inability to consider text appearing on the screen. A potentially effective solution involves implementing a system that provides interactive partial sketching functionality for efficiently structuring user interface elements. Additionally, the system should incorporate text queries to enhance its capabilities further. Our approach, TpD, represents the pioneering effort to enable an iterative search of screens by combining interactive sketching and keyword search techniques. TpD is built on a combination of the Rico repository of approximately 58k Android app screens and the PSDoodle. Our evaluation with third-party software developers showed that PSDoodle provided higher top-10 screen retrieval accuracy than state-of-the-art Swire and required less time to complete a query than other interactive solutions.

翻译：从现有存储库中定位特定的移动应用程序屏幕目前仅局限于基础关键词搜索（如谷歌图片搜索），或需要完整的查询屏幕图像（如Swire）。然而，基于交互式部分草图的方法（如PSDoodle）存在局限性，包括不准确以及无法考虑屏幕上的文本信息。一种潜在的有效解决方案是实施一个系统，该系统提供交互式部分草图绘制功能，以高效结构化用户界面元素，并集成文本查询以进一步增强其能力。我们的方法TpD首次实现了通过结合交互式草绘和关键词搜索技术进行迭代式屏幕搜索。TpD基于包含约5.8万个安卓应用屏幕的Rico存储库与PSDoodle构建。第三方软件开发者的评估表明，PSDoodle在屏幕检索前10名准确率上优于最先进的Swire，且完成查询所需时间少于其他交互式解决方案。