With the increasing interconnection of smart devices, users often desire to adopt the same app on quite different devices for identical tasks, such as watching the same movies on both their smartphones and TV. However, the significant differences in screen size, aspect ratio, and interaction styles make it challenging to adapt Graphical User Interfaces (GUIs) across these devices. Although there are millions of apps available on Google Play, only a few thousand are designed to support smart TV displays. Existing techniques to map a mobile app GUI to a TV either adopt a responsive design, which struggles to bridge the substantial gap between phone and TV or use mirror apps for improved video display, which requires hardware support and extra engineering efforts. Instead of developing another app for supporting TVs, we propose a semi-automated approach to generate corresponding adaptive TV GUIs, given the phone GUIs as the input. Based on our empirical study of GUI pairs for TV and phone in existing apps, we synthesize a list of rules for grouping and classifying phone GUIs, converting them to TV GUIs, and generating dynamic TV layouts and source code for the TV display. Our tool is not only beneficial to developers but also to GUI designers, who can further customize the generated GUIs for their TV app development. An evaluation and user study demonstrate the accuracy of our generated GUIs and the usefulness of our tool.
翻译:随着智能设备互联程度的日益加深,用户经常希望在不同设备上使用相同的应用程序完成相同任务,例如在智能手机和电视上观看同一部电影。然而,屏幕尺寸、宽高比和交互方式的显著差异使得在这些设备间适配图形用户界面充满挑战。尽管Google Play上有数百万个应用,但仅有数千个被设计为支持智能电视显示。现有将手机应用界面映射到电视的技术要么采用响应式设计,但难以弥合手机与电视之间的巨大差异;要么使用镜像应用改善视频显示,但这需要硬件支持和额外的工程投入。我们并未为电视开发另一个应用程序,而是提出了一种半自动化方法,以手机图形用户界面为输入,自动生成对应的自适应电视图形用户界面。基于对现有应用中电视与手机界面配对的实证研究,我们综合了一系列规则,用于对手机界面进行分组与分类、将其转换为电视界面,并生成动态电视布局及电视显示的源代码。我们的工具不仅对开发者有益,图形用户界面设计师也可进一步定制生成的界面以开发电视应用。评估与用户研究证明了我们生成界面的准确性及工具的实用性。