With the increasing interconnection of smart devices, users often desire to adopt the same app on quite different devices for identical tasks, such as watching the same movies on both their smartphones and TVs. However, the significant differences in screen size, aspect ratio, and interaction styles make it challenging to adapt Graphical User Interfaces (GUIs) across these devices. Although there are millions of apps available on Google Play, only a few thousand are designed to support smart TV displays. Existing techniques to map a mobile app GUI to a TV either adopt a responsive design, which struggles to bridge the substantial gap between phone and TV or use mirror apps for improved video display, which requires hardware support and extra engineering efforts. Instead of developing another app for supporting TVs, we propose a semi-automated approach to generate corresponding adaptive TV GUIs, given the phone GUIs as the input. Based on our empirical study of GUI pairs for TVs and phones in existing apps, we synthesize a list of rules for grouping and classifying phone GUIs, converting them to TV GUIs, and generating dynamic TV layouts and source code for the TV display. Our tool is not only beneficial to developers but also to GUI designers, who can further customize the generated GUIs for their TV app development. An evaluation and user study demonstrate the accuracy of our generated GUIs and the usefulness of our tool.
翻译:随着智能设备的互联日益增强,用户常希望在差异较大的设备上使用同一应用完成相同任务,例如在智能手机和电视上观看同一部电影。然而,屏幕尺寸、宽高比和交互方式的显著差异使得图形用户界面(GUI)在这些设备间的适配面临挑战。尽管Google Play上有数百万应用,但仅有数千款专为智能电视显示设计。现有将手机应用GUI映射到电视的技术要么采用响应式设计——难以弥合手机与电视的巨大差异,要么通过镜像应用改进视频显示——这需要硬件支持及额外工程投入。我们提出一种半自动化方法,无需为电视开发新应用,而是以手机GUI为输入,自动生成对应的自适应电视GUI。基于对现有应用中电视和手机GUI配对的经验研究,我们综合制定了一组规则:用于手机GUI分组分类、将其转换为电视GUI,并生成动态电视布局和电视显示源码。我们的工具不仅对开发者有益,GUI设计师也可进一步定制生成的GUI以开发电视应用。评估和用户研究证明了生成GUI的准确性及工具的实用性。