Recent research has begun to examine the potential of automatically finding and fixing accessibility issues that manifest in software. However, while recent work makes important progress, it has generally been skewed toward identifying issues that affect users with certain disabilities, such as those with visual or hearing impairments. However, there are other groups of users with different types of disabilities that also need software tooling support to improve their experience. As such, this paper aims to automatically identify accessibility issues that affect users with motor-impairments. To move toward this goal, this paper introduces a novel approach, called MotorEase, capable of identifying accessibility issues in mobile app UIs that impact motor-impaired users. Motor-impaired users often have limited ability to interact with touch-based devices, and instead may make use of a switch or other assistive mechanism -- hence UIs must be designed to support both limited touch gestures and the use of assistive devices. MotorEase adapts computer vision and text processing techniques to enable a semantic understanding of app UI screens, enabling the detection of violations related to four popular, previously unexplored UI design guidelines that support motor-impaired users, including: (i) visual touch target size, (ii) expanding sections, (iii) persisting elements, and (iv) adjacent icon visual distance. We evaluate MotorEase on a newly derived benchmark, called MotorCheck, that contains 555 manually annotated examples of violations to the above accessibility guidelines, across 1599 screens collected from 70 applications via a mobile app testing tool. Our experiments illustrate that MotorEase is able to identify violations with an average accuracy of ~90%, and a false positive rate of less than 9%, outperforming baseline techniques.

翻译：近期研究开始探索自动发现并修复软件中可访问性问题的潜力。然而，尽管这些工作取得了重要进展，但整体上仍偏向于识别影响特定残障用户群体（如视觉或听觉障碍者）的问题。而其他类型的残障用户同样需要软件工具支持以改善其使用体验。为此，本文旨在自动识别影响运动障碍用户的移动应用界面可访问性问题。为实现这一目标，本文提出一种名为MotorEase的新方法，能够识别移动应用界面中影响运动障碍用户的可访问性问题。运动障碍用户通常难以有效操作触控设备，转而依赖开关或其他辅助机制，因此界面设计需同时支持有限手势操作与辅助设备使用。MotorEase融合计算机视觉与文本处理技术，实现对应用界面屏幕的语义理解，进而检测四项此前未被探索的、支持运动障碍用户的界面设计准则违规行为，包括：(i) 视觉触摸目标尺寸、(ii) 可展开区域、(iii) 持久化元素、(iv) 相邻图标视觉间距。我们在新构建的基准测试集MotorCheck上评估MotorEase，该数据集包含555个手工标注的上述可访问性准则违规示例，这些示例来自通过移动应用测试工具从70个应用中采集的1599个屏幕截图。实验表明，MotorEase能以约90%的平均准确率和低于9%的误报率识别违规行为，性能优于基线方法。