AI tools like ChatGPT and Be-My-AI are increasingly being used by blind individuals. Although prior work has explored their use in some Do-It-Yourself (DIY) tasks by blind individuals, little is known about how they use these tools and the available product-manual resources to assemble, operate, and troubleshoot physical or tangible products - tasks requiring spatial reasoning, structural understanding, and precise execution. We address this knowledge gap via an interview study and a usability study with blind participants, investigating how they leverage AI tools and product manuals for DIY tasks with physical products. Findings show that manuals are essential resources, but product-manual instructions are often inadequate for blind users. AI tools presently do not adequately address this insufficiency; in fact, we observed that they often exacerbate this issue with incomplete, incoherent, or misleading guidance. Lastly, we suggest improvements to AI tools for generating tailored instructions for blind users' DIY tasks involving tangible products.
翻译:ChatGPT和Be-My-AI等AI工具正日益被视障人士所使用。尽管先前的研究已探讨过视障人士在某些DIY任务中对这些工具的应用,但关于他们如何利用这些工具及现有产品手册资源来完成实体或有形产品的组装、操作和故障排除——这些需要空间推理、结构理解和精确执行的任务——我们知之甚少。我们通过访谈研究和可用性研究,与视障参与者一起,探讨了他们如何利用AI工具和产品手册进行实体产品的DIY任务,以弥补这一知识空白。研究结果表明,手册是必不可少的资源,但产品手册中的说明往往对视障用户而言并不充分。目前,AI工具未能充分解决这一不足;事实上,我们观察到,它们常常因提供不完整、不连贯或具有误导性的指导而加剧了这一问题。最后,我们提出了改进AI工具的建议,以期为视障用户涉及实体产品的DIY任务生成量身定制的操作指南。