People with lower and upper body disabilities can benefit from wheelchairs and robotic arms to improve mobility and independence. Prior assistive interfaces, such as touchscreens and voice-driven predefined commands, often remain unintuitive and struggle to capture complex user intent. We propose a natural, dialogue based human robot interaction protocol that simulates an intelligent agent capable of communicating with users to understand intent and execute assistive actions. In a pilot study, five participants completed five assistive tasks (cleaning, drinking, feeding, drawer opening, and door opening) through dialogue-based interaction with a wheelchair and robotic arm. As a baseline, participants were required to open a door using the manual control (a wheelchair joystick and a game controller for the arm) and complete a questionnaire to gather their feedback. By analyzing the post-study questionnaires, we found that most participants enjoyed the dialogue-based interaction and assistive robot autonomy.

翻译：下肢与上肢残疾人士可通过轮椅和机械臂提升行动能力与独立性。现有辅助交互界面（如触摸屏及基于语音的预定义指令）往往不够直观，难以捕捉复杂的用户意图。我们提出一种基于对话的自然人机交互协议，该协议模拟了一个能够与用户沟通以理解意图并执行辅助动作的智能体。在一项试点研究中，五名参与者通过基于对话的交互方式，借助轮椅与机械臂完成了五项辅助任务（清洁、饮水、喂食、开抽屉及开门）。作为对照，参与者需使用手动控制方式（轮椅操纵杆与机械臂游戏控制器）完成开门任务，并填写问卷以收集反馈。通过分析研究后问卷，我们发现大多数参与者青睐基于对话的交互方式及辅助机器人的自主性。