The rehabilitation treatment helps to heal minor sports and occupational injuries. In a traditional rehabilitation process, a therapist will assign certain actions to a patient to perform in between hospital visits, and it will rely on the patient to remember actions correctly and the schedule to perform them. Unfortunately, many patients forget to perform actions or fail to recall actions in detail. As a consequence, the rehabilitation treatment is hampered or, in the worst case, the patient may suffer from additional injury caused by performing incorrect actions. To resolve these issues, we propose a HRNet-based rehabilitation monitoring system, which can remind a patient when to perform the actions and display the actions for the patient to follow via the patient's smartphone. In addition, it helps the therapist to monitor the progress of the rehabilitation for the patient. Our system consists of an iOS app and several components at the server side. The app is in charge of displaying and collecting action videos. The server computes the similarity score between the therapist's actions and the patient's in the videos to keep track of the number of repetitions of each action. Theses stats will be shown to both of the patient and therapist. The extensive experiments show that the F1-Score of the similarity calculation is as high as 0.9 and the soft accuracy of the number of repetitions is higher than 90%.
翻译:康复治疗有助于治愈轻微的运动损伤和职业损伤。在传统康复过程中,治疗师会指定某些动作让患者在就诊间隙完成,而这依赖于患者正确记忆动作及其执行时间表。遗憾的是,许多患者会忘记执行动作或无法准确回忆动作细节。因此,康复治疗的效果会受到影响,最坏情况下,患者可能因执行错误动作而导致额外损伤。为解决这些问题,我们提出了一种基于HRNet的康复监控系统,该系统可通过患者的智能手机提醒其何时执行动作,并显示动作供患者模仿。此外,该系统还能帮助治疗师监控患者的康复进展。我们的系统由一个iOS应用和服务器端的多个组件构成。该应用负责展示和采集动作视频。服务器计算视频中治疗师动作与患者动作之间的相似度得分,以追踪每个动作的重复次数。这些统计数据将同时展示给患者和治疗师。大量实验表明,相似度计算的F1分数高达0.9,且动作重复次数的软准确率超过90%。