This paper introduces CyanKitten, an interactive virtual companion system tailored for elderly users, integrating advanced posture recognition, behavior recognition, and multimodal interaction capabilities. The system utilizes a three-tier architecture to process and interpret user movements and gestures, leveraging a dual-camera setup and a convolutional neural network trained explicitly on elderly movement patterns. The behavior recognition module identifies and responds to three key interactive gestures: greeting waves, petting motions, and heart-making gestures. A multimodal integration layer also combines visual and audio inputs to facilitate natural and intuitive interactions. This paper outlines the technical implementation of each component, addressing challenges such as elderly-specific movement characteristics, real-time processing demands, and environmental adaptability. The result is an engaging and accessible virtual interaction experience designed to enhance the quality of life for elderly users.
翻译:本文介绍了CyanKitten,一款专为老年用户设计的交互式虚拟伴侣系统,集成了先进的姿态识别、行为识别与多模态交互能力。该系统采用三层架构处理并解析用户的动作与手势,利用双摄像头配置以及一个专门针对老年人运动模式训练的卷积神经网络。行为识别模块能够识别并响应三种关键交互手势:问候挥手、抚摸动作以及比心手势。一个多模态融合层还结合了视觉与音频输入,以促进自然直观的交互。本文详细阐述了各组件的技术实现,并针对老年人特有的运动特征、实时处理需求以及环境适应性等挑战进行了探讨。最终成果是一个旨在提升老年用户生活质量的、引人入胜且易于使用的虚拟交互体验。