In recent years, the intelligence of various parts of the home has become one of the essential features of any modern home. One of these parts is the intelligence lighting system that personalizes the light for each person. This paper proposes an intelligent system based on machine learning that personalizes lighting in the instant future location of a recognized user, inferred by trajectory prediction. Our proposed system consists of the following modules: (I) human detection to detect and localize the person in each given video frame, (II) face recognition to identify the detected person, (III) human tracking to track the person in the sequence of video frames and (IV) trajectory prediction to forecast the future location of the user in the environment using Inverse Reinforcement Learning. The proposed method provides a unique profile for each person, including specifications, face images, and custom lighting settings. This profile is used in the lighting adjustment process. Unlike other methods that consider constant lighting for every person, our system can apply each 'person's desired lighting in terms of color and light intensity without direct user intervention. Therefore, the lighting is adjusted with higher speed and better efficiency. In addition, the predicted trajectory path makes the proposed system apply the desired lighting, creating more pleasant and comfortable conditions for the home residents. In the experimental results, the system applied the desired lighting in an average time of 1.4 seconds from the moment of entry, as well as a performance of 22.1mAp in human detection, 95.12% accuracy in face recognition, 93.3% MDP in human tracking, and 10.80 MinADE20, 18.55 MinFDE20, 15.8 MinADE5 and 30.50 MinFDE5 in trajectory prediction.
翻译:近年来,住宅各部分的智能化已成为现代家居的基本特征之一,其中智能照明系统能够为每位用户提供个性化光线调节。本文提出一种基于机器学习的智能系统,该系统通过轨迹预测推断已识别用户在未来瞬时位置,并实现个性化照明。所提系统包含以下模块:(I)人体检测模块,用于在每帧视频图像中检测并定位人员;(II)人脸识别模块,用于识别检测到的人员身份;(III)人体跟踪模块,用于在连续视频帧序列中跟踪目标人员;(IV)轨迹预测模块,利用逆强化学习预测用户在环境中的未来位置。该方法为每位用户建立包含特征、人脸图像及自定义照明设置的唯一配置文件,该文件用于照明调节过程。与采用统一照明方案的其他方法不同,本系统无需用户直接干预,即可根据每位用户对光线颜色与强度的偏好进行个性化调节,从而以更高速度与更优效率实现照明自适应调整。此外,通过预测轨迹路径,系统可预先应用期望照明方案,为住户营造更愉悦舒适的居住环境。实验结果表明,系统在用户进入后平均1.4秒内完成期望照明设置,并在人体检测中达到22.1mAp性能,人脸识别准确率95.12%,人体跟踪MDP值93.3%,轨迹预测分别达到10.80 MinADE20、18.55 MinFDE20、15.8 MinADE5与30.50 MinFDE5。