We report on our effort to create a corpus dataset of different social context situations in an office setting for further disciplinary and interdisciplinary research in computer vision, psychology, and human-robot-interaction. For social robots to be able to behave appropriately, they need to be aware of the social context they act in. Consider, for example, a robot with the task to deliver a personal message to a person. If the person is arguing with an office mate at the time of message delivery, it might be more appropriate to delay playing the message as to respect the recipient's privacy and not to interfere with the current situation. This can only be done if the situation is classified correctly and in a second step if an appropriate behavior is chosen that fits the social situation. Our work aims to enable robots accomplishing the task of classifying social situations by creating a dataset composed of semantically annotated video scenes of office situations from television soap operas. The dataset can then serve as a basis for conducting research in both computer vision and human-robot interaction.
翻译:本文报告了我们在构建办公室场景下不同社会情境语料库数据集方面的工作,旨在为计算机视觉、心理学和人机交互等领域的学科内及跨学科研究提供支持。为实现社交机器人的得体行为,其需具备对所处社会情境的感知能力。例如,当机器人需向某人传递私人信息时,若该人正与同事争执,为尊重接收者隐私并避免干扰当前情境,延迟播放信息可能更为恰当。这一决策需两步实现:首先正确分类情境,其次选择适配该社会情境的恰当行为。我们的研究通过构建包含电视剧办公室场景语义标注视频片段的数据集,致力于使机器人掌握社会情境分类能力。该数据集可为人机交互及计算机视觉领域的后续研究提供基础支撑。