Human cognition significantly influences expressed behavior and is intrinsically tied to authentic personality traits. Personality assessment plays a pivotal role in various fields, including psychology, education, social media, etc. However, traditional self-report questionnaires can only provide data based on what individuals are willing and able to disclose, thereby lacking objective. Moreover, automated measurements and peer assessments demand significant human effort and resources. In this paper, given the advantages of the Virtual Reality (VR) technique, we develop a VR simulator -- PersonalityScanner, to stimulate cognitive processes and simulate daily behaviors based on an immersive and interactive simulation environment, in which participants carry out a battery of engaging tasks that formulate a natural story of first-day at work. Through this simulator, we collect a synchronous multi-modal dataset with ten modalities, including first/third-person video, audio, text, eye tracking, facial microexpression, pose, depth data, log, and inertial measurement unit. By systematically examining the contributions of different modalities on revealing personality, we demonstrate the superior performance and effectiveness of PersonalityScanner.

翻译：人类认知显著影响外显行为，且与真实人格特质存在内在关联。人格评估在心理学、教育、社交媒体等多个领域具有关键作用。然而，传统的自我报告问卷仅能提供基于个体意愿及能力所披露的数据，因而缺乏客观性。此外，自动化测量与同伴评估需要耗费大量人力与资源。本文基于虚拟现实（VR）技术的优势，开发了一款VR模拟器——PersonalityScanner，旨在通过沉浸式交互模拟环境激发认知过程并模拟日常行为。参与者在该环境中完成一系列构成"首日工作"自然叙事流程的交互任务。通过该模拟器，我们采集了包含十种模态的同步多模态数据集，涵盖第一/第三人称视频、音频、文本、眼动追踪、面部微表情、姿态、深度数据、操作日志及惯性测量单元数据。通过系统检验不同模态对揭示人格特质的贡献度，我们验证了PersonalityScanner的卓越性能与有效性。