This position paper explores the benefits, drawbacks, and ethical considerations of incorporating synthetic personae in HCI research, particularly focusing on the customization challenges beyond the limitations of current Large Language Models (LLMs). These perspectives are derived from the initial results of a sub-study employing vignettes to showcase the existence of bias within black-box LLMs and explore methods for manipulating them. The study aims to establish a foundation for understanding the challenges associated with these models, emphasizing the necessity of thorough testing before utilizing them to create synthetic personae for HCI research.
翻译:本文探讨了在人机交互研究中引入合成人格的益处、弊端及伦理考量,尤其聚焦于当前大型语言模型局限性之外的定制化挑战。这些观点源自一项子研究的初步结果,该研究通过案例分析法揭示了黑箱大型语言模型中存在的偏见,并探索了操控这些模型的方法。本研究旨在为理解这类模型所关联的挑战奠定基础,强调在将其用于创建人机交互研究合成人格前,必须进行充分测试。