Recent advances in AI are integrating AI into the fabric of human social life, creating transformative, co-shaping relationships between humans and AI. This trend makes it urgent to investigate how these systems, in turn, shape their users. We conducted a three-phase design study with 24 participants to explore this dynamic. Our findings reveal critical tensions: (1) social AI often exacerbates the very interpersonal problems it is designed to mitigate; (2) it introduces nuanced privacy harms for secondary users inadvertently involved in AI-mediated social interactions; and (3) it can threaten the primary user's personal agency and identity. We argue these tensions expose a problematic tendency in the user-centered paradigm, which often prioritizes immediate user experience at the expense of core human values like interpersonal ethics and self-efficacy. We call for a paradigm shift toward a more provocative and relational design perspective that foregrounds long-term social and personal consequences.
翻译:近期人工智能的进展正将AI融入人类社会生活的结构之中,创造出人类与AI之间相互形塑的变革性关系。这一趋势使得探究这些系统如何反过来塑造其使用者变得尤为迫切。我们与24名参与者开展了一项包含三个阶段的设计研究,以探索这一动态。我们的研究结果揭示了若干关键矛盾:(1)社交AI常常加剧其本应缓解的人际关系问题;(2)它为无意中卷入AI中介社交互动的次级使用者带来了微妙的隐私侵害;(3)它可能威胁主要使用者的个人能动性与身份认同。我们认为这些矛盾暴露了以用户为中心范式中的一个问题性倾向,即该范式往往优先考虑即时用户体验,却以牺牲人际伦理和自我效能等核心人类价值为代价。我们呼吁转向一种更具挑战性和关系性的设计视角,将长期的社会与个人后果置于前台。