With the widespread adoption of advanced generative models such as Gemini and GPT, there has been a notable increase in the incorporation of such models into sociotechnical systems, categorized under AI-as-a-Service (AIaaS). Despite their versatility across diverse sectors, concerns persist regarding discriminatory tendencies within these models, particularly favoring selected `majority' demographics across various sociodemographic dimensions. Despite widespread calls for diversification of media representations, marginalized racial and ethnic groups continue to face persistent distortion, stereotyping, and neglect within the AIaaS context. In this work, we provide a critical summary of the state of research in the context of social harms to lead the conversation to focus on their implications. We also present open-ended research questions, guided by our discussion, to help define future research pathways.

翻译：随着Gemini和GPT等先进生成式模型的广泛采用，此类模型融入社会技术系统的现象显著增加，这些系统被归类为AI即服务（AIaaS）。尽管这些模型在多个领域具有通用性，但其内部存在的歧视性倾向仍引发担忧，尤其是在各种社会人口维度上偏向特定的“多数”群体。尽管媒体代表性多样化的呼声日益强烈，边缘化的种族和民族群体在AIaaS背景下仍持续面临扭曲、刻板印象化和忽视的问题。在本研究中，我们系统梳理了社会危害相关研究现状，旨在引导学界聚焦其潜在影响。同时，基于我们的讨论，我们提出开放式研究问题，以期为未来研究路径的界定提供指引。