Intelligent software systems (e.g., conversational agents, profiling systems, hiring systems) are often designed in a manner which may perpetuates anti-Black racism and other forms of socio-cultural discrimination. This may reinforce social inequities by supporting the automation of consequential and sometimes unfair decisions that may be made by such systems and which may have an adverse impact on credit scores, insurance payouts, and even health evaluations, just to name a few. My lightning talk will therefore emphasize the need to propose a new type of non-functional requirements called ECI (emotional and cultural intelligence) requirements that will aim at developing discrimination-aware intelligent software systems. Such systems will notably be able to behave empathetically toward everyone, including minoritized groups and will ensure they are treated fairly. My talk will also emphasize the need to develop novel system assurance solutions to assure these ECI requirements are sufficiently supported by intelligent software systems.
翻译:智能软件系统(例如,对话代理、画像系统、招聘系统)通常以可能延续反黑人种族主义及其他形式社会文化歧视的方式进行设计。这可能会通过支持此类系统做出的、有时不公的关键决策的自动化,从而加剧社会不平等,并对信用评分、保险赔付甚至健康评估等方面产生不利影响,仅举几例。因此,我的闪电演讲将强调提出一种新型非功能需求,即ECI(情感和文化智能)需求的必要性,其旨在开发具有歧视感知能力的智能软件系统。此类系统应能够以同理心对待所有人,包括少数群体,并确保他们获得公平对待。我的演讲还将强调开发新型系统保证解决方案的必要性,以确保智能软件系统充分支持这些ECI需求。