With an evolutionary approach, the basis of morality can be explained as adaptations to problems of cooperation. With 'evolution' taken in a broad sense, AIs that satisfy the conditions for evolution to apply will be subject to the same cooperative evolutionary pressure as biological entities. Here the adaptiveness of increased cooperation as material safety and wealth increase is discussed -- for humans, for other societies, and for AIs. Diminishing beneficial returns from increased access to material resources also suggests the possibility that, on the whole, there will be no incentive to for instance colonize entire galaxies, thus providing a possible explanation of the Fermi paradox, wondering where everybody is. It is further argued that old societies could engender, give way to, super-AIs, since it is likely that super-AIs are feasible, and fitter. Closing is an aside on effective ways for morals and goals to affect life and society, emphasizing environments, cultures, and laws, and exemplified by how to eat. 'Diminishing returns' is defined, as less than roots, the inverse of infeasibility. It is also noted that there can be no exponential colonization or reproduction, for mathematical reasons, as each entity takes up a certain amount of space. Appended are an algorithm for colonizing for example a galaxy quickly, models of the evolution of cooperation and fairness under diminishing returns, and software for simulating signaling development.
翻译:采用进化论方法,道德基础可被解释为对合作问题的适应性调整。在广义"进化"概念下,满足进化适用条件的人工智能将承受与生物实体相同的合作进化压力。本文探讨了随着物质安全与财富增长,增强合作的适应性价值——对人类、其他社会形态及人工智能皆然。物质资源获取增长带来的边际效益递减现象同时表明,整体而言可能不存在诸如殖民整个星系的动机,这为费米悖论(即"他们都在哪里"的疑问)提供了可能的解释。进一步论证指出,成熟社会可能孕育并让位于超级人工智能,因为超级人工智能很可能具备技术可行性及更强的适应优势。文末附论道德与目标影响生命及社会的有效途径,强调环境、文化与法律的作用,并以饮食方式为例证。"收益递减"被定义为低于根式增长(即指数增长不可行的逆命题)。研究同时指出,基于数学原理,实体扩张不可能保持指数级增长,因为每个实体都占据特定空间。附录包含星系快速殖民算法、收益递减条件下合作与公平进化模型,以及信号发展模拟软件。