As AI technologies increase in capability and ubiquity, AI accidents are becoming more common. Based on normal accident theory, high reliability theory, and open systems theory, we create a framework for understanding the risks associated with AI applications. In addition, we also use AI safety principles to quantify the unique risks of increased intelligence and human-like qualities in AI. Together, these two fields give a more complete picture of the risks of contemporary AI. By focusing on system properties near accidents instead of seeking a root cause of accidents, we identify where attention should be paid to safety for current generation AI systems.

翻译：随着AI技术的能力与普及程度不断提升，AI事故也日益频发。基于常态事故理论、高可靠性理论和开放系统理论，我们构建了一个理解AI应用相关风险的框架。此外，我们运用AI安全原则量化AI中增强智能与拟人特质所引发的独特风险。这两大领域共同勾勒出当代AI风险的更完整图景。通过聚焦事故临近时的系统特性，而非追溯事故根本原因，我们明确了当前一代AI系统在安全性方面需重点关注的方向。