The advancement of AI capabilities compels researchers and the public to be more aware of its potential worldwide impact. A pressing near-term concern is the regulation of military AI applications. Armament manufacturers and defense contractors are increasingly investing in AI capabilities and forging partnerships with AI companies, creating a burgeoning coalition that demands military leaders, arms control diplomacy experts, and AI researchers collaborate to ensure a safer future. While AI researchers often focus on the long-term implications of superintelligent AI, this approach may not adequately address the immediate challenges posed by AI in military applications. Success requires acknowledging and mitigating the emerging risks of frontier AI models that plan to be integrated into defense applications, like military AI systems. Arms control has reduced past catastrophic risks, so lessons learned from nuclear deterrence can guide AI safety and security research towards innovations in verification and diplomacy. AI researchers, however, must assist in leading the technical research that clearly defines and alleviates instability in military settings. Given these new responsibilities and the lack of sufficiently reliable solutions, we argue that AI researchers must take a leading role in advancing arms control research to minimize risk in military AI applications.
翻译:人工智能能力的提升迫使研究人员和公众更加关注其潜在的全球影响。一个迫在眉睫的近期议题是对军事AI应用的监管。武器制造商和国防承包商正加大对AI能力的投资,并与AI公司建立合作伙伴关系,形成日益壮大的联盟,这要求军事领导人、军备控制外交专家与AI研究人员协作,以确保更安全的未来。尽管AI研究人员常聚焦于超级智能AI的长期影响,但这种思路可能无法充分应对军事应用场景中AI带来的即时挑战。成功应对需要承认并缓解前沿AI模型(例如计划整合到军事AI系统的国防应用模型)的新兴风险。军备控制曾减少过往灾难性风险,因此核威慑的经验教训可指导AI安全与安保研究,推动核查与外交领域的创新。然而,AI研究人员必须主导技术研究,明确界定并缓解军事环境中的不稳定性。鉴于这些新责任以及缺乏充分可靠的解决方案,我们认为AI研究人员必须肩负起推进军备控制研究的领导角色,以最小化军事AI应用中的风险。