The International Crises Behavior Events (ICBe) ontology provides high coverage over the thoughts, communications, and actions that constitute international relations. A major disadvantage of that level of detail is that it requires large human capital costs to apply it manually to new texts. Whether such an ontolgy is practical for international relations research given limited human and financial resources is a pressing concern. We introduce a working proof of concept showing that ICBe codings can be reliably extracted from new texts using the current generation of open source large language models (LLM) running on consumer grade computer hardware. Our solution requires no finetuning and only limited prompt engineering. We detail our solution and present benchmarks against the original ICBe codings. We conclude by discussing the implications of very high quality event coding of any text being within reach of individual researchers with limited resources.
翻译:国际危机行为事件(ICBe)本体对构成国际关系的思维、沟通和行动提供了高度覆盖。这种详细程度的一个主要缺陷是,手动将其应用于新文本需要高昂的人力成本。在人力资源和财力有限的情况下,此类本体是否对国际关系研究具有实用性,是一个紧迫的问题。我们提出一个工作概念验证,表明使用当前一代在消费级计算机硬件上运行的开源大语言模型(LLM),可以可靠地从新文本中提取ICBe编码。我们的解决方案无需微调,仅需有限的提示工程。我们详细介绍了解决方案,并针对原始ICBe编码进行了基准测试。最后,我们讨论了任何文本的高质量事件编码对资源有限的独立研究者而言已触手可及的深远意义。