This paper introduces OccCANINE, an open-source tool that maps occupational descriptions to HISCO codes. Manual coding is slow and error-prone; OccCANINE replaces weeks of work with results in minutes. We fine-tune CANINE on 15.8 million description-code pairs from 29 sources in 13 languages. The model achieves 96 percent accuracy, precision, and recall. We also show that the approach generalizes to three systems - OCC1950, OCCICEM, and ISCO-68 - and release them open source. By breaking the "HISCO barrier," OccCANINE democratizes access to high-quality occupational coding, enabling broader research in economics, economic history, and related disciplines.
翻译:本文介绍OccCANINE,一种将职业描述映射至HISCO代码的开源工具。人工编码耗时且易错;OccCANINE可将数周工作量缩减至数分钟完成。我们在涵盖13种语言、29个数据源的1580万条描述-代码对上对CANINE模型进行微调。该模型在准确率、精确率与召回率上均达到96%。我们进一步证明该方法可推广至OCC1950、OCCICEM和ISCO-68三种分类体系,并已开源发布。通过突破"HISCO壁垒",OccCANINE实现了高质量职业编码的普及化,为经济学、经济史学及相关领域的更广泛研究提供了支持。