This paper presents Global Benchmark Database (GBD), a comprehensive suite of tools for provisioning and sustainably maintaining benchmark instances and their metadata. The availability of benchmark metadata is essential for many tasks in empirical research, e.g., for the data-driven compilation of benchmarks, the domain-specific analysis of runtime experiments, or the instance-specific selection of solvers. In this paper, we introduce the data model of GBD as well as its interfaces and provide examples of how to interact with them. We also demonstrate the integration of custom data sources and explain how to extend GBD with additional problem domains, instance formats and feature extractors.
翻译:本文介绍全球基准数据库(GBD),这是一套用于配置和可持续维护基准实例及其元数据的综合工具集。基准元数据的可用性对于实证研究中的许多任务至关重要,例如用于数据驱动的基准编译、运行时实验的领域特定分析或求解器的实例特定选择。在本文中,我们介绍了GBD的数据模型及其接口,并提供了如何与它们交互的示例。我们还演示了自定义数据源的集成,并解释了如何通过额外的问题领域、实例格式和特征提取器来扩展GBD。