This paper presents Global Benchmark Database (GBD), a comprehensive suite of tools for provisioning and sustainably maintaining benchmark instances and their metadata. The availability of benchmark metadata is essential for many tasks in empirical research, e.g., for the data-driven compilation of benchmarks, the domain-specific analysis of runtime experiments, or the instance-specific selection of solvers. In this paper, we introduce the data model of GBD as well as its interfaces and provide examples of how to interact with them. We also demonstrate the integration of custom data sources and explain how to extend GBD with additional problem domains, instance formats and feature extractors.
翻译:本文提出了全局基准数据库(GBD),这是一套用于部署和可持续维护基准实例及其元数据的综合性工具集。基准元数据的可用性对实证研究中的许多任务至关重要,例如数据驱动的基准编译、运行时实验的领域特定分析,或特定实例的求解器选择。本文介绍了GBD的数据模型及其接口,并提供了与之交互的示例。我们还展示了自定义数据源的集成方法,并阐释了如何通过添加新的问题领域、实例格式和特征提取器来扩展GBD。