This paper presents AGNES, the first information retrieval system for archaeological grey literature, allowing full-text search of these long archaeological documents. This search system has a web interface that allows archaeology professionals and scholars to search through a collection of over 60,000 Dutch excavation reports, totalling 361 million words. We conducted a user study for the evaluation of AGNES's search interface, with a small but diverse user group. The evaluation was done by screen capturing and a think aloud protocol, combined with a user interface feedback questionnaire. The evaluation covered both controlled use (completion of a pre-defined task) as well as free use (completion of a freely chosen task). The free use allows us to study the information needs of archaeologists, as well as their interactions with the search system. We conclude that: (1) the information needs of archaeologists are typically recall-oriented, often requiring a list of items as answer; (2) the users prefer the use of free-text queries over metadata filters, confirming the value of a free-text search system; (3) the compilation of a diverse user group contributed to the collection of diverse issues as feedback for improving the system. We are currently refining AGNES's user interface and improving its precision for archaeological entities, so that AGNES will help archaeologists to answer their research questions more effectively and efficiently, leading to a more coherent narrative of the past.

翻译：本文介绍了考古灰色文献的首个信息检索系统AGERES, 这是考古灰色文献的首个信息检索系统, 允许对这些长长的考古文件进行全文搜索。这一搜索系统有一个网络界面,使考古专业人士和学者能够通过收集60,000多份荷兰挖掘报告(共3.61亿字)进行搜索。我们进行了用户研究,以评估AGENES的搜索界面,与一个小型但多样化的用户组进行了评估。评价是通过屏幕捕捉和高声思考程序,与用户界面反馈问卷相结合进行的。评价既包括有控制的使用(完成预先确定的任务),也包括免费使用(完成自由选择的任务)和免费使用(完成一项任务)。这种免费使用使我们能够研究考古学家的信息需求,以及他们与搜索系统的互动。我们的结论是:(1) 考古学家的信息需求通常以回顾为导向,通常要求一份答复项目清单;(2) 用户更愿意使用免费文本查询而不是元数据过滤器,确认自由文本搜索系统的价值;(3) 汇编一个多样化用户组有助于收集各种问题,作为改进系统的反馈。我们目前正在有效地改进AGEN的用户界面,并有效地改进其更精确性。