Just as other disciplines, the humanities explore how computational research approaches and tools can meaningfully contribute to scholarly knowledge production. We approach the design of computational tools through the analytical lens of 'human-AI collaboration.' However, there is no generalizable concept of what constitutes 'meaningful' human-AI collaboration. In terms of genuinely human competencies, we consider criticality and reflection as guiding principles of scholarly knowledge production. Although (designing for) reflection is a recurring topic in CSCW and HCI discourses, it has not been centered in work on human-AI collaboration. We posit that integrating both concepts is a viable approach to supporting 'meaningful' human-AI collaboration in the humanities. Our research, thus, is guided by the question of how critical reflection can be enabled in human-AI collaboration. We address this question with a use case that centers on computer vision (CV) tools for art historical image retrieval. Specifically, we conducted a qualitative interview study with art historians and extended the interviews with a think-aloud software exploration. We observed and recorded our participants' interaction with a ready-to-use CV tool in a possible research scenario. We found that critical reflection, indeed, constitutes a core prerequisite for 'meaningful' human-AI collaboration in humanities research contexts. However, we observed that critical reflection was not fully realized during interaction with the CV tool. We interpret this divergence as supporting our hypothesis that computational tools need to be intentionally designed in such a way that they actively scaffold and support critical reflection during interaction. Based on our findings, we suggest four empirically grounded design implications for 'critical-reflective human-AI collaboration'.

翻译：正如其他学科一样，人文学科也在探索计算研究方法与工具如何有价值地促进学术知识生产。我们通过"人机协作"的分析视角来审视计算工具的设计。然而，关于何谓"有意义"的人机协作，并不存在普适性概念。就真正的人类能力而言，我们将批判性与反思性视为学术知识生产的指导原则。尽管（为）反思（而设计）是CSCW和HCI领域反复出现的议题，但在人机协作研究中尚未被置于核心地位。我们主张，将这两个概念整合起来是支持人文学科中"有意义"人机协作的可行途径。因此，我们的研究围绕"如何在人机协作中实现批判性反思"这一核心问题展开。我们以一个聚焦于艺术史图像检索的计算机视觉（CV）工具应用案例来回应此问题。具体而言，我们开展了与艺术史学家的定性访谈研究，并通过"出声思考"软件探索扩展了访谈过程。我们观察并记录了参与者在可能的研究场景中与现成CV工具的交互情况。研究发现，批判性反思确实构成了人文学科研究语境中"有意义"人机协作的核心先决条件。但我们同时观察到，在与CV工具交互过程中，批判性反思未能完全实现。我们将这一差异解读为支持我们的假设：计算工具需要有意识地设计成在交互过程中积极搭建框架并支持批判性反思的形态。基于研究发现，我们提出了四项基于实证的"批判性反思人机协作"设计启示。