The evidence on the effects of generative AI (GenAI) on critical thinking is mixed, with studies suggesting both potential harms and benefits depending on its implementation. Some argue that AI-driven provocations, such as questions asking for human clarification and justification, are beneficial for eliciting critical thinking. Drawing on our experience designing and evaluating two GenAI-powered tools for knowledge work, ArtBot in the domain of fine art interpretation and Privy in the domain of AI privacy, we reflect on how design decisions shape the form and effectiveness of such provocations. Our observations and user feedback suggest that domain-specific provocations, implemented through productive friction and interactions that depend on user contribution, can meaningfully support critical thinking. We present participant experiences with both prototypes and discuss how supporting critical thinking may require moving beyond static provocations toward approaches that adapt to user preferences and levels of expertise.

翻译：关于生成式人工智能对批判性思维影响的证据尚无定论，研究表明其效果因实施方式不同而可能带来潜在危害或益处。部分学者认为，通过人工智能驱动的激发策略（例如要求人类提供解释与论证的提问）有助于激发批判性思维。基于我们在知识工作领域设计并评估两种生成式人工智能工具（美术解读领域的ArtBot与人工智能隐私领域的Privy）的经验，我们反思了设计决策如何塑造此类激发策略的形式与有效性。观察结果与用户反馈表明，通过生产性摩擦机制及依赖用户参与的交互方式所实现的领域特异性激发策略，能够有效支持批判性思维。我们呈现了两种原型系统的参与者体验，并探讨了支持批判性思维可能需要突破静态激发策略，转向适应用户偏好与专业水平的动态方法。