AI tools, particularly large-scale language model (LLM) based applications such as ChatGPT, have the potential to simplify qualitative research. Through semi-structured interviews with seventeen participants, we identified challenges and concerns in integrating ChatGPT into the qualitative analysis process. Collaborating with thirteen qualitative researchers, we developed a framework for designing prompts to enhance the effectiveness of ChatGPT in thematic analysis. Our findings indicate that improving transparency, providing guidance on prompts, and strengthening users' understanding of LLMs' capabilities significantly enhance the users' ability to interact with ChatGPT. We also discovered and revealed the reasons behind researchers' shift in attitude towards ChatGPT from negative to positive. This research not only highlights the importance of well-designed prompts in LLM applications but also offers reflections for qualitative researchers on the perception of AI's role. Finally, we emphasize the potential ethical risks and the impact of constructing AI ethical expectations by researchers, particularly those who are novices, on future research and AI development.
翻译:人工智能工具,特别是基于大规模语言模型(LLM)的应用程序(如ChatGPT),具有简化质性研究的潜力。通过对十七名参与者的半结构化访谈,我们识别了将ChatGPT整合到质性分析流程中所面临的挑战与关切。通过与十三位质性研究者的协作,我们开发了一个用于设计提示词的框架,以提升ChatGPT在主题分析中的有效性。我们的研究结果表明,提高透明度、提供关于提示词的指导以及加强用户对LLM能力的理解,能显著提升用户与ChatGPT互动的能力。我们还发现并揭示了研究者对ChatGPT的态度从负面转向正面的原因。本研究不仅凸显了精心设计的提示词在LLM应用中的重要性,也为质性研究者对人工智能角色的认知提供了反思。最后,我们强调了潜在的伦理风险,以及研究者(尤其是新手研究者)构建人工智能伦理期望对未来研究及人工智能发展的影响。