AI tools, particularly large-scale language model (LLM) based applications such as ChatGPT, have the potential to simplify qualitative research. Through semi-structured interviews with seventeen participants, we identified challenges and concerns in integrating ChatGPT into the qualitative analysis process. Collaborating with thirteen qualitative researchers, we developed a framework for designing prompts to enhance the effectiveness of ChatGPT in thematic analysis. Our findings indicate that improving transparency, providing guidance on prompts, and strengthening users' understanding of LLMs' capabilities significantly enhance the users' ability to interact with ChatGPT. We also discovered and revealed the reasons behind researchers' shift in attitude towards ChatGPT from negative to positive. This research not only highlights the importance of well-designed prompts in LLM applications but also offers reflections for qualitative researchers on the perception of AI's role. Finally, we emphasize the potential ethical risks and the impact of constructing AI ethical expectations by researchers, particularly those who are novices, on future research and AI development.
翻译:人工智能工具,尤其是基于大规模语言模型(LLM)的应用如ChatGPT,有潜力简化定性研究。通过对17名参与者进行半结构化访谈,我们识别了将ChatGPT融入定性分析过程中的挑战与顾虑。与13位定性研究人员合作,我们开发了一个设计提示词的框架,以增强ChatGPT在主题分析中的有效性。我们的研究结果表明,提高透明度、提供提示词指导以及加强用户对LLM能力的理解,显著增强了用户与ChatGPT交互的能力。我们还发现并揭示了研究人员对ChatGPT态度从消极转向积极的原因。本研究不仅强调了精心设计的提示词在LLM应用中的重要性,还为定性研究人员对AI角色认知提供了反思。最后,我们强调了潜在的伦理风险,以及研究人员(尤其是新手)构建AI伦理期望对未来研究和AI发展的影响。