ChatGPT has been emerging as a novel information source, and it is likely that the public might seek information from ChatGPT while taking protective actions when facing climate hazards such as floods and hurricanes. The objective of this study is to evaluate the accuracy and completeness of responses generated by ChatGPT when individuals seek information about aspects of taking protective actions. The survey analysis results indicated that: (1) the emergency managers considered the responses provided by ChatGPT as accurate and complete to a great extent; (2) it was statistically verified in evaluations that the generated information was accurate, but lacked completeness, implying that the extent of information provided is accurate; and (3) information generated for prompts related to hazard insurance received the highest evaluation, whereas the information generated related to evacuation received the lowest. This last result implies that, for complex, context-specific protective actions (such as evacuation), the information was rated as less complete compared with other protective actions. Also, the results showed that the perception of respondents regarding the utility of AI- assistive technologies (such as ChatGPT) for emergency preparedness and response improved after taking the survey and evaluating the information generated by ChatGPT. The findings from this study provide empirical evaluation regarding the utility of AI-assistive technologies for improving public decision-making and protective actions in disasters.
翻译:ChatGPT正逐渐成为一种新型信息源,公众在面对洪水和飓风等气候灾害时,可能会在采取保护行动的过程中向ChatGPT寻求信息。本研究旨在评估个人在获取保护行动相关方面信息时,ChatGPT所生成回答的准确性与完整性。调查分析结果表明:(1)应急管理人员普遍认为ChatGPT提供的回答具有较高准确性和完整性;(2)评估通过统计验证显示,生成的信息准确但缺乏完整性,即所提供信息在程度上准确;(3)与灾害保险相关的提示词生成信息获得最高评价,而与疏散相关的生成信息评价最低。最后一项结果表明,对于复杂且具情境特异性的保护行动(如疏散),其信息完整性评价低于其他保护行动。此外,研究结果显示,受访者在参与调查并评估ChatGPT生成信息后,对AI辅助技术(如ChatGPT)在应急准备与响应中实用性的认知有所提升。本研究的发现为AI辅助技术在改善公众灾决策与保护行动中的实用性提供了实证评估。