For many people, anxiety, depression, and other social and mental factors can make composing text messages an active challenge. To remedy this problem, large language models (LLMs) may yet prove to be the perfect tool to assist users that would otherwise find texting difficult or stressful. However, despite rapid uptake in LLM usage, considerations for their assistive usage in text message composition have not been explored. A primary concern regarding LLM usage is that poor public sentiment regarding AI introduces the possibility that its usage may harm perceptions of AI-assisted text messages, making usage counter-productive. To (in)validate this possibility, we explore how the belief that a text message did or did not receive AI assistance in composition alters its perceived tone, clarity, and ability to convey intent. In this study, we survey the perceptions of 26 participants on 18 randomly labeled pre-composed text messages. In analyzing the participants' ratings of message tone, clarity, and ability to convey intent, we find that there is no statistically significant evidence that the belief that AI is utilized alters recipient perceptions. This provides hopeful evidence that LLM-based text message composition assistance can be implemented without the risk of counter-productive outcomes.
翻译:对许多人而言,焦虑、抑郁及其他社会心理因素可能使编写短信成为一项挑战。为解决这一问题,大型语言模型(LLMs)或可成为辅助用户的理想工具,尤其是对那些认为编写短信困难或压力重重的人群。然而,尽管LLMs的使用率迅速增长,但其在短信编写中的辅助应用尚未得到充分研究。关于LLMs使用的首要担忧在于,公众对AI的负面情绪可能导致AI辅助的短信受到不良感知,从而适得其反。为验证(或否定)这一可能性,我们探讨了"相信短信是否获得AI辅助编写"这一信念如何改变其对语气、清晰度和意图传达能力的感知。在本研究中,我们调查了26名参与者对18条预先编写并随机标注"是否使用AI辅助"的短信的感知。通过分析参与者对短信语气、清晰度和意图传达能力的评分,我们发现无统计显著证据表明"认为使用了AI"会改变接收者的感知。这为基于LLM的短信编写辅助工具的实施提供了积极证据,表明其应用不会带来适得其反的风险。