Emotional voice communication plays a crucial role in effective daily interactions. Deaf and hard-of-hearing (DHH) individuals often rely on facial expressions to supplement sign language to convey emotions, as the use of voice is limited. However, in American Sign Language (ASL), these facial expressions serve not only emotional purposes but also as linguistic markers, altering sign meanings and often confusing non-signers when interpreting a signer's emotional state. Most existing ASL translation technologies focus solely on signs, neglecting the role of emotional facial expressions in the translated output (e.g., text, voice). This paper present studies which 1) confirmed the challenges for non-signers of interpreting emotions from facial expressions in ASL communication, of facial expressions, and 2) how integrating emotional voices into translation systems can enhance hearing individuals' comprehension of a signer's emotions. An online survey conducted with 45 hearing participants (Non-ASL Signers) revealed that they frequently misinterpret signers' emotions when emotional and linguistic facial expressions are used simultaneously. The findings indicate that incorporating emotional voice into translation systems significantly improves the recognition of signers' emotions by 32%. Additionally, further research involving 6 DHH participants discusses design considerations for the emotional voice feature from both perspectives, emphasizing the importance of integrating emotional voices in translation systems to bridge communication gaps between DHH and hearing communities.

翻译：情感语音交流在日常有效互动中扮演着关键角色。聋人及听力障碍者由于使用语音受限，常依赖面部表情辅助手语以传达情感。然而，在美国手语中，这些面部表情不仅具有情感功能，还作为语言标记改变手语含义，导致非手语使用者在解读手语者情感状态时经常产生混淆。现有的大多数美国手语翻译技术仅关注手语动作，在翻译输出（如文本、语音）中忽视了情感性面部表情的作用。本文通过两项研究：1）证实了非手语使用者在解读美国手语交流中面部表情（包括情感性与语言性表情）所传达情感时面临的挑战；2）论证了将情感语音整合至翻译系统如何提升健听人对聋人手语者情感的理解。一项针对45名健听参与者（非美国手语使用者）的在线调查显示，当情感性面部表情与语言性面部表情同时出现时，他们经常误解手语者的情感。研究结果表明，在翻译系统中整合情感语音能使健听人对聋人手语者情感的识别准确率显著提升32%。此外，另一项涉及6名聋人及听力障碍参与者的研究从双方视角探讨了情感语音功能的设计考量，强调在翻译系统中整合情感语音对于弥合聋人与健听社群间交流鸿沟的重要性。