This research investigates the effectiveness of ChatGPT, an AI language model by OpenAI, in translating English into Hindi, Telugu, and Kannada languages, aimed at assisting tourists in India's linguistically diverse environment. To measure the translation quality, a test set of 50 questions from diverse fields such as general knowledge, food, and travel was used. These were assessed by five volunteers for accuracy and fluency, and the scores were subsequently converted into a BLEU score. The BLEU score evaluates the closeness of a machine-generated translation to a human translation, with a higher score indicating better translation quality. The Hindi translations outperformed others, showcasing superior accuracy and fluency, whereas Telugu translations lagged behind. Human evaluators rated both the accuracy and fluency of translations, offering a comprehensive perspective on the language model's performance.
翻译:本研究探讨了OpenAI的人工智能语言模型ChatGPT在将英语翻译成印地语、泰卢固语和卡纳达语方面的有效性,旨在为印度语言多样性的环境中的游客提供帮助。为了衡量翻译质量,我们使用了一个涵盖常识、美食和旅游等多个领域的50个问题的测试集。这些翻译由五名志愿者评估准确性和流畅度,然后将其得分转换为BLEU分数。BLEU分数评估机器翻译与人工翻译的接近程度,分数越高表示翻译质量越好。印地语翻译表现最佳,显示出更高的准确性和流畅度,而泰卢固语翻译则相对落后。人类评估者对翻译的准确性和流畅度进行了评分,为语言模型的性能提供了全面的视角。