We introduce MERaLiON-AudioLLM (Multimodal Empathetic Reasoning and Learning in One Network), the first speech-text model tailored for Singapore's multilingual and multicultural landscape. Developed under the National Large Language Models Funding Initiative, Singapore, MERaLiON-AudioLLM integrates advanced speech and text processing to address the diverse linguistic nuances of local accents and dialects, enhancing accessibility and usability in complex, multilingual environments. Our results demonstrate improvements in both speech recognition and task-specific understanding, positioning MERaLiON-AudioLLM as a pioneering solution for region specific AI applications. We envision this release to set a precedent for future models designed to address localised linguistic and cultural contexts in a global framework.

翻译：我们推出MERaLiON-AudioLLM（多模态共情推理与学习一体化网络），这是首个为新加坡多语言与多元文化环境定制的语音-文本模型。该模型在新加坡国家大语言模型资助计划下开发，集成了先进的语音与文本处理技术，以应对当地口音和方言的多样语言细微差别，从而提升其在复杂多语言环境中的可访问性与可用性。我们的结果表明，该模型在语音识别和特定任务理解方面均取得了改进，使MERaLiON-AudioLLM成为面向区域特定人工智能应用的先驱性解决方案。我们期望此次发布能为未来旨在全球框架内解决本地化语言与文化背景的模型树立先例。