Breeze-7B is an open-source language model based on Mistral-7B, designed to address the need for improved language comprehension and chatbot-oriented capabilities in Traditional Chinese. This technical report provides an overview of the additional pretraining, finetuning, and evaluation stages for the Breeze-7B model. The Breeze-7B family of base and chat models exhibits good performance on language comprehension and chatbot-oriented tasks, reaching the top in several benchmarks among models comparable in its complexity class.
翻译:Breeze-7B是一个基于Mistral-7B的开源语言模型,旨在提升繁体中文领域的语言理解能力与面向聊天机器人的功能。本技术报告概述了Breeze-7B模型的额外预训练、微调及评估阶段。Breeze-7B系列的基础模型与聊天模型在语言理解及聊天机器人相关任务中表现出色,在同类复杂度模型的多个基准测试中均达到顶尖水平。