We release the Nemotron-4 340B model family, including Nemotron-4-340B-Base, Nemotron-4-340B-Instruct, and Nemotron-4-340B-Reward. Our models are open access under the NVIDIA Open Model License Agreement, a permissive model license that allows distribution, modification, and use of the models and its outputs. These models perform competitively to open access models on a wide range of evaluation benchmarks, and were sized to fit on a single DGX H100 with 8 GPUs when deployed in FP8 precision. We believe that the community can benefit from these models in various research studies and commercial applications, especially for generating synthetic data to train smaller language models. Notably, over 98% of data used in our model alignment process is synthetically generated, showcasing the effectiveness of these models in generating synthetic data. To further support open research and facilitate model development, we are also open-sourcing the synthetic data generation pipeline used in our model alignment process.

翻译：我们发布了 Nemotron-4 340B 模型系列，包括 Nemotron-4-340B-Base、Nemotron-4-340B-Instruct 和 Nemotron-4-340B-Reward。我们的模型在 NVIDIA 开放模型许可协议下开放访问，这是一个宽松的模型许可，允许分发、修改和使用模型及其输出。这些模型在广泛的评估基准测试中与开放访问模型相比具有竞争力，并且其规模设计为在部署时采用 FP8 精度可适配于配备 8 个 GPU 的单个 DGX H100。我们相信，社区可以在各种研究和商业应用中从这些模型中受益，特别是在生成合成数据以训练更小的语言模型方面。值得注意的是，我们模型对齐过程中使用的数据有超过 98% 是合成生成的，这展示了这些模型在生成合成数据方面的有效性。为了进一步支持开放研究并促进模型开发，我们还将开源我们模型对齐过程中使用的合成数据生成流程。