Foundation Large Language Models (LLMs) such as GPT-4 represent a revolution in AI due to their real-world applications though natural language processing. However, they also pose many significant risks such as the presence of biased, private, or harmful text, and the unauthorized inclusion of copyrighted material. We introduce h2oGPT, a suite of open-source code repositories for the creation and use of Large Language Models (LLMs) based on Generative Pretrained Transformers (GPTs). The goal of this project is to create the world's best truly open-source alternative to closed-source GPTs. In collaboration with and as part of the incredible and unstoppable open-source community, we open-source several fine-tuned h2oGPT models from 7 to 40 Billion parameters, ready for commercial use under fully permissive Apache 2.0 licenses. Included in our release is 100% private document search using natural language. Open-source language models help boost AI development and make it more accessible and trustworthy. They lower entry hurdles, allowing people and groups to tailor these models to their needs. This openness increases innovation, transparency, and fairness. An open-source strategy is needed to share AI benefits fairly, and H2O.ai will continue to democratize AI and LLMs.
翻译:基础大型语言模型(LLMs,如GPT-4)因其通过自然语言处理的现实应用而代表了人工智能领域的一场革命。然而,它们也带来了诸多显著风险,例如存在偏见、隐私或有害文本,以及未经授权包含受版权保护的材料。我们推出了h2oGPT,这是一套基于生成式预训练Transformer(GPT)创建和使用大型语言模型的开源代码仓库。该项目旨在打造全球最佳、真正开源的闭源GPT替代方案。我们与不可思议且势不可挡的开源社区合作,并作为其一部分,开源了多个从70亿到400亿参数微调后的h2oGPT模型,这些模型在完全宽松的Apache 2.0许可下可商用。我们的发布内容还包括使用自然语言进行100%私密的文档搜索。开源语言模型有助于推动人工智能发展,使其更加易用和可信。它们降低了准入门槛,使个人和团体能够根据自身需求定制这些模型。这种开放性增强了创新、透明度和公平性。为了公平分享人工智能的益处,需要开源策略,而H2O.ai将继续推进人工智能和大型语言模型的民主化。