We introduce OpenFlamingo, a family of autoregressive vision-language models ranging from 3B to 9B parameters. OpenFlamingo is an ongoing effort to produce an open-source replication of DeepMind's Flamingo models. On seven vision-language datasets, OpenFlamingo models average between 80 - 89% of corresponding Flamingo performance. This technical report describes our models, training data, hyperparameters, and evaluation suite. We share our models and code at https://github.com/mlfoundations/open_flamingo.
翻译:我们提出OpenFlamingo,这是一个参数规模从3B到9B的自回归视觉语言模型系列。OpenFlamingo是一项持续进行的工作,旨在对DeepMind的Flamingo模型进行开源复现。在七个视觉语言数据集上,OpenFlamingo模型的平均性能达到对应Flamingo模型的80%-89%。本技术报告详细描述了我们的模型、训练数据、超参数及评估套件。我们已在https://github.com/mlfoundations/open_flamingo 上公开分享模型与代码。