Generative models, such as large language models and text-to-image diffusion models, produce relevant information when presented a query. Different models may produce different information when presented the same query. As the landscape of generative models evolves, it is important to develop techniques to study and analyze differences in model behaviour. In this paper we present novel theoretical results for embedding-based representations of generative models in the context of a set of queries. In particular, we establish sufficient conditions for the consistent estimation of the model embeddings in situations where the query set and the number of models grow.
翻译:生成模型,例如大型语言模型和文生图扩散模型,在接收查询时会产生相关信息。不同模型对相同查询可能生成不同信息。随着生成模型生态的发展,开发技术以研究和分析模型行为差异变得至关重要。本文针对基于嵌入的生成模型表示,在查询集合的背景下提出了新的理论结果。特别地,我们建立了在查询集与模型数量同时增长的情况下,模型嵌入能够被一致性估计的充分条件。