In the context of neuroevolution, Quality-Diversity algorithms have proven effective in generating repertoires of diverse and efficient policies by relying on the definition of a behavior space. A natural goal induced by the creation of such a repertoire is trying to achieve behaviors on demand, which can be done by running the corresponding policy from the repertoire. However, in uncertain environments, two problems arise. First, policies can lack robustness and repeatability, meaning that multiple episodes under slightly different conditions often result in very different behaviors. Second, due to the discrete nature of the repertoire, solutions vary discontinuously. Here we present a new approach to achieve behavior-conditioned trajectory generation based on two mechanisms: First, MAP-Elites Low-Spread (ME-LS), which constrains the selection of solutions to those that are the most consistent in the behavior space. Second, the Quality-Diversity Transformer (QDT), a Transformer-based model conditioned on continuous behavior descriptors, which trains on a dataset generated by policies from a ME-LS repertoire and learns to autoregressively generate sequences of actions that achieve target behaviors. Results show that ME-LS produces consistent and robust policies, and that its combination with the QDT yields a single policy capable of achieving diverse behaviors on demand with high accuracy.

翻译：在神经进化背景下，质量多样性算法通过定义行为空间，已被证明能够有效生成多样化且高效策略的库。创建此类库所引发的自然目标是尝试按需实现特定行为，这可通过执行库中对应的策略来完成。然而，在不确定环境中会出现两个问题：首先，策略可能缺乏鲁棒性和可重复性，即在略微不同的条件下多次执行通常会得到截然不同的行为；其次，由于库的离散特性，解决方案呈现不连续变化。本文提出了一种基于两种机制实现行为条件轨迹生成的新方法：第一，MAP-Elites低分散算法（ME-LS），其将解决方案的选择约束为在行为空间中一致性最高的那些方案；第二，质量多样性变换器（QDT），这是一种基于连续行为描述符的变换器模型，通过在ME-LS库中策略生成的数据集上进行训练，学习自回归地生成能够达成目标行为的动作序列。结果表明，ME-LS能产生一致且鲁棒的策略，而将其与QDT相结合，可得到一个能以高精度按需实现多样化行为的单一策略。