The current thesis aims to explore the reinforcement learning field and build on existing methods to produce improved ones to tackle the problem of learning in high-dimensional and complex environments. It addresses such goals by decomposing learning tasks in a hierarchical fashion known as Hierarchical Reinforcement Learning. We start in the first chapter by getting familiar with the Markov Decision Process framework and presenting some of its recent techniques that the following chapters use. We then proceed to build our Hierarchical Policy learning as an answer to the limitations of a single primitive policy. The hierarchy is composed of a manager agent at the top and employee agents at the lower level. In the last chapter, which is the core of this thesis, we attempt to learn lower-level elements of the hierarchy independently of the manager level in what is known as the "Eigenoption". Based on the graph structure of the environment, Eigenoptions allow us to build agents that are aware of the geometric and dynamic properties of the environment. Their decision-making has a special property: it is invariant to symmetric transformations of the environment, allowing as a consequence to greatly reduce the complexity of the learning task.

翻译：本论文旨在探索强化学习领域，并在现有方法基础上进行改进，以解决高维复杂环境中的学习问题。为此，我们采用分层学习任务分解的方式，即分层强化学习。第一章首先介绍马尔可夫决策过程框架，并展示后续章节将使用的若干最新技术。随后，我们提出分层策略学习，以克服单一原始策略的局限性。该层级结构由顶层的管理者智能体和低层的执行者智能体组成。在作为本论文核心的最后一章中，我们尝试独立于管理者层级学习层级结构中的低层元素，即"本征选项"。基于环境图结构，本征选项使我们能够构建感知环境几何与动态特性的智能体。其决策具有特殊性质：对环境对称变换保持不变性，从而大幅降低学习任务的复杂度。