In addressing control problems such as regulation and tracking through reinforcement learning, it is often required to guarantee that the acquired policy meets essential performance and stability criteria such as a desired settling time and steady-state error prior to deployment. Motivated by this necessity, we present a set of results and a systematic reward shaping procedure that (i) ensures the optimal policy generates trajectories that align with specified control requirements and (ii) allows to assess whether any given policy satisfies them. We validate our approach through comprehensive numerical experiments conducted in two representative environments from OpenAI Gym: the Inverted Pendulum swing-up problem and the Lunar Lander. Utilizing both tabular and deep reinforcement learning methods, our experiments consistently affirm the efficacy of our proposed framework, highlighting its effectiveness in ensuring policy adherence to the prescribed control requirements.

翻译：在通过强化学习解决调节和跟踪等控制问题时，通常需要在部署前保证所获得的策略满足关键性能与稳定性标准，例如期望的调节时间和稳态误差。受此需求驱动，我们提出了一组成果和一套系统性奖励塑造方法，该方法（i）确保最优策略生成的轨迹符合指定的控制要求，并且（ii）允许评估任何给定策略是否满足这些要求。我们通过在OpenAI Gym中两个代表性环境（倒立摆摆动控制问题和月球着陆器）中进行的全面数值实验验证了我们的方法。利用表格法和深度强化学习方法，我们的实验一致证实了所提出框架的有效性，突出了其在确保策略遵守规定控制要求方面的实用性。