In this paper, we aim to improve the percentage of packets meeting their deadline in discrete-time M/M/1 queues with infrequent monitoring. More specifically, we look into policies that only monitor the system (and subsequently take actions) after a packet arrival. We model the system as an MDP and provide the optimal policy for some special cases. Furthermore, we introduce a heuristic algorithm called "AB-n" for general deadlines. Finally, we provide numerical results demonstrating the desirable performance of "AB-n" policies.
翻译:本文旨在提升低频监测下离散时间M/M/1队列中满足截止期限的数据包比例。具体而言,我们探究仅在数据包到达后监测系统(并据此采取行动)的策略。我们将该系统建模为马尔可夫决策过程,并为若干特例给出最优策略。此外,针对一般性截止期限,我们提出了一种名为"AB-n"的启发式算法。最后,我们通过数值结果展示了"AB-n"策略的优越性能。