We study the real-time remote tracking of a two-state Markov process by an energy harvesting source. The source decides whether to transmit over an unreliable channel based on the state. We formulate this scenario as a Markov decision process (MDP) to determine the optimal transmission policy that minimizes the average Version Innovation Age (VIA) as a performance metric. We demonstrate that the optimal transmission policy is threshold-based, determined by the battery level, source state, and VIA value. We numerically verify the analytical structure of the optimal policy and compare the performance of our proposed policy against two baseline policies across various system parameters, establishing the superior performance of our approach.

翻译：我们研究了一个能量收集源对两状态马尔可夫过程的实时远程跟踪问题。源根据状态决定是否通过一个不可靠信道进行传输。我们将此场景建模为一个马尔可夫决策过程（MDP），以确定最优传输策略，从而最小化作为性能指标的版本创新年龄（VIA）的平均值。我们证明了最优传输策略是基于阈值的，该阈值由电池电量、源状态和VIA值共同决定。我们通过数值方法验证了最优策略的分析结构，并在多种系统参数下，将我们提出的策略与两种基线策略的性能进行了比较，证实了我们方法的优越性能。