R\'enyi entropy is an important measure in the context of information theory as a generalization of Shannon entropy. This information measure was often used for uncertainty quantification of dynamical behaviour of stochastic processes. In this paper, we study in detail this measure for multivariate controlled autoregressive moving average (MCARMA) systems. The characteristic function of output process is represented from the terms of its residual characteristic function. An explicit formula to compute the R\'enyi entropy for the output process of MCARMA system is derived. In addition, we investigate the covariance matrix to find the upper bound of R\'enyi entropy. We present three simulations that serve to illustrate the behavior of information in MCARMA system, where the control and noise follow the Gaussian, Cauchy and Laplace distributions. Finally, the behaviour of R\'enyi entropy is illustrated in two real-world applications: a paper-making process and an electric circuit system.
翻译:Rényi熵作为香农熵的推广,是信息论领域中的重要度量指标。该信息度量常被用于量化随机过程动态行为的不确定性。本文详细研究了多元受控自回归移动平均(MCARMA)系统的Rényi熵。通过残差特征函数项,推导了输出过程特征函数的表示形式,并建立了计算MCARMA系统输出过程Rényi熵的显式公式。此外,通过研究协方差矩阵,确定了Rényi熵的上界。我们通过三个仿真实验展示了MCARMA系统中信息量的变化特征,其中控制量与噪声分别服从高斯分布、柯西分布和拉普拉斯分布。最后,通过造纸工艺和电路系统两个实际应用案例,进一步阐释了Rényi熵的行为特性。