The Extended Long Short-Term Memory (xLSTM) network has demonstrated strong capability in modeling complex long-term dependencies in time series data. Despite its success, the deterministic architecture of xLSTM limits its representational capacity and forecasting performance, especially on challenging real-world time series datasets characterized by inherent uncertainty, stochasticity, and complex hierarchical latent dynamics. In this work, we propose StoxLSTM, a stochastic xLSTM within a designed state space modeling framework, which integrates latent stochastic variables directly into the recurrent units to effectively model deep latent temporal dynamics and uncertainty. The designed state space model follows an efficient non-autoregressive generative approach, achieving strong predictive performance without complex modifications to the original xLSTM architecture. Extensive experiments on publicly available benchmark datasets demonstrate that StoxLSTM consistently outperforms state-of-the-art baselines, achieving superior performance and generalization.
翻译:扩展长短期记忆(xLSTM)网络在建模时间序列数据中复杂的长期依赖性方面已展现出强大能力。尽管取得了成功,但xLSTM的确定性架构限制了其表示能力和预测性能,尤其是在具有固有不确定性、随机性和复杂层次化潜在动态特性的挑战性现实世界时间序列数据集上。本工作中,我们提出了StoxLSTM,这是一种在设计的状态空间建模框架内的随机xLSTM,它将潜在随机变量直接集成到循环单元中,以有效建模深层潜在时间动态和不确定性。所设计的状态空间模型遵循一种高效的非自回归生成方法,无需对原始xLSTM架构进行复杂修改即可实现强大的预测性能。在公开可用的基准数据集上进行的大量实验表明,StoxLSTM始终优于最先进的基线模型,实现了卓越的性能和泛化能力。