Partial differential equations (PDEs) are widely used to model complex physical systems, but solving them efficiently remains a significant challenge. Recently, Transformers have emerged as the preferred architecture for PDEs due to their ability to capture intricate dependencies. However, they struggle with representing continuous dynamics and long-range interactions. To overcome these limitations, we introduce the Mamba Neural Operator (MNO), a novel framework that enhances neural operator-based techniques for solving PDEs. MNO establishes a formal theoretical connection between structured state-space models (SSMs) and neural operators, offering a unified structure that can adapt to diverse architectures, including Transformer-based models. By leveraging the structured design of SSMs, MNO captures long-range dependencies and continuous dynamics more effectively than traditional Transformers. Through extensive analysis, we show that MNO significantly boosts the expressive power and accuracy of neural operators, making it not just a complement but a superior framework for PDE-related tasks, bridging the gap between efficient representation and accurate solution approximation. Our code is available on https://github.com/Math-ML-X/Mamba-Neural-Operator

翻译：偏微分方程被广泛用于建模复杂物理系统，但如何高效求解仍是一个重大挑战。近年来，Transformer凭借其捕捉复杂依赖关系的能力，已成为求解偏微分方程的首选架构。然而，它们在表示连续动力学和长程相互作用方面存在不足。为克服这些限制，我们提出了Mamba神经算子——一种增强基于神经算子的偏微分方程求解技术的新颖框架。MNO在结构化状态空间模型与神经算子之间建立了形式化的理论联系，提供了一个能适配包括Transformer模型在内的多种架构的统一结构。通过利用SSM的结构化设计，MNO比传统Transformer更有效地捕捉长程依赖和连续动力学。大量分析表明，MNO显著提升了神经算子的表达能力和精度，使其不仅是偏微分方程相关任务的补充框架，更是一种优越的解决方案，弥合了高效表示与精确求解近似之间的鸿沟。我们的代码公开于https://github.com/Math-ML-X/Mamba-Neural-Operator