We introduce the Fourier Learning Machine (FLM), a neural network (NN) architecture designed to represent a multidimensional nonharmonic Fourier series. The FLM uses a simple feedforward structure with cosine activation functions to learn the frequencies, amplitudes, and phase shifts of the series as trainable parameters. This design allows the model to create a problem-specific spectral basis adaptable to both periodic and nonperiodic functions. Unlike previous Fourier-inspired NN models, the FLM is the first architecture able to represent a multidimensional Fourier series with a complete set of basis functions in separable form, doing so by using a standard Multilayer Perceptron-like architecture. A one-to-one correspondence between the Fourier coefficients and amplitudes and phase-shifts is demonstrated, allowing for the translation between a full, separable basis form and the cosine phase-shifted one. Additionally, we evaluate the performance of FLMs on several scientific computing problems, including benchmark Partial Differential Equations (PDEs) and a family of Optimal Control Problems (OCPs). Computational experiments show that the performance of FLMs is comparable, and often superior, to that of established architectures like SIREN and vanilla feedforward NNs.
翻译:本文介绍傅里叶学习机(FLM),一种设计用于表示多维非调和傅里叶级数的神经网络架构。FLM采用具有余弦激活函数的简单前馈结构,将级数的频率、振幅和相移作为可训练参数进行学习。该设计使模型能够创建适应周期函数与非周期函数的、针对具体问题的谱基。与先前受傅里叶启发的神经网络模型不同,FLM是首个能够以可分离形式表示具有完备基函数集的多维傅里叶级数的架构,其实现方式是采用类似标准多层感知机的结构。我们论证了傅里叶系数与振幅及相移之间的一一对应关系,从而实现了完整的可分离基形式与余弦相移形式之间的转换。此外,我们在多个科学计算问题上评估了FLM的性能,包括基准偏微分方程(PDE)和一族最优控制问题(OCP)。计算实验表明,FLM的性能与SIREN及标准前馈神经网络等成熟架构相当,且通常更优。