We analyze the universal approximation property of Kolmogorov-Arnold Networks (KANs) in terms of their edge functions. If these functions are all affine, then universality clearly fails. How many non-affine functions are needed, in addition to affine ones, to ensure universality? We show that a single one suffices. More precisely, we prove that deep KANs in which all edge functions are either affine or equal to a fixed continuous function $σ$ are dense in $C(K)$ for every compact set $K\subset\mathbb{R}^n$ if and only if $σ$ is non-affine. In contrast, for KANs with exactly two hidden layers, universality holds if and only if $σ$ is nonpolynomial. We further show that the full class of affine functions is not required; it can be replaced by a finite set without affecting universality. In particular, in the nonpolynomial case, a fixed family of five affine functions suffices when the depth is arbitrary. More generally, for every continuous non-affine function $σ$, there exists a finite affine family $A_σ$ such that deep KANs with edge functions in $A_σ\cup\{σ\}$ remain universal. We also prove that KANs with the spline-based edge parameterization introduced by Liu et al.~\cite{Liu2024} are universal approximators in the classical sense, even when the spline degree and knot sequence are fixed in advance.
翻译:我们从边函数的角度分析了Kolmogorov-Arnold网络(KANs)的普适逼近性质。若所有边函数均为仿射函数,则普适性显然无法成立。在仿射函数之外,需要多少个非仿射函数才能确保普适性?我们证明仅需一个即可。更精确地,我们证明:对于每个紧集$K\subset\mathbb{R}^n$,当且仅当$σ$为非仿射连续函数时,所有边函数要么为仿射函数、要么等于固定连续函数$σ$的深度KAN在$C(K)$中稠密。相比之下,对于恰好具有两个隐藏层的KAN,当且仅当$σ$为非多项式函数时,普适性成立。我们进一步证明,无需完整的仿射函数类,可用有限集合替代而不影响普适性。特别地,在非多项式情形下,当深度任意时,五个仿射函数组成的固定族即可满足要求。更一般地,对任意连续非仿射函数$σ$,存在有限仿射族$A_σ$,使得边函数取自$A_σ\cup\{σ\}$的深度KAN仍具有普适性。我们还证明,采用Liu等人~\cite{Liu2024}提出的基于样条的边参数化的KAN,即使在样条次数和节点序列预先固定的情况下,也是经典意义上的普适逼近器。