Due to their intrinsic capabilities on parallel signal processing, optical neural networks (ONNs) have attracted extensive interests recently as a potential alternative to electronic artificial neural networks (ANNs) with reduced power consumption and low latency. Preliminary confirmation of the parallelism in optical computing has been widely done by applying the technology of wavelength division multiplexing (WDM) in the linear transformation part of neural networks. However, inter-channel crosstalk has obstructed WDM technologies to be deployed in nonlinear activation in ONNs. Here, we propose a universal WDM structure called multiplexed neuron sets (MNS) which apply WDM technologies to optical neurons and enable ONNs to be further compressed. A corresponding back-propagation (BP) training algorithm is proposed to alleviate or even cancel the influence of inter-channel crosstalk on MNS-based WDM-ONNs. For simplicity, semiconductor optical amplifiers (SOAs) are employed as an example of MNS to construct a WDM-ONN trained with the new algorithm. The result shows that the combination of MNS and the corresponding BP training algorithm significantly downsize the system and improve the energy efficiency to tens of times while giving similar performance to traditional ONNs.
翻译:由于其固有的并行信号处理能力,光神经网络(ONN)作为电子人工神经网络(ANN)的潜在替代方案,近年来因功耗降低和低延迟优势而受到广泛关注。通过在神经网络线性变换部分应用波分复用(WDM)技术,光计算并行性已得到初步验证。然而,通道间串扰阻碍了WDM技术在ONN非线性激活中的部署。为此,我们提出一种通用WDM结构——复用神经元组(MNS),将WDM技术应用于光学神经元,使ONN得以进一步压缩。同时提出对应的反向传播(BP)训练算法,以缓解甚至消除通道间串扰对基于MNS的WDM-ONN的影响。为简化起见,以半导体光放大器(SOA)作为MNS实例构建WDM-ONN,并采用新算法进行训练。结果表明,MNS与对应BP训练算法的结合可显著缩小系统规模、提升数十倍的能效,同时保持与传统ONN相近的性能表现。