The Hopfield network model and its generalizations were introduced as a model of associative, or content-addressable, memory. They were widely investigated both as an unsupervised learning method in artificial intelligence and as a model of biological neural dynamics in computational neuroscience. The complexity features of biological neural networks have attracted the scientific community's interest for the last two decades. More recently, concepts and tools borrowed from complex network theory were applied to artificial neural networks and learning, thus focusing on the topological aspects. However, the temporal structure is also a crucial property displayed by biological neural networks and investigated in the framework of systems displaying complex intermittency. The Intermittency-Driven Complexity (IDC) approach indeed focuses on the metastability of self-organized states, whose signature is a power-decay in the inter-event time distribution or a scaling behaviour in the related event-driven diffusion processes. The investigation of IDC in neural dynamics and its relationship with network topology is still in its early stages. In this work, we present the preliminary results of an IDC analysis carried out on a bio-inspired Hopfield-type neural network comparing two different connectivities, i.e., scale-free vs. random network topology. We found that random networks can trigger complexity features similar to that of scale-free networks, even if with some differences and for different parameter values, in particular for different noise levels
翻译:Hopfield网络模型及其推广形式作为联想记忆或内容可寻址记忆模型被提出。该模型在人工智能领域作为无监督学习方法,以及在计算神经科学中作为生物神经动力学模型,均得到了广泛研究。近二十年来,生物神经网络的复杂性特征持续吸引着科学界的关注。近期,复杂网络理论中的概念与工具被应用于人工神经网络与学习过程,从而聚焦于拓扑结构层面的研究。然而,时间结构同样是生物神经网络表现出的关键特性,并在呈现复杂间歇性行为的系统框架下被深入探究。间歇性驱动复杂性(IDC)方法着重关注自组织状态的亚稳态特征,其典型表现为事件间隔时间分布中的幂律衰减,或相关事件驱动扩散过程中的标度行为。目前,针对神经动力学中IDC现象及其与网络拓扑关系的研究仍处于早期阶段。本研究对受生物启发的Hopfield型神经网络进行了IDC分析,比较了两种不同连接拓扑(即无标度网络与随机网络)下的特性,并展示了初步结果。我们发现,随机网络能够触发与无标度网络相似的复杂性特征,尽管二者存在一定差异且对应不同参数取值(特别是不同噪声水平时)。