首页> 美国卫生研究院文献>other >Criticality meets learning: Criticality signatures in a self-organizing recurrent neural network
【2h】

Criticality meets learning: Criticality signatures in a self-organizing recurrent neural network

机译:关键性与学习相结合:自组织循环神经网络中的关键性特征

代理获取
本网站仅为用户提供外文OA文献查询和代理获取服务,本网站没有原文。下单后我们将采用程序或人工为您竭诚获取高质量的原文,但由于OA文献来源多样且变更频繁,仍可能出现获取不到、文献不完整或与标题不符等情况,如果获取不到我们将提供退款服务。请知悉。

摘要

Many experiments have suggested that the brain operates close to a critical state, based on signatures of criticality such as power-law distributed neuronal avalanches. In neural network models, criticality is a dynamical state that maximizes information processing capacities, e.g. sensitivity to input, dynamical range and storage capacity, which makes it a favorable candidate state for brain function. Although models that self-organize towards a critical state have been proposed, the relation between criticality signatures and learning is still unclear. Here, we investigate signatures of criticality in a self-organizing recurrent neural network (SORN). Investigating criticality in the SORN is of particular interest because it has not been developed to show criticality. Instead, the SORN has been shown to exhibit spatio-temporal pattern learning through a combination of neural plasticity mechanisms and it reproduces a number of biological findings on neural variability and the statistics and fluctuations of synaptic efficacies. We show that, after a transient, the SORN spontaneously self-organizes into a dynamical state that shows criticality signatures comparable to those found in experiments. The plasticity mechanisms are necessary to attain that dynamical state, but not to maintain it. Furthermore, onset of external input transiently changes the slope of the avalanche distributions – matching recent experimental findings. Interestingly, the membrane noise level necessary for the occurrence of the criticality signatures reduces the model’s performance in simple learning tasks. Overall, our work shows that the biologically inspired plasticity and homeostasis mechanisms responsible for the SORN’s spatio-temporal learning abilities can give rise to criticality signatures in its activity when driven by random input, but these break down under the structured input of short repeating sequences.
机译:许多实验表明,基于诸如功率法分布的神经元雪崩之类的临界信号,大脑接近临界状态。在神经网络模型中,关键程度是一种动态状态,可最大化信息处理能力,例如对输入,动态范围和存储容量的敏感性,使其成为大脑功能的良好候选状态。尽管已经提出了向临界状态自我组织的模型,但是临界特征和学习之间的关系仍然不清楚。在这里,我们研究自组织循环神经网络(SORN)中的关键性签名。在SORN中研究关键性尤为重要,因为尚未开发出显示关键性的方法。取而代之的是,SORN已显示出通过神经可塑性机制的组合表现出时空模式学习,并且它再现了许多有关神经变异性以及突触功效的统计和波动的生物学发现。我们表明,经过短暂的瞬变后,SORN会自发自发地组织成一个动态状态,该状态显示出与实验中发现的那些信号相当的临界信号。可塑性机制对于获得这种动态状态是必要的,但并不能维持这种状态。此外,外部输入的出现会暂时改变雪崩分布的斜率,与最近的实验结果相符。有趣的是,关键特征出现所需的膜噪声级会降低模型在简单学习任务中的性能。总体而言,我们的工作表明,由SORN的时空学习能力引起的生物学启发的可塑性和动态平衡机制在随机输入的驱动下会在其活动中产生临界特征,但在短重复序列的结构性输入下会分解。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
代理获取

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号