首页> 外文OA文献 >Bounding the search space for global optimization of neural networks learning error: an interval analysis approach
【2h】

Bounding the search space for global optimization of neural networks learning error: an interval analysis approach

机译:限制搜索空间以进行神经网络学习误差的全局优化:区间分析方法

摘要

Training a multilayer perceptron (MLP) with algorithms employing global search strategies has been an important research direction in the field of neural networks. Despite a number of significant results, an important matter concerning the bounds of the search region---typically defined as a box---where a global optimization method has to search for a potential global minimizer seems to be unresolved. The approach presented in this paper builds on interval analysis and attempts to define guaranteed bounds in the search space prior to applying a global search algorithm for training an MLP. These bounds depend on the machine precision and the term guaranteed denotes that the region defined surely encloses weight sets that are global minimizers of the neural network's error function. Although the solution set to the bounding problem for an MLP is in general non-convex, the paper presents the theoretical results that help deriving a box which is a convex set. This box is an outer approximation of the algebraic solutions to the interval equations resulting from the function implemented by the network nodes. An experimental study using well known benchmarks is presented in accordance with the theoretical results.
机译:利用采用全局搜索策略的算法训练多层感知器(MLP)已经成为神经网络领域的重要研究方向。尽管取得了许多显着结果,但是关于搜索区域边界的一个重要问题(通常定义为方框)似乎尚未解决,在该区域中,全局优化方法必须搜索潜在的全局最小化器。本文提出的方法建立在间隔分析的基础上,并尝试在应用全局搜索算法训练MLP之前在搜索空间中定义保证范围。这些界限取决于机器的精度,“保证”一词表示所定义的区域肯定包含权重集,这些权重集是神经网络误差函数的全局极小值。尽管针对MLP的边界问题的解集通常是非凸的,但本文提出的理论结果有助于推导作为凸集的盒子。此框是对由网络节点实现的函数得出的区间方程的代数解的外部近似。根据理论结果,提出了使用众所周知的基准进行的实验研究。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号