Advertisement
Published in:
2012 | OriginalPaper | Chapter
Square Unit Augmented, Radially Extended, Multilayer Perceptrons
Author : Gary William Flake
Published in: Neural Networks: Tricks of the Trade
Publisher: Springer Berlin Heidelberg
Activate our intelligent search to find suitable subject content or patents.
Select sections of text to find matching patents with Artificial Intelligence. powered by
Select sections of text to find additional relevant content using AI-assisted search. powered by
Consider a multilayer perceptron (MLP) with
d
inputs, a single hidden sigmoidal layer and a linear output. By adding an additional
d
inputs to the network with values set to the square of the first d inputs, properties reminiscent of higher-order neural networks and radial basis function networks (RBFN) are added to the architecture with little added expense in terms of weight requirements. Of particular interest, this architecture has the ability to form localized features in a
d
-dimensional space with a single hidden node but can also span large volumes of the input space; thus, the architecture has the localized properties of an RBFN but does not suffer as badly from the curse of dimensionality. I refer to a network of this type as a SQuare Unit Augmented, Radially Extended, MultiLayer Perceptron (SQUARE-MLP or SMLP).