Mixed Radial Basis Function Neural Network Training Using Genetic Algorithm

The Radial Basis Function Neural Network (RBFNN) is a feedforward artificial neural network employing radial basis functions as activation functions in the hidden layer. The output of the RBFNN is a linear combination of the outputs from the hidden layer. This paper present a Mixed Radial Basis Function Neural Network (MRBFNN) training using Genetic Algorithm (GA). The choice of the type of Radial Basis Functions (RBFs) utilized in each hidden layer neuron has a significant impact on convergence, interpolation and performance. In this work, the authors are introducing a new approach to optimizing the choice of radial basis functions, centers, radius and weights of the output layer. We model in terms of mixed-variable optimization problems with linear constraints. To solve this model we will use an approach based on the genetic algorithm, allows us to determine the types of RBF to use in the hidden layer and the optimal weight of the output layer which gives us a good generalization. The results numerically demonstrate the performance of the theoretic results presented in this paper, as well as the benefits of the new modeling.