Skip to main content
Top

2012 | OriginalPaper | Chapter

13. Construction of Radial Basis Function Networks with Diversified Topologies

Authors : X. Hong, S. Chen, C. J. Harris

Published in: System Identification, Environmental Modelling, and Control System Design

Publisher: Springer London

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this review we bring together some of our recent work from the angle of the diversified RBF topologies, including three different topologies; (i) the RBF network with tunable nodes; (ii) the Box-Cox output transformation based RBF network (Box-Cox RBF); and (iii) the RBF network with boundary value constraints (BVC-RBF). We show that the modified topologies have some advantages over the conventional RBF topology for specific problems. For each modified topology, the model construction algorithms have been developed. These proposed RBF topologies are respectively aimed at enhancing the modelling capabilities of; (i)flexible basis function shaping for improved model generalization with the minimal model;(ii) effectively handling some dynamical processes in which the model residuals exhibit heteroscedasticity; and (iii) achieving automatic constraints satisfaction so as to incorporate deterministic prior knowledge with ease. It is shown that it is advantageous that the linear learning algorithms, e.g. the orthogonal forward selection (OFS) algorithm based leave-one-out (LOO) criteria, are still applicable as part of the proposed algorithms.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Hong, X., Mitchell, R.J., Chen, S., Harris, C.J., Li, K., Irwin, G.W.: Model selection approaches for nonlinear system identification: a review. Int. J. Syst. Sci. 39(10), 925–946 (2008) MathSciNetMATHCrossRef Hong, X., Mitchell, R.J., Chen, S., Harris, C.J., Li, K., Irwin, G.W.: Model selection approaches for nonlinear system identification: a review. Int. J. Syst. Sci. 39(10), 925–946 (2008) MathSciNetMATHCrossRef
2.
go back to reference Harris, C.J., Hong, X., Gan, Q.: Adaptive Modelling, Estimation and Fusion from Data: A Neurofuzzy Approach. Springer, Berlin (2002) MATHCrossRef Harris, C.J., Hong, X., Gan, Q.: Adaptive Modelling, Estimation and Fusion from Data: A Neurofuzzy Approach. Springer, Berlin (2002) MATHCrossRef
3.
go back to reference Brown, M., Harris, C.J.: Neurofuzzy Adaptive Modelling and Control. Prentice Hall, Upper Saddle River (1994) Brown, M., Harris, C.J.: Neurofuzzy Adaptive Modelling and Control. Prentice Hall, Upper Saddle River (1994)
4.
go back to reference Ruano, A.E.: Intelligent Control Systems using Computational Intelligence Techniques. IEE Publishing, New York (2005) MATHCrossRef Ruano, A.E.: Intelligent Control Systems using Computational Intelligence Techniques. IEE Publishing, New York (2005) MATHCrossRef
5.
go back to reference Murray-Smith, R., Johansen, T.A.: Multiple Model Approaches to Modelling and Control. Taylor and Francis, London (1997) Murray-Smith, R., Johansen, T.A.: Multiple Model Approaches to Modelling and Control. Taylor and Francis, London (1997)
6.
go back to reference Fabri, S.G., Kadirkamanathan, V.: Functional Adaptive Control: An Intelligent Systems Approach. Springer, Berlin (2001) MATH Fabri, S.G., Kadirkamanathan, V.: Functional Adaptive Control: An Intelligent Systems Approach. Springer, Berlin (2001) MATH
7.
go back to reference Leonard, J.A., Kramer, M.A.: Radial basis function networks for classifying process faults. IEEE Control Syst. Mag. 11(3), 31–38 (1991) CrossRef Leonard, J.A., Kramer, M.A.: Radial basis function networks for classifying process faults. IEEE Control Syst. Mag. 11(3), 31–38 (1991) CrossRef
8.
go back to reference Caiti, A., Parisini, T.: Mapping ocean sediments by RBF networks. IEEE J. Ocean. Eng. 19(4), 577–582 (1994) CrossRef Caiti, A., Parisini, T.: Mapping ocean sediments by RBF networks. IEEE J. Ocean. Eng. 19(4), 577–582 (1994) CrossRef
9.
go back to reference Li, Y., Sundararajan, N., Saratchandran, P., Wang, Z.: Robust neuro-H∞ controller design for aircraft auto-landing. IEEE Trans. Aerosp. Electron. Syst. 40(1), 158–167 (2004) CrossRef Li, Y., Sundararajan, N., Saratchandran, P., Wang, Z.: Robust neuro-H controller design for aircraft auto-landing. IEEE Trans. Aerosp. Electron. Syst. 40(1), 158–167 (2004) CrossRef
10.
go back to reference Ng, S.X., Yee, M.S., Hanzo, L.: Coded modulation assisted radial basis function aided turbo equalization for dispersive Rayleigh-fading channels. IEEE Trans. Wirel. Commun. 3(6), 2198–2206 (2004) CrossRef Ng, S.X., Yee, M.S., Hanzo, L.: Coded modulation assisted radial basis function aided turbo equalization for dispersive Rayleigh-fading channels. IEEE Trans. Wirel. Commun. 3(6), 2198–2206 (2004) CrossRef
11.
go back to reference Stone, M.: Cross validatory choice and assessment of statistical predictions. J. R. Stat. Soc. B 36, 117–147 (1974) Stone, M.: Cross validatory choice and assessment of statistical predictions. J. R. Stat. Soc. B 36, 117–147 (1974)
12.
go back to reference Akaike, H.: A new look at the statistical model identification. IEEE Trans. Autom. Control AC-19, 716–723 (1974) MathSciNetCrossRef Akaike, H.: A new look at the statistical model identification. IEEE Trans. Autom. Control AC-19, 716–723 (1974) MathSciNetCrossRef
13.
go back to reference Chen, S., Billings, S.A., Luo, W.: Orthogonal least squares methods and their applications to non-linear system identification. Int. J. Control 50, 1873–1896 (1989) MathSciNetMATHCrossRef Chen, S., Billings, S.A., Luo, W.: Orthogonal least squares methods and their applications to non-linear system identification. Int. J. Control 50, 1873–1896 (1989) MathSciNetMATHCrossRef
14.
go back to reference Korenberg, M.J.: Identifying nonlinear difference equation and functional expansion representations: the fast orthogonal algorithm. Ann. Biomed. Eng. 16, 123–142 (1988) CrossRef Korenberg, M.J.: Identifying nonlinear difference equation and functional expansion representations: the fast orthogonal algorithm. Ann. Biomed. Eng. 16, 123–142 (1988) CrossRef
15.
go back to reference Wang, L., Mendel, J.M.: Fuzzy basis functions, universal approximation, and orthogonal least-squares learning. IEEE Trans. Neural Netw. 5, 807–814 (1992) CrossRef Wang, L., Mendel, J.M.: Fuzzy basis functions, universal approximation, and orthogonal least-squares learning. IEEE Trans. Neural Netw. 5, 807–814 (1992) CrossRef
16.
go back to reference Hong, X., Harris, C.J.: Neurofuzzy design and model construction of nonlinear dynamical processes from data. IEE Proc., Control Theory Appl. 148(6), 530–538 (2001) CrossRef Hong, X., Harris, C.J.: Neurofuzzy design and model construction of nonlinear dynamical processes from data. IEE Proc., Control Theory Appl. 148(6), 530–538 (2001) CrossRef
17.
go back to reference Zhang, Q.: Using wavelets network in nonparametric estimation. IEEE Trans. Neural Netw. 8(2), 1997 (1993) Zhang, Q.: Using wavelets network in nonparametric estimation. IEEE Trans. Neural Netw. 8(2), 1997 (1993)
18.
go back to reference Billings, S.A., Wei, H.L.: The wavelet-narmax representation: a hybrid model structure combining polynomial models with multiresolution wavelet decompositions. Int. J. Syst. Sci. 36(3), 137–152 (2005) MathSciNetMATHCrossRef Billings, S.A., Wei, H.L.: The wavelet-narmax representation: a hybrid model structure combining polynomial models with multiresolution wavelet decompositions. Int. J. Syst. Sci. 36(3), 137–152 (2005) MathSciNetMATHCrossRef
19.
go back to reference Hong, X., Sharkey, P.M., Warwick, K.: Automatic nonlinear predictive model construction using forward regression and the PRESS statistic. IEE Proc., Control Theory Appl. 150(3), 245–254 (2003) CrossRef Hong, X., Sharkey, P.M., Warwick, K.: Automatic nonlinear predictive model construction using forward regression and the PRESS statistic. IEE Proc., Control Theory Appl. 150(3), 245–254 (2003) CrossRef
20.
go back to reference Chen, S., Hong, X., Harris, C.J.: Construction of tunable radial basis function networks using orthogonal forward selection. IEEE Trans. Syst. Man Cybern., Part B, Cybern. 39(2), 457–466 (2009) MathSciNetCrossRef Chen, S., Hong, X., Harris, C.J.: Construction of tunable radial basis function networks using orthogonal forward selection. IEEE Trans. Syst. Man Cybern., Part B, Cybern. 39(2), 457–466 (2009) MathSciNetCrossRef
21.
go back to reference Hong, X.: Modified radial basisfunction neural networks using output transformation. IEE Proc., Control Theory Appl. 1(1), 1–8 (2007) MATHCrossRef Hong, X.: Modified radial basisfunction neural networks using output transformation. IEE Proc., Control Theory Appl. 1(1), 1–8 (2007) MATHCrossRef
22.
go back to reference Hong, X., Chen, S.: A new RBF neural network with boundary value constraints. IEEE Trans. Syst. Man Cybern., Part B, Cybern. 39(1), 298–303 (2009) CrossRef Hong, X., Chen, S.: A new RBF neural network with boundary value constraints. IEEE Trans. Syst. Man Cybern., Part B, Cybern. 39(1), 298–303 (2009) CrossRef
23.
go back to reference Vapnik, V.: The Nature of Statictical Learning Theory. Springer, New York (1995) Vapnik, V.: The Nature of Statictical Learning Theory. Springer, New York (1995)
24.
go back to reference Gunn, S.R.: Support vector machine for classification and regression. Technical Report, ISIS Research Group, Dept of Electronics and Computer Science, University of Southampton (1998) Gunn, S.R.: Support vector machine for classification and regression. Technical Report, ISIS Research Group, Dept of Electronics and Computer Science, University of Southampton (1998)
25.
go back to reference Chen, S.S., Donoho, D.L., Saunders, M.A.: Atomic decomposition by basis pursuit. SIAM J. Sci. Comput. 20(1), 33–61 (1998) MathSciNetCrossRef Chen, S.S., Donoho, D.L., Saunders, M.A.: Atomic decomposition by basis pursuit. SIAM J. Sci. Comput. 20(1), 33–61 (1998) MathSciNetCrossRef
26.
go back to reference Tipping, M.E.: Sparse Bayesian learning and the relevance vector machine. J. Mach. Learn. Res. 1, 211–244 (2001) MathSciNetMATH Tipping, M.E.: Sparse Bayesian learning and the relevance vector machine. J. Mach. Learn. Res. 1, 211–244 (2001) MathSciNetMATH
27.
go back to reference Chen, S., Hong, X., Harris, C.J., Sharkey, P.M.: Sparse modelling using orthogonal forward regression with PRESS statistic and regularization. IEEE Trans. Syst. Man Cybern., Part B, Cybern. 34(2), 898–911 (2004) CrossRef Chen, S., Hong, X., Harris, C.J., Sharkey, P.M.: Sparse modelling using orthogonal forward regression with PRESS statistic and regularization. IEEE Trans. Syst. Man Cybern., Part B, Cybern. 34(2), 898–911 (2004) CrossRef
28.
go back to reference Myers, R.H.: Classical and Modern Regression with Applications, 2nd edn. PWS-KENT, Boston (1990) Myers, R.H.: Classical and Modern Regression with Applications, 2nd edn. PWS-KENT, Boston (1990)
29.
go back to reference Chen, S., Wang, X.X., Harris, C.J.: Experiments with repeating weighted boosting search for optimization signal processing applications. IEEE Trans. Syst. Man Cybern., Part B, Cybern. 35(4), 682–693 (2005) CrossRef Chen, S., Wang, X.X., Harris, C.J.: Experiments with repeating weighted boosting search for optimization signal processing applications. IEEE Trans. Syst. Man Cybern., Part B, Cybern. 35(4), 682–693 (2005) CrossRef
31.
go back to reference Chen, S., Hong, X., Luk, B.L., Harris, C.J.: Nonlinear system identification using particle swarm optimization tuned radial basis function models. Int. J. Bio-Inspired Comput. 1(4), 246–258 (2009) CrossRef Chen, S., Hong, X., Luk, B.L., Harris, C.J.: Nonlinear system identification using particle swarm optimization tuned radial basis function models. Int. J. Bio-Inspired Comput. 1(4), 246–258 (2009) CrossRef
32.
33.
go back to reference Carroll, R.J., Ruppert, D.: Transformation and Weighting in Regression. Chapman and Hall, London (1988) MATH Carroll, R.J., Ruppert, D.: Transformation and Weighting in Regression. Chapman and Hall, London (1988) MATH
34.
go back to reference Ding, A.A., He, X.: Backpropagation of pseudoerrors: neural networks that are adaptive to heterogeneous noise. IEEE Trans. Neural Netw. 14(2), 253–262 (2003) CrossRef Ding, A.A., He, X.: Backpropagation of pseudoerrors: neural networks that are adaptive to heterogeneous noise. IEEE Trans. Neural Netw. 14(2), 253–262 (2003) CrossRef
35.
go back to reference Chen, S., Wu, Y., Luk, B.L.: Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networks. IEEE Trans. Neural Netw. 10, 1239–1243 (1999) CrossRef Chen, S., Wu, Y., Luk, B.L.: Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networks. IEEE Trans. Neural Netw. 10, 1239–1243 (1999) CrossRef
36.
go back to reference Hong, X., Harris, C.J.: Nonlinear model structure design and construction using orthogonal least squares and D-optimality design. IEEE Trans. Neural Netw. 13(5), 1245–1250 (2002) CrossRef Hong, X., Harris, C.J.: Nonlinear model structure design and construction using orthogonal least squares and D-optimality design. IEEE Trans. Neural Netw. 13(5), 1245–1250 (2002) CrossRef
37.
go back to reference Chen, S.: Locally regularised orthogonal least squares algorithm for the construction of sparse kernel regression models. In: Proceedings of 6th Int. Conf. Signal Processing, Beijing, China, pp. 1229–1232 (2002) Chen, S.: Locally regularised orthogonal least squares algorithm for the construction of sparse kernel regression models. In: Proceedings of 6th Int. Conf. Signal Processing, Beijing, China, pp. 1229–1232 (2002)
38.
go back to reference Powell, M.J.D.: Problems related to unconstrained optimization. In: Murray, W. (ed.) Numerical Methods for Unconstrained Optimization, pp. 29–55. Academic Press, London (1972) Powell, M.J.D.: Problems related to unconstrained optimization. In: Murray, W. (ed.) Numerical Methods for Unconstrained Optimization, pp. 29–55. Academic Press, London (1972)
39.
go back to reference Hipel, K.W., Mcleod, A.I.: Time Series Modelling of Water Resources and Environmental Systems. Elsevier, Amsterdam (1994) Hipel, K.W., Mcleod, A.I.: Time Series Modelling of Water Resources and Environmental Systems. Elsevier, Amsterdam (1994)
40.
go back to reference Atkinson, A.C., Donev, A.N.: Optimum Experimental Designs. Clarendon Press, Oxford (1992) MATH Atkinson, A.C., Donev, A.N.: Optimum Experimental Designs. Clarendon Press, Oxford (1992) MATH
41.
go back to reference Hong, X., Harris, C.J.: Experimental design and model construction algorithms for radial basis function networks. Int. J. Syst. Sci. 34(14–15), 733–745 (2003) MATHCrossRef Hong, X., Harris, C.J.: Experimental design and model construction algorithms for radial basis function networks. Int. J. Syst. Sci. 34(14–15), 733–745 (2003) MATHCrossRef
Metadata
Title
Construction of Radial Basis Function Networks with Diversified Topologies
Authors
X. Hong
S. Chen
C. J. Harris
Copyright Year
2012
Publisher
Springer London
DOI
https://doi.org/10.1007/978-0-85729-974-1_13