Skip to main content

2012 | OriginalPaper | Buchkapitel

13. Construction of Radial Basis Function Networks with Diversified Topologies

verfasst von : X. Hong, S. Chen, C. J. Harris

Erschienen in: System Identification, Environmental Modelling, and Control System Design

Verlag: Springer London

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this review we bring together some of our recent work from the angle of the diversified RBF topologies, including three different topologies; (i) the RBF network with tunable nodes; (ii) the Box-Cox output transformation based RBF network (Box-Cox RBF); and (iii) the RBF network with boundary value constraints (BVC-RBF). We show that the modified topologies have some advantages over the conventional RBF topology for specific problems. For each modified topology, the model construction algorithms have been developed. These proposed RBF topologies are respectively aimed at enhancing the modelling capabilities of; (i)flexible basis function shaping for improved model generalization with the minimal model;(ii) effectively handling some dynamical processes in which the model residuals exhibit heteroscedasticity; and (iii) achieving automatic constraints satisfaction so as to incorporate deterministic prior knowledge with ease. It is shown that it is advantageous that the linear learning algorithms, e.g. the orthogonal forward selection (OFS) algorithm based leave-one-out (LOO) criteria, are still applicable as part of the proposed algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hong, X., Mitchell, R.J., Chen, S., Harris, C.J., Li, K., Irwin, G.W.: Model selection approaches for nonlinear system identification: a review. Int. J. Syst. Sci. 39(10), 925–946 (2008) MathSciNetMATHCrossRef Hong, X., Mitchell, R.J., Chen, S., Harris, C.J., Li, K., Irwin, G.W.: Model selection approaches for nonlinear system identification: a review. Int. J. Syst. Sci. 39(10), 925–946 (2008) MathSciNetMATHCrossRef
2.
Zurück zum Zitat Harris, C.J., Hong, X., Gan, Q.: Adaptive Modelling, Estimation and Fusion from Data: A Neurofuzzy Approach. Springer, Berlin (2002) MATHCrossRef Harris, C.J., Hong, X., Gan, Q.: Adaptive Modelling, Estimation and Fusion from Data: A Neurofuzzy Approach. Springer, Berlin (2002) MATHCrossRef
3.
Zurück zum Zitat Brown, M., Harris, C.J.: Neurofuzzy Adaptive Modelling and Control. Prentice Hall, Upper Saddle River (1994) Brown, M., Harris, C.J.: Neurofuzzy Adaptive Modelling and Control. Prentice Hall, Upper Saddle River (1994)
4.
Zurück zum Zitat Ruano, A.E.: Intelligent Control Systems using Computational Intelligence Techniques. IEE Publishing, New York (2005) MATHCrossRef Ruano, A.E.: Intelligent Control Systems using Computational Intelligence Techniques. IEE Publishing, New York (2005) MATHCrossRef
5.
Zurück zum Zitat Murray-Smith, R., Johansen, T.A.: Multiple Model Approaches to Modelling and Control. Taylor and Francis, London (1997) Murray-Smith, R., Johansen, T.A.: Multiple Model Approaches to Modelling and Control. Taylor and Francis, London (1997)
6.
Zurück zum Zitat Fabri, S.G., Kadirkamanathan, V.: Functional Adaptive Control: An Intelligent Systems Approach. Springer, Berlin (2001) MATH Fabri, S.G., Kadirkamanathan, V.: Functional Adaptive Control: An Intelligent Systems Approach. Springer, Berlin (2001) MATH
7.
Zurück zum Zitat Leonard, J.A., Kramer, M.A.: Radial basis function networks for classifying process faults. IEEE Control Syst. Mag. 11(3), 31–38 (1991) CrossRef Leonard, J.A., Kramer, M.A.: Radial basis function networks for classifying process faults. IEEE Control Syst. Mag. 11(3), 31–38 (1991) CrossRef
8.
Zurück zum Zitat Caiti, A., Parisini, T.: Mapping ocean sediments by RBF networks. IEEE J. Ocean. Eng. 19(4), 577–582 (1994) CrossRef Caiti, A., Parisini, T.: Mapping ocean sediments by RBF networks. IEEE J. Ocean. Eng. 19(4), 577–582 (1994) CrossRef
9.
Zurück zum Zitat Li, Y., Sundararajan, N., Saratchandran, P., Wang, Z.: Robust neuro-H∞ controller design for aircraft auto-landing. IEEE Trans. Aerosp. Electron. Syst. 40(1), 158–167 (2004) CrossRef Li, Y., Sundararajan, N., Saratchandran, P., Wang, Z.: Robust neuro-H controller design for aircraft auto-landing. IEEE Trans. Aerosp. Electron. Syst. 40(1), 158–167 (2004) CrossRef
10.
Zurück zum Zitat Ng, S.X., Yee, M.S., Hanzo, L.: Coded modulation assisted radial basis function aided turbo equalization for dispersive Rayleigh-fading channels. IEEE Trans. Wirel. Commun. 3(6), 2198–2206 (2004) CrossRef Ng, S.X., Yee, M.S., Hanzo, L.: Coded modulation assisted radial basis function aided turbo equalization for dispersive Rayleigh-fading channels. IEEE Trans. Wirel. Commun. 3(6), 2198–2206 (2004) CrossRef
11.
Zurück zum Zitat Stone, M.: Cross validatory choice and assessment of statistical predictions. J. R. Stat. Soc. B 36, 117–147 (1974) Stone, M.: Cross validatory choice and assessment of statistical predictions. J. R. Stat. Soc. B 36, 117–147 (1974)
12.
Zurück zum Zitat Akaike, H.: A new look at the statistical model identification. IEEE Trans. Autom. Control AC-19, 716–723 (1974) MathSciNetCrossRef Akaike, H.: A new look at the statistical model identification. IEEE Trans. Autom. Control AC-19, 716–723 (1974) MathSciNetCrossRef
13.
Zurück zum Zitat Chen, S., Billings, S.A., Luo, W.: Orthogonal least squares methods and their applications to non-linear system identification. Int. J. Control 50, 1873–1896 (1989) MathSciNetMATHCrossRef Chen, S., Billings, S.A., Luo, W.: Orthogonal least squares methods and their applications to non-linear system identification. Int. J. Control 50, 1873–1896 (1989) MathSciNetMATHCrossRef
14.
Zurück zum Zitat Korenberg, M.J.: Identifying nonlinear difference equation and functional expansion representations: the fast orthogonal algorithm. Ann. Biomed. Eng. 16, 123–142 (1988) CrossRef Korenberg, M.J.: Identifying nonlinear difference equation and functional expansion representations: the fast orthogonal algorithm. Ann. Biomed. Eng. 16, 123–142 (1988) CrossRef
15.
Zurück zum Zitat Wang, L., Mendel, J.M.: Fuzzy basis functions, universal approximation, and orthogonal least-squares learning. IEEE Trans. Neural Netw. 5, 807–814 (1992) CrossRef Wang, L., Mendel, J.M.: Fuzzy basis functions, universal approximation, and orthogonal least-squares learning. IEEE Trans. Neural Netw. 5, 807–814 (1992) CrossRef
16.
Zurück zum Zitat Hong, X., Harris, C.J.: Neurofuzzy design and model construction of nonlinear dynamical processes from data. IEE Proc., Control Theory Appl. 148(6), 530–538 (2001) CrossRef Hong, X., Harris, C.J.: Neurofuzzy design and model construction of nonlinear dynamical processes from data. IEE Proc., Control Theory Appl. 148(6), 530–538 (2001) CrossRef
17.
Zurück zum Zitat Zhang, Q.: Using wavelets network in nonparametric estimation. IEEE Trans. Neural Netw. 8(2), 1997 (1993) Zhang, Q.: Using wavelets network in nonparametric estimation. IEEE Trans. Neural Netw. 8(2), 1997 (1993)
18.
Zurück zum Zitat Billings, S.A., Wei, H.L.: The wavelet-narmax representation: a hybrid model structure combining polynomial models with multiresolution wavelet decompositions. Int. J. Syst. Sci. 36(3), 137–152 (2005) MathSciNetMATHCrossRef Billings, S.A., Wei, H.L.: The wavelet-narmax representation: a hybrid model structure combining polynomial models with multiresolution wavelet decompositions. Int. J. Syst. Sci. 36(3), 137–152 (2005) MathSciNetMATHCrossRef
19.
Zurück zum Zitat Hong, X., Sharkey, P.M., Warwick, K.: Automatic nonlinear predictive model construction using forward regression and the PRESS statistic. IEE Proc., Control Theory Appl. 150(3), 245–254 (2003) CrossRef Hong, X., Sharkey, P.M., Warwick, K.: Automatic nonlinear predictive model construction using forward regression and the PRESS statistic. IEE Proc., Control Theory Appl. 150(3), 245–254 (2003) CrossRef
20.
Zurück zum Zitat Chen, S., Hong, X., Harris, C.J.: Construction of tunable radial basis function networks using orthogonal forward selection. IEEE Trans. Syst. Man Cybern., Part B, Cybern. 39(2), 457–466 (2009) MathSciNetCrossRef Chen, S., Hong, X., Harris, C.J.: Construction of tunable radial basis function networks using orthogonal forward selection. IEEE Trans. Syst. Man Cybern., Part B, Cybern. 39(2), 457–466 (2009) MathSciNetCrossRef
21.
Zurück zum Zitat Hong, X.: Modified radial basisfunction neural networks using output transformation. IEE Proc., Control Theory Appl. 1(1), 1–8 (2007) MATHCrossRef Hong, X.: Modified radial basisfunction neural networks using output transformation. IEE Proc., Control Theory Appl. 1(1), 1–8 (2007) MATHCrossRef
22.
Zurück zum Zitat Hong, X., Chen, S.: A new RBF neural network with boundary value constraints. IEEE Trans. Syst. Man Cybern., Part B, Cybern. 39(1), 298–303 (2009) CrossRef Hong, X., Chen, S.: A new RBF neural network with boundary value constraints. IEEE Trans. Syst. Man Cybern., Part B, Cybern. 39(1), 298–303 (2009) CrossRef
23.
Zurück zum Zitat Vapnik, V.: The Nature of Statictical Learning Theory. Springer, New York (1995) Vapnik, V.: The Nature of Statictical Learning Theory. Springer, New York (1995)
24.
Zurück zum Zitat Gunn, S.R.: Support vector machine for classification and regression. Technical Report, ISIS Research Group, Dept of Electronics and Computer Science, University of Southampton (1998) Gunn, S.R.: Support vector machine for classification and regression. Technical Report, ISIS Research Group, Dept of Electronics and Computer Science, University of Southampton (1998)
25.
Zurück zum Zitat Chen, S.S., Donoho, D.L., Saunders, M.A.: Atomic decomposition by basis pursuit. SIAM J. Sci. Comput. 20(1), 33–61 (1998) MathSciNetCrossRef Chen, S.S., Donoho, D.L., Saunders, M.A.: Atomic decomposition by basis pursuit. SIAM J. Sci. Comput. 20(1), 33–61 (1998) MathSciNetCrossRef
26.
Zurück zum Zitat Tipping, M.E.: Sparse Bayesian learning and the relevance vector machine. J. Mach. Learn. Res. 1, 211–244 (2001) MathSciNetMATH Tipping, M.E.: Sparse Bayesian learning and the relevance vector machine. J. Mach. Learn. Res. 1, 211–244 (2001) MathSciNetMATH
27.
Zurück zum Zitat Chen, S., Hong, X., Harris, C.J., Sharkey, P.M.: Sparse modelling using orthogonal forward regression with PRESS statistic and regularization. IEEE Trans. Syst. Man Cybern., Part B, Cybern. 34(2), 898–911 (2004) CrossRef Chen, S., Hong, X., Harris, C.J., Sharkey, P.M.: Sparse modelling using orthogonal forward regression with PRESS statistic and regularization. IEEE Trans. Syst. Man Cybern., Part B, Cybern. 34(2), 898–911 (2004) CrossRef
28.
Zurück zum Zitat Myers, R.H.: Classical and Modern Regression with Applications, 2nd edn. PWS-KENT, Boston (1990) Myers, R.H.: Classical and Modern Regression with Applications, 2nd edn. PWS-KENT, Boston (1990)
29.
Zurück zum Zitat Chen, S., Wang, X.X., Harris, C.J.: Experiments with repeating weighted boosting search for optimization signal processing applications. IEEE Trans. Syst. Man Cybern., Part B, Cybern. 35(4), 682–693 (2005) CrossRef Chen, S., Wang, X.X., Harris, C.J.: Experiments with repeating weighted boosting search for optimization signal processing applications. IEEE Trans. Syst. Man Cybern., Part B, Cybern. 35(4), 682–693 (2005) CrossRef
31.
Zurück zum Zitat Chen, S., Hong, X., Luk, B.L., Harris, C.J.: Nonlinear system identification using particle swarm optimization tuned radial basis function models. Int. J. Bio-Inspired Comput. 1(4), 246–258 (2009) CrossRef Chen, S., Hong, X., Luk, B.L., Harris, C.J.: Nonlinear system identification using particle swarm optimization tuned radial basis function models. Int. J. Bio-Inspired Comput. 1(4), 246–258 (2009) CrossRef
32.
Zurück zum Zitat Box, G.E.P., Cox, D.R.: An analysis of transformation. J. R. Stat. Soc. B 26(2), 211–252 (1964) MathSciNetMATH Box, G.E.P., Cox, D.R.: An analysis of transformation. J. R. Stat. Soc. B 26(2), 211–252 (1964) MathSciNetMATH
33.
Zurück zum Zitat Carroll, R.J., Ruppert, D.: Transformation and Weighting in Regression. Chapman and Hall, London (1988) MATH Carroll, R.J., Ruppert, D.: Transformation and Weighting in Regression. Chapman and Hall, London (1988) MATH
34.
Zurück zum Zitat Ding, A.A., He, X.: Backpropagation of pseudoerrors: neural networks that are adaptive to heterogeneous noise. IEEE Trans. Neural Netw. 14(2), 253–262 (2003) CrossRef Ding, A.A., He, X.: Backpropagation of pseudoerrors: neural networks that are adaptive to heterogeneous noise. IEEE Trans. Neural Netw. 14(2), 253–262 (2003) CrossRef
35.
Zurück zum Zitat Chen, S., Wu, Y., Luk, B.L.: Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networks. IEEE Trans. Neural Netw. 10, 1239–1243 (1999) CrossRef Chen, S., Wu, Y., Luk, B.L.: Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networks. IEEE Trans. Neural Netw. 10, 1239–1243 (1999) CrossRef
36.
Zurück zum Zitat Hong, X., Harris, C.J.: Nonlinear model structure design and construction using orthogonal least squares and D-optimality design. IEEE Trans. Neural Netw. 13(5), 1245–1250 (2002) CrossRef Hong, X., Harris, C.J.: Nonlinear model structure design and construction using orthogonal least squares and D-optimality design. IEEE Trans. Neural Netw. 13(5), 1245–1250 (2002) CrossRef
37.
Zurück zum Zitat Chen, S.: Locally regularised orthogonal least squares algorithm for the construction of sparse kernel regression models. In: Proceedings of 6th Int. Conf. Signal Processing, Beijing, China, pp. 1229–1232 (2002) Chen, S.: Locally regularised orthogonal least squares algorithm for the construction of sparse kernel regression models. In: Proceedings of 6th Int. Conf. Signal Processing, Beijing, China, pp. 1229–1232 (2002)
38.
Zurück zum Zitat Powell, M.J.D.: Problems related to unconstrained optimization. In: Murray, W. (ed.) Numerical Methods for Unconstrained Optimization, pp. 29–55. Academic Press, London (1972) Powell, M.J.D.: Problems related to unconstrained optimization. In: Murray, W. (ed.) Numerical Methods for Unconstrained Optimization, pp. 29–55. Academic Press, London (1972)
39.
Zurück zum Zitat Hipel, K.W., Mcleod, A.I.: Time Series Modelling of Water Resources and Environmental Systems. Elsevier, Amsterdam (1994) Hipel, K.W., Mcleod, A.I.: Time Series Modelling of Water Resources and Environmental Systems. Elsevier, Amsterdam (1994)
40.
Zurück zum Zitat Atkinson, A.C., Donev, A.N.: Optimum Experimental Designs. Clarendon Press, Oxford (1992) MATH Atkinson, A.C., Donev, A.N.: Optimum Experimental Designs. Clarendon Press, Oxford (1992) MATH
41.
Zurück zum Zitat Hong, X., Harris, C.J.: Experimental design and model construction algorithms for radial basis function networks. Int. J. Syst. Sci. 34(14–15), 733–745 (2003) MATHCrossRef Hong, X., Harris, C.J.: Experimental design and model construction algorithms for radial basis function networks. Int. J. Syst. Sci. 34(14–15), 733–745 (2003) MATHCrossRef
Metadaten
Titel
Construction of Radial Basis Function Networks with Diversified Topologies
verfasst von
X. Hong
S. Chen
C. J. Harris
Copyright-Jahr
2012
Verlag
Springer London
DOI
https://doi.org/10.1007/978-0-85729-974-1_13

Neuer Inhalt