Skip to main content
Top

2018 | OriginalPaper | Chapter

Ensemble Neural Network with Type-2 Fuzzy Weights Using Response Integration for Time Series Prediction

Authors : Fernando Gaxiola, Patricia Melin, Fevrier Valdez, Juan R. Castro

Published in: Recent Developments and the New Direction in Soft-Computing Foundations and Applications

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper an ensemble of three neural networks with type-2 fuzzy weights is proposed. One neural network uses type-2 fuzzy inference systems with Gaussian membership functions for obtain the fuzzy weights; the second neural network uses type-2 fuzzy inference systems with triangular membership functions; and the third neural network uses type-2 fuzzy inference systems with triangular membership functions with uncertainty in the standard deviation. Average integration and type-2 fuzzy integrator are used for the results of the ensemble neural network. The proposed approach is applied to a case of time series prediction, specifically in the Mackey-Glass time series.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference M. Cazorla, F. Escolano, Two Bayesian methods for junction detection. IEEE Trans. Image Process. 12(3), 317–327 (2003)MathSciNetCrossRef M. Cazorla, F. Escolano, Two Bayesian methods for junction detection. IEEE Trans. Image Process. 12(3), 317–327 (2003)MathSciNetCrossRef
2.
go back to reference G. Martinez, P. Melin, D. Bravo, F. Gonzalez, M. Gonzalez, Modular neural networks and fuzzy Sugeno integral for face and fingerprint recognition. Adv. Soft Comput. 34, 603–618 (2006)MATH G. Martinez, P. Melin, D. Bravo, F. Gonzalez, M. Gonzalez, Modular neural networks and fuzzy Sugeno integral for face and fingerprint recognition. Adv. Soft Comput. 34, 603–618 (2006)MATH
3.
go back to reference O. De Wilde, The magnitude of the diagonal elements in neural networks. Neural Netw. 10(3), 499–504 (1997)CrossRef O. De Wilde, The magnitude of the diagonal elements in neural networks. Neural Netw. 10(3), 499–504 (1997)CrossRef
4.
go back to reference P.A. Salazar, P. Melin, O. Castillo, A new biometric recognition technique based on hand geometry and voice using neural networks and fuzzy logic, in Soft Computing for Hybrid Intelligent Systems (2008), pp. 171–186 P.A. Salazar, P. Melin, O. Castillo, A new biometric recognition technique based on hand geometry and voice using neural networks and fuzzy logic, in Soft Computing for Hybrid Intelligent Systems (2008), pp. 171–186
5.
go back to reference V.V. Phansalkar, P.S. Sastry, Analysis of the back-propagation algorithm with momentum. IEEE Trans. Neural Networks 5(3), 505–506 (1994)CrossRef V.V. Phansalkar, P.S. Sastry, Analysis of the back-propagation algorithm with momentum. IEEE Trans. Neural Networks 5(3), 505–506 (1994)CrossRef
6.
go back to reference O. Castillo, P. Melin, Soft Computing for Control of Non-linear Dynamical Systems (Springer, Heidelberg, Germany, 2001)CrossRef O. Castillo, P. Melin, Soft Computing for Control of Non-linear Dynamical Systems (Springer, Heidelberg, Germany, 2001)CrossRef
7.
go back to reference P. Melin, O. Castillo, Hybrid Intelligent Systems for Pattern Recognition Using Soft Computing (Springer, Heidelberg, 2005), pp. 2–3CrossRef P. Melin, O. Castillo, Hybrid Intelligent Systems for Pattern Recognition Using Soft Computing (Springer, Heidelberg, 2005), pp. 2–3CrossRef
9.
go back to reference M. Okamura, H. Kikuch, R. Yager, S. Nakanishi, Character diagnosis of fuzzy systems by genetic algorithm and fuzzy inference, in Proceedings of the Vietnam-Japan Bilateral Symposium on Fuzzy Systems and Applications, Halong Bay, Vietnam (1998), pp. 468–473 M. Okamura, H. Kikuch, R. Yager, S. Nakanishi, Character diagnosis of fuzzy systems by genetic algorithm and fuzzy inference, in Proceedings of the Vietnam-Japan Bilateral Symposium on Fuzzy Systems and Applications, Halong Bay, Vietnam (1998), pp. 468–473
10.
go back to reference W. Wang, S. Bridges, Genetic Algorithm Optimization of Membership Functions for Mining Fuzzy Association Rules (Department of Computer Science Mississippi State University, 2000) W. Wang, S. Bridges, Genetic Algorithm Optimization of Membership Functions for Mining Fuzzy Association Rules (Department of Computer Science Mississippi State University, 2000)
11.
go back to reference J.S.R. Jang, C.T. Sun, E. Mizutani, Neuro-fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence (Prentice Hall, 1997) J.S.R. Jang, C.T. Sun, E. Mizutani, Neuro-fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence (Prentice Hall, 1997)
12.
go back to reference O. Castillo, P. Melin, Type-2 Fuzzy Logic Theory and Applications (Springer, Berlin, 2008), pp. 29–43 O. Castillo, P. Melin, Type-2 Fuzzy Logic Theory and Applications (Springer, Berlin, 2008), pp. 29–43
13.
go back to reference J. Castro, O. Castillo, P. Melin, An interval type-2 fuzzy logic toolbox for control applications, in FUZZ-IEEE (2007), pp. 1–6 J. Castro, O. Castillo, P. Melin, An interval type-2 fuzzy logic toolbox for control applications, in FUZZ-IEEE (2007), pp. 1–6
14.
go back to reference J. Castro, O. Castillo, P. Melin, A. Rodriguez-Diaz, Building fuzzy inference systems with a new interval type-2 fuzzy logic toolbox. Trans. Comput. Sci. 1, 104–114 (2008) J. Castro, O. Castillo, P. Melin, A. Rodriguez-Diaz, Building fuzzy inference systems with a new interval type-2 fuzzy logic toolbox. Trans. Comput. Sci. 1, 104–114 (2008)
15.
go back to reference D. Hidalgo, O. Castillo, P. Melin, Type-1 and type-2 fuzzy inference systems as integration methods in modular neural networks for multimodal biometry and its optimization with genetic algorithms, in Soft Computing for Hybrid Intelligent Systems (2008), pp. 89–114 D. Hidalgo, O. Castillo, P. Melin, Type-1 and type-2 fuzzy inference systems as integration methods in modular neural networks for multimodal biometry and its optimization with genetic algorithms, in Soft Computing for Hybrid Intelligent Systems (2008), pp. 89–114
16.
go back to reference D. Sanchez, P. Melin, Optimization of modular neural networks and type-2 fuzzy integrators using hierarchical genetic algorithms for human recognition, in IFSA World Congress, Surabaya, Indonesia, OS-414 (2011) D. Sanchez, P. Melin, Optimization of modular neural networks and type-2 fuzzy integrators using hierarchical genetic algorithms for human recognition, in IFSA World Congress, Surabaya, Indonesia, OS-414 (2011)
17.
go back to reference R. Sepúlveda, O. Castillo, P. Melin, A. Rodriguez, O. Montiel, Experimental study of intelligent controllers under uncertainty using type-1 and type-2 fuzzy logic. Inf. Sci. 177(11), 2023–2048 (2007)CrossRef R. Sepúlveda, O. Castillo, P. Melin, A. Rodriguez, O. Montiel, Experimental study of intelligent controllers under uncertainty using type-1 and type-2 fuzzy logic. Inf. Sci. 177(11), 2023–2048 (2007)CrossRef
18.
go back to reference T.G. Barbounis, J.B. Theocharis, Locally recurrent neural networks for wind speed prediction using spatial correlation. Inf. Sci. 177(24), 5775–5797 (2007)CrossRef T.G. Barbounis, J.B. Theocharis, Locally recurrent neural networks for wind speed prediction using spatial correlation. Inf. Sci. 177(24), 5775–5797 (2007)CrossRef
19.
go back to reference T. Gedeon, Additive neural networks and periodic patterns. Neural Netw. 12(4–5), 617–626 (1999)CrossRef T. Gedeon, Additive neural networks and periodic patterns. Neural Netw. 12(4–5), 617–626 (1999)CrossRef
20.
go back to reference M. Meltser, M. Shoham, L. Manevitz, Approximating functions by neural networks: a constructive solution in the uniform norm. Neural Netw. 9(6), 965–978 (1996)CrossRef M. Meltser, M. Shoham, L. Manevitz, Approximating functions by neural networks: a constructive solution in the uniform norm. Neural Netw. 9(6), 965–978 (1996)CrossRef
21.
go back to reference D. Yeung, P. Chan, W. Ng, Radial basis function network learning using localized generalization error bound. Inf. Sci. 179(19), 3199–3217 (2009)CrossRef D. Yeung, P. Chan, W. Ng, Radial basis function network learning using localized generalization error bound. Inf. Sci. 179(19), 3199–3217 (2009)CrossRef
22.
go back to reference D. Casasent, S. Natarajan, A classifier neural net with complex-valued weights and square-law nonlinearities. Neural Netw. 8(6), 989–998 (1995)CrossRef D. Casasent, S. Natarajan, A classifier neural net with complex-valued weights and square-law nonlinearities. Neural Netw. 8(6), 989–998 (1995)CrossRef
23.
go back to reference S. Draghici, On the capabilities of neural networks using limited precision weights. Neural Netw. 15(3), 395–414 (2002)CrossRef S. Draghici, On the capabilities of neural networks using limited precision weights. Neural Netw. 15(3), 395–414 (2002)CrossRef
24.
go back to reference R.S. Neville, S. Eldridge, Transformations of Sigma–Pi Nets: obtaining reflected functions by reflecting weight matrices. Neural Netw. 15(3), 375–393 (2002)CrossRef R.S. Neville, S. Eldridge, Transformations of Sigma–Pi Nets: obtaining reflected functions by reflecting weight matrices. Neural Netw. 15(3), 375–393 (2002)CrossRef
25.
go back to reference J. Yam, T. Chow, A weight initialization method for improving training speed in feedforward neural network. Neurocomputing 30(1–4), 219–232 (2000)CrossRef J. Yam, T. Chow, A weight initialization method for improving training speed in feedforward neural network. Neurocomputing 30(1–4), 219–232 (2000)CrossRef
26.
go back to reference H. Ishibuchi, K. Morioka, H. Tanaka, A fuzzy neural network with trapezoid fuzzy weights, fuzzy systems, in IEEE World Congress on Computational Intelligence, vol. 1 (1994), pp. 228–233 H. Ishibuchi, K. Morioka, H. Tanaka, A fuzzy neural network with trapezoid fuzzy weights, fuzzy systems, in IEEE World Congress on Computational Intelligence, vol. 1 (1994), pp. 228–233
27.
go back to reference H. Ishibuchi, H. Tanaka, H. Okada, Fuzzy neural networks with fuzzy weights and fuzzy biases, in IEEE International Conference on Neural Networks, vol. 3 (1993), pp. 160–165 H. Ishibuchi, H. Tanaka, H. Okada, Fuzzy neural networks with fuzzy weights and fuzzy biases, in IEEE International Conference on Neural Networks, vol. 3 (1993), pp. 160–165
28.
go back to reference M.T. Hagan, H.B. Demuth, M.H. Beale, Neural Network Design (PWS Publishing, Boston, 1996), p. 736 M.T. Hagan, H.B. Demuth, M.H. Beale, Neural Network Design (PWS Publishing, Boston, 1996), p. 736
29.
go back to reference J. Castro, O. Castillo, P. Melin, A. Rodríguez-Díaz, A hybrid learning algorithm for a class of interval type-2 fuzzy neural networks. Inf. Sci. 179(13), 2175–2193 (2009)CrossRef J. Castro, O. Castillo, P. Melin, A. Rodríguez-Díaz, A hybrid learning algorithm for a class of interval type-2 fuzzy neural networks. Inf. Sci. 179(13), 2175–2193 (2009)CrossRef
30.
go back to reference S. Kamarthi, S. Pittner, Accelerating neural network training using weight extrapolations. Neural Netw. 12(9), 1285–1299 (1999)CrossRef S. Kamarthi, S. Pittner, Accelerating neural network training using weight extrapolations. Neural Netw. 12(9), 1285–1299 (1999)CrossRef
31.
go back to reference T. Feuring, Learning in fuzzy neural networks, in IEEE International Conference on Neural Networks, vol. 2 (1996), pp. 1061–1066 T. Feuring, Learning in fuzzy neural networks, in IEEE International Conference on Neural Networks, vol. 2 (1996), pp. 1061–1066
32.
go back to reference J. Castro, O. Castillo, P. Melin, O. Mendoza, A. Rodríguez-Díaz, An interval type-2 fuzzy neural network for chaotic time series prediction with cross-validation and Akaike test, in Soft Computing for Intelligent Control and Mobile Robotics (2011), pp. 269–285 J. Castro, O. Castillo, P. Melin, O. Mendoza, A. Rodríguez-Díaz, An interval type-2 fuzzy neural network for chaotic time series prediction with cross-validation and Akaike test, in Soft Computing for Intelligent Control and Mobile Robotics (2011), pp. 269–285
33.
go back to reference N. Karnik, J. Mendel, Applications of type-2 fuzzy logic systems to forecasting of time-series. Inf. Sci. 120(1–4), 89–111 (1999)CrossRef N. Karnik, J. Mendel, Applications of type-2 fuzzy logic systems to forecasting of time-series. Inf. Sci. 120(1–4), 89–111 (1999)CrossRef
34.
go back to reference R. Abiyev, A type-2 fuzzy wavelet neural network for time series prediction. Lect. Notes Comput. Sci. 6098, 518–527 (2010)CrossRef R. Abiyev, A type-2 fuzzy wavelet neural network for time series prediction. Lect. Notes Comput. Sci. 6098, 518–527 (2010)CrossRef
35.
go back to reference F. Gaxiola, P. Melin, F. Valdez, O. Castillo, Interval type-2 fuzzy weight adjustment for backpropagation neural networks with application in time series prediction. Inf. Sci. 260, 1–14 (2014)MathSciNetCrossRef F. Gaxiola, P. Melin, F. Valdez, O. Castillo, Interval type-2 fuzzy weight adjustment for backpropagation neural networks with application in time series prediction. Inf. Sci. 260, 1–14 (2014)MathSciNetCrossRef
36.
go back to reference O. Castillo, P. Melin, A review on the design and optimization of interval type-2 fuzzy controllers. Appl. Soft Comput. 12(4), 1267–1278 (2012)CrossRef O. Castillo, P. Melin, A review on the design and optimization of interval type-2 fuzzy controllers. Appl. Soft Comput. 12(4), 1267–1278 (2012)CrossRef
37.
go back to reference P. Melin, Modular Neural Networks and Type-2 Fuzzy Systems for Pattern Recognition (Springer, 2012), pp. 1–204CrossRef P. Melin, Modular Neural Networks and Type-2 Fuzzy Systems for Pattern Recognition (Springer, 2012), pp. 1–204CrossRef
38.
go back to reference H. Hagras, Type-2 fuzzy logic controllers: a way forward for fuzzy systems in real world environments, in IEEE World Congress on Computational Intelligence (2008), pp. 181–200 H. Hagras, Type-2 fuzzy logic controllers: a way forward for fuzzy systems in real world environments, in IEEE World Congress on Computational Intelligence (2008), pp. 181–200
39.
go back to reference R. Sepúlveda, O. Castillo, P. Melin, O. Montiel, An efficient computational method to implement type-2 fuzzy logic in control applications, in Analysis and Design of Intelligent Systems using Soft Computing Techniques (2007), pp. 45–52 R. Sepúlveda, O. Castillo, P. Melin, O. Montiel, An efficient computational method to implement type-2 fuzzy logic in control applications, in Analysis and Design of Intelligent Systems using Soft Computing Techniques (2007), pp. 45–52
40.
go back to reference M.D. Monirul Islam, K. Murase, A new algorithm to design compact two-hidden-layer artificial neural networks. Neural Netw. 14(9), 1265–1278 (2001)CrossRef M.D. Monirul Islam, K. Murase, A new algorithm to design compact two-hidden-layer artificial neural networks. Neural Netw. 14(9), 1265–1278 (2001)CrossRef
Metadata
Title
Ensemble Neural Network with Type-2 Fuzzy Weights Using Response Integration for Time Series Prediction
Authors
Fernando Gaxiola
Patricia Melin
Fevrier Valdez
Juan R. Castro
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-75408-6_15

Premium Partner