Skip to main content

2016 | OriginalPaper | Buchkapitel

Genetic Optimization of Type-1 and Interval Type-2 Fuzzy Integrators in Ensembles of ANFIS Models for Time Series Prediction

verfasst von : Jesus Soto, Patricia Melin, Oscar Castillo

Erschienen in: Recent Developments and New Direction in Soft-Computing Foundations and Applications

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper describes the Mackey-Glass time series prediction using genetic optimization of type-1 and interval type-2 fuzzy integrators in Ensembles of adaptive neuro-fuzzy inferences systems (ANFIS) models, with emphasis on its application to the prediction of chaotic time series. The considered chaotic problem is the Mackey-Glass time series that is generated from the differential equations, so this benchmark time series is used to the test of performance of the proposed Ensemble architecture. We used the interval type-2 and type-1 fuzzy systems to integrate the outputs (forecasts) of each of the ANFIS models in the Ensemble. Genetic algorithms (GAs) were used for the optimization of memberships function (with linguistic labels “Small, Middle, and Large”) parameters of the fuzzy integrators. In the experiments, the GAs optimized the Gaussians, generalized bell and triangular membership functions for each of the fuzzy integrators, thereby increasing the complexity of the training. Simulation results show the effectiveness of the proposed approach.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Brocklebank, J.C., Dickey, D.A.: SAS for Forecasting Series, pp. 6–140. SAS Institute Inc., Cary (2003)MATH Brocklebank, J.C., Dickey, D.A.: SAS for Forecasting Series, pp. 6–140. SAS Institute Inc., Cary (2003)MATH
2.
Zurück zum Zitat Holland, J.H.: Outline for a logical theory of adaptive systems. J. Assoc. Comput. Mach. 3, 297–314 (1962)CrossRefMATH Holland, J.H.: Outline for a logical theory of adaptive systems. J. Assoc. Comput. Mach. 3, 297–314 (1962)CrossRefMATH
3.
Zurück zum Zitat Holland, J.H.: Adaptation in natural and artificial systems. University of Michigan Press, Ann Arbor (1975) Holland, J.H.: Adaptation in natural and artificial systems. University of Michigan Press, Ann Arbor (1975)
4.
Zurück zum Zitat Goldberg, D.E., Kalyanmoy, D.: A comparative analysis of selection schemes used in genetic algorithms. In: G.J.E. Rawlins (eds.) Foundations of Genetic Algorithms, pp. 69–93. Morgan Kaufmann Publishers, San Mateo (1991) Goldberg, D.E., Kalyanmoy, D.: A comparative analysis of selection schemes used in genetic algorithms. In: G.J.E. Rawlins (eds.) Foundations of Genetic Algorithms, pp. 69–93. Morgan Kaufmann Publishers, San Mateo (1991)
5.
Zurück zum Zitat Goldberg, D.E., Korb, B., Kalyanmoy, D.: Messy genetic algorithms: motivation, analysis, and first results. Complex Syst. 3, 493–530 (1989)MathSciNetMATH Goldberg, D.E., Korb, B., Kalyanmoy, D.: Messy genetic algorithms: motivation, analysis, and first results. Complex Syst. 3, 493–530 (1989)MathSciNetMATH
6.
Zurück zum Zitat Lawrence, D.: Handbook of Genetic Algorithms. Van Nostrand Reinhold, New York (1991) Lawrence, D.: Handbook of Genetic Algorithms. Van Nostrand Reinhold, New York (1991)
7.
Zurück zum Zitat Mackey, M.C., Glass, L.: Oscillation and chaos in physiological control systems. Science 197, 287–289 (1997)CrossRef Mackey, M.C., Glass, L.: Oscillation and chaos in physiological control systems. Science 197, 287–289 (1997)CrossRef
9.
Zurück zum Zitat Brockwell, P.D., Richard, A.D.: Introduction to Time Series and Forecasting. Springer, New York, pp 1–219 (2002) Brockwell, P.D., Richard, A.D.: Introduction to Time Series and Forecasting. Springer, New York, pp 1–219 (2002)
10.
Zurück zum Zitat Jang, J.S.R.: ANFIS: Adaptive-network-based fuzzy inference systems. IEEE Trans. Syst Man Cybern. 23, 665–685 (1992) Jang, J.S.R.: ANFIS: Adaptive-network-based fuzzy inference systems. IEEE Trans. Syst Man Cybern. 23, 665–685 (1992)
11.
Zurück zum Zitat Melin, P., Soto, J., Castillo, O., Soria, J.: A new approach for time series prediction using ensembles of ANFIS models. Experts Syst Appl, El-Sevier 39(3), 3494–3506 (2012)CrossRef Melin, P., Soto, J., Castillo, O., Soria, J.: A new approach for time series prediction using ensembles of ANFIS models. Experts Syst Appl, El-Sevier 39(3), 3494–3506 (2012)CrossRef
12.
Zurück zum Zitat Wang, C., Zhang, J.P.: Time series prediction based on ensemble ANFIS. In: Proceedings of the Fourth International Conference on Machine Learning and Cybernetics, Guangzhou, 18–21 Aug 2005 Wang, C., Zhang, J.P.: Time series prediction based on ensemble ANFIS. In: Proceedings of the Fourth International Conference on Machine Learning and Cybernetics, Guangzhou, 18–21 Aug 2005
13.
Zurück zum Zitat Werbos, P.: Beyond regression: new tools for prediction and analysis in the behavioral sciences. Ph.D. thesis, Harvard University (1974) Werbos, P.: Beyond regression: new tools for prediction and analysis in the behavioral sciences. Ph.D. thesis, Harvard University (1974)
14.
Zurück zum Zitat Castro, J.R., Castillo, O., Melin, P., Rodríguez, A.: Hybrid learning algorithm for interval type-2 fuzzy neural networks. GrC, pp. 157–162 (2007) Castro, J.R., Castillo, O., Melin, P., Rodríguez, A.: Hybrid learning algorithm for interval type-2 fuzzy neural networks. GrC, pp. 157–162 (2007)
15.
Zurück zum Zitat Castro, J.R., Castillo, O., Melin, P., Rodriguez, A.: A hybrid learning algorithm for interval type-2 fuzzy neural networks: the case of time series prediction, vol. 15a, pp. 363–386. Springer, Berlin (2008) Castro, J.R., Castillo, O., Melin, P., Rodriguez, A.: A hybrid learning algorithm for interval type-2 fuzzy neural networks: the case of time series prediction, vol. 15a, pp. 363–386. Springer, Berlin (2008)
16.
Zurück zum Zitat Pulido, M., Mancilla, A., Melin, P.: Redes ensemble con integración Difusa para Pronosticar Series de Tiempo Complejas. Tijuana Institute of Technology, Mexico, 21 Sept 2009 Pulido, M., Mancilla, A., Melin, P.: Redes ensemble con integración Difusa para Pronosticar Series de Tiempo Complejas. Tijuana Institute of Technology, Mexico, 21 Sept 2009
17.
Zurück zum Zitat Jang, J.S.R.: Rule extraction using generalized neural networks. En Proceedings of te 4th IFSA World Congress, pp. 82–86 (1991) Jang, J.S.R.: Rule extraction using generalized neural networks. En Proceedings of te 4th IFSA World Congress, pp. 82–86 (1991)
18.
Zurück zum Zitat Takagi, T., Sugeno, M.: Derivation of fuzzy control rules from human operation control actions. In: Proceedings of the IFAC Symposium on Fuzzy Information, Knowledge Representation and Decision Analysis, pp. 55–60 (1983) Takagi, T., Sugeno, M.: Derivation of fuzzy control rules from human operation control actions. In: Proceedings of the IFAC Symposium on Fuzzy Information, Knowledge Representation and Decision Analysis, pp. 55–60 (1983)
19.
Zurück zum Zitat Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning internal representations by error propagation. In: Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. 1, pp. 318–362. MIT Press, Cambridge (1986) Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning internal representations by error propagation. In: Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. 1, pp. 318–362. MIT Press, Cambridge (1986)
20.
Zurück zum Zitat Takagi, T., Sugeno, M.: Derivation of fuzzy control rules from human operation control actions. In: Proceedings of the IFAC Symposium on Fuzzy Information, Knowledge Representation and Decision Analysis, pp. 55-60 (1983) Takagi, T., Sugeno, M.: Derivation of fuzzy control rules from human operation control actions. In: Proceedings of the IFAC Symposium on Fuzzy Information, Knowledge Representation and Decision Analysis, pp. 55-60 (1983)
21.
Zurück zum Zitat Zhou, Z.H., Wu, J., Tang, W.: Ensembling neural networks: many could be better than all. Artif. Intell. 137(1–2), 239–263 (2002)MathSciNetCrossRefMATH Zhou, Z.H., Wu, J., Tang, W.: Ensembling neural networks: many could be better than all. Artif. Intell. 137(1–2), 239–263 (2002)MathSciNetCrossRefMATH
24.
Zurück zum Zitat Jang, J.S.R.: Fuzzy modeling using generalized neural networks and Kalman fliter algorithm. In: Proceedings of the Ninth National Conference on Artificial Intelligence (AAAI-91), pp. 762–767 (1991) Jang, J.S.R.: Fuzzy modeling using generalized neural networks and Kalman fliter algorithm. In: Proceedings of the Ninth National Conference on Artificial Intelligence (AAAI-91), pp. 762–767 (1991)
25.
Zurück zum Zitat Melin, P., Mendoza, O., Castillo, O.: An improved method for edge detection based on interval type-2 fuzzy logic. Expert Syst Appl. 37(12), 8527–8535 (2010)CrossRef Melin, P., Mendoza, O., Castillo, O.: An improved method for edge detection based on interval type-2 fuzzy logic. Expert Syst Appl. 37(12), 8527–8535 (2010)CrossRef
26.
Zurück zum Zitat Mendel, J.M.: Why we need type-2 fuzzy logic systems. Article is provided courtesy of Prentice Hall, By Jerry Mendel, 11 May 2001 Mendel, J.M.: Why we need type-2 fuzzy logic systems. Article is provided courtesy of Prentice Hall, By Jerry Mendel, 11 May 2001
27.
Zurück zum Zitat Mendel, J.M.: Uncertain rule-based fuzzy logic systems: introduction and new, directions, pp. 25–200. Prentice Hall, USA (2000) (Ed) Mendel, J.M.: Uncertain rule-based fuzzy logic systems: introduction and new, directions, pp. 25–200. Prentice Hall, USA (2000) (Ed)
28.
Zurück zum Zitat Mendel, J.M., Mouzouris, G.C.: Type-2 fuzzy logic systems. IEEE Trans. Fuzzy Syst. 7, 643–658 (1999)CrossRef Mendel, J.M., Mouzouris, G.C.: Type-2 fuzzy logic systems. IEEE Trans. Fuzzy Syst. 7, 643–658 (1999)CrossRef
29.
Zurück zum Zitat Goldberg, D.E.: Genetic Algorithms in Search, Optimization, and Machine Learning. Addison-Wesley Publishing Company, Boston (1989) Goldberg, D.E.: Genetic Algorithms in Search, Optimization, and Machine Learning. Addison-Wesley Publishing Company, Boston (1989)
30.
Zurück zum Zitat Castillo, O., Melin, P.: Optimization of type-2 fuzzy systems based on bio-inspired methods: a concise review. Appl. Soft Comput. 12(4), 1267–1278 (2012)CrossRef Castillo, O., Melin, P.: Optimization of type-2 fuzzy systems based on bio-inspired methods: a concise review. Appl. Soft Comput. 12(4), 1267–1278 (2012)CrossRef
31.
Zurück zum Zitat Castro, J.R., Castillo, O., Martínez, L.G.: Interval type-2 fuzzy logic toolbox. Eng. Lett. 15(1), 89–98 (2007) Castro, J.R., Castillo, O., Martínez, L.G.: Interval type-2 fuzzy logic toolbox. Eng. Lett. 15(1), 89–98 (2007)
32.
Zurück zum Zitat Chua, T.W., Tan, W.W.: Genetically evolved fuzzy rule-based classifiers and application to automotive classification. Lect. Notes Comput. Sci. 5361, 101–110 (2008)CrossRef Chua, T.W., Tan, W.W.: Genetically evolved fuzzy rule-based classifiers and application to automotive classification. Lect. Notes Comput. Sci. 5361, 101–110 (2008)CrossRef
33.
Zurück zum Zitat Cordon, O., Gomide, F., Herrera, F., Hoffmann, F., Magdalena, L.: Ten years of genetic fuzzy systems: current framework and new trends. Fuzzy Sets Syst. 141, 5–31 (2004)MathSciNetCrossRefMATH Cordon, O., Gomide, F., Herrera, F., Hoffmann, F., Magdalena, L.: Ten years of genetic fuzzy systems: current framework and new trends. Fuzzy Sets Syst. 141, 5–31 (2004)MathSciNetCrossRefMATH
34.
Zurück zum Zitat Cordon, O., Herrera, F., Hoffmann, F., Magdalena, L.: “Genetic Fuzzy Systems: Evolutionary Tuning and Learning of Fuzzy”, Knowledge Bases. World Scientific, Singapore (2001)CrossRefMATH Cordon, O., Herrera, F., Hoffmann, F., Magdalena, L.: “Genetic Fuzzy Systems: Evolutionary Tuning and Learning of Fuzzy”, Knowledge Bases. World Scientific, Singapore (2001)CrossRefMATH
35.
Zurück zum Zitat Eiben, A.E., Smith, J.E.: Introduction to Evolutionary Computation, pp. 37–69. Springer, Berlin (2003)MATH Eiben, A.E., Smith, J.E.: Introduction to Evolutionary Computation, pp. 37–69. Springer, Berlin (2003)MATH
36.
Zurück zum Zitat Cordon, O., Herrera, F., Villar, P.: Analysis and guidelines to obtain a good uniform fuzzy partition granularity for fuzzy rule-based systems using simulated annealing. Int. J. Approximate Reasoning 25, 187–215 (2000)CrossRefMATH Cordon, O., Herrera, F., Villar, P.: Analysis and guidelines to obtain a good uniform fuzzy partition granularity for fuzzy rule-based systems using simulated annealing. Int. J. Approximate Reasoning 25, 187–215 (2000)CrossRefMATH
Metadaten
Titel
Genetic Optimization of Type-1 and Interval Type-2 Fuzzy Integrators in Ensembles of ANFIS Models for Time Series Prediction
verfasst von
Jesus Soto
Patricia Melin
Oscar Castillo
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-32229-2_24

Premium Partner