Skip to main content
Erschienen in: Neural Computing and Applications 2/2010

01.03.2010 | KES 2008

A comprehensive survey on functional link neural networks and an adaptive PSO–BP learning for CFLNN

verfasst von: Satchidananda Dehuri, Sung-Bae Cho

Erschienen in: Neural Computing and Applications | Ausgabe 2/2010

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Functional link neural network (FLNN) is a class of higher order neural networks (HONs) and have gained extensive popularity in recent years. FLNN have been successfully used in many applications such as system identification, channel equalization, short-term electric-load forecasting, and some of the tasks of data mining. The goals of this paper are to: (1) provide readers who are novice to this area with a basis of understanding FLNN and a comprehensive survey, while offering specialists an updated picture of the depth and breadth of the theory and applications; (2) present a new hybrid learning scheme for Chebyshev functional link neural network (CFLNN); and (3) suggest possible remedies and guidelines for practical applications in data mining. We then validate the proposed learning scheme for CFLNN in classification by an extensive simulation study. Comprehensive performance comparisons with a number of existing methods are presented.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Haykin S (1999) Neural networks—a comprehensive foundation. Prentice Hall, Englewood CliffsMATH Haykin S (1999) Neural networks—a comprehensive foundation. Prentice Hall, Englewood CliffsMATH
2.
Zurück zum Zitat Zhang GP (207) Avoiding pitfalls in neural network research. IEEE Trans Syst Man Cybern Part C Appl Rev 37(1):3–16 Zhang GP (207) Avoiding pitfalls in neural network research. IEEE Trans Syst Man Cybern Part C Appl Rev 37(1):3–16
3.
Zurück zum Zitat Anders U, Korn O (1999) Model selection in neural networks. Neural Netw 12:309–323 Anders U, Korn O (1999) Model selection in neural networks. Neural Netw 12:309–323
4.
Zurück zum Zitat Benitez JM, Castro JL, Requena I (1997) Are artificial neural networks black boxes? IEEE Trans Neural Netw 8(5):1156–1164 Benitez JM, Castro JL, Requena I (1997) Are artificial neural networks black boxes? IEEE Trans Neural Netw 8(5):1156–1164
5.
Zurück zum Zitat Cheng B, Titterington D (1994) Neural networks: a review from a statistical perspective. Stat Sci 9(1):2–54MATHMathSciNet Cheng B, Titterington D (1994) Neural networks: a review from a statistical perspective. Stat Sci 9(1):2–54MATHMathSciNet
6.
Zurück zum Zitat McCulloch W, Pitts W (1943) A logical calculus of the ideas immanent in nervous activity. Bull Math Biophys 7:115–133MathSciNet McCulloch W, Pitts W (1943) A logical calculus of the ideas immanent in nervous activity. Bull Math Biophys 7:115–133MathSciNet
7.
Zurück zum Zitat Giles CL, Maxwell T (1987) Learning invariance, and generalization in a higher order neural networks. Appl Opt 26(23):4972–4978 Giles CL, Maxwell T (1987) Learning invariance, and generalization in a higher order neural networks. Appl Opt 26(23):4972–4978
8.
Zurück zum Zitat Belli MR, Conti M, Crippa P, Turchetti C (1999) Artificial neural networks as approximators of stochastic processes. Neural Netw 12(4–5):647–658 Belli MR, Conti M, Crippa P, Turchetti C (1999) Artificial neural networks as approximators of stochastic processes. Neural Netw 12(4–5):647–658
9.
Zurück zum Zitat Castro JL, Mantas CJ, Benitez JM (2000) Neural networks with a continuous squashing function in the output are universal approximators. Neural Netw 13(6):561–563 Castro JL, Mantas CJ, Benitez JM (2000) Neural networks with a continuous squashing function in the output are universal approximators. Neural Netw 13(6):561–563
10.
Zurück zum Zitat Funahashi K (1989) On the approximate realization of continuous mappings by neural networks. Neural Netw 2:183–192 Funahashi K (1989) On the approximate realization of continuous mappings by neural networks. Neural Netw 2:183–192
11.
Zurück zum Zitat Andrews R, Diederich J, Tickle AB (1995) Survey and critique of techniques for extracting rules from trained artificial neural networks. Knowl Based Syst 8(6):373–389 Andrews R, Diederich J, Tickle AB (1995) Survey and critique of techniques for extracting rules from trained artificial neural networks. Knowl Based Syst 8(6):373–389
12.
Zurück zum Zitat Castro JL, Requena I, Benitez JM (2002) Interpretation of artificial neural networks by means of fuzzy rules. IEEE Trans Neural Netw 13(1):101–116 Castro JL, Requena I, Benitez JM (2002) Interpretation of artificial neural networks by means of fuzzy rules. IEEE Trans Neural Netw 13(1):101–116
13.
Zurück zum Zitat Setiono R, Leow WK, Zurada J (2002) Extraction of rules from artificial neural networks for nonlinear regression. IEEE Trans Neural Network 13(3):564–577 Setiono R, Leow WK, Zurada J (2002) Extraction of rules from artificial neural networks for nonlinear regression. IEEE Trans Neural Network 13(3):564–577
14.
Zurück zum Zitat Setiono R, Thong JYL (2004) An approach to generate rules from neural networks for regression problems. Eur J Oper Res 155:239–250MATH Setiono R, Thong JYL (2004) An approach to generate rules from neural networks for regression problems. Eur J Oper Res 155:239–250MATH
15.
Zurück zum Zitat Gish H (1990) A probabilistic approach to the understanding and training of neural network classifiers. In: Proc IEEE international conference acoustic, speech signal process 3:1361–1364 Gish H (1990) A probabilistic approach to the understanding and training of neural network classifiers. In: Proc IEEE international conference acoustic, speech signal process 3:1361–1364
16.
Zurück zum Zitat Zhang GP (2000) Neural networks for classification: a survey. IEEE Trans Syst Man Cybern C 30(4):451–462 Zhang GP (2000) Neural networks for classification: a survey. IEEE Trans Syst Man Cybern C 30(4):451–462
17.
Zurück zum Zitat Michie D, Spiegelhalter DJ, Taylor CC (1994) Machine learning, neural and statistical classification. Ellis Horwood, New YorkMATH Michie D, Spiegelhalter DJ, Taylor CC (1994) Machine learning, neural and statistical classification. Ellis Horwood, New YorkMATH
18.
Zurück zum Zitat Adya M, Collopy F (1998) How effective are neural networks at forecasting and prediction? A review and evaluation. J Forecast 17:481–495 Adya M, Collopy F (1998) How effective are neural networks at forecasting and prediction? A review and evaluation. J Forecast 17:481–495
19.
Zurück zum Zitat Callen JL, Kwan CCY, Yip PCY, Yuan Y (1996) Neural network forecasting of quarterly accounting earnings. Int J Forecast 12:475–482 Callen JL, Kwan CCY, Yip PCY, Yuan Y (1996) Neural network forecasting of quarterly accounting earnings. Int J Forecast 12:475–482
20.
Zurück zum Zitat Church KB, Curram SP (1996) Forecasting comsumers’ expenditure: a comparison between econometric and neural network models. Int J Forecast 12:255–267 Church KB, Curram SP (1996) Forecasting comsumers’ expenditure: a comparison between econometric and neural network models. Int J Forecast 12:255–267
21.
Zurück zum Zitat Connor JT, Martin RD, Atlas LE (1994) Recurrent neural networks and robust time series prediction. IEEE Trans Neural Netw 51(2):240–254 Connor JT, Martin RD, Atlas LE (1994) Recurrent neural networks and robust time series prediction. IEEE Trans Neural Netw 51(2):240–254
22.
Zurück zum Zitat Cottrell M, Girard B, Girard Y, Mangeas M, Muller C (1995) Neural modeling for time series: a statistical stepwise method for weight elimination. IEEE Trans Neural Netw 6(6):1355–1364 Cottrell M, Girard B, Girard Y, Mangeas M, Muller C (1995) Neural modeling for time series: a statistical stepwise method for weight elimination. IEEE Trans Neural Netw 6(6):1355–1364
23.
Zurück zum Zitat Faraway JJ, Chatfield C (1998) Time series forecasting with neural networks: a comparative study using the airline data. Appl Stat 47:231–250 Faraway JJ, Chatfield C (1998) Time series forecasting with neural networks: a comparative study using the airline data. Appl Stat 47:231–250
24.
Zurück zum Zitat Fletcher D, Goss E (1993) Forecasting with neural networks—an application using bankruptcy data. Inf Manag 24:159–167 Fletcher D, Goss E (1993) Forecasting with neural networks—an application using bankruptcy data. Inf Manag 24:159–167
25.
Zurück zum Zitat Gorr WL (1994) Research prospective on neural network forecasting. Int J Forecast 10:1–4 Gorr WL (1994) Research prospective on neural network forecasting. Int J Forecast 10:1–4
26.
Zurück zum Zitat Hippert HS, Pedreira CE, Souza RC (2001) Neural networks for short-term forecasting: a review and evaluation. IEEE Trans Power Syst 16(1):44–55 Hippert HS, Pedreira CE, Souza RC (2001) Neural networks for short-term forecasting: a review and evaluation. IEEE Trans Power Syst 16(1):44–55
27.
Zurück zum Zitat Hu MY, Zhang GP, Jiang CX, Patuwo BE (1999) A cross-validation analysis of neural network out-of-sample performance in exchange rate forecasting. Decis Sci 30:197–216 Hu MY, Zhang GP, Jiang CX, Patuwo BE (1999) A cross-validation analysis of neural network out-of-sample performance in exchange rate forecasting. Decis Sci 30:197–216
28.
Zurück zum Zitat Kaastra I, Boyd M (1996) Designing a neural network for forecasting financial and economic time series. Neurocomputing 10:215–236 Kaastra I, Boyd M (1996) Designing a neural network for forecasting financial and economic time series. Neurocomputing 10:215–236
29.
Zurück zum Zitat Maier HR, Dandy GC (2000) Neural networks for the prediction and forecasting of water resources variables: a review of modeling issues and applications. Environ Model Softw 15:101–124 Maier HR, Dandy GC (2000) Neural networks for the prediction and forecasting of water resources variables: a review of modeling issues and applications. Environ Model Softw 15:101–124
30.
Zurück zum Zitat Park YR, Murray TJ, Chen C (1996) Predicting sun spots using a layered perceptron neural network. IEEE Trans Neural Netw 7(2):501–505 Park YR, Murray TJ, Chen C (1996) Predicting sun spots using a layered perceptron neural network. IEEE Trans Neural Netw 7(2):501–505
31.
Zurück zum Zitat Qi M, Zhang GP (2001) An investigation of model selection criteria for neural network time series forecasting. Eur J Oper Res 132:666–680MATH Qi M, Zhang GP (2001) An investigation of model selection criteria for neural network time series forecasting. Eur J Oper Res 132:666–680MATH
32.
Zurück zum Zitat Kracha KA, Wagner U (1999) Applications of artificial neural networks in management science: a survey. J Retail Consum Serv 6:185–203 Kracha KA, Wagner U (1999) Applications of artificial neural networks in management science: a survey. J Retail Consum Serv 6:185–203
33.
Zurück zum Zitat Wong BK, Bodnovich TA, Selvi Y (1997) Neural network applications in business: a review and analysis of the literature (1988–1995). Decis Support Syst 19:301–320 Wong BK, Bodnovich TA, Selvi Y (1997) Neural network applications in business: a review and analysis of the literature (1988–1995). Decis Support Syst 19:301–320
34.
Zurück zum Zitat Flood I, Kartam N (1994) Neural network in civil engineering-I: principles and understanding. J Comput Civil Eng 8(2):131–148 Flood I, Kartam N (1994) Neural network in civil engineering-I: principles and understanding. J Comput Civil Eng 8(2):131–148
35.
Zurück zum Zitat Lu CN, Wu HT, Vemuri S (1993) Neural network based short term load forecasting. IEEE Trans Power Syst 8(1):336–342 Lu CN, Wu HT, Vemuri S (1993) Neural network based short term load forecasting. IEEE Trans Power Syst 8(1):336–342
36.
Zurück zum Zitat Lisboa PJG (2002) A review of evidence of health benefit from artificial neural networks in medical intervention. Neural Netw 15:11–39 Lisboa PJG (2002) A review of evidence of health benefit from artificial neural networks in medical intervention. Neural Netw 15:11–39
37.
Zurück zum Zitat Protney LG, Watkins MP (2000) Foundations of clinical research: applications to practice. Prentice-Hall, Princeton Protney LG, Watkins MP (2000) Foundations of clinical research: applications to practice. Prentice-Hall, Princeton
38.
Zurück zum Zitat Hosseini-Nezhad SM, Yamashita TS, Bielefeld RA, Krug SE, Pao YH (1995) A neural network approach for the determination of interhospital transport mode. Comput Biomed Res 28(4):319–334 Hosseini-Nezhad SM, Yamashita TS, Bielefeld RA, Krug SE, Pao YH (1995) A neural network approach for the determination of interhospital transport mode. Comput Biomed Res 28(4):319–334
39.
Zurück zum Zitat Tawfik H, Liatsis P (1997) Prediction of non-linear time series using higher order neural networks. In: Proceeding IWSSIP1997 conference, Poznan, Poland Tawfik H, Liatsis P (1997) Prediction of non-linear time series using higher order neural networks. In: Proceeding IWSSIP1997 conference, Poznan, Poland
40.
Zurück zum Zitat Kaita T, Tomita S, Yamanaka J (2002) On a higher order neural network for distortion invariant pattern recognition. Pattern Recognit Lett 23:977–984MATH Kaita T, Tomita S, Yamanaka J (2002) On a higher order neural network for distortion invariant pattern recognition. Pattern Recognit Lett 23:977–984MATH
41.
Zurück zum Zitat Ghosh J, Shin Y (1992) Efficient higher-order neural networks for classification and function approximation. Int J Neural Syst 3:323–350 Ghosh J, Shin Y (1992) Efficient higher-order neural networks for classification and function approximation. Int J Neural Syst 3:323–350
42.
Zurück zum Zitat Minsky M, Papert S (1969) Perceptrons. The MIT Press Minsky M, Papert S (1969) Perceptrons. The MIT Press
43.
Zurück zum Zitat Widrow B, Hoff ME (1960) Adaptive switching circuits. IRE WESCON Convention Record, pp 96–104 Widrow B, Hoff ME (1960) Adaptive switching circuits. IRE WESCON Convention Record, pp 96–104
44.
Zurück zum Zitat Widrow B, Lehr M (1990) 30 years of adaptive neural networks: perceptron, madaline, and back-propagation. Proc IEEE 78(9):1415–1442 Widrow B, Lehr M (1990) 30 years of adaptive neural networks: perceptron, madaline, and back-propagation. Proc IEEE 78(9):1415–1442
45.
Zurück zum Zitat Cover TM (1965) Geometrical and statistical properites of systems of linear inequalities with applications in pattern recognition. IEEE Trans Electron Comput 14:326–334MATH Cover TM (1965) Geometrical and statistical properites of systems of linear inequalities with applications in pattern recognition. IEEE Trans Electron Comput 14:326–334MATH
46.
Zurück zum Zitat Hornik K et al (1989) Multi-layer feed-forward networks are universal approximators. Neural Netw 2:359–366 Hornik K et al (1989) Multi-layer feed-forward networks are universal approximators. Neural Netw 2:359–366
47.
Zurück zum Zitat Giles CL, Maxwell T (1987) Learning, invariance and generalization in higher-order neural networks. Appl Opt 26(23):4972-4978 Giles CL, Maxwell T (1987) Learning, invariance and generalization in higher-order neural networks. Appl Opt 26(23):4972-4978
48.
Zurück zum Zitat Pao YH (1989) Adaptive pattern recognition and neural network. Addison-Wesley, Reading, MA Pao YH (1989) Adaptive pattern recognition and neural network. Addison-Wesley, Reading, MA
49.
Zurück zum Zitat Venkatesh SS, Baldi P (1991) Programmed interactions in higher order neural networks: maximal capacity. J Complex 7:316–337MATHMathSciNet Venkatesh SS, Baldi P (1991) Programmed interactions in higher order neural networks: maximal capacity. J Complex 7:316–337MATHMathSciNet
50.
Zurück zum Zitat Antyomov E, Pecht OY (2005) Modified higher order neural network for invariant pattern recognition. Pattern Recognit Lett 26:843–851 Antyomov E, Pecht OY (2005) Modified higher order neural network for invariant pattern recognition. Pattern Recognit Lett 26:843–851
51.
Zurück zum Zitat Misra BB, Dehuri S (2007) Functional link neural network for classification task in data mining. J Comput Sci 3(12):948–955 Misra BB, Dehuri S (2007) Functional link neural network for classification task in data mining. J Comput Sci 3(12):948–955
52.
Zurück zum Zitat Mirea L, Marcu T (2002) System identification using functional link neural networks with dynamic structure. 15th Triennial World Congress, Barcelona, Spain Mirea L, Marcu T (2002) System identification using functional link neural networks with dynamic structure. 15th Triennial World Congress, Barcelona, Spain
53.
Zurück zum Zitat Cass R, Radl B (1996) Adaptive process optimization using functional link networks and evolutionary algorithms. Control Eng Pract 4(11):1579–1584 Cass R, Radl B (1996) Adaptive process optimization using functional link networks and evolutionary algorithms. Control Eng Pract 4(11):1579–1584
54.
Zurück zum Zitat Pao Y-H, Philips SM (1995) The functional link net learning optimal control. Neurocomputing 9:149–164MATH Pao Y-H, Philips SM (1995) The functional link net learning optimal control. Neurocomputing 9:149–164MATH
55.
Zurück zum Zitat Shin Y, Ghosh J (1995) Ridge polynomial networks. IEEE Trans Neural Netw 6(2):610–622 Shin Y, Ghosh J (1995) Ridge polynomial networks. IEEE Trans Neural Netw 6(2):610–622
56.
Zurück zum Zitat Shin Y, Ghosh J (1992) Approximation of multivariate functions using ridge polynomial networks. In: Proceedings of international joint conference on neural networks II, pp 380–385 Shin Y, Ghosh J (1992) Approximation of multivariate functions using ridge polynomial networks. In: Proceedings of international joint conference on neural networks II, pp 380–385
57.
Zurück zum Zitat Voutriaridis C, Boutalis YS, Mertzios G (2003) Ridge polynomial networks in pattern recognition. 4th EURASIP conference focused on video/image processing and multimedia communications, Croatia, pp 519–524 Voutriaridis C, Boutalis YS, Mertzios G (2003) Ridge polynomial networks in pattern recognition. 4th EURASIP conference focused on video/image processing and multimedia communications, Croatia, pp 519–524
58.
Zurück zum Zitat Shin Y, Ghosh J (1991) The pi-sigma networks: an efficient higher order neural network for pattern classification and function approximation. In: Proceedings of international joint conference on neural networks I, pp 13–18 Shin Y, Ghosh J (1991) The pi-sigma networks: an efficient higher order neural network for pattern classification and function approximation. In: Proceedings of international joint conference on neural networks I, pp 13–18
59.
Zurück zum Zitat Shin Y, Ghosh J (1992) Computationally efficient invariant pattern recognition with higher order pi-sigma networks. The University of Texas at Austin, Tech. Report Shin Y, Ghosh J (1992) Computationally efficient invariant pattern recognition with higher order pi-sigma networks. The University of Texas at Austin, Tech. Report
60.
Zurück zum Zitat Shin Y, Ghosh J (1991) Realization of boolean functions using binary pi-sigma networks. In: Proceedings of conference on artificial neural networks in engineering, St. Louis Shin Y, Ghosh J (1991) Realization of boolean functions using binary pi-sigma networks. In: Proceedings of conference on artificial neural networks in engineering, St. Louis
61.
Zurück zum Zitat Hussain AJ, Liatsis P (2002) Recurrent pi-sigma networks for DPCM image coding. Neurocomputing 55:363–382 Hussain AJ, Liatsis P (2002) Recurrent pi-sigma networks for DPCM image coding. Neurocomputing 55:363–382
62.
Zurück zum Zitat Xiong Y et al (2007) Training pi-sigma network by on-line gradient algorithm with penalty for small weight update. Neural Comput 19:3356–3368MATH Xiong Y et al (2007) Training pi-sigma network by on-line gradient algorithm with penalty for small weight update. Neural Comput 19:3356–3368MATH
63.
Zurück zum Zitat Iyoda EM et al (2007) Image compression and reconstruction using pi t -sigma neural networks. Soft Comput 11:53–61MATH Iyoda EM et al (2007) Image compression and reconstruction using pi t -sigma neural networks. Soft Comput 11:53–61MATH
64.
Zurück zum Zitat Hussain AJ et al (2008) Physical time series prediction using recurrent pi-sigma neural networks. Int J Artif Intell Soft Comput 1(1):130–145MathSciNet Hussain AJ et al (2008) Physical time series prediction using recurrent pi-sigma neural networks. Int J Artif Intell Soft Comput 1(1):130–145MathSciNet
65.
Zurück zum Zitat Nie Y, Deng W (2008) A hybrid genetic learning algorithm for pi-sigma neural network and the analysis of its convergence. In: Proceedings of fourth international conference on natural computation, IEEE Press, pp 19–23 Nie Y, Deng W (2008) A hybrid genetic learning algorithm for pi-sigma neural network and the analysis of its convergence. In: Proceedings of fourth international conference on natural computation, IEEE Press, pp 19–23
66.
Zurück zum Zitat Zhu Q, Cai Y, Liu L (1999) A global learning algorithm for a RBF network. Neural Netw 12:527–540 Zhu Q, Cai Y, Liu L (1999) A global learning algorithm for a RBF network. Neural Netw 12:527–540
67.
Zurück zum Zitat Li M, Tian J, Chen F (2008) Imrpoving multiclass pattern recognition with a co-evolutionary RBFNN. Pattern Recognit Lett 29:392–406 Li M, Tian J, Chen F (2008) Imrpoving multiclass pattern recognition with a co-evolutionary RBFNN. Pattern Recognit Lett 29:392–406
68.
Zurück zum Zitat Dybowski R (1998) Classification of incomplete feature vectors by radial basis function networks. Pattern Recognit Lett 19:1257–1264MATH Dybowski R (1998) Classification of incomplete feature vectors by radial basis function networks. Pattern Recognit Lett 19:1257–1264MATH
69.
Zurück zum Zitat Leonardis A, Bischof H (1998) An efficient MDL based construction of RBF networks. Neural Netw 11:963–973 Leonardis A, Bischof H (1998) An efficient MDL based construction of RBF networks. Neural Netw 11:963–973
70.
Zurück zum Zitat Chen S, Wu Y, Luk BL (1999) Combined genetic algorithm optimization and regularized orthogonal least square learning for radial basis function networks. IEEE Tran Neural Netw 10(5):1239–1243 Chen S, Wu Y, Luk BL (1999) Combined genetic algorithm optimization and regularized orthogonal least square learning for radial basis function networks. IEEE Tran Neural Netw 10(5):1239–1243
71.
Zurück zum Zitat Lee YC, Doolen G, Chen HH, Sun GZ, Maxwell T, Lee HY, Giles CL (1986) Machine learning using a higher order correlation network. Physica 22D:276–306MathSciNet Lee YC, Doolen G, Chen HH, Sun GZ, Maxwell T, Lee HY, Giles CL (1986) Machine learning using a higher order correlation network. Physica 22D:276–306MathSciNet
72.
Zurück zum Zitat Peretto P, Niez JJ (1986) Long-term memory storage capacity of multiconnected neural networks. Biol Cybern 54:5363 Peretto P, Niez JJ (1986) Long-term memory storage capacity of multiconnected neural networks. Biol Cybern 54:5363
73.
Zurück zum Zitat Psaltis D, Park CH (1986) Nonlinear discriminant functions and associative memories. In: Denker JS (ed) Neural networks for computing. Amererican Institute of Physics, New York, pp 370–375 Psaltis D, Park CH (1986) Nonlinear discriminant functions and associative memories. In: Denker JS (ed) Neural networks for computing. Amererican Institute of Physics, New York, pp 370–375
74.
Zurück zum Zitat Gardner E (1987) Multiconnected neural-network models. J Phys A Math Gen 20:3453–3464 Gardner E (1987) Multiconnected neural-network models. J Phys A Math Gen 20:3453–3464
75.
Zurück zum Zitat Abbott LF, Arian Y (1987) Storage capacity of generalized networks. Phys Rev A 36:5091–5094 Abbott LF, Arian Y (1987) Storage capacity of generalized networks. Phys Rev A 36:5091–5094
76.
Zurück zum Zitat Kamp Y, Hasler M (1990) Recursive neural networks for associative memory. Wiley, New YorkMATH Kamp Y, Hasler M (1990) Recursive neural networks for associative memory. Wiley, New YorkMATH
77.
Zurück zum Zitat Horn D, Usher M (1988) Capacities of multiconnected memory models. J Phys France 49:389–395 Horn D, Usher M (1988) Capacities of multiconnected memory models. J Phys France 49:389–395
78.
Zurück zum Zitat Guillermo V (1998) A distributed approach to neural network simulation program. Master thesis, The University of Texas at E1 Paso, TX Guillermo V (1998) A distributed approach to neural network simulation program. Master thesis, The University of Texas at E1 Paso, TX
79.
Zurück zum Zitat Zurada JM (1992) Introduction to artificial neural system. West Publishing Company, St. Paul, MN Zurada JM (1992) Introduction to artificial neural system. West Publishing Company, St. Paul, MN
80.
Zurück zum Zitat Beale R, Jackson T (1991) Neural computing: an introduction. Hilger, Philadelphia, PA Beale R, Jackson T (1991) Neural computing: an introduction. Hilger, Philadelphia, PA
81.
Zurück zum Zitat Haring B, Kok JN (1995) Finding functional links for neural networks by evolutionary computation. In: Van de Merckt T et al (eds) BENELEARN1995, proceedings of the fifth Belgian–Dutch conference on machine learning, Brussels, Belgium, pp 71–78 Haring B, Kok JN (1995) Finding functional links for neural networks by evolutionary computation. In: Van de Merckt T et al (eds) BENELEARN1995, proceedings of the fifth Belgian–Dutch conference on machine learning, Brussels, Belgium, pp 71–78
82.
Zurück zum Zitat Panagiotopoulos DA et al (1999) Planning with a functional neural network architecture. IEEE Trans Neural Netw 10(1):115–127 Panagiotopoulos DA et al (1999) Planning with a functional neural network architecture. IEEE Trans Neural Netw 10(1):115–127
83.
Zurück zum Zitat Patra JC et al (1999) Identification of non -linear dynamic systems using functional link artificial neural networks. IEEE IEEE Trans Syst Man Cyber Part B Cybern 29(2):254–262 Patra JC et al (1999) Identification of non -linear dynamic systems using functional link artificial neural networks. IEEE IEEE Trans Syst Man Cyber Part B Cybern 29(2):254–262
84.
Zurück zum Zitat Sierra A, Macias JA, Corbacho F (2001) Evolution of Functional Link Networks. IEEE Tranas Evol Comput 5(1):54–65 Sierra A, Macias JA, Corbacho F (2001) Evolution of Functional Link Networks. IEEE Tranas Evol Comput 5(1):54–65
85.
Zurück zum Zitat Marcu T, Koppen-Seliger B (2004) Dynamic functional link neural networks genetically evolved applied to system identification. In: Proceedings of ESANN’2004, Bruges (Belgium), pp 115–120 Marcu T, Koppen-Seliger B (2004) Dynamic functional link neural networks genetically evolved applied to system identification. In: Proceedings of ESANN’2004, Bruges (Belgium), pp 115–120
86.
Zurück zum Zitat Patra JC, Pal NR (1995) A functional link neural network for adaptive channel equalization. Signal Process 43:181–195MATH Patra JC, Pal NR (1995) A functional link neural network for adaptive channel equalization. Signal Process 43:181–195MATH
87.
Zurück zum Zitat Zhao H, Zhang J (2008) Functional link neural network cascaded with Chebyshev orthogonal polynomial for non-linear channel equalization. signal Process 88:1946–1957MATH Zhao H, Zhang J (2008) Functional link neural network cascaded with Chebyshev orthogonal polynomial for non-linear channel equalization. signal Process 88:1946–1957MATH
88.
Zurück zum Zitat Haring et al (1997) Feature selection for neural networks through functional links found by evolutionary computation. In: Liu X et al (eds) Adavnces in intelligent data analysis (IDA-97). LNCS 1280:199–210 Haring et al (1997) Feature selection for neural networks through functional links found by evolutionary computation. In: Liu X et al (eds) Adavnces in intelligent data analysis (IDA-97). LNCS 1280:199–210
89.
Zurück zum Zitat Patra JC et al (2000) Modelling of an intelligent pressure sensor using functional link artificial neural networks. ISA Trans 39:15–27 Patra JC et al (2000) Modelling of an intelligent pressure sensor using functional link artificial neural networks. ISA Trans 39:15–27
90.
Zurück zum Zitat Dehuri S et al (2008) Genetic feature selection for optimal functional link neural network in classification. In: Fyfe C et al (eds) IDEAL 2008, LNCS 5326:156–163 Dehuri S et al (2008) Genetic feature selection for optimal functional link neural network in classification. In: Fyfe C et al (eds) IDEAL 2008, LNCS 5326:156–163
91.
Zurück zum Zitat Majhi B et al (2005) An improved scheme for digital watermarking using functional link artificial neural network. J Comput Sci 1(2):169–174 Majhi B et al (2005) An improved scheme for digital watermarking using functional link artificial neural network. J Comput Sci 1(2):169–174
92.
Zurück zum Zitat Patra JC et al (2008) Functional link neural networks-based intelligent sensors for Harsh Environments. Sens Transducers J 90:209–220 Patra JC et al (2008) Functional link neural networks-based intelligent sensors for Harsh Environments. Sens Transducers J 90:209–220
93.
Zurück zum Zitat Dash PK et al (1999) A functional link neural network for short term electric load forecasting. J Intell Fuzzy Syst 7:209–221MathSciNet Dash PK et al (1999) A functional link neural network for short term electric load forecasting. J Intell Fuzzy Syst 7:209–221MathSciNet
94.
Zurück zum Zitat Krishnaiah D et al (2008) Application of ultrasonic waves coupled with functional link neural network for estimation of carrageenan concentration. Int J Phys Sci 3(4):90–96 Krishnaiah D et al (2008) Application of ultrasonic waves coupled with functional link neural network for estimation of carrageenan concentration. Int J Phys Sci 3(4):90–96
95.
Zurück zum Zitat Sing SN, Srivastava KN (2002) Degree of insecurity estimation in a power system using functional link neural network. ETEP 12(5):353–359 Sing SN, Srivastava KN (2002) Degree of insecurity estimation in a power system using functional link neural network. ETEP 12(5):353–359
96.
Zurück zum Zitat Abu-Mahfouz I-A (2005) A comparative study of three artificial neural networks for the detection and classification of gear faults. Int J Gen Syst 34(3):261–277MATHMathSciNet Abu-Mahfouz I-A (2005) A comparative study of three artificial neural networks for the detection and classification of gear faults. Int J Gen Syst 34(3):261–277MATHMathSciNet
97.
Zurück zum Zitat Hu Y-C, Tseng F-M (2007) Functional-link net with fuzzy integral for bankruptcy prediction. Neurocomputing 70:2959–2968 Hu Y-C, Tseng F-M (2007) Functional-link net with fuzzy integral for bankruptcy prediction. Neurocomputing 70:2959–2968
98.
Zurück zum Zitat Park GH, Pao YH (2000) Unconstrained word-based approach for off-line script recognition using density based random vector functional link net. Neurocomputing 31:45–65 Park GH, Pao YH (2000) Unconstrained word-based approach for off-line script recognition using density based random vector functional link net. Neurocomputing 31:45–65
100.
Zurück zum Zitat Chen CLP et al (1998) An incremental adaptive implementation of functional link processing for function approximation, time series prediction, and system identification. Neurocomputing 18:11–31 Chen CLP et al (1998) An incremental adaptive implementation of functional link processing for function approximation, time series prediction, and system identification. Neurocomputing 18:11–31
101.
Zurück zum Zitat Weng W-D, Yen CT (2004) Reduced decision feed-back FLANN non-linear channel equaliser for digital communication systems. IEE Proc Commun 151(4):305–311 Weng W-D, Yen CT (2004) Reduced decision feed-back FLANN non-linear channel equaliser for digital communication systems. IEE Proc Commun 151(4):305–311
102.
Zurück zum Zitat Hussain A et al (1997) A new adaptive functional link neural network based DFE for overcoming co-channel interference. IEEE IEEE Trans Commun 45(11):1358–1362 Hussain A et al (1997) A new adaptive functional link neural network based DFE for overcoming co-channel interference. IEEE IEEE Trans Commun 45(11):1358–1362
103.
Zurück zum Zitat Patra JC et al (1999) Non-linear channel equalization for QAM signal constellation using artificial neural networks. IEEE Tranasactions on Systems, Man, Cybernetics-Part B: Cybernetics 29(2):262–271 Patra JC et al (1999) Non-linear channel equalization for QAM signal constellation using artificial neural networks. IEEE Tranasactions on Systems, Man, Cybernetics-Part B: Cybernetics 29(2):262–271
104.
Zurück zum Zitat Purwar S et al (2007) On-line system identification of complex systems using Chebyshev neural networks. Appl Soft Comput 7:364–372 Purwar S et al (2007) On-line system identification of complex systems using Chebyshev neural networks. Appl Soft Comput 7:364–372
105.
Zurück zum Zitat Weng W-D et al (2007) A channel equalizer usi ng reduced decision feedback Chebyshev function link artificial neural networks. Inf Sci 177:2642–2654MATH Weng W-D et al (2007) A channel equalizer usi ng reduced decision feedback Chebyshev function link artificial neural networks. Inf Sci 177:2642–2654MATH
106.
Zurück zum Zitat Patra JC et al (2002) Non-linear dynamic system identification using Chebyshev functional link artificial neural networks. IEEE Trans Syst Man Cybern Part B Cybern 32(4):505–511MathSciNet Patra JC et al (2002) Non-linear dynamic system identification using Chebyshev functional link artificial neural networks. IEEE Trans Syst Man Cybern Part B Cybern 32(4):505–511MathSciNet
107.
Zurück zum Zitat Fogel DB (2000) Evolutionary computation: towards a new philosophy of machine intelligence. IEEE Press, New York Fogel DB (2000) Evolutionary computation: towards a new philosophy of machine intelligence. IEEE Press, New York
108.
Zurück zum Zitat Pearson DW et al (eds) (1995) Artificial neural networks and genetic algorithms. Springer Verlag Pearson DW et al (eds) (1995) Artificial neural networks and genetic algorithms. Springer Verlag
109.
Zurück zum Zitat Suzuki J (1995) A Markov chain analysis on simple genetic algorithms. IEEE Trans Syst Man Cybern 25(4):6–659 Suzuki J (1995) A Markov chain analysis on simple genetic algorithms. IEEE Trans Syst Man Cybern 25(4):6–659
110.
Zurück zum Zitat Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of the IEEE international conference on neural networks. Pisacataway, NJ, pp 1942–9148 Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of the IEEE international conference on neural networks. Pisacataway, NJ, pp 1942–9148
111.
Zurück zum Zitat Schaffer JD, Whitley D, Eshelman LJ (1992) Combinations of genetic algorithms and neural networks: a survey of the state of the art. In: Proceedings of international workshop on combinations of genetic algorithms and neural networks pp 1–37 Schaffer JD, Whitley D, Eshelman LJ (1992) Combinations of genetic algorithms and neural networks: a survey of the state of the art. In: Proceedings of international workshop on combinations of genetic algorithms and neural networks pp 1–37
112.
Zurück zum Zitat Davidor Y (1990) Epistasis variance: suitability of a representation to genetic algorithms. Complex Syst 4:368–383 Davidor Y (1990) Epistasis variance: suitability of a representation to genetic algorithms. Complex Syst 4:368–383
113.
Zurück zum Zitat Eshelman LJ, Schaffer JD (1993) Real coded genetic algorithms and interval schemata. In: Whitley LD (ed) Foundation of genetic algorithms. Morgan Kaufmann, San Mateo, pp 187–202 Eshelman LJ, Schaffer JD (1993) Real coded genetic algorithms and interval schemata. In: Whitley LD (ed) Foundation of genetic algorithms. Morgan Kaufmann, San Mateo, pp 187–202
114.
Zurück zum Zitat Muhlenbein H, Schlierkamp-Voosen D (1993) Predictive models for the breeder genetic algorithm I. Continuous parameters optimization. Evol Comput 1(1):24–49 Muhlenbein H, Schlierkamp-Voosen D (1993) Predictive models for the breeder genetic algorithm I. Continuous parameters optimization. Evol Comput 1(1):24–49
115.
Zurück zum Zitat Schutte JF, Groenwold AA (2005) A study of global optimization using particle swarms. J Glob Optim 31(1):93–108MATHMathSciNet Schutte JF, Groenwold AA (2005) A study of global optimization using particle swarms. J Glob Optim 31(1):93–108MATHMathSciNet
116.
Zurück zum Zitat Ali MM, Kaelo P (2008) Improved particle swarm algorithms for global optimization. Appl Math Comput 196:578–593MATHMathSciNet Ali MM, Kaelo P (2008) Improved particle swarm algorithms for global optimization. Appl Math Comput 196:578–593MATHMathSciNet
117.
Zurück zum Zitat Yu J, Wang S, Xi L (2008) Evolving artificial neural networks using an improved PSO and DPSO. Neurocomputing 71:1054–1060 Yu J, Wang S, Xi L (2008) Evolving artificial neural networks using an improved PSO and DPSO. Neurocomputing 71:1054–1060
118.
Zurück zum Zitat Da Y, Ge XR (2005) An improved PSO-based ANN with simulated annealing technique. Neurocomput Lett 63:527–533 Da Y, Ge XR (2005) An improved PSO-based ANN with simulated annealing technique. Neurocomput Lett 63:527–533
120.
Zurück zum Zitat Pao Y-H, Phillips SM, Sobajic DJ (1992) Neural-net computing and intelligent control systems. Int J Control 56(2):263–289MATHMathSciNet Pao Y-H, Phillips SM, Sobajic DJ (1992) Neural-net computing and intelligent control systems. Int J Control 56(2):263–289MATHMathSciNet
121.
Zurück zum Zitat Hornik K (1991) Approximation capabilities of multilayer feed-forward networks. Neural Netw 4:251–257 Hornik K (1991) Approximation capabilities of multilayer feed-forward networks. Neural Netw 4:251–257
122.
Zurück zum Zitat Smith KA, Gupta JND (2002) Neural networks in business: techniques and applications. Idea Group, Hershey, PA Smith KA, Gupta JND (2002) Neural networks in business: techniques and applications. Idea Group, Hershey, PA
123.
Zurück zum Zitat Lee TT, Jeng JT (1998) The Chebyshev polynomial based unified model neural networks for function approximations. IEEE Trans Syst Man Cybern Part B 28:925–935 Lee TT, Jeng JT (1998) The Chebyshev polynomial based unified model neural networks for function approximations. IEEE Trans Syst Man Cybern Part B 28:925–935
124.
Zurück zum Zitat Namatame A, Veda N (1992) Pattern classification with Chebyshev neural network. Int J Neural Netw 3:23–31 Namatame A, Veda N (1992) Pattern classification with Chebyshev neural network. Int J Neural Netw 3:23–31
125.
Zurück zum Zitat Klasser MS, Pao YH (1988) Characteristics of the functional link net: a higher order delta rule net. IEEE proceedings of 2nd annual international conference on neural networks, San Diago, CA Klasser MS, Pao YH (1988) Characteristics of the functional link net: a higher order delta rule net. IEEE proceedings of 2nd annual international conference on neural networks, San Diago, CA
126.
Zurück zum Zitat Pao YH, Takefuji Y (1992) Functional link net computing: theory, system, architecture and functionalities. IEEE Comput, pp 76–79 Pao YH, Takefuji Y (1992) Functional link net computing: theory, system, architecture and functionalities. IEEE Comput, pp 76–79
127.
Zurück zum Zitat Goldberg DE (1989) Genetic algorithms in search, optimization and machine learning. Morgan Kaufmann, San Mateo Goldberg DE (1989) Genetic algorithms in search, optimization and machine learning. Morgan Kaufmann, San Mateo
128.
Zurück zum Zitat Kennedy J, Eberhart RC (1999) The particle swarm: social adaptation in information processing systems. In: Corne D, Dorigo M, Glover F (eds) New ideas in optimization. McGraw–Hill, Cambridge, UK, pp 379–387 Kennedy J, Eberhart RC (1999) The particle swarm: social adaptation in information processing systems. In: Corne D, Dorigo M, Glover F (eds) New ideas in optimization. McGraw–Hill, Cambridge, UK, pp 379–387
129.
Zurück zum Zitat Shi Y, Eberhart RC (1998) A modified particle swarm optimizer. In: Proceedings of the IEEE international conference on evolutionary computation. IEEE Press, Pisacataway, NJ, pp 69–73 Shi Y, Eberhart RC (1998) A modified particle swarm optimizer. In: Proceedings of the IEEE international conference on evolutionary computation. IEEE Press, Pisacataway, NJ, pp 69–73
130.
Zurück zum Zitat Shi Y, Eberhart RC (1998) Parameter selection in particle swarm optimization. Evolutionary Programming VII, LNCS, Springer, Berlin 1447:591–600 Shi Y, Eberhart RC (1998) Parameter selection in particle swarm optimization. Evolutionary Programming VII, LNCS, Springer, Berlin 1447:591–600
131.
Zurück zum Zitat Forie PC, Groenwold AA (2002) The particle swarm optimization algorithm in size and shape optimization. Struct Multidiscipl Optim 23(4):259–267 Forie PC, Groenwold AA (2002) The particle swarm optimization algorithm in size and shape optimization. Struct Multidiscipl Optim 23(4):259–267
132.
Zurück zum Zitat Clerc M, Kennedy J (2002) The particle swarm explosion, stability and convergence in a multidimensional complex space. IEEE Trans Evol Comput 6(1):58–73 Clerc M, Kennedy J (2002) The particle swarm explosion, stability and convergence in a multidimensional complex space. IEEE Trans Evol Comput 6(1):58–73
133.
Zurück zum Zitat Zhang JR et al (2007) A hybrid particle swarm optimization-back-propagation algorithm for feed-forward neural network training. Appl Math Comput 185:1026–1037MATH Zhang JR et al (2007) A hybrid particle swarm optimization-back-propagation algorithm for feed-forward neural network training. Appl Math Comput 185:1026–1037MATH
134.
Zurück zum Zitat Ratnaweera A, Halgamuge SK, Watson HC (2004) Self-organizing hierarchical particle swarm optimizer with time varying acceleration coefficients. IEEE Trans Evol Comput 8(3):240–255 Ratnaweera A, Halgamuge SK, Watson HC (2004) Self-organizing hierarchical particle swarm optimizer with time varying acceleration coefficients. IEEE Trans Evol Comput 8(3):240–255
135.
Zurück zum Zitat Lippmann R (1987) An introduction to computing with neural networks. IEEE ASSP Mag 4:4–22 Lippmann R (1987) An introduction to computing with neural networks. IEEE ASSP Mag 4:4–22
136.
Zurück zum Zitat Preshelt L (1994) Proben1-a set of neural network benchmark problems and benchmarking rules. Technical Report 21/94, Universitat Karlsruhe, Germany Preshelt L (1994) Proben1-a set of neural network benchmark problems and benchmarking rules. Technical Report 21/94, Universitat Karlsruhe, Germany
137.
Zurück zum Zitat Ghosh A, Dehuri S, Ghosh S (2008) Multi-objective evolutionary algorithms for knowledge discovery from databases. Springer Ghosh A, Dehuri S, Ghosh S (2008) Multi-objective evolutionary algorithms for knowledge discovery from databases. Springer
138.
Zurück zum Zitat Kriegel H-P et al (2007) Future trends in data mining. Data Mining Knowl Discov 15(1):87–97MathSciNet Kriegel H-P et al (2007) Future trends in data mining. Data Mining Knowl Discov 15(1):87–97MathSciNet
139.
Zurück zum Zitat Vellido A, Lisboa PJG, Vaughan J (1999) Neural networks in business: a survey of applications (1992–1998). Expert Syst Appl 17:51–70 Vellido A, Lisboa PJG, Vaughan J (1999) Neural networks in business: a survey of applications (1992–1998). Expert Syst Appl 17:51–70
140.
Zurück zum Zitat Liatsis P, Hussain AJ (1999) Non-linear one dimensional DPCM image prediction using polynomial neural network. In: Proceedings of SPIE applications of artificial neural networks in image processing IV, San Jose, CA 3647:58–68 Liatsis P, Hussain AJ (1999) Non-linear one dimensional DPCM image prediction using polynomial neural network. In: Proceedings of SPIE applications of artificial neural networks in image processing IV, San Jose, CA 3647:58–68
Metadaten
Titel
A comprehensive survey on functional link neural networks and an adaptive PSO–BP learning for CFLNN
verfasst von
Satchidananda Dehuri
Sung-Bae Cho
Publikationsdatum
01.03.2010
Verlag
Springer-Verlag
Erschienen in
Neural Computing and Applications / Ausgabe 2/2010
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-009-0288-5

Weitere Artikel der Ausgabe 2/2010

Neural Computing and Applications 2/2010 Zur Ausgabe