Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 3/2022

29-05-2021 | Original Article

Stochastic configuration broad learning system and its approximation capability analysis

Authors: Wei Zhou, Degang Wang, Hongxing Li, Menghong Bao

Published in: International Journal of Machine Learning and Cybernetics | Issue 3/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, a kind of stochastic configuration broad learning system (SCBLS) is proposed for data modeling. The proposed SCBLS is established in the form of a flat network and its architecture is determined by a constructive learning approach. The input parameters of feature nodes and enhancement nodes of SCBLS are randomly assigned in the light of a supervisory mechanism. Inequality constraints are used to randomly assign the hidden parameters and adaptively select the scopes of random parameters. The output parameters of SCBLS are determined either by a constructive manner or by solving a global least squares problem. It is proved that the proposed SCBLS possesses universal approximation properties. The performances of the proposed SCBLS are evaluated by function approximation, benchmark datasets and time series prediction. Numerical examples show that SCBLS can achieve satisfactory approximation accuracy.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Footnotes
2
TSDL: https:/ /datamarket.com /data /list /?q = provider:tsdl.
 
Literature
1.
go back to reference Chen J (2012) Structural vibration suppression by using neural classifier with genetic algorithm. Int J Mach Learn Cybernet 3(3):215–221CrossRef Chen J (2012) Structural vibration suppression by using neural classifier with genetic algorithm. Int J Mach Learn Cybernet 3(3):215–221CrossRef
2.
go back to reference Barakat M, Lefebvre M, Khalil M et al (2013) Parameter selection algorithm with self-adaptive growing neural network classifier for diagnosis issues. Int J Mach Learn Cybernet 4(3):217–233CrossRef Barakat M, Lefebvre M, Khalil M et al (2013) Parameter selection algorithm with self-adaptive growing neural network classifier for diagnosis issues. Int J Mach Learn Cybernet 4(3):217–233CrossRef
3.
go back to reference Rech PC (2015) Period-adding and spiral organization of the periodicity in a Hopfield neural network. Int J Mach Learn Cybernet 6(1):1–6CrossRef Rech PC (2015) Period-adding and spiral organization of the periodicity in a Hopfield neural network. Int J Mach Learn Cybernet 6(1):1–6CrossRef
4.
go back to reference He Q, Shang TF, Zhuang FZ et al (2013) Parallel extreme learning machine for regression based on MapReduce. Neurocomputing 102:52–58CrossRef He Q, Shang TF, Zhuang FZ et al (2013) Parallel extreme learning machine for regression based on MapReduce. Neurocomputing 102:52–58CrossRef
5.
go back to reference Wang DG, Song WY, Pedrycz W et al (2021) An integrated neural network with nonlinear output structure for interval-valued data. J Intell Fuzzy Syst 40(1):673–683CrossRef Wang DG, Song WY, Pedrycz W et al (2021) An integrated neural network with nonlinear output structure for interval-valued data. J Intell Fuzzy Syst 40(1):673–683CrossRef
6.
go back to reference Wang DG, Song WY, Pedrycz W (2018) A two stage forecasting approach for interval-valued time series. J Intell Fuzzy Syst 35(2):2501–2512CrossRef Wang DG, Song WY, Pedrycz W (2018) A two stage forecasting approach for interval-valued time series. J Intell Fuzzy Syst 35(2):2501–2512CrossRef
8.
go back to reference He Q, Jin X, Du CY et al (2014) Clustering in extreme learning machine feature space. Neurocomputing 128:88–95CrossRef He Q, Jin X, Du CY et al (2014) Clustering in extreme learning machine feature space. Neurocomputing 128:88–95CrossRef
9.
go back to reference Min F, Zhang S, Ciucci D et al (2020) Three-way active learning through clustering selection. Int J Mach Learn Cybernet 11:1033–1046CrossRef Min F, Zhang S, Ciucci D et al (2020) Three-way active learning through clustering selection. Int J Mach Learn Cybernet 11:1033–1046CrossRef
10.
go back to reference Zhang YX, Huang DG, Lin HM et al (2020) Knowledge reasoning approach with linguistic-valued intuitionistic fuzzy credibility. Int J Mach Learn Cybernet 11:169–184CrossRef Zhang YX, Huang DG, Lin HM et al (2020) Knowledge reasoning approach with linguistic-valued intuitionistic fuzzy credibility. Int J Mach Learn Cybernet 11:169–184CrossRef
11.
go back to reference Zou L, Wen X, Wang YX (2016) Linguistic truth-valued intuitionistic fuzzy reasoning with applications in human factors engineering. Inf Sci 327:201–216MathSciNetCrossRef Zou L, Wen X, Wang YX (2016) Linguistic truth-valued intuitionistic fuzzy reasoning with applications in human factors engineering. Inf Sci 327:201–216MathSciNetCrossRef
12.
go back to reference Liu X, Wang Y, Li XN et al (2017) A linguistic-valued approximate reasoning approach for financial decision making. Int J Comput Intell syst 10:312–319CrossRef Liu X, Wang Y, Li XN et al (2017) A linguistic-valued approximate reasoning approach for financial decision making. Int J Comput Intell syst 10:312–319CrossRef
13.
go back to reference Igelnik B, Pao YH (1995) Stochastic choice of basis functions in adaptive function approximation and the functional-link net. IEEE Trans Neural Netw 6(6):1320–1329CrossRef Igelnik B, Pao YH (1995) Stochastic choice of basis functions in adaptive function approximation and the functional-link net. IEEE Trans Neural Netw 6(6):1320–1329CrossRef
14.
go back to reference Pao YH, Park GH, Sobajic DJ (1994) Learning and generalization characteristics of the random vector Functional-link net. Neurocomputing 6(2):163–180CrossRef Pao YH, Park GH, Sobajic DJ (1994) Learning and generalization characteristics of the random vector Functional-link net. Neurocomputing 6(2):163–180CrossRef
15.
go back to reference Chen CLP, Liu Z (2018) Broad learning system: an effective and efficient incremental learning system without the need for deep architecture. IEEE Trans Neural Netw Learn Syst 29(1):10–24MathSciNetCrossRef Chen CLP, Liu Z (2018) Broad learning system: an effective and efficient incremental learning system without the need for deep architecture. IEEE Trans Neural Netw Learn Syst 29(1):10–24MathSciNetCrossRef
16.
go back to reference Chen CLP, Liu Z, Feng S (2019) Universal approximation capability of broad learning system and its structural variations. IEEE Trans Neural Netw Learn Syst 30(4):1191–1204MathSciNetCrossRef Chen CLP, Liu Z, Feng S (2019) Universal approximation capability of broad learning system and its structural variations. IEEE Trans Neural Netw Learn Syst 30(4):1191–1204MathSciNetCrossRef
17.
go back to reference Feng S, Chen CLP (2020) Fuzzy broad learning system: a novel neuro-fuzzy model for regression and classification. IEEE Trans Cybernet 50(2):414–424CrossRef Feng S, Chen CLP (2020) Fuzzy broad learning system: a novel neuro-fuzzy model for regression and classification. IEEE Trans Cybernet 50(2):414–424CrossRef
18.
go back to reference Han M, Feng S, Chen CLP (2019) Structured manifold broad learning system: a manifold perspective for large-scale chaotic time series analysis and prediction. IEEE Trans Knowl Data Eng 31(9):1809–1821CrossRef Han M, Feng S, Chen CLP (2019) Structured manifold broad learning system: a manifold perspective for large-scale chaotic time series analysis and prediction. IEEE Trans Knowl Data Eng 31(9):1809–1821CrossRef
19.
go back to reference Xu M, Han M, Chen CLP (2020) Recurrent broad learning systems for time series prediction. IEEE Trans Cybernet 50(4):1405–1417CrossRef Xu M, Han M, Chen CLP (2020) Recurrent broad learning systems for time series prediction. IEEE Trans Cybernet 50(4):1405–1417CrossRef
20.
go back to reference Liu Z, Chen CLP, Feng S et al (2021) Stacked broad learning system: from incremental flatted structure to deep model. IEEE Trans Syst Man Cybern 51(1):209–222CrossRef Liu Z, Chen CLP, Feng S et al (2021) Stacked broad learning system: from incremental flatted structure to deep model. IEEE Trans Syst Man Cybern 51(1):209–222CrossRef
21.
go back to reference Huang GB, Chen L, Siew CK (2006) Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans Neural Netw 17(4):879–892CrossRef Huang GB, Chen L, Siew CK (2006) Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans Neural Netw 17(4):879–892CrossRef
22.
go back to reference Huang GB, Chen L (2008) Enhanced random search based incremental extreme learning machine. Neurocomputing 71(16–18):3460–3468CrossRef Huang GB, Chen L (2008) Enhanced random search based incremental extreme learning machine. Neurocomputing 71(16–18):3460–3468CrossRef
23.
go back to reference Qiao J, Li F, Han H et al (2016) Constructive algorithm for fully connected cascade feedforward neural networks. Neurocomputing 182(19):154–164CrossRef Qiao J, Li F, Han H et al (2016) Constructive algorithm for fully connected cascade feedforward neural networks. Neurocomputing 182(19):154–164CrossRef
24.
go back to reference Li M, Wang D (2017) Insights into randomized algorithms for neural networks: Practical issues and common pitfalls. Inf Sci 382–383:170–178CrossRef Li M, Wang D (2017) Insights into randomized algorithms for neural networks: Practical issues and common pitfalls. Inf Sci 382–383:170–178CrossRef
25.
go back to reference Gorban AN, Tyukin IY, Prokhorov DV et al (2016) Approximation with random bases: Pro et Contra. Inf Sci 364–365:129–145CrossRef Gorban AN, Tyukin IY, Prokhorov DV et al (2016) Approximation with random bases: Pro et Contra. Inf Sci 364–365:129–145CrossRef
26.
go back to reference Wang D, Li M (2017) Stochastic configuration networks: fundamentals and algorithms. IEEE Trans Cybern 47(10):3466–3479CrossRef Wang D, Li M (2017) Stochastic configuration networks: fundamentals and algorithms. IEEE Trans Cybern 47(10):3466–3479CrossRef
27.
go back to reference Wang D, Li M (2017) Robust stochastic configuration networks with kernel density estimation for uncertain data regression. Inf Sci 412–413:210–222MathSciNetCrossRef Wang D, Li M (2017) Robust stochastic configuration networks with kernel density estimation for uncertain data regression. Inf Sci 412–413:210–222MathSciNetCrossRef
28.
go back to reference Pratama M, Wang D (2019) Deep stacked stochastic configuration networks for lifelong learning of non-stationary data streams. Inf Sci 495:150–174MathSciNetCrossRef Pratama M, Wang D (2019) Deep stacked stochastic configuration networks for lifelong learning of non-stationary data streams. Inf Sci 495:150–174MathSciNetCrossRef
29.
go back to reference Wang Q, Dai W, Ma X et al (2020) Driving amount based stochastic configuration network for industrial process modeling. Neurocomputing 394:61–69CrossRef Wang Q, Dai W, Ma X et al (2020) Driving amount based stochastic configuration network for industrial process modeling. Neurocomputing 394:61–69CrossRef
Metadata
Title
Stochastic configuration broad learning system and its approximation capability analysis
Authors
Wei Zhou
Degang Wang
Hongxing Li
Menghong Bao
Publication date
29-05-2021
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 3/2022
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-021-01341-5

Other articles of this Issue 3/2022

International Journal of Machine Learning and Cybernetics 3/2022 Go to the issue