Skip to main content
Erschienen in: Neural Computing and Applications 10/2020

30.11.2019 | ATCI 2019

Application and comparison of several machine learning algorithms and their integration models in regression problems

verfasst von: Jui-Chan Huang, Kuo-Min Ko, Ming-Hung Shu, Bi-Min Hsu

Erschienen in: Neural Computing and Applications | Ausgabe 10/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With the rapid development of machine learning technology, as a regression problem that helps people to find the law from the massive data to achieve the prediction effect, more and more people pay attention. Data prediction has become an important part of people’s daily life. Currently, the technology is widely used in many fields such as weather forecasting, medical diagnosis and financial forecasting. Therefore, the research of machine learning algorithms in regression problems is a research hotspot in the field of machine learning in recent years. However, real-world regression problems often have very complex internal and external factors, and various machine learning algorithms have different effects on scalability and predictive performance. In order to better study the application effect of machine learning algorithm in regression problem, this paper mainly adopts three common machine learning algorithms: BP neural network, extreme learning machine and support vector machine. Then, by comparing the effects of the single model and integrated model of these machine learning algorithms in the application of regression problems, the advantages and disadvantages of each machine learning algorithm are studied. Finally, the performance of each machine learning algorithm in regression prediction is verified by simulation experiments on four different data sets. The results show that the research on several machine learning algorithms and their integration models has certain feasibility and rationality.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Wu S, Wang L, Wu Z (2004) Prediction of port container throughput using improved grey model. Water Transp Manag 26(11):14–16 Wu S, Wang L, Wu Z (2004) Prediction of port container throughput using improved grey model. Water Transp Manag 26(11):14–16
2.
Zurück zum Zitat Wei F, Huang J (2010) Predictability of statistical downscaling of summer precipitation in eastern China. Acta Trop Meteorol 26(4):483–490 Wei F, Huang J (2010) Predictability of statistical downscaling of summer precipitation in eastern China. Acta Trop Meteorol 26(4):483–490
3.
Zurück zum Zitat Zhang M, Zhang Y (2006) Container throughput forecast of Qingdao Port based on cubic exponential smoothing method. J Trop Meteorol Contain 07:37–39 Zhang M, Zhang Y (2006) Container throughput forecast of Qingdao Port based on cubic exponential smoothing method. J Trop Meteorol Contain 07:37–39
4.
Zurück zum Zitat Guo J, Huang W, Willians B (2014) Two adaptive Kalman filter approach for stochastic short-term traffic flow rate prediction and uncertainty quantification. Transp Res Part C Emerg Technol 43:50–64CrossRef Guo J, Huang W, Willians B (2014) Two adaptive Kalman filter approach for stochastic short-term traffic flow rate prediction and uncertainty quantification. Transp Res Part C Emerg Technol 43:50–64CrossRef
5.
Zurück zum Zitat Xue JN, Shi ZK (2014) Short-time traffic flow prediction based on chaos time series theory. J Transp Syst Eng Inf Technol 8(5):68–72 Xue JN, Shi ZK (2014) Short-time traffic flow prediction based on chaos time series theory. J Transp Syst Eng Inf Technol 8(5):68–72
6.
Zurück zum Zitat Viana DR, Sansigolo CA (2016) Monthly and seasonal rainfall forecasting in Southern Brazil using multiple discriminant analysis. Weather Forecast 31(6):1947–1960CrossRef Viana DR, Sansigolo CA (2016) Monthly and seasonal rainfall forecasting in Southern Brazil using multiple discriminant analysis. Weather Forecast 31(6):1947–1960CrossRef
7.
Zurück zum Zitat Baser F, Demirhan F (2017) A fuzzy regression with support vector machine approach to the estimation of horizontal global solar radiation. Energy 123:229–240CrossRef Baser F, Demirhan F (2017) A fuzzy regression with support vector machine approach to the estimation of horizontal global solar radiation. Energy 123:229–240CrossRef
8.
Zurück zum Zitat Jingjing H, Xiaolei H, Changyou Z (2016) Proactive service selection based on acquaintance model and LS-SVM. Neurocomputing 211:60–65CrossRef Jingjing H, Xiaolei H, Changyou Z (2016) Proactive service selection based on acquaintance model and LS-SVM. Neurocomputing 211:60–65CrossRef
10.
Zurück zum Zitat Duan J, Ding C, Lu Y et al (2017) Short-term passenger flow forecasting method for rail transit sites considering dynamic volatility. J Traffic Inf Saf 35(05):68–75 Duan J, Ding C, Lu Y et al (2017) Short-term passenger flow forecasting method for rail transit sites considering dynamic volatility. J Traffic Inf Saf 35(05):68–75
11.
Zurück zum Zitat Ma X, Ding C, Luan S et al (2017) Prioritizing influential factors for freeway incident clearance time prediction using the gradient boosting decision trees method. IEEE Trans Intel Transp Syst 99:1–8 Ma X, Ding C, Luan S et al (2017) Prioritizing influential factors for freeway incident clearance time prediction using the gradient boosting decision trees method. IEEE Trans Intel Transp Syst 99:1–8
12.
Zurück zum Zitat Makridakis S, Winkler RL (1983) Averages of forecasts-some empirical results. Manag Sci 29(9):987–996CrossRef Makridakis S, Winkler RL (1983) Averages of forecasts-some empirical results. Manag Sci 29(9):987–996CrossRef
13.
Zurück zum Zitat Granger CWJ, Ramanathan R (1984) Improved methods of combining. J Forecast 3:197–204CrossRef Granger CWJ, Ramanathan R (1984) Improved methods of combining. J Forecast 3:197–204CrossRef
14.
Zurück zum Zitat Diebold FX, Pauly P (1987) Structural change and the combination forecast. J Forecast 6:21–40CrossRef Diebold FX, Pauly P (1987) Structural change and the combination forecast. J Forecast 6:21–40CrossRef
15.
Zurück zum Zitat Fu G, Tang X, Zeng Y (1995) Research on generalized recursive variance reciprocal combination forecasting method. J Univ Electron Sci Technol China 24(2):211–217 Fu G, Tang X, Zeng Y (1995) Research on generalized recursive variance reciprocal combination forecasting method. J Univ Electron Sci Technol China 24(2):211–217
16.
Zurück zum Zitat Chen H (2001) Research on combined prediction model based on prediction validity. Prediction 20(3):72–73 Chen H (2001) Research on combined prediction model based on prediction validity. Prediction 20(3):72–73
17.
Zurück zum Zitat Chen H, Hou D (2003) Combined forecasting model based on standard deviation for predictive validity. J Syst Eng 15(3):203–210MathSciNet Chen H, Hou D (2003) Combined forecasting model based on standard deviation for predictive validity. J Syst Eng 15(3):203–210MathSciNet
18.
Zurück zum Zitat Jingrong D, Xiusi Y (1999) Research on nonlinear combination forecasting method based on fuzzy logic system. J Manag Sci 3:28–33 Jingrong D, Xiusi Y (1999) Research on nonlinear combination forecasting method based on fuzzy logic system. J Manag Sci 3:28–33
19.
Zurück zum Zitat Dong J (2000) Research on nonlinear combination forecasting method based on wavelet network. J Syst Eng 4:383–388 Dong J (2000) Research on nonlinear combination forecasting method based on wavelet network. J Syst Eng 4:383–388
20.
Zurück zum Zitat Cao Y, Zhang D (2004) Nonlinear intelligent combination forecasting model and its application. J China Univ Min Technol 4:428–432 Cao Y, Zhang D (2004) Nonlinear intelligent combination forecasting model and its application. J China Univ Min Technol 4:428–432
21.
Zurück zum Zitat Liu C, Zhang Q (2007) Dynamic prediction of container throughput based on time series BP neural network. Water Transp Eng 1:4–7 Liu C, Zhang Q (2007) Dynamic prediction of container throughput based on time series BP neural network. Water Transp Eng 1:4–7
22.
Zurück zum Zitat Zhen Y, Hao M, Lu B et al (2015) Research on medium and long-term precipitation prediction model based on random forest. Hydropower Sci 6:6–10 Zhen Y, Hao M, Lu B et al (2015) Research on medium and long-term precipitation prediction model based on random forest. Hydropower Sci 6:6–10
23.
Zurück zum Zitat Stoll S, Abbot-Smith K, Lieven E (2010) Lexically restricted utterances in Russian, German, and English child-directed speech. Cognit Sci 33(1):75–103CrossRef Stoll S, Abbot-Smith K, Lieven E (2010) Lexically restricted utterances in Russian, German, and English child-directed speech. Cognit Sci 33(1):75–103CrossRef
24.
Zurück zum Zitat Wu H, Liu G (2016) Forecast of Ningbo Port container sea-rail combined transportation based on grey RBF combined model. J Ningbo Univ (Nat Sci Ed) 29(4):123–127 Wu H, Liu G (2016) Forecast of Ningbo Port container sea-rail combined transportation based on grey RBF combined model. J Ningbo Univ (Nat Sci Ed) 29(4):123–127
25.
Zurück zum Zitat Wen P, Wang T (2016) Research on container throughput prediction of Nantong port by combined model. China Bus Rev 8:138–141 Wen P, Wang T (2016) Research on container throughput prediction of Nantong port by combined model. China Bus Rev 8:138–141
26.
Zurück zum Zitat Zhu Y (2016) Artificial intelligence revolution “combustion promoter”: machine learning. Sci Technol Rev 34(7):64–66 Zhu Y (2016) Artificial intelligence revolution “combustion promoter”: machine learning. Sci Technol Rev 34(7):64–66
27.
Zurück zum Zitat Ibrahim AO, Shamsuddin SM, Abraham A et al (2019) Adaptive memetic method of multi-objective genetic evolutionary algorithm for backpropagation neural network. Neural Comput Appl 4:1–18 Ibrahim AO, Shamsuddin SM, Abraham A et al (2019) Adaptive memetic method of multi-objective genetic evolutionary algorithm for backpropagation neural network. Neural Comput Appl 4:1–18
28.
Zurück zum Zitat Geng G, Luo X, Xiao Y (2005) Statistical learning theory and support vector machine. China Sci Technol Inf 12:178 Geng G, Luo X, Xiao Y (2005) Statistical learning theory and support vector machine. China Sci Technol Inf 12:178
29.
Zurück zum Zitat Tan L, Liu H, Tan L (2014) Prediction and analysis of shanghai composite index based on extreme learning machine. J North China Univ Sci Technol 4:57–60 Tan L, Liu H, Tan L (2014) Prediction and analysis of shanghai composite index based on extreme learning machine. J North China Univ Sci Technol 4:57–60
30.
Zurück zum Zitat Xing X (2019) Ocean Mammalian sound recognition based on feature fusion. Rev Cient 29(3):653–664 Xing X (2019) Ocean Mammalian sound recognition based on feature fusion. Rev Cient 29(3):653–664
Metadaten
Titel
Application and comparison of several machine learning algorithms and their integration models in regression problems
verfasst von
Jui-Chan Huang
Kuo-Min Ko
Ming-Hung Shu
Bi-Min Hsu
Publikationsdatum
30.11.2019
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 10/2020
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-019-04644-5

Weitere Artikel der Ausgabe 10/2020

Neural Computing and Applications 10/2020 Zur Ausgabe

Advances in Parallel and Distributed Computing for Neural Computing

Workload-driven coordination between virtual machine allocation and task scheduling

Premium Partner