Skip to main content

2020 | OriginalPaper | Buchkapitel

Performance of Repeated Cross Validation for Machine Learning Models in Building Energy Analysis

verfasst von : Xiangfei Li, Baoquan Yin, Wei Tian, Yu Sun

Erschienen in: Proceedings of the 11th International Symposium on Heating, Ventilation and Air Conditioning (ISHVAC 2019)

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Machine learning models have been widely used in building energy assessment to provide fast and reliable energy estimation. To validate these machine learning models, the cross-validation technique has been often used to estimate model accuracy. However, most cross-validation methods are used without repetition to have only one value that may have large variations due to different sampling seeds. Therefore, this paper applies repeated cross validation to provide reliable model accuracy with small variations. An office building with ten input variables is used as case study to demonstrate the performance of cross validation in building energy analysis. The results indicate that repeated cross validation can have stable results with sufficient sampling data available and medium fold number (ten in this case). At least 200 sampling number is required to obtain reliable model accuracy estimation. Ten times of cross validation is recommended to reduce the variations of model accuracy.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Romani, Z., Draoui, A., Allard, F.: Metamodeling the heating and cooling energy needs and simultaneous building envelope optimization for low energy building design in Morocco. Energy Build. 102, 139–148 (2015)CrossRef Romani, Z., Draoui, A., Allard, F.: Metamodeling the heating and cooling energy needs and simultaneous building envelope optimization for low energy building design in Morocco. Energy Build. 102, 139–148 (2015)CrossRef
2.
Zurück zum Zitat Tian, W., Wilde, Pd., Li, Z., et al.: Uncertainty and sensitivity analysis of energy assessment for office buildings based on dempster-shafer theory. Energy Convers. Manag. 174, 705–718 (2018) Tian, W., Wilde, Pd., Li, Z., et al.: Uncertainty and sensitivity analysis of energy assessment for office buildings based on dempster-shafer theory. Energy Convers. Manag. 174, 705–718 (2018)
3.
Zurück zum Zitat Tian, W.: A review of sensitivity analysis methods in building energy analysis. Renew. Sustain. Energy Rev. 20, 411–419 (2013)CrossRef Tian, W.: A review of sensitivity analysis methods in building energy analysis. Renew. Sustain. Energy Rev. 20, 411–419 (2013)CrossRef
4.
Zurück zum Zitat Wei, L., Tian, W., Silva, E.A., et al.: Comparative study on machine learning for urban building energy analysis. Procedia Eng. 121, 285–292 (2015)CrossRef Wei, L., Tian, W., Silva, E.A., et al.: Comparative study on machine learning for urban building energy analysis. Procedia Eng. 121, 285–292 (2015)CrossRef
5.
Zurück zum Zitat Fan, C., Xiao, F., Yan, C., et al.: A novel methodology to explain and evaluate data-driven building energy performance models based on interpretable machine learning. Appl. Energy 235, 1551–1560 (2019)CrossRef Fan, C., Xiao, F., Yan, C., et al.: A novel methodology to explain and evaluate data-driven building energy performance models based on interpretable machine learning. Appl. Energy 235, 1551–1560 (2019)CrossRef
6.
Zurück zum Zitat Ngo, N.-T.: Early predicting cooling loads for energy-efficient design in office buildings by machine learning. Energy Build. 182, 264–273 (2019)CrossRef Ngo, N.-T.: Early predicting cooling loads for energy-efficient design in office buildings by machine learning. Energy Build. 182, 264–273 (2019)CrossRef
7.
Zurück zum Zitat Tian, W., Yang, S., Zuo, J., et al.: Relationship between built form and energy performance of office buildings in a severe cold Chinese region. Build. Simul. 10(1), 11–24 (2017)CrossRef Tian, W., Yang, S., Zuo, J., et al.: Relationship between built form and energy performance of office buildings in a severe cold Chinese region. Build. Simul. 10(1), 11–24 (2017)CrossRef
8.
Zurück zum Zitat MOC.: GB50189-2015. Design standard for energy efficiency of public buildings. Ministry of Construction (MOC) of P. R. China Planning Press (2015) MOC.: GB50189-2015. Design standard for energy efficiency of public buildings. Ministry of Construction (MOC) of P. R. China Planning Press (2015)
9.
Zurück zum Zitat China Meteorological Bureau, Tsinghua University. China Standard Weather Data for Analyzing Building Thermal Conditions. China Building Industry Publishing House, Beijing (2005) China Meteorological Bureau, Tsinghua University. China Standard Weather Data for Analyzing Building Thermal Conditions. China Building Industry Publishing House, Beijing (2005)
10.
Zurück zum Zitat DOE. EnergyPlus V9.0.1, October 2018, Department of Energy, USA (2018) DOE. EnergyPlus V9.0.1, October 2018, Department of Energy, USA (2018)
11.
Zurück zum Zitat Varoquaux, G., Raamana, P.R., Engemann, D.A., Hoyos-Idrobo, A., Schwartz, Y., Thirion, B.: Assessing and tuning brain decoders: cross-validation, caveats, and guidelines. NeuroImage 145, 166–179 (2017)CrossRef Varoquaux, G., Raamana, P.R., Engemann, D.A., Hoyos-Idrobo, A., Schwartz, Y., Thirion, B.: Assessing and tuning brain decoders: cross-validation, caveats, and guidelines. NeuroImage 145, 166–179 (2017)CrossRef
12.
Zurück zum Zitat Tian, W., Heo, Y., de Wilde, P., et al.: A review of uncertainty analysis in building energy assessment. Renew. Sustain. Energy Rev. 93, 285–301 (2018)CrossRef Tian, W., Heo, Y., de Wilde, P., et al.: A review of uncertainty analysis in building energy assessment. Renew. Sustain. Energy Rev. 93, 285–301 (2018)CrossRef
13.
Zurück zum Zitat Kuhn, M., Johnson, K.: Applied Predictive Modeling. Springer, Berlin (2013) Kuhn, M., Johnson, K.: Applied Predictive Modeling. Springer, Berlin (2013)
Metadaten
Titel
Performance of Repeated Cross Validation for Machine Learning Models in Building Energy Analysis
verfasst von
Xiangfei Li
Baoquan Yin
Wei Tian
Yu Sun
Copyright-Jahr
2020
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-13-9528-4_53