Skip to main content
Top

2020 | OriginalPaper | Chapter

Performance of Repeated Cross Validation for Machine Learning Models in Building Energy Analysis

Authors : Xiangfei Li, Baoquan Yin, Wei Tian, Yu Sun

Published in: Proceedings of the 11th International Symposium on Heating, Ventilation and Air Conditioning (ISHVAC 2019)

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Machine learning models have been widely used in building energy assessment to provide fast and reliable energy estimation. To validate these machine learning models, the cross-validation technique has been often used to estimate model accuracy. However, most cross-validation methods are used without repetition to have only one value that may have large variations due to different sampling seeds. Therefore, this paper applies repeated cross validation to provide reliable model accuracy with small variations. An office building with ten input variables is used as case study to demonstrate the performance of cross validation in building energy analysis. The results indicate that repeated cross validation can have stable results with sufficient sampling data available and medium fold number (ten in this case). At least 200 sampling number is required to obtain reliable model accuracy estimation. Ten times of cross validation is recommended to reduce the variations of model accuracy.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Romani, Z., Draoui, A., Allard, F.: Metamodeling the heating and cooling energy needs and simultaneous building envelope optimization for low energy building design in Morocco. Energy Build. 102, 139–148 (2015)CrossRef Romani, Z., Draoui, A., Allard, F.: Metamodeling the heating and cooling energy needs and simultaneous building envelope optimization for low energy building design in Morocco. Energy Build. 102, 139–148 (2015)CrossRef
2.
go back to reference Tian, W., Wilde, Pd., Li, Z., et al.: Uncertainty and sensitivity analysis of energy assessment for office buildings based on dempster-shafer theory. Energy Convers. Manag. 174, 705–718 (2018) Tian, W., Wilde, Pd., Li, Z., et al.: Uncertainty and sensitivity analysis of energy assessment for office buildings based on dempster-shafer theory. Energy Convers. Manag. 174, 705–718 (2018)
3.
go back to reference Tian, W.: A review of sensitivity analysis methods in building energy analysis. Renew. Sustain. Energy Rev. 20, 411–419 (2013)CrossRef Tian, W.: A review of sensitivity analysis methods in building energy analysis. Renew. Sustain. Energy Rev. 20, 411–419 (2013)CrossRef
4.
go back to reference Wei, L., Tian, W., Silva, E.A., et al.: Comparative study on machine learning for urban building energy analysis. Procedia Eng. 121, 285–292 (2015)CrossRef Wei, L., Tian, W., Silva, E.A., et al.: Comparative study on machine learning for urban building energy analysis. Procedia Eng. 121, 285–292 (2015)CrossRef
5.
go back to reference Fan, C., Xiao, F., Yan, C., et al.: A novel methodology to explain and evaluate data-driven building energy performance models based on interpretable machine learning. Appl. Energy 235, 1551–1560 (2019)CrossRef Fan, C., Xiao, F., Yan, C., et al.: A novel methodology to explain and evaluate data-driven building energy performance models based on interpretable machine learning. Appl. Energy 235, 1551–1560 (2019)CrossRef
6.
go back to reference Ngo, N.-T.: Early predicting cooling loads for energy-efficient design in office buildings by machine learning. Energy Build. 182, 264–273 (2019)CrossRef Ngo, N.-T.: Early predicting cooling loads for energy-efficient design in office buildings by machine learning. Energy Build. 182, 264–273 (2019)CrossRef
7.
go back to reference Tian, W., Yang, S., Zuo, J., et al.: Relationship between built form and energy performance of office buildings in a severe cold Chinese region. Build. Simul. 10(1), 11–24 (2017)CrossRef Tian, W., Yang, S., Zuo, J., et al.: Relationship between built form and energy performance of office buildings in a severe cold Chinese region. Build. Simul. 10(1), 11–24 (2017)CrossRef
8.
go back to reference MOC.: GB50189-2015. Design standard for energy efficiency of public buildings. Ministry of Construction (MOC) of P. R. China Planning Press (2015) MOC.: GB50189-2015. Design standard for energy efficiency of public buildings. Ministry of Construction (MOC) of P. R. China Planning Press (2015)
9.
go back to reference China Meteorological Bureau, Tsinghua University. China Standard Weather Data for Analyzing Building Thermal Conditions. China Building Industry Publishing House, Beijing (2005) China Meteorological Bureau, Tsinghua University. China Standard Weather Data for Analyzing Building Thermal Conditions. China Building Industry Publishing House, Beijing (2005)
10.
go back to reference DOE. EnergyPlus V9.0.1, October 2018, Department of Energy, USA (2018) DOE. EnergyPlus V9.0.1, October 2018, Department of Energy, USA (2018)
11.
go back to reference Varoquaux, G., Raamana, P.R., Engemann, D.A., Hoyos-Idrobo, A., Schwartz, Y., Thirion, B.: Assessing and tuning brain decoders: cross-validation, caveats, and guidelines. NeuroImage 145, 166–179 (2017)CrossRef Varoquaux, G., Raamana, P.R., Engemann, D.A., Hoyos-Idrobo, A., Schwartz, Y., Thirion, B.: Assessing and tuning brain decoders: cross-validation, caveats, and guidelines. NeuroImage 145, 166–179 (2017)CrossRef
12.
go back to reference Tian, W., Heo, Y., de Wilde, P., et al.: A review of uncertainty analysis in building energy assessment. Renew. Sustain. Energy Rev. 93, 285–301 (2018)CrossRef Tian, W., Heo, Y., de Wilde, P., et al.: A review of uncertainty analysis in building energy assessment. Renew. Sustain. Energy Rev. 93, 285–301 (2018)CrossRef
13.
go back to reference Kuhn, M., Johnson, K.: Applied Predictive Modeling. Springer, Berlin (2013) Kuhn, M., Johnson, K.: Applied Predictive Modeling. Springer, Berlin (2013)
Metadata
Title
Performance of Repeated Cross Validation for Machine Learning Models in Building Energy Analysis
Authors
Xiangfei Li
Baoquan Yin
Wei Tian
Yu Sun
Copyright Year
2020
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-13-9528-4_53