Skip to main content
Erschienen in: Water Resources Management 11/2018

26.05.2018

A Mixed Strategy Based on Self-Organizing Map for Water Demand Pattern Profiling of Large-Size Smart Water Grid Data

verfasst von: Roberta Padulano, Giuseppe Del Giudice

Erschienen in: Water Resources Management | Ausgabe 11/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In the present paper a procedure is introduced to detect water consumption patterns within water distribution systems. The analysis is based on hourly consumption data referred to single-household flow meters, connected to the Smart Water Network of Soccavo (Naples, Italy). The procedure is structured in two consecutive phases, namely clustering and classification. Clustering is performed on a selection of standardized monthly time series, randomly chosen within the database; different clustering models are tested, basing on K-means, dendrogram and Self-Organizing Map, and the most performant is identified comparing a selection of Clustering Validity Indices. Supervised classification is performed on the remaining time series to associate unlabeled patterns to the previously defined clusters. Final results show that the proposed procedure is able to detect annual patterns describing significant customers behaviors, along with patterns related to instrumental errors and to abnormal consumptions.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Alvisi S, Franchini M, Marinelli A (2007) A short-term, pattern-based model for water-demand forecasting. J Hydroinf 9(1):39–50CrossRef Alvisi S, Franchini M, Marinelli A (2007) A short-term, pattern-based model for water-demand forecasting. J Hydroinf 9(1):39–50CrossRef
Zurück zum Zitat Arbués F, Villanúa I, Barberán R (2010) Household size and residential water demand: an empirical approach. Aust J Agric Resour Econ 54(1):61–80CrossRef Arbués F, Villanúa I, Barberán R (2010) Household size and residential water demand: an empirical approach. Aust J Agric Resour Econ 54(1):61–80CrossRef
Zurück zum Zitat Avni N, Fishbain B, Shamir U (2015) Water consumption patterns as a basis for water demand modeling. Water Resour Res 51(10):8165–8181CrossRef Avni N, Fishbain B, Shamir U (2015) Water consumption patterns as a basis for water demand modeling. Water Resour Res 51(10):8165–8181CrossRef
Zurück zum Zitat Bergel T, Szelag B, Woyciechowska O (2017) Influence of a season on hourly and daily variations in water demand patterns in a rural water supply line–case study. J Water Land Dev 34(1):59–64CrossRef Bergel T, Szelag B, Woyciechowska O (2017) Influence of a season on hourly and daily variations in water demand patterns in a rural water supply line–case study. J Water Land Dev 34(1):59–64CrossRef
Zurück zum Zitat Blokker E, Vreeburg J, Van Dijk J (2010) Simulating residential water demand with a stochastic end-use model. J Water Resour Plan Manag 136(1):19–26CrossRef Blokker E, Vreeburg J, Van Dijk J (2010) Simulating residential water demand with a stochastic end-use model. J Water Resour Plan Manag 136(1):19–26CrossRef
Zurück zum Zitat Bocci L, Mingo I (2012) Clustering large data set: An applied comparative study. In: Advanced statistical methods for the analysis of large data-sets. Springer, Berlin, pp 3–12 Bocci L, Mingo I (2012) Clustering large data set: An applied comparative study. In: Advanced statistical methods for the analysis of large data-sets. Springer, Berlin, pp 3–12
Zurück zum Zitat Breiman L, Friedman J, Stone CJ, Olshen RA (1984) Classification and regression trees. Chapman & Hall/CRC, Boca Raton Breiman L, Friedman J, Stone CJ, Olshen RA (1984) Classification and regression trees. Chapman & Hall/CRC, Boca Raton
Zurück zum Zitat Briggs WM, Zaretzki R (2008) The skill plot: a graphical technique for evaluating continuous diagnostic tests. Biometrics 64(1):250–256CrossRef Briggs WM, Zaretzki R (2008) The skill plot: a graphical technique for evaluating continuous diagnostic tests. Biometrics 64(1):250–256CrossRef
Zurück zum Zitat Browne AL, Medd W, Anderson B (2013) Developing novel approaches to tracking domestic water demand under uncertainty - A reflection on the “up-scaling” of social science approaches in the United Kingdom. Water Resour Manag 27(4):1013–1035CrossRef Browne AL, Medd W, Anderson B (2013) Developing novel approaches to tracking domestic water demand under uncertainty - A reflection on the “up-scaling” of social science approaches in the United Kingdom. Water Resour Manag 27(4):1013–1035CrossRef
Zurück zum Zitat Caliński T, Harabasz J (1974) A dendrite method for cluster analysis. Commun Stat Theory Methods 3(1):1–27CrossRef Caliński T, Harabasz J (1974) A dendrite method for cluster analysis. Commun Stat Theory Methods 3(1):1–27CrossRef
Zurück zum Zitat Cominola A, Giuliani M, Castelletti A, Rosenberg DE, Abdallah A (2018) Implications of data sampling resolution on water use simulation, end-use disaggregation, and demand management. Environ Model Softw 102:199–212CrossRef Cominola A, Giuliani M, Castelletti A, Rosenberg DE, Abdallah A (2018) Implications of data sampling resolution on water use simulation, end-use disaggregation, and demand management. Environ Model Softw 102:199–212CrossRef
Zurück zum Zitat Cousineau D, Chartier S (2010) Outliers detection and treatment: a review. Int J Psychol Res 3(1):58–67CrossRef Cousineau D, Chartier S (2010) Outliers detection and treatment: a review. Int J Psychol Res 3(1):58–67CrossRef
Zurück zum Zitat Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines and other Kernel-based learning methods, 1st. Cambridge University Press, CambridgeCrossRef Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines and other Kernel-based learning methods, 1st. Cambridge University Press, CambridgeCrossRef
Zurück zum Zitat Davies DL, Bouldin DW (1979) A cluster separation measure. IEEE Trans Pattern Anal Mach Intell 2:224–227CrossRef Davies DL, Bouldin DW (1979) A cluster separation measure. IEEE Trans Pattern Anal Mach Intell 2:224–227CrossRef
Zurück zum Zitat Dimitriadou E, Dolničar S, Weingessel A (2002) An examination of indexes for determining the number of clusters in binary data sets. Psychometrika 67(3):137–159CrossRef Dimitriadou E, Dolničar S, Weingessel A (2002) An examination of indexes for determining the number of clusters in binary data sets. Psychometrika 67(3):137–159CrossRef
Zurück zum Zitat Fawcett T (2004) ROC Graphs: notes and practical considerations for researchers. Mach Learn 31(1):1–38 Fawcett T (2004) ROC Graphs: notes and practical considerations for researchers. Mach Learn 31(1):1–38
Zurück zum Zitat Fawcett T (2006) An introduction to ROC analysis. Pattern Recogn Lett 27(8):861–874CrossRef Fawcett T (2006) An introduction to ROC analysis. Pattern Recogn Lett 27(8):861–874CrossRef
Zurück zum Zitat Ferreira AM, Cavalcante CA, Fontes CH, Marambio JE (2013) A new method for pattern recognition in load profiles to support decision-making in the management of the electric sector. Int J Electr Power Energy Syst 53:824–831CrossRef Ferreira AM, Cavalcante CA, Fontes CH, Marambio JE (2013) A new method for pattern recognition in load profiles to support decision-making in the management of the electric sector. Int J Electr Power Energy Syst 53:824–831CrossRef
Zurück zum Zitat Fontanazza CM, Notaro V, Puleo V, Freni G (2016) Multivariate statistical analysis for water demand modelling: implementation, performance analysis, and comparison with the PRP model. J Hydroinf 18(1): 4–22CrossRef Fontanazza CM, Notaro V, Puleo V, Freni G (2016) Multivariate statistical analysis for water demand modelling: implementation, performance analysis, and comparison with the PRP model. J Hydroinf 18(1): 4–22CrossRef
Zurück zum Zitat Friedman JH, Bentley JL, Finkel RA (1977) An algorithm for finding best matches in logarithmic expected time. ACM Trans Math Softw 3(3):209–226CrossRef Friedman JH, Bentley JL, Finkel RA (1977) An algorithm for finding best matches in logarithmic expected time. ACM Trans Math Softw 3(3):209–226CrossRef
Zurück zum Zitat Gargano R, Tricarico C, Del Giudice G, Granata F (2016) A stochastic model for daily residential water demand. Water Sci Technol Water Supply 16(6):1753–1767CrossRef Gargano R, Tricarico C, Del Giudice G, Granata F (2016) A stochastic model for daily residential water demand. Water Sci Technol Water Supply 16(6):1753–1767CrossRef
Zurück zum Zitat Ghavidelfar S, Shamseldin AY, Melville BW (2017) A multi-scale analysis of single-unit housing water demand through integration of water consumption, land use and demographic data. Water Resour Manag 31(7):2173–2186CrossRef Ghavidelfar S, Shamseldin AY, Melville BW (2017) A multi-scale analysis of single-unit housing water demand through integration of water consumption, land use and demographic data. Water Resour Manag 31(7):2173–2186CrossRef
Zurück zum Zitat Haque MM, de Souza A, Rahman A (2017) Water demand modelling using independent iomponent regression technique. Water Resour Manag 31(1):299–312CrossRef Haque MM, de Souza A, Rahman A (2017) Water demand modelling using independent iomponent regression technique. Water Resour Manag 31(1):299–312CrossRef
Zurück zum Zitat Johnson SC (1967) Hierarchical clustering schemes. Psychometrika 32(3):241–254CrossRef Johnson SC (1967) Hierarchical clustering schemes. Psychometrika 32(3):241–254CrossRef
Zurück zum Zitat Jota PR, Silva VR, Jota FG (2011) Building load management using cluster and statistical analyses. Int J Electr Power Energy Syst 33(8):1498–1505CrossRef Jota PR, Silva VR, Jota FG (2011) Building load management using cluster and statistical analyses. Int J Electr Power Energy Syst 33(8):1498–1505CrossRef
Zurück zum Zitat Kalteh AM, Hjorth P, Berndtsson R (2008) Review of the Self-Organizing Map (SOM) approach in water resources: analysis, modelling and application. Environ Model Softw 23(7):835–845CrossRef Kalteh AM, Hjorth P, Berndtsson R (2008) Review of the Self-Organizing Map (SOM) approach in water resources: analysis, modelling and application. Environ Model Softw 23(7):835–845CrossRef
Zurück zum Zitat Keogh E, Chakrabarti K, Pazzani M, Mehrotra S (2001) Locally adaptive dimensionality reduction for indexing large time series databases. ACM SIGMOD Record 30(2):151–162CrossRef Keogh E, Chakrabarti K, Pazzani M, Mehrotra S (2001) Locally adaptive dimensionality reduction for indexing large time series databases. ACM SIGMOD Record 30(2):151–162CrossRef
Zurück zum Zitat Kohonen T (1982) Self-organized formation of topologically correct feature maps. Biol Cybern 43(1):59–69CrossRef Kohonen T (1982) Self-organized formation of topologically correct feature maps. Biol Cybern 43(1):59–69CrossRef
Zurück zum Zitat Krzanowski WJ (1988) Principles of multivariate analysis: a user’s perspective. Oxford University Press, Clarendon Krzanowski WJ (1988) Principles of multivariate analysis: a user’s perspective. Oxford University Press, Clarendon
Zurück zum Zitat Laspidou C, Papageorgiou E, Kokkinos K, Sahu S, Gupta A, Tassiulas L (2015) Exploring patterns in water consumption by clustering. Procedia Engineering 119:1439–1446CrossRef Laspidou C, Papageorgiou E, Kokkinos K, Sahu S, Gupta A, Tassiulas L (2015) Exploring patterns in water consumption by clustering. Procedia Engineering 119:1439–1446CrossRef
Zurück zum Zitat Lebart L, Morineau A, Piron M (2004) Statistique exploratoire multidimensionnelle. Dunod, Paris Lebart L, Morineau A, Piron M (2004) Statistique exploratoire multidimensionnelle. Dunod, Paris
Zurück zum Zitat López JJ, Aguado JA, Martín F, Munoz F, Rodríguez A, Ruiz JE (2011) Hopfield–K-Means clustering algorithm: A proposal for the segmentation of electricity customers. Electr Power Syst Res 81(2):716–724CrossRef López JJ, Aguado JA, Martín F, Munoz F, Rodríguez A, Ruiz JE (2011) Hopfield–K-Means clustering algorithm: A proposal for the segmentation of electricity customers. Electr Power Syst Res 81(2):716–724CrossRef
Zurück zum Zitat Loureiro D, Mamade A, Cabral M, Amado C, Covas D (2016) A comprehensive approach for spatial and temporal water demand profiling to improve management in network areas. Water Resour Manag 30(10):3443–3457CrossRef Loureiro D, Mamade A, Cabral M, Amado C, Covas D (2016) A comprehensive approach for spatial and temporal water demand profiling to improve management in network areas. Water Resour Manag 30(10):3443–3457CrossRef
Zurück zum Zitat Macedo M, Galo J, De Almeida L, Lima AdC (2015) Demand side management using artificial neural networks in a smart grid environment. Renew Sust Energ Rev 41:128–133CrossRef Macedo M, Galo J, De Almeida L, Lima AdC (2015) Demand side management using artificial neural networks in a smart grid environment. Renew Sust Energ Rev 41:128–133CrossRef
Zurück zum Zitat MacQueen J et al (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings of the 5th Berkeley symposium on mathematical statistics and probability, Oakland, CA, USA, vol 1, pp 281–297 MacQueen J et al (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings of the 5th Berkeley symposium on mathematical statistics and probability, Oakland, CA, USA, vol 1, pp 281–297
Zurück zum Zitat McKenna S, Fusco F, Eck B (2014) Water demand pattern classification from smart meter data. Procedia Engineering 70:1121–1130CrossRef McKenna S, Fusco F, Eck B (2014) Water demand pattern classification from smart meter data. Procedia Engineering 70:1121–1130CrossRef
Zurück zum Zitat Papa JP, Falcao AX, Suzuki CT (2009) Supervised pattern classification based on optimum-path forest. Int J Imaging Syst Technol 19(2):120–131CrossRef Papa JP, Falcao AX, Suzuki CT (2009) Supervised pattern classification based on optimum-path forest. Int J Imaging Syst Technol 19(2):120–131CrossRef
Zurück zum Zitat Parker JM, Wilby RL (2013) Quantifying household water demand: a review of theory and practice in the UK. Water Resour Manag 27(4):981–1011CrossRef Parker JM, Wilby RL (2013) Quantifying household water demand: a review of theory and practice in the UK. Water Resour Manag 27(4):981–1011CrossRef
Zurück zum Zitat Popivanov I, Miller RJ (2002) Similarity search over time-series data using wavelets. In: Proceedings of the 18th international conference on data engineering, San Jose, CA, USA, pp 212–221 Popivanov I, Miller RJ (2002) Similarity search over time-series data using wavelets. In: Proceedings of the 18th international conference on data engineering, San Jose, CA, USA, pp 212–221
Zurück zum Zitat Powers DM (2007) Evaluation: from precision, recall and F-Factor to ROC, informedness, markedness & correlation. Tech. Rep. SIE-07-001, School of Informatics and Engineering Flinders University, Adelaide, Australia Powers DM (2007) Evaluation: from precision, recall and F-Factor to ROC, informedness, markedness & correlation. Tech. Rep. SIE-07-001, School of Informatics and Engineering Flinders University, Adelaide, Australia
Zurück zum Zitat Räsänen T, Voukantsis D, Niska H, Karatzas K, Kolehmainen M (2010) Data-based method for creating electricity use load profiles using large amount of customer-specific hourly measured electricity use data. Appl Energy 87(11):3538–3545CrossRef Räsänen T, Voukantsis D, Niska H, Karatzas K, Kolehmainen M (2010) Data-based method for creating electricity use load profiles using large amount of customer-specific hourly measured electricity use data. Appl Energy 87(11):3538–3545CrossRef
Zurück zum Zitat Sancho-Asensio A, Navarro J, Arrieta-Salinas I, Armendáriz-Íñigo JE, Jiménez-Ruano V, Zaballos A, Golobardes E (2014) Improving data partition schemes in smart grids via clustering data streams. Expert Syst Appl 41(13):5832–5842CrossRef Sancho-Asensio A, Navarro J, Arrieta-Salinas I, Armendáriz-Íñigo JE, Jiménez-Ruano V, Zaballos A, Golobardes E (2014) Improving data partition schemes in smart grids via clustering data streams. Expert Syst Appl 41(13):5832–5842CrossRef
Zurück zum Zitat Schikuta E (1996) Grid-clustering: an efficient hierarchical clustering method for very large data sets. In: Proceedings of the 13th international conference on pattern recognition, Wien, Austria, vol 2, pp 101–105 Schikuta E (1996) Grid-clustering: an efficient hierarchical clustering method for very large data sets. In: Proceedings of the 13th international conference on pattern recognition, Wien, Austria, vol 2, pp 101–105
Zurück zum Zitat Verdú SV, García MO, Senabre C, Marín AG, Franco FG (2006) Classification, filtering, and identification of electrical customer load patterns through the use of self-organizing maps. IEEE Trans Power Syst 21(4):1672–1682CrossRef Verdú SV, García MO, Senabre C, Marín AG, Franco FG (2006) Classification, filtering, and identification of electrical customer load patterns through the use of self-organizing maps. IEEE Trans Power Syst 21(4):1672–1682CrossRef
Zurück zum Zitat Zhou Kl, Yang Sl, Shen C (2013) A review of electric load classification in smart grid environment. Renew Sust Energ Rev 24:103–110CrossRef Zhou Kl, Yang Sl, Shen C (2013) A review of electric load classification in smart grid environment. Renew Sust Energ Rev 24:103–110CrossRef
Zurück zum Zitat Zhu X (2006) Semi-supervised learning literature survey. Computer Science Tech Rep 1530, University of Wisconsin-Madison Zhu X (2006) Semi-supervised learning literature survey. Computer Science Tech Rep 1530, University of Wisconsin-Madison
Metadaten
Titel
A Mixed Strategy Based on Self-Organizing Map for Water Demand Pattern Profiling of Large-Size Smart Water Grid Data
verfasst von
Roberta Padulano
Giuseppe Del Giudice
Publikationsdatum
26.05.2018
Verlag
Springer Netherlands
Erschienen in
Water Resources Management / Ausgabe 11/2018
Print ISSN: 0920-4741
Elektronische ISSN: 1573-1650
DOI
https://doi.org/10.1007/s11269-018-2012-7

Weitere Artikel der Ausgabe 11/2018

Water Resources Management 11/2018 Zur Ausgabe