Top

Water Resources Management

Published in:

26-05-2018

A Mixed Strategy Based on Self-Organizing Map for Water Demand Pattern Profiling of Large-Size Smart Water Grid Data

Authors: Roberta Padulano, Giuseppe Del Giudice

Published in: Water Resources Management | Issue 11/2018

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

In the present paper a procedure is introduced to detect water consumption patterns within water distribution systems. The analysis is based on hourly consumption data referred to single-household flow meters, connected to the Smart Water Network of Soccavo (Naples, Italy). The procedure is structured in two consecutive phases, namely clustering and classification. Clustering is performed on a selection of standardized monthly time series, randomly chosen within the database; different clustering models are tested, basing on K-means, dendrogram and Self-Organizing Map, and the most performant is identified comparing a selection of Clustering Validity Indices. Supervised classification is performed on the remaining time series to associate unlabeled patterns to the previously defined clusters. Final results show that the proposed procedure is able to detect annual patterns describing significant customers behaviors, along with patterns related to instrumental errors and to abnormal consumptions.

previous article Risk Assessment of Factors Influencing Non-Revenue Water Using Bayesian Networks and Fuzzy Logic

next article Monthly Hydrological Indicators to Assess Possible Alterations on Rivers’ Flow Regime

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Alvisi S, Franchini M, Marinelli A (2007) A short-term, pattern-based model for water-demand forecasting. J Hydroinf 9(1):39–50CrossRef

Arbués F, Villanúa I, Barberán R (2010) Household size and residential water demand: an empirical approach. Aust J Agric Resour Econ 54(1):61–80CrossRef

Avni N, Fishbain B, Shamir U (2015) Water consumption patterns as a basis for water demand modeling. Water Resour Res 51(10):8165–8181CrossRef

Bergel T, Szelag B, Woyciechowska O (2017) Influence of a season on hourly and daily variations in water demand patterns in a rural water supply line–case study. J Water Land Dev 34(1):59–64CrossRef

Blokker E, Vreeburg J, Van Dijk J (2010) Simulating residential water demand with a stochastic end-use model. J Water Resour Plan Manag 136(1):19–26CrossRef

Bocci L, Mingo I (2012) Clustering large data set: An applied comparative study. In: Advanced statistical methods for the analysis of large data-sets. Springer, Berlin, pp 3–12

Breiman L, Friedman J, Stone CJ, Olshen RA (1984) Classification and regression trees. Chapman & Hall/CRC, Boca Raton

Briggs WM, Zaretzki R (2008) The skill plot: a graphical technique for evaluating continuous diagnostic tests. Biometrics 64(1):250–256CrossRef

Browne AL, Medd W, Anderson B (2013) Developing novel approaches to tracking domestic water demand under uncertainty - A reflection on the “up-scaling” of social science approaches in the United Kingdom. Water Resour Manag 27(4):1013–1035CrossRef

Caliński T, Harabasz J (1974) A dendrite method for cluster analysis. Commun Stat Theory Methods 3(1):1–27CrossRef

Cominola A, Giuliani M, Castelletti A, Rosenberg DE, Abdallah A (2018) Implications of data sampling resolution on water use simulation, end-use disaggregation, and demand management. Environ Model Softw 102:199–212CrossRef

Cousineau D, Chartier S (2010) Outliers detection and treatment: a review. Int J Psychol Res 3(1):58–67CrossRef

Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines and other Kernel-based learning methods, 1st. Cambridge University Press, CambridgeCrossRef

Davies DL, Bouldin DW (1979) A cluster separation measure. IEEE Trans Pattern Anal Mach Intell 2:224–227CrossRef

Dimitriadou E, Dolničar S, Weingessel A (2002) An examination of indexes for determining the number of clusters in binary data sets. Psychometrika 67(3):137–159CrossRef

Fawcett T (2004) ROC Graphs: notes and practical considerations for researchers. Mach Learn 31(1):1–38

Fawcett T (2006) An introduction to ROC analysis. Pattern Recogn Lett 27(8):861–874CrossRef

Ferreira AM, Cavalcante CA, Fontes CH, Marambio JE (2013) A new method for pattern recognition in load profiles to support decision-making in the management of the electric sector. Int J Electr Power Energy Syst 53:824–831CrossRef

Fontanazza CM, Notaro V, Puleo V, Freni G (2016) Multivariate statistical analysis for water demand modelling: implementation, performance analysis, and comparison with the PRP model. J Hydroinf 18(1): 4–22CrossRef

Friedman JH, Bentley JL, Finkel RA (1977) An algorithm for finding best matches in logarithmic expected time. ACM Trans Math Softw 3(3):209–226CrossRef

Gargano R, Tricarico C, Del Giudice G, Granata F (2016) A stochastic model for daily residential water demand. Water Sci Technol Water Supply 16(6):1753–1767CrossRef

Ghavidelfar S, Shamseldin AY, Melville BW (2017) A multi-scale analysis of single-unit housing water demand through integration of water consumption, land use and demographic data. Water Resour Manag 31(7):2173–2186CrossRef

Haque MM, de Souza A, Rahman A (2017) Water demand modelling using independent iomponent regression technique. Water Resour Manag 31(1):299–312CrossRef

Johnson SC (1967) Hierarchical clustering schemes. Psychometrika 32(3):241–254CrossRef

Jota PR, Silva VR, Jota FG (2011) Building load management using cluster and statistical analyses. Int J Electr Power Energy Syst 33(8):1498–1505CrossRef

Kalteh AM, Hjorth P, Berndtsson R (2008) Review of the Self-Organizing Map (SOM) approach in water resources: analysis, modelling and application. Environ Model Softw 23(7):835–845CrossRef

Keogh E, Chakrabarti K, Pazzani M, Mehrotra S (2001) Locally adaptive dimensionality reduction for indexing large time series databases. ACM SIGMOD Record 30(2):151–162CrossRef

Kohonen T (1982) Self-organized formation of topologically correct feature maps. Biol Cybern 43(1):59–69CrossRef

Krzanowski WJ (1988) Principles of multivariate analysis: a user’s perspective. Oxford University Press, Clarendon

Laspidou C, Papageorgiou E, Kokkinos K, Sahu S, Gupta A, Tassiulas L (2015) Exploring patterns in water consumption by clustering. Procedia Engineering 119:1439–1446CrossRef

Lebart L, Morineau A, Piron M (2004) Statistique exploratoire multidimensionnelle. Dunod, Paris

López JJ, Aguado JA, Martín F, Munoz F, Rodríguez A, Ruiz JE (2011) Hopfield–K-Means clustering algorithm: A proposal for the segmentation of electricity customers. Electr Power Syst Res 81(2):716–724CrossRef

Loureiro D, Mamade A, Cabral M, Amado C, Covas D (2016) A comprehensive approach for spatial and temporal water demand profiling to improve management in network areas. Water Resour Manag 30(10):3443–3457CrossRef

Macedo M, Galo J, De Almeida L, Lima AdC (2015) Demand side management using artificial neural networks in a smart grid environment. Renew Sust Energ Rev 41:128–133CrossRef

MacQueen J et al (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings of the 5th Berkeley symposium on mathematical statistics and probability, Oakland, CA, USA, vol 1, pp 281–297

McKenna S, Fusco F, Eck B (2014) Water demand pattern classification from smart meter data. Procedia Engineering 70:1121–1130CrossRef

Papa JP, Falcao AX, Suzuki CT (2009) Supervised pattern classification based on optimum-path forest. Int J Imaging Syst Technol 19(2):120–131CrossRef

Parker JM, Wilby RL (2013) Quantifying household water demand: a review of theory and practice in the UK. Water Resour Manag 27(4):981–1011CrossRef

Popivanov I, Miller RJ (2002) Similarity search over time-series data using wavelets. In: Proceedings of the 18th international conference on data engineering, San Jose, CA, USA, pp 212–221

Powers DM (2007) Evaluation: from precision, recall and F-Factor to ROC, informedness, markedness & correlation. Tech. Rep. SIE-07-001, School of Informatics and Engineering Flinders University, Adelaide, Australia

Räsänen T, Voukantsis D, Niska H, Karatzas K, Kolehmainen M (2010) Data-based method for creating electricity use load profiles using large amount of customer-specific hourly measured electricity use data. Appl Energy 87(11):3538–3545CrossRef

Sancho-Asensio A, Navarro J, Arrieta-Salinas I, Armendáriz-Íñigo JE, Jiménez-Ruano V, Zaballos A, Golobardes E (2014) Improving data partition schemes in smart grids via clustering data streams. Expert Syst Appl 41(13):5832–5842CrossRef

Schikuta E (1996) Grid-clustering: an efficient hierarchical clustering method for very large data sets. In: Proceedings of the 13th international conference on pattern recognition, Wien, Austria, vol 2, pp 101–105

Verdú SV, García MO, Senabre C, Marín AG, Franco FG (2006) Classification, filtering, and identification of electrical customer load patterns through the use of self-organizing maps. IEEE Trans Power Syst 21(4):1672–1682CrossRef

Zhou Kl, Yang Sl, Shen C (2013) A review of electric load classification in smart grid environment. Renew Sust Energ Rev 24:103–110CrossRef

Zhu X (2006) Semi-supervised learning literature survey. Computer Science Tech Rep 1530, University of Wisconsin-Madison

Title: A Mixed Strategy Based on Self-Organizing Map for Water Demand Pattern Profiling of Large-Size Smart Water Grid Data
Authors: Roberta Padulano
Giuseppe Del Giudice
Publication date: 26-05-2018
Publisher: Springer Netherlands
Published in: Water Resources Management / Issue 11/2018
Print ISSN: 0920-4741
Electronic ISSN: 1573-1650
DOI: https://doi.org/10.1007/s11269-018-2012-7

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Springer Professional "Wirtschaft+Technik"

Other articles of this Issue 11/2018

Analysis of Effective Environmental Flow Release Strategies for Lake Urmia Restoration

Water Scarcity in Vietnam: a Point of View on Virtual Water Perspective

A Derivative-Free Hybrid Optimization Model for Short-Term Operation of a Multi-Objective Reservoir System Under Uncertainty

Delineation of Subsea Freshwater Extension by Marine Geoelectromagnetic Soundings (SE Mediterranean Sea)

Deriving Optimal Operating Rules of a Multi-Reservoir System Considering Incremental Multi-Agent Benefit Allocation

Development of a Hybrid Data Driven Model for Hydrological Estimation