Skip to main content

2016 | OriginalPaper | Buchkapitel

A Data Cleaning Method and Its Application for Earthen Site Data Monitored by WSN

verfasst von : Yun Xiao, Xuanhong Wang, Xin Wang, Pengfei Xu, Xiaojiang Chen, Dingyi Fang, Baoying Liu

Erschienen in: Pattern Recognition

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper focuses on a data cleaning method to denoise and detect outliers of earthen site monitoring data with wireless sensor network (WSN). A data cleaning method, named DC_ESVS is proposed, which is based on the temporal and spatial characteristics of monitoring data with WSN. Using the cubic exponential smoothing algorithm and voting strategy, it can denoise and detect outliers of earthen site monitoring data based on the decision rule. We conduct various experiments on the dataset of the monitoring data of Xi’an Tang Hanguangmen city wall site with WSN to show detection accuracy of the presented method. Experimental results on anther dataset of the monitoring data of the Ming Great Wall in Shaanxi also show good performance of the proposed method.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Abrardo, A., Balucanti, L., Belleschi, M., et al.: Health monitoring of architectural heritage: the case study of San Gimignano. In: 2010 IEEE Workshop on Environmental Energy and Structural Monitoring Systems (EESMS)(2010) Abrardo, A., Balucanti, L., Belleschi, M., et al.: Health monitoring of architectural heritage: the case study of San Gimignano. In: 2010 IEEE Workshop on Environmental Energy and Structural Monitoring Systems (EESMS)(2010)
2.
Zurück zum Zitat Rodriguez-Sanchez, M.C., Borromeo, S., Hernández-Tamames, J.A.: Wireless sensor networks for conservation and monitoring cultural assets. IEEE Sens. J. 11, 1382–1389 (2011)CrossRef Rodriguez-Sanchez, M.C., Borromeo, S., Hernández-Tamames, J.A.: Wireless sensor networks for conservation and monitoring cultural assets. IEEE Sens. J. 11, 1382–1389 (2011)CrossRef
3.
Zurück zum Zitat Wang, X., Dong, X.L., Meliou, A.: Data X-ray: a diagnostic tool for data errors. In: Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data (2015) Wang, X., Dong, X.L., Meliou, A.: Data X-ray: a diagnostic tool for data errors. In: Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data (2015)
4.
Zurück zum Zitat Sean, K., Jeffrey, H., Catherine, P., et al.: Research directions in data wrangling: visualizations and transformations for usable and credible data. Inf. Vis. 10(4), 271–288 (2011)CrossRef Sean, K., Jeffrey, H., Catherine, P., et al.: Research directions in data wrangling: visualizations and transformations for usable and credible data. Inf. Vis. 10(4), 271–288 (2011)CrossRef
5.
Zurück zum Zitat Wang, M.J., Pan, Q.M., Liu, Z., Chen, W.: Survey of visualization data cleaning. J. Image Graph. 20(4), 0468–0482 (2015) Wang, M.J., Pan, Q.M., Liu, Z., Chen, W.: Survey of visualization data cleaning. J. Image Graph. 20(4), 0468–0482 (2015)
6.
Zurück zum Zitat Bohannon, P., Fan, W., Flaster, M., Rastogi, R.: A cost-based model and effective heuristic for repairing constraints by value modification. In: SIGMOD (2005) Bohannon, P., Fan, W., Flaster, M., Rastogi, R.: A cost-based model and effective heuristic for repairing constraints by value modification. In: SIGMOD (2005)
7.
Zurück zum Zitat Chiang, F., Miller, R.J.: A unified model for data and constraint repair. In ICDE (2011) Chiang, F., Miller, R.J.: A unified model for data and constraint repair. In ICDE (2011)
8.
Zurück zum Zitat Chu, X., Ilyas, I.F., Papotti, P.: Holistic data cleaning: putting violations into context. In: ICDE (2013) Chu, X., Ilyas, I.F., Papotti, P.: Holistic data cleaning: putting violations into context. In: ICDE (2013)
9.
Zurück zum Zitat Geerts, F., Mecca, G., Papotti, P., Santoro, D.: The LLUNATIC data-cleaning framework. In: VLDB (2013) Geerts, F., Mecca, G., Papotti, P., Santoro, D.: The LLUNATIC data-cleaning framework. In: VLDB (2013)
10.
Zurück zum Zitat Song, S., Cheng, H., Yu, J.X., Chen, L.: Repairing vertex labels under neighborhood constraints. In: VLDB (2014) Song, S., Cheng, H., Yu, J.X., Chen, L.: Repairing vertex labels under neighborhood constraints. In: VLDB (2014)
11.
Zurück zum Zitat May_eld, C., Neville, J., Prabhakar, S.: ERACER: a database approach for statistical inference and data cleaning. In: SIGMOD (2010) May_eld, C., Neville, J., Prabhakar, S.: ERACER: a database approach for statistical inference and data cleaning. In: SIGMOD (2010)
12.
Zurück zum Zitat Yakout, M., Berti-Equille, L., Elmagarmid, A.K.: Don’t be SCAREd: use SCalable Automatic REpairing with maximal likelihood and bounded changes. In: SIGMOD (2013) Yakout, M., Berti-Equille, L., Elmagarmid, A.K.: Don’t be SCAREd: use SCalable Automatic REpairing with maximal likelihood and bounded changes. In: SIGMOD (2013)
13.
Zurück zum Zitat Fan, W., Li, J., Ma, S., Tang, N., Yu, W.: Towards certain fixes with editing rules and master data. In: VLDB (2012) Fan, W., Li, J., Ma, S., Tang, N., Yu, W.: Towards certain fixes with editing rules and master data. In: VLDB (2012)
14.
Zurück zum Zitat Raman, V., Hellerstein, J.M.: Potter’s wheel: an interactive data cleaning system. In: VLDB (2001) Raman, V., Hellerstein, J.M.: Potter’s wheel: an interactive data cleaning system. In: VLDB (2001)
15.
Zurück zum Zitat Volkovs, M., Chiang, F., Szlichta, J., Miller, R.J.: Continuous data cleaning. In: ICDE (2014) Volkovs, M., Chiang, F., Szlichta, J., Miller, R.J.: Continuous data cleaning. In: ICDE (2014)
16.
Zurück zum Zitat Yakout, M., Elmagarmid, A.K., Neville, J., Ouzzani, M., Ilyas, I.F.: Guided data repair. In: VLDB (2011) Yakout, M., Elmagarmid, A.K., Neville, J., Ouzzani, M., Ilyas, I.F.: Guided data repair. In: VLDB (2011)
17.
Zurück zum Zitat Zhang, W., Yang, Y., Wang, Q.: Handling missing data in software effort prediction with naive Bayes and EM algorithm. In: Proceedings of the 7th International Conference on Predictive Models in Software Engineering (2011) Zhang, W., Yang, Y., Wang, Q.: Handling missing data in software effort prediction with naive Bayes and EM algorithm. In: Proceedings of the 7th International Conference on Predictive Models in Software Engineering (2011)
18.
Zurück zum Zitat Liming, Wang, Lian, Wang: Application of time series analysis. Fudan University Press, Shanghai (2009) Liming, Wang, Lian, Wang: Application of time series analysis. Fudan University Press, Shanghai (2009)
19.
Zurück zum Zitat Lu, J., Xu, F.: Research on prediction model of landslide based on the exponential smoothing and regression analysis. J. Wuhan Univ. Technol. 33(10), 88–91 (2011) Lu, J., Xu, F.: Research on prediction model of landslide based on the exponential smoothing and regression analysis. J. Wuhan Univ. Technol. 33(10), 88–91 (2011)
Metadaten
Titel
A Data Cleaning Method and Its Application for Earthen Site Data Monitored by WSN
verfasst von
Yun Xiao
Xuanhong Wang
Xin Wang
Pengfei Xu
Xiaojiang Chen
Dingyi Fang
Baoying Liu
Copyright-Jahr
2016
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-3002-4_52

Premium Partner