Skip to main content
Top

2016 | OriginalPaper | Chapter

A Data Cleaning Method and Its Application for Earthen Site Data Monitored by WSN

Authors : Yun Xiao, Xuanhong Wang, Xin Wang, Pengfei Xu, Xiaojiang Chen, Dingyi Fang, Baoying Liu

Published in: Pattern Recognition

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper focuses on a data cleaning method to denoise and detect outliers of earthen site monitoring data with wireless sensor network (WSN). A data cleaning method, named DC_ESVS is proposed, which is based on the temporal and spatial characteristics of monitoring data with WSN. Using the cubic exponential smoothing algorithm and voting strategy, it can denoise and detect outliers of earthen site monitoring data based on the decision rule. We conduct various experiments on the dataset of the monitoring data of Xi’an Tang Hanguangmen city wall site with WSN to show detection accuracy of the presented method. Experimental results on anther dataset of the monitoring data of the Ming Great Wall in Shaanxi also show good performance of the proposed method.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Abrardo, A., Balucanti, L., Belleschi, M., et al.: Health monitoring of architectural heritage: the case study of San Gimignano. In: 2010 IEEE Workshop on Environmental Energy and Structural Monitoring Systems (EESMS)(2010) Abrardo, A., Balucanti, L., Belleschi, M., et al.: Health monitoring of architectural heritage: the case study of San Gimignano. In: 2010 IEEE Workshop on Environmental Energy and Structural Monitoring Systems (EESMS)(2010)
2.
go back to reference Rodriguez-Sanchez, M.C., Borromeo, S., Hernández-Tamames, J.A.: Wireless sensor networks for conservation and monitoring cultural assets. IEEE Sens. J. 11, 1382–1389 (2011)CrossRef Rodriguez-Sanchez, M.C., Borromeo, S., Hernández-Tamames, J.A.: Wireless sensor networks for conservation and monitoring cultural assets. IEEE Sens. J. 11, 1382–1389 (2011)CrossRef
3.
go back to reference Wang, X., Dong, X.L., Meliou, A.: Data X-ray: a diagnostic tool for data errors. In: Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data (2015) Wang, X., Dong, X.L., Meliou, A.: Data X-ray: a diagnostic tool for data errors. In: Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data (2015)
4.
go back to reference Sean, K., Jeffrey, H., Catherine, P., et al.: Research directions in data wrangling: visualizations and transformations for usable and credible data. Inf. Vis. 10(4), 271–288 (2011)CrossRef Sean, K., Jeffrey, H., Catherine, P., et al.: Research directions in data wrangling: visualizations and transformations for usable and credible data. Inf. Vis. 10(4), 271–288 (2011)CrossRef
5.
go back to reference Wang, M.J., Pan, Q.M., Liu, Z., Chen, W.: Survey of visualization data cleaning. J. Image Graph. 20(4), 0468–0482 (2015) Wang, M.J., Pan, Q.M., Liu, Z., Chen, W.: Survey of visualization data cleaning. J. Image Graph. 20(4), 0468–0482 (2015)
6.
go back to reference Bohannon, P., Fan, W., Flaster, M., Rastogi, R.: A cost-based model and effective heuristic for repairing constraints by value modification. In: SIGMOD (2005) Bohannon, P., Fan, W., Flaster, M., Rastogi, R.: A cost-based model and effective heuristic for repairing constraints by value modification. In: SIGMOD (2005)
7.
go back to reference Chiang, F., Miller, R.J.: A unified model for data and constraint repair. In ICDE (2011) Chiang, F., Miller, R.J.: A unified model for data and constraint repair. In ICDE (2011)
8.
go back to reference Chu, X., Ilyas, I.F., Papotti, P.: Holistic data cleaning: putting violations into context. In: ICDE (2013) Chu, X., Ilyas, I.F., Papotti, P.: Holistic data cleaning: putting violations into context. In: ICDE (2013)
9.
go back to reference Geerts, F., Mecca, G., Papotti, P., Santoro, D.: The LLUNATIC data-cleaning framework. In: VLDB (2013) Geerts, F., Mecca, G., Papotti, P., Santoro, D.: The LLUNATIC data-cleaning framework. In: VLDB (2013)
10.
go back to reference Song, S., Cheng, H., Yu, J.X., Chen, L.: Repairing vertex labels under neighborhood constraints. In: VLDB (2014) Song, S., Cheng, H., Yu, J.X., Chen, L.: Repairing vertex labels under neighborhood constraints. In: VLDB (2014)
11.
go back to reference May_eld, C., Neville, J., Prabhakar, S.: ERACER: a database approach for statistical inference and data cleaning. In: SIGMOD (2010) May_eld, C., Neville, J., Prabhakar, S.: ERACER: a database approach for statistical inference and data cleaning. In: SIGMOD (2010)
12.
go back to reference Yakout, M., Berti-Equille, L., Elmagarmid, A.K.: Don’t be SCAREd: use SCalable Automatic REpairing with maximal likelihood and bounded changes. In: SIGMOD (2013) Yakout, M., Berti-Equille, L., Elmagarmid, A.K.: Don’t be SCAREd: use SCalable Automatic REpairing with maximal likelihood and bounded changes. In: SIGMOD (2013)
13.
go back to reference Fan, W., Li, J., Ma, S., Tang, N., Yu, W.: Towards certain fixes with editing rules and master data. In: VLDB (2012) Fan, W., Li, J., Ma, S., Tang, N., Yu, W.: Towards certain fixes with editing rules and master data. In: VLDB (2012)
14.
go back to reference Raman, V., Hellerstein, J.M.: Potter’s wheel: an interactive data cleaning system. In: VLDB (2001) Raman, V., Hellerstein, J.M.: Potter’s wheel: an interactive data cleaning system. In: VLDB (2001)
15.
go back to reference Volkovs, M., Chiang, F., Szlichta, J., Miller, R.J.: Continuous data cleaning. In: ICDE (2014) Volkovs, M., Chiang, F., Szlichta, J., Miller, R.J.: Continuous data cleaning. In: ICDE (2014)
16.
go back to reference Yakout, M., Elmagarmid, A.K., Neville, J., Ouzzani, M., Ilyas, I.F.: Guided data repair. In: VLDB (2011) Yakout, M., Elmagarmid, A.K., Neville, J., Ouzzani, M., Ilyas, I.F.: Guided data repair. In: VLDB (2011)
17.
go back to reference Zhang, W., Yang, Y., Wang, Q.: Handling missing data in software effort prediction with naive Bayes and EM algorithm. In: Proceedings of the 7th International Conference on Predictive Models in Software Engineering (2011) Zhang, W., Yang, Y., Wang, Q.: Handling missing data in software effort prediction with naive Bayes and EM algorithm. In: Proceedings of the 7th International Conference on Predictive Models in Software Engineering (2011)
18.
go back to reference Liming, Wang, Lian, Wang: Application of time series analysis. Fudan University Press, Shanghai (2009) Liming, Wang, Lian, Wang: Application of time series analysis. Fudan University Press, Shanghai (2009)
19.
go back to reference Lu, J., Xu, F.: Research on prediction model of landslide based on the exponential smoothing and regression analysis. J. Wuhan Univ. Technol. 33(10), 88–91 (2011) Lu, J., Xu, F.: Research on prediction model of landslide based on the exponential smoothing and regression analysis. J. Wuhan Univ. Technol. 33(10), 88–91 (2011)
Metadata
Title
A Data Cleaning Method and Its Application for Earthen Site Data Monitored by WSN
Authors
Yun Xiao
Xuanhong Wang
Xin Wang
Pengfei Xu
Xiaojiang Chen
Dingyi Fang
Baoying Liu
Copyright Year
2016
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-3002-4_52

Premium Partner