Skip to main content
Erschienen in: Earth Science Informatics 2/2021

01.04.2021 | Research Article

Robust outlier detection in geo-spatial data based on LOLIMOT and KNN search

verfasst von: Mohammadreza Tabatabaei, Roohollah Kimiaefar, Alireza Hajian, Alireza Akbari

Erschienen in: Earth Science Informatics | Ausgabe 2/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

One of the most challenging topics in analyzing multi-dimensional geo-spatial data such as geophysical data-sets is detecting outlier data. The issue mainly originates from the difficulty in describing “normality” or “abnormality” due to the complexity of the relationships between the data elements. Considerable number of methods have been proposed and applied for detecting outliers whether they are assumed to be noise, anomalies within the data-set or simply isolated events. A new outlier detection method reached from automatic training of Local Linear Model Tree (LOLIMOT) network, and based on the data selected by K-Nearest Neighborhood (KNN) search is proposed in this research. The procedure of selecting data pairs is through decile analysis using distances calculated during KNN data grouping. Experiment on a synthetic 12 cluster 3D data-set is indicative of the method’s robust performance where calculated Cumulative Error Percentage (CEP) is 13% for the method whereas the nearest value for the KNN is 19%. Also, by applying the method on a micro-gravimetric data and an earthquake catalogue related to the north Zagros- west Alborz, and based on the output of the analyses performed, the superiority of the method in outlier detection was confirmed.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Arabelos D, Asteriadis G, Contadakis M, Zioutas G, Xu D, Zhang C, Zheng B (2001) The use of an outlier detecting method in time series of continuous daily measurements of underground water level and temperature in earthquake prediction investigation. Tectonophysics 338(3):315–323. https://doi.org/10.1016/S0040-1951(01)00086-5CrossRef Arabelos D, Asteriadis G, Contadakis M, Zioutas G, Xu D, Zhang C, Zheng B (2001) The use of an outlier detecting method in time series of continuous daily measurements of underground water level and temperature in earthquake prediction investigation. Tectonophysics 338(3):315–323. https://​doi.​org/​10.​1016/​S0040-1951(01)00086-5CrossRef
Zurück zum Zitat Hajian A, Zomorrodian H, Styles P, Greco F, Lucas C (2011) Depth estimation of cavities from microgravity data using a new approach: the local linear model tree (LOLIMOT). Near Surf Geophys 10(3):221–234CrossRef Hajian A, Zomorrodian H, Styles P, Greco F, Lucas C (2011) Depth estimation of cavities from microgravity data using a new approach: the local linear model tree (LOLIMOT). Near Surf Geophys 10(3):221–234CrossRef
Zurück zum Zitat Hodge V, Austin J (2004) A survey of outlier detection methodologies. Artif Intell Rev 22:85–126CrossRef Hodge V, Austin J (2004) A survey of outlier detection methodologies. Artif Intell Rev 22:85–126CrossRef
Zurück zum Zitat Hu L-Y, Huang M-W, Ke S-W, Tsai C-F (2016) The distance function effect on k-nearest neighbor classification for medical datasets. SpringerPlus 5 (1) Hu L-Y, Huang  M-W, Ke S-W, Tsai C-F (2016) The distance function effect on k-nearest neighbor classification for medical datasets. SpringerPlus 5 (1)
Zurück zum Zitat Liu FT, Ting KM, Zhou ZH (2008) Isolation forest in data mining. In: ICDM’08. Eighth IEEE international conference on data mining, pp 413–422 Liu FT, Ting KM, Zhou ZH (2008) Isolation forest in data mining. In: ICDM’08. Eighth IEEE international conference on data mining, pp 413–422
Zurück zum Zitat Nelles O (1997) Nonlinear system identification with neurofuzzy, intelligent hybrid systems-fuzzy logic, neural networks, Genetic Algorithms. Kluwer Academic Publishers Nelles O (1997) Nonlinear system identification with neurofuzzy, intelligent hybrid systems-fuzzy logic, neural networks, Genetic Algorithms. Kluwer Academic Publishers
Zurück zum Zitat Nelles O (2001) Nonlinear systems identification. Springer Nelles O (2001) Nonlinear systems identification. Springer
Zurück zum Zitat Onda S, Sano Y, Takahata N, Kagoshima T, Miyajima T, Shibata T, Pinti DL, Lan T, Kim NK, Kusakabe M, Nishio Y (2018) Groundwater oxygen isotope anomaly before the M6. 6 Tottori earthquake in Southwest Japan. Sci Rep 8(1):1–7CrossRef Onda S, Sano Y, Takahata N, Kagoshima T, Miyajima T, Shibata T, Pinti DL, Lan T, Kim NK, Kusakabe M, Nishio Y (2018) Groundwater oxygen isotope anomaly before the M6. 6 Tottori earthquake in Southwest Japan. Sci Rep 8(1):1–7CrossRef
Zurück zum Zitat Purkhauser AF, Pail R (2019) Next generation gravity missions: near-real time gravity field retrieval strategy. Geophys J Int 217(2):1314–1333CrossRef Purkhauser AF, Pail R (2019) Next generation gravity missions: near-real time gravity field retrieval strategy. Geophys J Int 217(2):1314–1333CrossRef
Zurück zum Zitat Seth S., Babbar S. (2015) Outlier detection algorithm suite in MATLAB Seth S., Babbar S. (2015) Outlier detection algorithm suite in MATLAB
Zurück zum Zitat Steiner M., Straka W., Flores-Orozco A. (2018) Event detection in ambient seismic noise by means of robust outlier detection. EGU 2018 General Assembly Conference: 17365. Steiner M., Straka W., Flores-Orozco A. (2018) Event detection in ambient seismic noise by means of robust outlier detection. EGU 2018 General Assembly Conference: 17365.
Zurück zum Zitat Xu X, Liu H, Li L, Yao M (2018) A comparison of outlier detection techniques for high-dimensional data. Int J Comput Intell Syst 11(1):652–662CrossRef Xu X, Liu H, Li L, Yao M (2018) A comparison of outlier detection techniques for high-dimensional data. Int J Comput Intell Syst 11(1):652–662CrossRef
Metadaten
Titel
Robust outlier detection in geo-spatial data based on LOLIMOT and KNN search
verfasst von
Mohammadreza Tabatabaei
Roohollah Kimiaefar
Alireza Hajian
Alireza Akbari
Publikationsdatum
01.04.2021
Verlag
Springer Berlin Heidelberg
Erschienen in
Earth Science Informatics / Ausgabe 2/2021
Print ISSN: 1865-0473
Elektronische ISSN: 1865-0481
DOI
https://doi.org/10.1007/s12145-021-00610-9

Weitere Artikel der Ausgabe 2/2021

Earth Science Informatics 2/2021 Zur Ausgabe

Premium Partner