Skip to main content
Top
Published in: Earth Science Informatics 2/2021

01-04-2021 | Research Article

Robust outlier detection in geo-spatial data based on LOLIMOT and KNN search

Authors: Mohammadreza Tabatabaei, Roohollah Kimiaefar, Alireza Hajian, Alireza Akbari

Published in: Earth Science Informatics | Issue 2/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

One of the most challenging topics in analyzing multi-dimensional geo-spatial data such as geophysical data-sets is detecting outlier data. The issue mainly originates from the difficulty in describing “normality” or “abnormality” due to the complexity of the relationships between the data elements. Considerable number of methods have been proposed and applied for detecting outliers whether they are assumed to be noise, anomalies within the data-set or simply isolated events. A new outlier detection method reached from automatic training of Local Linear Model Tree (LOLIMOT) network, and based on the data selected by K-Nearest Neighborhood (KNN) search is proposed in this research. The procedure of selecting data pairs is through decile analysis using distances calculated during KNN data grouping. Experiment on a synthetic 12 cluster 3D data-set is indicative of the method’s robust performance where calculated Cumulative Error Percentage (CEP) is 13% for the method whereas the nearest value for the KNN is 19%. Also, by applying the method on a micro-gravimetric data and an earthquake catalogue related to the north Zagros- west Alborz, and based on the output of the analyses performed, the superiority of the method in outlier detection was confirmed.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Hajian A, Zomorrodian H, Styles P, Greco F, Lucas C (2011) Depth estimation of cavities from microgravity data using a new approach: the local linear model tree (LOLIMOT). Near Surf Geophys 10(3):221–234CrossRef Hajian A, Zomorrodian H, Styles P, Greco F, Lucas C (2011) Depth estimation of cavities from microgravity data using a new approach: the local linear model tree (LOLIMOT). Near Surf Geophys 10(3):221–234CrossRef
go back to reference Hodge V, Austin J (2004) A survey of outlier detection methodologies. Artif Intell Rev 22:85–126CrossRef Hodge V, Austin J (2004) A survey of outlier detection methodologies. Artif Intell Rev 22:85–126CrossRef
go back to reference Hu L-Y, Huang M-W, Ke S-W, Tsai C-F (2016) The distance function effect on k-nearest neighbor classification for medical datasets. SpringerPlus 5 (1) Hu L-Y, Huang  M-W, Ke S-W, Tsai C-F (2016) The distance function effect on k-nearest neighbor classification for medical datasets. SpringerPlus 5 (1)
go back to reference Liu FT, Ting KM, Zhou ZH (2008) Isolation forest in data mining. In: ICDM’08. Eighth IEEE international conference on data mining, pp 413–422 Liu FT, Ting KM, Zhou ZH (2008) Isolation forest in data mining. In: ICDM’08. Eighth IEEE international conference on data mining, pp 413–422
go back to reference Nelles O (1997) Nonlinear system identification with neurofuzzy, intelligent hybrid systems-fuzzy logic, neural networks, Genetic Algorithms. Kluwer Academic Publishers Nelles O (1997) Nonlinear system identification with neurofuzzy, intelligent hybrid systems-fuzzy logic, neural networks, Genetic Algorithms. Kluwer Academic Publishers
go back to reference Nelles O (2001) Nonlinear systems identification. Springer Nelles O (2001) Nonlinear systems identification. Springer
go back to reference Onda S, Sano Y, Takahata N, Kagoshima T, Miyajima T, Shibata T, Pinti DL, Lan T, Kim NK, Kusakabe M, Nishio Y (2018) Groundwater oxygen isotope anomaly before the M6. 6 Tottori earthquake in Southwest Japan. Sci Rep 8(1):1–7CrossRef Onda S, Sano Y, Takahata N, Kagoshima T, Miyajima T, Shibata T, Pinti DL, Lan T, Kim NK, Kusakabe M, Nishio Y (2018) Groundwater oxygen isotope anomaly before the M6. 6 Tottori earthquake in Southwest Japan. Sci Rep 8(1):1–7CrossRef
go back to reference Purkhauser AF, Pail R (2019) Next generation gravity missions: near-real time gravity field retrieval strategy. Geophys J Int 217(2):1314–1333CrossRef Purkhauser AF, Pail R (2019) Next generation gravity missions: near-real time gravity field retrieval strategy. Geophys J Int 217(2):1314–1333CrossRef
go back to reference Seth S., Babbar S. (2015) Outlier detection algorithm suite in MATLAB Seth S., Babbar S. (2015) Outlier detection algorithm suite in MATLAB
go back to reference Steiner M., Straka W., Flores-Orozco A. (2018) Event detection in ambient seismic noise by means of robust outlier detection. EGU 2018 General Assembly Conference: 17365. Steiner M., Straka W., Flores-Orozco A. (2018) Event detection in ambient seismic noise by means of robust outlier detection. EGU 2018 General Assembly Conference: 17365.
go back to reference Xu X, Liu H, Li L, Yao M (2018) A comparison of outlier detection techniques for high-dimensional data. Int J Comput Intell Syst 11(1):652–662CrossRef Xu X, Liu H, Li L, Yao M (2018) A comparison of outlier detection techniques for high-dimensional data. Int J Comput Intell Syst 11(1):652–662CrossRef
Metadata
Title
Robust outlier detection in geo-spatial data based on LOLIMOT and KNN search
Authors
Mohammadreza Tabatabaei
Roohollah Kimiaefar
Alireza Hajian
Alireza Akbari
Publication date
01-04-2021
Publisher
Springer Berlin Heidelberg
Published in
Earth Science Informatics / Issue 2/2021
Print ISSN: 1865-0473
Electronic ISSN: 1865-0481
DOI
https://doi.org/10.1007/s12145-021-00610-9

Other articles of this Issue 2/2021

Earth Science Informatics 2/2021 Go to the issue

Premium Partner