Skip to main content
Top
Published in: Cluster Computing 4/2019

06-02-2018

The methods of big data fusion and semantic collision detection in Internet of Thing

Authors: Ruo Hu, Hui-min Zhao, Yantai Wu

Published in: Cluster Computing | Special Issue 4/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We sometimes find ourselves with plenty of data fusion in Internet of Thing, which necessitates an automatic removing semantic collision. For this, it is necessary to detect semantic collision, with a fairly reliable method to find many semantic collision and powerful enough to run in a reasonable time. Big data fusion in Internet of Thing represents today an important data quality challenge which leads to bad decision-making. This paper proposes and compares on real data effective fusion matching methods for automatic removing semantic collision of files based on names, working with Chinese texts or English texts, and the names of people or places, in East or in the West. After conducting a more complete classification of big data fusion than the usual classifications, we introduce several methods for big data fusion. Through a simple model, we highlight a global efficiency, accuracy and recover. We propose a new measuring mechanism between records, as well as rules for automatic big data fusion. Analyses made on Internet of Thing containing real data in western cities, and on a known standard Internet of Thing containing names of companies in the China, have shown better results than those of known methods, with a lesser complexity.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Generalization, 2nd edn. Wiley Inter-science, Hoboken (2012) Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Generalization, 2nd edn. Wiley Inter-science, Hoboken (2012)
2.
go back to reference Hu, R., Jiang, C.Y., Xu, H.: A new efficiency judging method for healthy big data system using heuristic algorithm. Basic Clin. Pharmacol. Toxicol. 118, 42 (2016) Hu, R., Jiang, C.Y., Xu, H.: A new efficiency judging method for healthy big data system using heuristic algorithm. Basic Clin. Pharmacol. Toxicol. 118, 42 (2016)
3.
go back to reference Kishore, J.K., Patnaik, L.M., Mani, V., Agrawal, V.K.: Application of genetic programming for multi-category pattern generalization. IEEE Trans. Evolut. Comput. 4(3), 242–258 (2014)CrossRef Kishore, J.K., Patnaik, L.M., Mani, V., Agrawal, V.K.: Application of genetic programming for multi-category pattern generalization. IEEE Trans. Evolut. Comput. 4(3), 242–258 (2014)CrossRef
4.
go back to reference Robinson, D.: Implications of neural networks for how we think about brain function. Behav. Brain Sci. 15, 644–655 (2012) Robinson, D.: Implications of neural networks for how we think about brain function. Behav. Brain Sci. 15, 644–655 (2012)
5.
go back to reference Holland, J.H., Holyoak, K.J., Nisbett, R.E., Thagard, P.R.: Induction: Steps of Inference, Learning, and Discovery. Cambridge University Press, Cambridge (2013) Holland, J.H., Holyoak, K.J., Nisbett, R.E., Thagard, P.R.: Induction: Steps of Inference, Learning, and Discovery. Cambridge University Press, Cambridge (2013)
6.
go back to reference Hu, R.: Channel access controlling in wireless integrated information network using smart grid system. Appl. Math. Inf. Sci. 6(3), 813–820 (2012)MathSciNet Hu, R.: Channel access controlling in wireless integrated information network using smart grid system. Appl. Math. Inf. Sci. 6(3), 813–820 (2012)MathSciNet
8.
go back to reference Ruo, H.: New network access control method using intelligence agent technology. Appl. Math. Inf. Sci. 7, 44–48 (2013)CrossRef Ruo, H.: New network access control method using intelligence agent technology. Appl. Math. Inf. Sci. 7, 44–48 (2013)CrossRef
9.
go back to reference O’Neill, M., Ryan, C.: Grammatical Evolution: Evolutionary Automatic Programming in an Arbitrary Language. Kluwer Academic Publishers, Dordrecht (2013)MATH O’Neill, M., Ryan, C.: Grammatical Evolution: Evolutionary Automatic Programming in an Arbitrary Language. Kluwer Academic Publishers, Dordrecht (2013)MATH
10.
go back to reference Schwab, I., Link, N.: Reusable artificial intelligence from big data analysis generalization. In: Genetic and Evolutionary Computing (ICGEC 2011), (2013) Schwab, I., Link, N.: Reusable artificial intelligence from big data analysis generalization. In: Genetic and Evolutionary Computing (ICGEC 2011), (2013)
11.
go back to reference Hu, R., Hu, H., Xu, H.: Abnormal access matching through big data analytics in health neural network. Basic Clin. Pharmacol. Toxicol. 118, 73–73 (2016) Hu, R., Hu, H., Xu, H.: Abnormal access matching through big data analytics in health neural network. Basic Clin. Pharmacol. Toxicol. 118, 73–73 (2016)
12.
go back to reference Hu, R., Hu, H., Xiao, Z.H.: Matching unit of health neural network unit based on relation object framework. Basic Clin. Pharmacol. Toxicol 118, 72–73 (2016) Hu, R., Hu, H., Xiao, Z.H.: Matching unit of health neural network unit based on relation object framework. Basic Clin. Pharmacol. Toxicol 118, 72–73 (2016)
13.
go back to reference Kotanchek, M., Smits, G., Kordon, A.: Industrial strength genetic programming. In: Riolo, R., Kluwer, B.W. (eds.) GP Theory and Practice. Springer, New York (2003) Kotanchek, M., Smits, G., Kordon, A.: Industrial strength genetic programming. In: Riolo, R., Kluwer, B.W. (eds.) GP Theory and Practice. Springer, New York (2003)
14.
go back to reference Smits, G., Kotanchek, M.: Cloud plan-front exploitation in big data analysis. In: Riolo, R., Kluwer, B.W. (eds.) GP Theory and Practice. Springer, New York (2004) Smits, G., Kotanchek, M.: Cloud plan-front exploitation in big data analysis. In: Riolo, R., Kluwer, B.W. (eds.) GP Theory and Practice. Springer, New York (2004)
Metadata
Title
The methods of big data fusion and semantic collision detection in Internet of Thing
Authors
Ruo Hu
Hui-min Zhao
Yantai Wu
Publication date
06-02-2018
Publisher
Springer US
Published in
Cluster Computing / Issue Special Issue 4/2019
Print ISSN: 1386-7857
Electronic ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-017-1577-x

Other articles of this Special Issue 4/2019

Cluster Computing 4/2019 Go to the issue

Premium Partner