Skip to main content

2018 | OriginalPaper | Buchkapitel

Associative Graph Data Structures Used for Acceleration of K Nearest Neighbor Classifiers

verfasst von : Adrian Horzyk, Krzysztof Gołdon

Erschienen in: Artificial Neural Networks and Machine Learning – ICANN 2018

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper introduces a new associative approach for significant acceleration of k Nearest Neighbor classifiers (kNN). The kNN classifier is a lazy method, i.e. it does not create a computational model, so it is inefficient during classification using big training data sets because it requires going through all training patterns when classifying each sample. In this paper, we propose to use Associative Graph Data Structures (AGDS) as an efficient model for storing training patterns and their relations, allowing for fast access to nearest neighbors during classification made by kNNs. Hence, the AGDS significantly accelerates the classification made by kNNs, especially for large and huge training datasets. In this paper, we introduce an Associative Acceleration Algorithm and demonstrate how it works on this associative structure substantially reducing the number of checked patterns and quickly selecting k nearest neighbors for kNNs. The presented approach was compared to classic kNN approaches successfully.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Abidin, T., Perrizo, W.: A fast and scalable nearest neighbor based classifier for data mining. In: Proceedings of ACM SAC 2006, Dijon, France, pp. 536–540. ACM Press, New York (2006) Abidin, T., Perrizo, W.: A fast and scalable nearest neighbor based classifier for data mining. In: Proceedings of ACM SAC 2006, Dijon, France, pp. 536–540. ACM Press, New York (2006)
2.
Zurück zum Zitat Agrawal, R.: Extensions of k-nearest neighbor algorithm. Res. J. Appl. Sci. Eng. Technol. 13(1), 24–29 (2016) Agrawal, R.: Extensions of k-nearest neighbor algorithm. Res. J. Appl. Sci. Eng. Technol. 13(1), 24–29 (2016)
3.
Zurück zum Zitat Cormen, T., Leiserson, C., Rivest, R., Stein, C.: Introduction to Algorithms, 3rd edn. MIT Press, Cambridge (2009)MATH Cormen, T., Leiserson, C., Rivest, R., Stein, C.: Introduction to Algorithms, 3rd edn. MIT Press, Cambridge (2009)MATH
4.
Zurück zum Zitat Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. MIT Press, Cambridge (2016)MATH Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. MIT Press, Cambridge (2016)MATH
5.
Zurück zum Zitat Grana, M.: Advances in Knowledge-Based and Intelligent Information and Engineering Systems. IOS Press, Amsterdam (2012) Grana, M.: Advances in Knowledge-Based and Intelligent Information and Engineering Systems. IOS Press, Amsterdam (2012)
6.
Zurück zum Zitat Horzyk, A.: Artificial Associative Systems and Associative Artificial Intelligence. EXIT, Warsaw (2013) Horzyk, A.: Artificial Associative Systems and Associative Artificial Intelligence. EXIT, Warsaw (2013)
7.
Zurück zum Zitat Horzyk, A.: Associative graph data structures with an efficient access via AVB+trees. In: 11th Conference on Human System Interaction (HSI 2018). IEEE Xplore (2018, in print) Horzyk, A.: Associative graph data structures with an efficient access via AVB+trees. In: 11th Conference on Human System Interaction (HSI 2018). IEEE Xplore (2018, in print)
9.
Zurück zum Zitat Horzyk, A.: Deep associative semantic neural graphs for knowledge representation and fast data exploration. In: Proceedings of KEOD 2017, pp. 67–79. Scitepress Digital Library (2017) Horzyk, A.: Deep associative semantic neural graphs for knowledge representation and fast data exploration. In: Proceedings of KEOD 2017, pp. 67–79. Scitepress Digital Library (2017)
10.
Zurück zum Zitat Horzyk, A., Starzyk, J.A.: Multi-class and multi-label classification using associative pulsing neural networks. In: 2018 IEEE WCCI IJCNN, pp. 427–434. IEEE Xplore (2018) Horzyk, A., Starzyk, J.A.: Multi-class and multi-label classification using associative pulsing neural networks. In: 2018 IEEE WCCI IJCNN, pp. 427–434. IEEE Xplore (2018)
12.
Zurück zum Zitat Kalat, J.W.: Biological Grounds of Psychology, 10th edn. Wadsworth Publishing, Belmont (2008) Kalat, J.W.: Biological Grounds of Psychology, 10th edn. Wadsworth Publishing, Belmont (2008)
13.
Zurück zum Zitat Tadeusiewicz, R.: New trends in neurocybernetics. Comput. Methods Mater. Sci. 10, 1–7 (2010) Tadeusiewicz, R.: New trends in neurocybernetics. Comput. Methods Mater. Sci. 10, 1–7 (2010)
14.
Zurück zum Zitat Tadeusiewicz, R.: Introduction to intelligent systems. In: Fault Diagnosis. Models, Artificial Intelligence, Applications, CRC Press, Boca Raton (2011) Tadeusiewicz, R.: Introduction to intelligent systems. In: Fault Diagnosis. Models, Artificial Intelligence, Applications, CRC Press, Boca Raton (2011)
15.
Zurück zum Zitat Shalev-Shwartz, S., Ben-David, S.: Understanding Machine Learning: From Theory to Algorithms. Cambridge university Press, Cambridge (2014)CrossRef Shalev-Shwartz, S., Ben-David, S.: Understanding Machine Learning: From Theory to Algorithms. Cambridge university Press, Cambridge (2014)CrossRef
16.
Zurück zum Zitat Vivencio, D.P., et al.: Feature-weighted k-nearest neighbor classifier. In: Proceedings of FOCI, pp. 481–486 (2007) Vivencio, D.P., et al.: Feature-weighted k-nearest neighbor classifier. In: Proceedings of FOCI, pp. 481–486 (2007)
17.
Zurück zum Zitat Witten, I.H., Frank, E.: Data Mining: Practical Machine Learning Tools and Techniques, 2nd edn. Morgan Kaufmann Publishers, Morgan Kaufmann Publishers (2005)MATH Witten, I.H., Frank, E.: Data Mining: Practical Machine Learning Tools and Techniques, 2nd edn. Morgan Kaufmann Publishers, Morgan Kaufmann Publishers (2005)MATH
18.
Zurück zum Zitat Wu, X., Zhu, X., Wu, G.Q., Ding, W.: Data mining with big data. Trans. Knowl. Data Eng. 26(1), 97–107 (2014)CrossRef Wu, X., Zhu, X., Wu, G.Q., Ding, W.: Data mining with big data. Trans. Knowl. Data Eng. 26(1), 97–107 (2014)CrossRef
20.
Zurück zum Zitat Dudani, S.A.: The distance-weighted k-nearest neighbor rule. IEEE Trans. Syst. Man Cybern. 6, 325–327 (1976)CrossRef Dudani, S.A.: The distance-weighted k-nearest neighbor rule. IEEE Trans. Syst. Man Cybern. 6, 325–327 (1976)CrossRef
21.
Zurück zum Zitat Gou, J., Lan, D., Zhang, Y., Xiong, T.: A new distance-weighted k-nearest neighbor classifier. J. Inf. Comput. Sci. 9(6), 1429–1436 (2012) Gou, J., Lan, D., Zhang, Y., Xiong, T.: A new distance-weighted k-nearest neighbor classifier. J. Inf. Comput. Sci. 9(6), 1429–1436 (2012)
Metadaten
Titel
Associative Graph Data Structures Used for Acceleration of K Nearest Neighbor Classifiers
verfasst von
Adrian Horzyk
Krzysztof Gołdon
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-030-01418-6_64