Skip to main content
Erschienen in: Cluster Computing 4/2016

01.12.2016

Multi-label classification algorithm research based on swarm intelligence

verfasst von: Qinghua Wu, Hanmin Liu, Xuesong Yan

Erschienen in: Cluster Computing | Ausgabe 4/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Since data and resources have massive feature and feature of data are increasingly complex, traditional data structures are not suitable for current data anymore. Therefore, traditional single-label learning method cannot meet the requirements of technology development and the importance of multi-label leaning method becomes more and more highlighted. K-Nearest Neighbor (KNN) classification method is a lazy learning method in data classification methods. It does not need data training process and theoretical system is mature. In addition, principle and implementation is simple. This paper proposed improvements strategies only considers numerical feature of sample KNN when classifying, but not consider the disadvantage of sample structure feature. This paper introduced particle swarm optimization algorithm into KNN classification and make adjustments to Euclidean distance formula in traditional KNN classification algorithm and add weight value to each feature. Using adjusted distance formula to train training data through particle swarm optimization algorithm and optimized a set of weight value for all features and put these optimized weight values to adjusted distance formula and calculated the distance between each example in test data set and in training data set and predict the test data set. Experiment results show that weighted KNN classification algorithm based on particle swarm optimization algorithm can achieve better classification accuracy than traditional KNN classification algorithm.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Sinan, L.I., Ning, L.I., Zhanhuai, L.I.: Multi-label data mining technology: research summary. Comput. Sci. 40(4), 14–19 (2013) Sinan, L.I., Ning, L.I., Zhanhuai, L.I.: Multi-label data mining technology: research summary. Comput. Sci. 40(4), 14–19 (2013)
2.
Zurück zum Zitat Cover, T.M., Hart, P.E.: Nearest neighbor pattern classification. IEEE Trans. Inf. Theory 13, 21–27 (1967)CrossRefMATH Cover, T.M., Hart, P.E.: Nearest neighbor pattern classification. IEEE Trans. Inf. Theory 13, 21–27 (1967)CrossRefMATH
3.
Zurück zum Zitat Yan, X., Luo, W., Wu, Q., Sheng, V.S.: A hybrid intelligent data classification algorithm. Int. J. Wirel. Mob. Comput. 6(6), 573–580 (2013)CrossRef Yan, X., Luo, W., Wu, Q., Sheng, V.S.: A hybrid intelligent data classification algorithm. Int. J. Wirel. Mob. Comput. 6(6), 573–580 (2013)CrossRef
4.
Zurück zum Zitat Yan, X., Li, W., Chen, W., Luo, W., Zhang, C., Wu, Q., Liu, H.: Weighted K-nearest neighbor classification algorithm based on Genetic Algorithm. TELKOMNIKA Indones. J. Electr. Eng. 11(10), 6173–6178 (2013) Yan, X., Li, W., Chen, W., Luo, W., Zhang, C., Wu, Q., Liu, H.: Weighted K-nearest neighbor classification algorithm based on Genetic Algorithm. TELKOMNIKA Indones. J. Electr. Eng. 11(10), 6173–6178 (2013)
5.
Zurück zum Zitat Zhang, M.L., Zhou, Z.H.: ML-kNN: A lazy learning approach to multi-label learning. Pattern Recogn. 40(7), 2038–2048 (2007)CrossRefMATH Zhang, M.L., Zhou, Z.H.: ML-kNN: A lazy learning approach to multi-label learning. Pattern Recogn. 40(7), 2038–2048 (2007)CrossRefMATH
6.
Zurück zum Zitat Guang, K., Pan, J.: K-Nearest Neighbor Multi-label text classification algorithm based on vector angel. Comput. Sci. 35(4), 205–207 (2008) Guang, K., Pan, J.: K-Nearest Neighbor Multi-label text classification algorithm based on vector angel. Comput. Sci. 35(4), 205–207 (2008)
7.
Zurück zum Zitat Wang, C.: Weighted ML-KNN algorithm. Comput. Knowl. Technol. 8(4), 816–818 (2012) Wang, C.: Weighted ML-KNN algorithm. Comput. Knowl. Technol. 8(4), 816–818 (2012)
8.
Zurück zum Zitat Cheng, S., Huang, Q., Liu, J.: Revised ML-KNN Multi-label file classification method. Haerbin Industry University Journey 45(11), 45–49 (2013) Cheng, S., Huang, Q., Liu, J.: Revised ML-KNN Multi-label file classification method. Haerbin Industry University Journey 45(11), 45–49 (2013)
9.
Zurück zum Zitat Xuesong, Y., Qinghua, W., Sheng, V.S.: A double weighted Naive Bayes with niching cultural algorithm for multi-label classification, Int. J. Pattern Recognit. Artif. Intell. 30(6), 1650013 (2016) Xuesong, Y., Qinghua, W., Sheng, V.S.: A double weighted Naive Bayes with niching cultural algorithm for multi-label classification, Int. J. Pattern Recognit. Artif. Intell. 30(6), 1650013 (2016)
10.
Zurück zum Zitat Kennedy, J., Eberhart, R.C.: Particle Swarm Optimization. In: Proceedings of IEEE International Conference on Neural Networks (1995), 1942–1948 Kennedy, J., Eberhart, R.C.: Particle Swarm Optimization. In: Proceedings of IEEE International Conference on Neural Networks (1995), 1942–1948
11.
Zurück zum Zitat Clerc, M., Kennedy, J.: The particle swarm—explosion, stability, and convergence in a multidimensional complex space. IEEE Trans. Evol. Comput. 6(1), 58–73 (2002)CrossRef Clerc, M., Kennedy, J.: The particle swarm—explosion, stability, and convergence in a multidimensional complex space. IEEE Trans. Evol. Comput. 6(1), 58–73 (2002)CrossRef
12.
Zurück zum Zitat Coello, C.A., Lechuga, M.S.: Mopso, A proposal for multiple objective particle swarm optimization. In: IEEE Proceedings World Congress on Computational Intelligence, pp. 1051–1056 (2002) Coello, C.A., Lechuga, M.S.: Mopso, A proposal for multiple objective particle swarm optimization. In: IEEE Proceedings World Congress on Computational Intelligence, pp. 1051–1056 (2002)
13.
Zurück zum Zitat Kennedy, J.: The particle swarm: social adaptation of knowledge. In: Proceedings of the IEEE international Conference on evolutionary computation, pp. 3003-3008 (1997) Kennedy, J.: The particle swarm: social adaptation of knowledge. In: Proceedings of the IEEE international Conference on evolutionary computation, pp. 3003-3008 (1997)
14.
Zurück zum Zitat Oscan, E., Mohan, C.K.: Analysis of a simple particle swarm optimization system. Intell. Eng. Syst. Artif. Neural Netw. 8, 253–258 (1998) Oscan, E., Mohan, C.K.: Analysis of a simple particle swarm optimization system. Intell. Eng. Syst. Artif. Neural Netw. 8, 253–258 (1998)
15.
Zurück zum Zitat Yan, X., Zhang, C., Luo, W., Li, W., Chen, W., Liu, H.: Solve traveling salesman problem using particle swarm optimization algorithm. Int. J. Comput. Sci. 9(6), 264–271 (2012) Yan, X., Zhang, C., Luo, W., Li, W., Chen, W., Liu, H.: Solve traveling salesman problem using particle swarm optimization algorithm. Int. J. Comput. Sci. 9(6), 264–271 (2012)
16.
Zurück zum Zitat Yan, X., Yao, H., Liang, Q., Hu, C., Fan, Y., Huang, W.: Engineering optimization algorithm based on particle swarm optimization. Int. J. Adv. Comput. Technol. 5(3), 113–121 (2013) Yan, X., Yao, H., Liang, Q., Hu, C., Fan, Y., Huang, W.: Engineering optimization algorithm based on particle swarm optimization. Int. J. Adv. Comput. Technol. 5(3), 113–121 (2013)
17.
Zurück zum Zitat Yan, X., Hu, C., Yao, H., Fan, Y., Liang, Q., Liu, C.: Electronic circuit optimization design algorithm based on particle swarm optimization. Przeglad Elektrotechniczny 89(03b), 50–52 (2013) Yan, X., Hu, C., Yao, H., Fan, Y., Liang, Q., Liu, C.: Electronic circuit optimization design algorithm based on particle swarm optimization. Przeglad Elektrotechniczny 89(03b), 50–52 (2013)
18.
Zurück zum Zitat Yan, X., Wu, Q., Hu, C., Yao, H., Fan, Y., Liang, Q., Liu, C.: Robot path planning based on swarm Intelligence. Int. J. Control Autom. 7(7), 15–32 (2014)CrossRef Yan, X., Wu, Q., Hu, C., Yao, H., Fan, Y., Liang, Q., Liu, C.: Robot path planning based on swarm Intelligence. Int. J. Control Autom. 7(7), 15–32 (2014)CrossRef
19.
Zurück zum Zitat Wu, Q., Liu, H., Yan, X.: An improved design optimisation algorithm based on swarm intelligence. Int. J. Comput. Sci. Math. 5(1), 27–36 (2014)MathSciNetCrossRefMATH Wu, Q., Liu, H., Yan, X.: An improved design optimisation algorithm based on swarm intelligence. Int. J. Comput. Sci. Math. 5(1), 27–36 (2014)MathSciNetCrossRefMATH
20.
Zurück zum Zitat Chen, H.: Weighted KNN Algorithm and Its Application. Hebei University, Hebei (2005) Chen, H.: Weighted KNN Algorithm and Its Application. Hebei University, Hebei (2005)
Metadaten
Titel
Multi-label classification algorithm research based on swarm intelligence
verfasst von
Qinghua Wu
Hanmin Liu
Xuesong Yan
Publikationsdatum
01.12.2016
Verlag
Springer US
Erschienen in
Cluster Computing / Ausgabe 4/2016
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-016-0646-x

Weitere Artikel der Ausgabe 4/2016

Cluster Computing 4/2016 Zur Ausgabe