Skip to main content
Erschienen in: Neural Computing and Applications 1/2018

19.07.2016 | Original Article

A comparative study of fuzzy PSO and fuzzy SVD-based RBF neural network for multi-label classification

verfasst von: Shikha Agrawal, Jitendra Agrawal, Shilpy Kaur, Sanjeev Sharma

Erschienen in: Neural Computing and Applications | Ausgabe 1/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In multi-label classification problems, every instance is associated with multiple labels at the same time. Binary classification, multi-class classification and ordinal regression problems can be seen as unique cases of multi-label classification where each instance is assigned only one label. Text classification is the main application area of multi-label classification techniques. However, relevant works are found in areas like bioinformatics, medical diagnosis, scene classification and music categorization. There are two approaches to do multi-label classification: The first is an algorithm-independent approach or problem transformation in which multi-label problem is dealt by transforming the original problem into a set of single-label problems, and the second approach is algorithm adaptation, where specific algorithms have been proposed to solve multi-label classification problem. Through our work, we not only investigate various research works that have been conducted under algorithm adaptation for multi-label classification but also perform comparative study of two proposed algorithms. The first proposed algorithm is named as fuzzy PSO-based ML-RBF, which is the hybridization of fuzzy PSO and ML-RBF. The second proposed algorithm is named as FSVD-MLRBF that hybridizes fuzzy c-means clustering along with singular value decomposition. Both the proposed algorithms are applied to real-world datasets, i.e., yeast and scene dataset. The experimental results show that both the proposed algorithms meet or beat ML-RBF and ML-KNN when applied on the test datasets.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Tsoumakas G, Katakis I (2007) Multi-label classification: an overview. Int J Data Wareh Mining 3(1):1–13CrossRef Tsoumakas G, Katakis I (2007) Multi-label classification: an overview. Int J Data Wareh Mining 3(1):1–13CrossRef
2.
Zurück zum Zitat Read J (2008) A pruned problem transformation method for multi-label classification. In: Proceedings of the 2008 New Zealand computer science research student conference, NZCSRS ‘08, pp 143–150 Read J (2008) A pruned problem transformation method for multi-label classification. In: Proceedings of the 2008 New Zealand computer science research student conference, NZCSRS ‘08, pp 143–150
3.
Zurück zum Zitat Tsoumakas G, Vlahavas I (2007) Random k-labelset: an ensemble method for multi-label classification. In: Proceedings of the 18th European conference on machine learning, ECML’07, Warsaw, pp 406–417 Tsoumakas G, Vlahavas I (2007) Random k-labelset: an ensemble method for multi-label classification. In: Proceedings of the 18th European conference on machine learning, ECML’07, Warsaw, pp 406–417
4.
Zurück zum Zitat Hullermeier E, Furnkranz J, Chang W, Brinker K (2008) Label ranking by learning pairwise preferences. Artif Intell 172(16–17):1897–1916MathSciNetCrossRefMATH Hullermeier E, Furnkranz J, Chang W, Brinker K (2008) Label ranking by learning pairwise preferences. Artif Intell 172(16–17):1897–1916MathSciNetCrossRefMATH
5.
Zurück zum Zitat Furnkranz J, Hullermeier E, Mencia EL, Brinker K (2008) Multi-label classification via calibrated label ranking. Mach Learn 73(2):133–153CrossRef Furnkranz J, Hullermeier E, Mencia EL, Brinker K (2008) Multi-label classification via calibrated label ranking. Mach Learn 73(2):133–153CrossRef
6.
Zurück zum Zitat Schapire RE, Singer Y (2000) Boostexter: a boosting-based system for text categorization. Mach Learn 39(2–3):135–168CrossRefMATH Schapire RE, Singer Y (2000) Boostexter: a boosting-based system for text categorization. Mach Learn 39(2–3):135–168CrossRefMATH
7.
Zurück zum Zitat Ueda N, Saito K (2002) Single-shot detection of multiple categories of text using parametric mixture models. In: Proceedings of the KDD, pp 626–631 Ueda N, Saito K (2002) Single-shot detection of multiple categories of text using parametric mixture models. In: Proceedings of the KDD, pp 626–631
8.
Zurück zum Zitat Ghamrawi N, McCallum A (2005) Collective multi-label classification. CIKM, BremenCrossRef Ghamrawi N, McCallum A (2005) Collective multi-label classification. CIKM, BremenCrossRef
9.
Zurück zum Zitat Wei Z, Zhang H, Zhang Z, Li W, Miao D (2011) A naive bayesian multi-label classification algorithm with application to visualize text search results. Int J Adv Intell 3(2):173–188 Wei Z, Zhang H, Zhang Z, Li W, Miao D (2011) A naive bayesian multi-label classification algorithm with application to visualize text search results. Int J Adv Intell 3(2):173–188
10.
Zurück zum Zitat Wang H, Huang M, Zhu X (2008) A generative probabilistic model for multi-label classification. Eighth IEEE international conference on data mining, pp 1550–4786 Wang H, Huang M, Zhu X (2008) A generative probabilistic model for multi-label classification. Eighth IEEE international conference on data mining, pp 1550–4786
11.
Zurück zum Zitat Zhang M-L, Pena Jose M, Robles V (2009) Feature selection for multi-label naive Bayes classification. Inf Sci 179:3218–3229CrossRefMATH Zhang M-L, Pena Jose M, Robles V (2009) Feature selection for multi-label naive Bayes classification. Inf Sci 179:3218–3229CrossRefMATH
12.
Zurück zum Zitat Wang X, Liu X, Shi Z, Shi Z, Sui H (2010) Voting conditional random fields for multi-label image classification. In: 3rd International congress on image and signal processing (CISP), vol 4, pp 1984–1988 Wang X, Liu X, Shi Z, Shi Z, Sui H (2010) Voting conditional random fields for multi-label image classification. In: 3rd International congress on image and signal processing (CISP), vol 4, pp 1984–1988
13.
Zurück zum Zitat Ma H, Chen E, Xu L, Xiong H (2012) Capturing correlations of multiple labels: a generative probabilistic model for multi-label learning. Neurocomputing 92:116–123CrossRef Ma H, Chen E, Xu L, Xiong H (2012) Capturing correlations of multiple labels: a generative probabilistic model for multi-label learning. Neurocomputing 92:116–123CrossRef
14.
Zurück zum Zitat Elisseeff A, Weston J (2002) A kernel method for multi-labelled classification. In: Dietterich TG, Becker S, Ghahramani Z (eds) Advances in neural information processing systems, vol 14., MIT PressCambridge, MA, pp 681–687 Elisseeff A, Weston J (2002) A kernel method for multi-labelled classification. In: Dietterich TG, Becker S, Ghahramani Z (eds) Advances in neural information processing systems, vol 14., MIT PressCambridge, MA, pp 681–687
15.
Zurück zum Zitat Godbole S, Sarawagi S (2004) Discriminative methods for multi-labeled classification. LNCS Adv Knowl Discov Data Mining 3056(1):22–30CrossRef Godbole S, Sarawagi S (2004) Discriminative methods for multi-labeled classification. LNCS Adv Knowl Discov Data Mining 3056(1):22–30CrossRef
16.
Zurück zum Zitat Qin Y-P, Wang X-K (2009) Study on multi-label text classification based on SVM. In: Proceeding FSKD'09 Proceedings of the 6th international conference on fuzzy systems and knowledge discovery, vol 1, pp 300–304 Qin Y-P, Wang X-K (2009) Study on multi-label text classification based on SVM. In: Proceeding FSKD'09 Proceedings of the 6th international conference on fuzzy systems and knowledge discovery, vol 1, pp 300–304
17.
Zurück zum Zitat Hariharan B, Vishwanathan SVN, Varma M (2012) Efficient max-margin multi-label classification with applications to zero-shot learning. Mach Learn J 88(1):127–155MathSciNetCrossRefMATH Hariharan B, Vishwanathan SVN, Varma M (2012) Efficient max-margin multi-label classification with applications to zero-shot learning. Mach Learn J 88(1):127–155MathSciNetCrossRefMATH
18.
Zurück zum Zitat Jianhua Xu (2012) An efficient multi-label support vector machine with a zero label. Expert Syst Appl 39:4796–4804CrossRef Jianhua Xu (2012) An efficient multi-label support vector machine with a zero label. Expert Syst Appl 39:4796–4804CrossRef
19.
Zurück zum Zitat Zhang M-L, Zhou Z-H (2007) ML-KNN: a lazy learning approach to multi-label learning. Pattern Recogn 40(7):2038–3048CrossRefMATH Zhang M-L, Zhou Z-H (2007) ML-KNN: a lazy learning approach to multi-label learning. Pattern Recogn 40(7):2038–3048CrossRefMATH
20.
Zurück zum Zitat Spyromitros E, Tsoumakas G, Vlahavas I (2008) An empirical study of lazy multilabel classification algorithms. In: Proceedings of the 5th Hellenic conference on artificial intelligence (SETN 2008) Springer, LNAI, vol 5138, pp 401–406 Spyromitros E, Tsoumakas G, Vlahavas I (2008) An empirical study of lazy multilabel classification algorithms. In: Proceedings of the 5th Hellenic conference on artificial intelligence (SETN 2008) Springer, LNAI, vol 5138, pp 401–406
21.
Zurück zum Zitat Coelho TA, Esmin AAA, Junior WM (2007) Particle swarm optimization for multi-label classification. GECCO ACM, New York Coelho TA, Esmin AAA, Junior WM (2007) Particle swarm optimization for multi-label classification. GECCO ACM, New York
22.
Zurück zum Zitat Zhang M-L, Zhou Z-H (2006) Multi-label neural networks with applications to functional genomics and text categorization. IEEE Trans Knowl Data Eng 18(10):1338–1351CrossRef Zhang M-L, Zhou Z-H (2006) Multi-label neural networks with applications to functional genomics and text categorization. IEEE Trans Knowl Data Eng 18(10):1338–1351CrossRef
23.
Zurück zum Zitat Grodzicki R, Mandziuk J, Wang L (2008) Improved multi-label classification with neural networks. LNCS Adv Knowl Discov Data Mining 5199(1):409–416 Grodzicki R, Mandziuk J, Wang L (2008) Improved multi-label classification with neural networks. LNCS Adv Knowl Discov Data Mining 5199(1):409–416
24.
25.
Zurück zum Zitat Sapozhnikova EP (2009) Art-based neural networks for multi-label classification. In: Adams NM, Robardet C, Siebes A, Boulicaut J-F (eds) IDA, series. Lecture notes in computer science, vol 5772. Springer, New York, pp 167–177 Sapozhnikova EP (2009) Art-based neural networks for multi-label classification. In: Adams NM, Robardet C, Siebes A, Boulicaut J-F (eds) IDA, series. Lecture notes in computer science, vol 5772. Springer, New York, pp 167–177
26.
Zurück zum Zitat Benites F, Brucker F, Sapozhnikova E (2010) Multi-label classification by ART-based neural networks and hierarchy extraction. In: Proceedings of the international joint conference on neural networks (IJCNN), pp 1–9 Benites F, Brucker F, Sapozhnikova E (2010) Multi-label classification by ART-based neural networks and hierarchy extraction. In: Proceedings of the international joint conference on neural networks (IJCNN), pp 1–9
27.
Zurück zum Zitat De Souza AF, Pedroni F, Oliveira E, Ciarelli PM, Henrique WF, Veronese L, Badue C (2009) Automated multi-label text categorization with VG-RAM weightless neural networks. Neurocomputing 72:2209–2217CrossRef De Souza AF, Pedroni F, Oliveira E, Ciarelli PM, Henrique WF, Veronese L, Badue C (2009) Automated multi-label text categorization with VG-RAM weightless neural networks. Neurocomputing 72:2209–2217CrossRef
28.
Zurück zum Zitat Ciarelli PM, Oliveria E, Badue C, De Souza AF (2009) Multi-label text categorization using a probabilistic neural network. Int J Comput Inf Syst Ind Manag Appl (IJCISIM) 1:133–144. ISSN: 2150-7988 Ciarelli PM, Oliveria E, Badue C, De Souza AF (2009) Multi-label text categorization using a probabilistic neural network. Int J Comput Inf Syst Ind Manag Appl (IJCISIM) 1:133–144. ISSN: 2150-7988
29.
Zurück zum Zitat Chen Z, Chi Z, Hong Fu, Feng D (2013) Multi-instance multi-label image classification: a neural approach. Neurocomputing 99:298–306CrossRef Chen Z, Chi Z, Hong Fu, Feng D (2013) Multi-instance multi-label image classification: a neural approach. Neurocomputing 99:298–306CrossRef
30.
Zurück zum Zitat Abdelbar AM, Abdelshahid S, Wunsch II DC (2005) Fuzzy PSO: a generalization of particle swarm optimization. In: Proceedings of IEEE international joint conference on neural networks (IJCNN), vol 2, Montereal Abdelbar AM, Abdelshahid S, Wunsch II DC (2005) Fuzzy PSO: a generalization of particle swarm optimization. In: Proceedings of IEEE international joint conference on neural networks (IJCNN), vol 2, Montereal
Metadaten
Titel
A comparative study of fuzzy PSO and fuzzy SVD-based RBF neural network for multi-label classification
verfasst von
Shikha Agrawal
Jitendra Agrawal
Shilpy Kaur
Sanjeev Sharma
Publikationsdatum
19.07.2016
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 1/2018
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-016-2446-x

Weitere Artikel der Ausgabe 1/2018

Neural Computing and Applications 1/2018 Zur Ausgabe