Skip to main content
Top
Published in: Soft Computing 12/2019

20-02-2018 | Methodologies and Application

Belief-based chaotic algorithm for support vector data description

Authors: Javad Hamidzadeh, Neda Namaei

Published in: Soft Computing | Issue 12/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

One of the efficient tools to handle segregation of imbalanced data is support vector data description (SVDD). In contrast to support vector machine (SVM), enclosing target data in a hyper-sphere by SVDD leads to avoid biasing toward major data. SVDD can gain the best description of data when its free parameters are set to proper values. In this paper, we propose belief-based chaotic krill herd algorithm for SVDD (BCKH-SVDD) with the aim of designing effective description of data. First, we introduce a new SVDD based on belief function theory, and then, we tune the free parameters by chaotic krill herd algorithm. Belief function theory is one of the best methods to enhance decision making for uncertain data. By adding a new belief-based weight, we can decide better about the data around the SVDD boundary and the classification will be more precise. Chaotic krill herd optimization algorithm introduces chaotic maps in the krill herd algorithm. With the help of chaotic maps, the two issues, namely local optima avoidance and convergence speed, can be overcome. Thus, chaotic krill herd algorithm is constructed based on chaotic functions and automatic switching between global and local searches of krill herd. To present the power of BCKH-SVDD, several experiments have been conducted based on tenfold cross-validation over real-world data sets from UCI repository. Experimental results show the superiority of the proposed algorithm to state-of-the-art methods in terms of classification accuracy, precision and recall measures.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Bartlett P, Mendelson S (2002) Rademacher and Gaussian complexities: risk bounds and structural results. J Mach Learn Res 3:463–482MathSciNetMATH Bartlett P, Mendelson S (2002) Rademacher and Gaussian complexities: risk bounds and structural results. J Mach Learn Res 3:463–482MathSciNetMATH
go back to reference Cha M, Kim JS, Park SH, Baek J (2012) Nonparametric control chart using density weighted support vector data description. In: Proceedings of world academy of science, engineering and technology, world academy of science, engineering and technology (WASET) 1020 Cha M, Kim JS, Park SH, Baek J (2012) Nonparametric control chart using density weighted support vector data description. In: Proceedings of world academy of science, engineering and technology, world academy of science, engineering and technology (WASET) 1020
go back to reference Cha M, Kim JS, Baek J (2014) Density weighted support vector data description. Expert Syst Appl 41:3343–3350CrossRef Cha M, Kim JS, Baek J (2014) Density weighted support vector data description. Expert Syst Appl 41:3343–3350CrossRef
go back to reference Chen G, Zhang X, Wang J, Li F (2015) Robust SVDD for outlier detection with noise or uncertain data. Knowl Based Syst 90:129–137CrossRef Chen G, Zhang X, Wang J, Li F (2015) Robust SVDD for outlier detection with noise or uncertain data. Knowl Based Syst 90:129–137CrossRef
go back to reference Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20:273–297MATH Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20:273–297MATH
go back to reference Demsar J (2006) Statistical comparisons of classifers over multiple data sets. J Mach Learn Res 7:1–30MathSciNetMATH Demsar J (2006) Statistical comparisons of classifers over multiple data sets. J Mach Learn Res 7:1–30MathSciNetMATH
go back to reference El Boujnouni M, Jedra M, Zahid N (2014) Support vector domain description with a new confidence coefficient. In: 2014 9th International conference on intelligent systems: theories and applications (SITA-14), pp 1–8 El Boujnouni M, Jedra M, Zahid N (2014) Support vector domain description with a new confidence coefficient. In: 2014 9th International conference on intelligent systems: theories and applications (SITA-14), pp 1–8
go back to reference Esme E, Karlik B (2016) Fuzzy c-mean based support vector machines classifier for perfume recognition. Appl Soft Comput 46:452–458CrossRef Esme E, Karlik B (2016) Fuzzy c-mean based support vector machines classifier for perfume recognition. Appl Soft Comput 46:452–458CrossRef
go back to reference GhasemiGol M, Sabzekar M, Monsefi R, Naghibzadeh M, Yazdi HS (2010) A new support vector data description with fuzzy constraints. In: 2010 International conference on intelligent systems, modelling and simulation (ISMS), pp 10–14 GhasemiGol M, Sabzekar M, Monsefi R, Naghibzadeh M, Yazdi HS (2010) A new support vector data description with fuzzy constraints. In: 2010 International conference on intelligent systems, modelling and simulation (ISMS), pp 10–14
go back to reference Ghoting A, Parthasarathy S, Eric Otey M (2008) Fast mining of distance-based outliers in high-dimensional datasets. Data Min Knowl Disc 16:349–364MathSciNetCrossRef Ghoting A, Parthasarathy S, Eric Otey M (2008) Fast mining of distance-based outliers in high-dimensional datasets. Data Min Knowl Disc 16:349–364MathSciNetCrossRef
go back to reference Hamidzadeh J, Monsefi R, Yazdi H (2015) IRAHC: instance reduction algorithm using hyperrectangle clustering. Pattern Recognit 48:1878–1889CrossRefMATH Hamidzadeh J, Monsefi R, Yazdi H (2015) IRAHC: instance reduction algorithm using hyperrectangle clustering. Pattern Recognit 48:1878–1889CrossRefMATH
go back to reference Hao P, Chiang J, Lin Y (2009) a new maximal-margin spherical-structured multi-class support vector machine. Appl Intell 30:98–111CrossRef Hao P, Chiang J, Lin Y (2009) a new maximal-margin spherical-structured multi-class support vector machine. Appl Intell 30:98–111CrossRef
go back to reference Hu Y, Liu JN, Wang Y, Lai L (2012) A weighted support vector data description based on rough neighborhood approximation. In: 2012 IEEE 12th international conference on data mining workshops (ICDMW), pp 635–642 Hu Y, Liu JN, Wang Y, Lai L (2012) A weighted support vector data description based on rough neighborhood approximation. In: 2012 IEEE 12th international conference on data mining workshops (ICDMW), pp 635–642
go back to reference Hu W, Wang S, Chung F, Liu Y, Ying W (2015) Privacy preserving and fast decision for novelty detection using support vector data description. Soft Comput 19(5):1–16CrossRefMATH Hu W, Wang S, Chung F, Liu Y, Ying W (2015) Privacy preserving and fast decision for novelty detection using support vector data description. Soft Comput 19(5):1–16CrossRefMATH
go back to reference Jeong YS, Jayaraman R (2015) Support vector-based algorithms with weighted dynamic time warping kernel function for time series classification. Knowl Based Syst 75:184–191CrossRef Jeong YS, Jayaraman R (2015) Support vector-based algorithms with weighted dynamic time warping kernel function for time series classification. Knowl Based Syst 75:184–191CrossRef
go back to reference Jiang Y, Wang Y, Luo H (2015) Fault diagnosis of analog circuit based on a second map SVDD. Analog Integr Circ Sig Process 85:395–404CrossRef Jiang Y, Wang Y, Luo H (2015) Fault diagnosis of analog circuit based on a second map SVDD. Analog Integr Circ Sig Process 85:395–404CrossRef
go back to reference Jones M, Nikovski D, Imamura M, Hirata T (2016) Exemplar learning for extremely efficient anomaly detection in real-valued time series. Data Min Knowl Disc 30(6):1427–1454MathSciNetCrossRef Jones M, Nikovski D, Imamura M, Hirata T (2016) Exemplar learning for extremely efficient anomaly detection in real-valued time series. Data Min Knowl Disc 30(6):1427–1454MathSciNetCrossRef
go back to reference Kaveh A, Talatahari S (2010) Optimum design of skeletal structures using imperialist competitive algorithm. Comput Struct 88:1220–1229CrossRefMATH Kaveh A, Talatahari S (2010) Optimum design of skeletal structures using imperialist competitive algorithm. Comput Struct 88:1220–1229CrossRefMATH
go back to reference Krawczyk B, Woźniak M (2015) Bagging for combining weighted one-class support vector machines. Procedia Comput Sci 51:1565–1573CrossRef Krawczyk B, Woźniak M (2015) Bagging for combining weighted one-class support vector machines. Procedia Comput Sci 51:1565–1573CrossRef
go back to reference Kutsuna T, Yamamoto A (2016) Outlier detection using binary decision diagrams. Data Min Knowl Disc 458:1–26MATH Kutsuna T, Yamamoto A (2016) Outlier detection using binary decision diagrams. Data Min Knowl Disc 458:1–26MATH
go back to reference Lai V, Nguyen D, Nguyen K, Le T (2015) Mixture of support vector data description. In: 2nd National foundation for science and technology development conference on information and computer science (NICS), pp 135–140 Lai V, Nguyen D, Nguyen K, Le T (2015) Mixture of support vector data description. In: 2nd National foundation for science and technology development conference on information and computer science (NICS), pp 135–140
go back to reference Lee K, Kim DW, Lee KH, Lee D (2007) Density-induced support vector data description. IEEE Trans Neural Netw 18:284–289CrossRef Lee K, Kim DW, Lee KH, Lee D (2007) Density-induced support vector data description. IEEE Trans Neural Netw 18:284–289CrossRef
go back to reference Li J, Su L, Cheng C (2011) Finding pre-image via evolution strategies. Appl Soft Comput 11:4183–4194CrossRef Li J, Su L, Cheng C (2011) Finding pre-image via evolution strategies. Appl Soft Comput 11:4183–4194CrossRef
go back to reference Liu B, Xiao Y, Cao L, Hao Z, Deng F (2013) SVDD-based outlier detection on uncertain data. Knowl Inf Syst 34:597–618CrossRef Liu B, Xiao Y, Cao L, Hao Z, Deng F (2013) SVDD-based outlier detection on uncertain data. Knowl Inf Syst 34:597–618CrossRef
go back to reference Liu B, Xiao Y, Yu P, Hao Z, Cao L (2014a) An efficient approach for outlier detection with imperfect data labels. IEEE Trans Knowl Data Eng 26:1602–1616CrossRef Liu B, Xiao Y, Yu P, Hao Z, Cao L (2014a) An efficient approach for outlier detection with imperfect data labels. IEEE Trans Knowl Data Eng 26:1602–1616CrossRef
go back to reference Liu Z, Pan Q, Dezert J, Mercier G (2014b) Credal classification rule for uncertain data based on belief functions. Pattern Recognit 47:2532–2541CrossRef Liu Z, Pan Q, Dezert J, Mercier G (2014b) Credal classification rule for uncertain data based on belief functions. Pattern Recognit 47:2532–2541CrossRef
go back to reference Luo J, Ding L, Pan Z, Ni G, Hu G (2007) Research on cost-sensitive learning in one-class anomaly detection algorithms. In: Autonomic and trusted computing, pp 259–268 Luo J, Ding L, Pan Z, Ni G, Hu G (2007) Research on cost-sensitive learning in one-class anomaly detection algorithms. In: Autonomic and trusted computing, pp 259–268
go back to reference Moghaddam V, Hamidzadeh J (2016) New Hermite orthogonal polynomial kernel and combined kernels in Support Vector Machine classifier. Pattern Recognit 60:921–935CrossRefMATH Moghaddam V, Hamidzadeh J (2016) New Hermite orthogonal polynomial kernel and combined kernels in Support Vector Machine classifier. Pattern Recognit 60:921–935CrossRefMATH
go back to reference Peng X, Tan J (2015) EL-SVDD: an improved and localized multi-class classification algorithm. In: Applied mechanics and materials, Trans. Tech. Publ., vol 713, pp 1693–1698 Peng X, Tan J (2015) EL-SVDD: an improved and localized multi-class classification algorithm. In: Applied mechanics and materials, Trans. Tech. Publ., vol 713, pp 1693–1698
go back to reference Peng X, Xu D (2012) Efficient support vector data descriptions for novelty detection. Neural Comput Appl 21:2023–2032CrossRef Peng X, Xu D (2012) Efficient support vector data descriptions for novelty detection. Neural Comput Appl 21:2023–2032CrossRef
go back to reference Shafer G (1976) A mathematical theory of evidence. Princeton University Press, PrincetonMATH Shafer G (1976) A mathematical theory of evidence. Princeton University Press, PrincetonMATH
go back to reference Smets P (1990) The combination of evidence in the transferable belief model. IEEE Trans Pattern Anal Mach Intell 12:447–458CrossRef Smets P (1990) The combination of evidence in the transferable belief model. IEEE Trans Pattern Anal Mach Intell 12:447–458CrossRef
go back to reference Smets P (2007) Analyzing the combination of conflicting belief functions. Inf Fus 8:387–412CrossRef Smets P (2007) Analyzing the combination of conflicting belief functions. Inf Fus 8:387–412CrossRef
go back to reference Tavakkoli A, Nicolescu M, Bebis G (2008) Incremental SVDD training: improving efficiency of background modeling in videos. In: Proceedings of the 10th IASTED international conference, pp 92 Tavakkoli A, Nicolescu M, Bebis G (2008) Incremental SVDD training: improving efficiency of background modeling in videos. In: Proceedings of the 10th IASTED international conference, pp 92
go back to reference Tax D, Laskov P (2003) Online SVM learning: from classification to data description and back. In: 2003 IEEE 13th workshop on neural networks for signal processing, 2003. NNSP’03, pp 499–508 Tax D, Laskov P (2003) Online SVM learning: from classification to data description and back. In: 2003 IEEE 13th workshop on neural networks for signal processing, 2003. NNSP’03, pp 499–508
go back to reference Wang Z, Zhao Z, Weng S, Zhang C (2015) Solving one-class problem with outlier examples by SVM. Neurocomputing 149:100–105CrossRef Wang Z, Zhao Z, Weng S, Zhang C (2015) Solving one-class problem with outlier examples by SVM. Neurocomputing 149:100–105CrossRef
go back to reference Wang L, Jia P, Huang T, Duan S, Yan J, Wang L (2016) A novel optimization technique to improve gas recognition by electronic noses based on the enhanced krill herd algorithm. Sensors 8:16 Wang L, Jia P, Huang T, Duan S, Yan J, Wang L (2016) A novel optimization technique to improve gas recognition by electronic noses based on the enhanced krill herd algorithm. Sensors 8:16
go back to reference Wu M, Ye J (2009) A small sphere and large margin approach for novelty detection using training data with outliers. IEEE Trans Pattern Anal Mach Intell 31:2088–2092CrossRef Wu M, Ye J (2009) A small sphere and large margin approach for novelty detection using training data with outliers. IEEE Trans Pattern Anal Mach Intell 31:2088–2092CrossRef
go back to reference Zhang Y, Chi Z, Li K (2009) Fuzzy multi-class classifier based on support vector data description and improved PCM. Expert Syst Appl 36:8714–8718CrossRef Zhang Y, Chi Z, Li K (2009) Fuzzy multi-class classifier based on support vector data description and improved PCM. Expert Syst Appl 36:8714–8718CrossRef
go back to reference Zhang X, Li A, Pan R (2016) Stock trend prediction based on a new status box method and AdaBoost probabilistic support vector machine. Appl Soft Comput 49:385–398CrossRef Zhang X, Li A, Pan R (2016) Stock trend prediction based on a new status box method and AdaBoost probabilistic support vector machine. Appl Soft Comput 49:385–398CrossRef
go back to reference Zheng S (2016) Smoothly approximated support vector domain description. Pattern Recognit 49:55–64CrossRefMATH Zheng S (2016) Smoothly approximated support vector domain description. Pattern Recognit 49:55–64CrossRefMATH
go back to reference Zhu X, Wu X (2004) Class noise vs. attribute noise: a quantitative study of their impacts. Artif Intell Rev 22:177–210CrossRefMATH Zhu X, Wu X (2004) Class noise vs. attribute noise: a quantitative study of their impacts. Artif Intell Rev 22:177–210CrossRefMATH
Metadata
Title
Belief-based chaotic algorithm for support vector data description
Authors
Javad Hamidzadeh
Neda Namaei
Publication date
20-02-2018
Publisher
Springer Berlin Heidelberg
Published in
Soft Computing / Issue 12/2019
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-018-3083-3

Other articles of this Issue 12/2019

Soft Computing 12/2019 Go to the issue

Premium Partner