Skip to main content
Top
Published in: Artificial Intelligence Review 1/2019

19-04-2017

Granular support vector machine: a review

Authors: Husheng Guo, Wenjian Wang

Published in: Artificial Intelligence Review | Issue 1/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The time complexity of traditional support vector machine (SVM) is \(O(l^{3})\) and l is the the training sample size, and it can not solve the large scale problems. Granular support vector machine (GSVM) is a novel machine learning model based on granular computing and statistical learning theory, and it can solve the low efficiency learning problem that exists in the traditional SVM and obtain satisfactory generalization performance, as well. This paper primarily reviews the past (rudiment), present (basic model) and future (development direction) of GSVM. Firstly, we briefly introduce the basic theory of SVM and GSVM. Secondly, we describe the past related research works conducted before the GSVM was proposed. Next, the latest thoughts, models, algorithms and applications of GSVM are described. Finally, we note the research and development prospects of GSVM.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Asharaf S, Murty MN, Shevade SK (2007) Multiclass core vector machine. In: Proceedings of the 24th international conference on machine learning, Corvallis, OR, pp 41–48 Asharaf S, Murty MN, Shevade SK (2007) Multiclass core vector machine. In: Proceedings of the 24th international conference on machine learning, Corvallis, OR, pp 41–48
go back to reference Bai XF, Wang WJ (2014) Saliency-SVM: an automatic approach for image segmentation. Neurocomputing 136(2014):243–255CrossRef Bai XF, Wang WJ (2014) Saliency-SVM: an automatic approach for image segmentation. Neurocomputing 136(2014):243–255CrossRef
go back to reference Bargiela A, Pedrycz W (2008) Toward a theory of granular computing for human-centered information processing. IEEE Trans Fuzzy Syst 16(2):320–330CrossRef Bargiela A, Pedrycz W (2008) Toward a theory of granular computing for human-centered information processing. IEEE Trans Fuzzy Syst 16(2):320–330CrossRef
go back to reference Cao Y, Wan G, Wang F (2011) Predicting financial distress of Chinese listed companies using rough set theory and support vector machine. Asia-Pac J Oper Res 28(1):95–109MathSciNetCrossRef Cao Y, Wan G, Wang F (2011) Predicting financial distress of Chinese listed companies using rough set theory and support vector machine. Asia-Pac J Oper Res 28(1):95–109MathSciNetCrossRef
go back to reference Chen B, Johnson M (2009) Protein local 3D structure prediction by Super Granule Support Vector Machines (Super GSVM). BMC Bioinform 10(11):296–300 Chen B, Johnson M (2009) Protein local 3D structure prediction by Super Granule Support Vector Machines (Super GSVM). BMC Bioinform 10(11):296–300
go back to reference Cheng W, Zhang YP, Zhao S (2009) Research of yield prediction model based on support vector machine within the framework of quotient space theory. J China Agric Univ 14(5):135–139 Cheng W, Zhang YP, Zhao S (2009) Research of yield prediction model based on support vector machine within the framework of quotient space theory. J China Agric Univ 14(5):135–139
go back to reference Deb AK, Jayadeva, Gopal M (2007) SVM-based tree-type neural networks as a critic in adaptive critic designs for control. IEEE Trans Neural Netw 18(4):1016–1030CrossRef Deb AK, Jayadeva, Gopal M (2007) SVM-based tree-type neural networks as a critic in adaptive critic designs for control. IEEE Trans Neural Netw 18(4):1016–1030CrossRef
go back to reference Ding SF, Huang HJ, Yu JZ et al (2015) Research on the hybrid models of granular computing and support vector machine. Artif Intell Rev 43(6):565–577CrossRef Ding SF, Huang HJ, Yu JZ et al (2015) Research on the hybrid models of granular computing and support vector machine. Artif Intell Rev 43(6):565–577CrossRef
go back to reference D’Urso P, Leski JM (2016) Fuzzy c-ordered medoids clustering for interval-valued data. Pattern Recognit 58:49–67CrossRef D’Urso P, Leski JM (2016) Fuzzy c-ordered medoids clustering for interval-valued data. Pattern Recognit 58:49–67CrossRef
go back to reference Erfani SM, Rajasegarar S, Karunasekera S et al (2016) High-dimensional and large-scale anomaly detection using a linear one-class SVM with deep learning. Pattern Recognit 58:121–134CrossRef Erfani SM, Rajasegarar S, Karunasekera S et al (2016) High-dimensional and large-scale anomaly detection using a linear one-class SVM with deep learning. Pattern Recognit 58:121–134CrossRef
go back to reference Guo G, Zhang JS (2007) Reducing examples to accelerate support vector regression. Pattern Recognit Lett 28(16):2173–2183CrossRef Guo G, Zhang JS (2007) Reducing examples to accelerate support vector regression. Pattern Recognit Lett 28(16):2173–2183CrossRef
go back to reference Guo HS, Wang WJ, Men CQ (2009) A novel learning model-Kernel Granular support vector machine. In: Proceedings of the 2009 International Conference on Machine Learning and Cybernetics, Baoding, China, pp 930–935 Guo HS, Wang WJ, Men CQ (2009) A novel learning model-Kernel Granular support vector machine. In: Proceedings of the 2009 International Conference on Machine Learning and Cybernetics, Baoding, China, pp 930–935
go back to reference Guo HS, Wang WJ (2015) An active learning-based SVM multiple classification model. Pattern Recognit 48(5):1577–1597CrossRefMATH Guo HS, Wang WJ (2015) An active learning-based SVM multiple classification model. Pattern Recognit 48(5):1577–1597CrossRefMATH
go back to reference Guo HS, Wang WJ (2016) Support vector machine based on hierarchical and dynamical granulation. Neurocomputing 211:22–33CrossRef Guo HS, Wang WJ (2016) Support vector machine based on hierarchical and dynamical granulation. Neurocomputing 211:22–33CrossRef
go back to reference Huang CH, Kao HY (2009) Interval regression analysis with soft-margin reduced support vector machine. Lecture Notes in Computer Science, Next-Generation Applied Intelligence 5579:826–835CrossRef Huang CH, Kao HY (2009) Interval regression analysis with soft-margin reduced support vector machine. Lecture Notes in Computer Science, Next-Generation Applied Intelligence 5579:826–835CrossRef
go back to reference Joachims T (1999) Making large-scale SVM learning practical. In: Schölkopf B, Burges C, Smola A (eds) Advances in kernel methods-support vector learning. MIT Press, Cambridge, pp 169–184 Joachims T (1999) Making large-scale SVM learning practical. In: Schölkopf B, Burges C, Smola A (eds) Advances in kernel methods-support vector learning. MIT Press, Cambridge, pp 169–184
go back to reference Katagiri S, Abe S (2006) Incremental training of support vector machines using hyperspheres. Pattern Recognit Lett 27(13):1495–1507CrossRef Katagiri S, Abe S (2006) Incremental training of support vector machines using hyperspheres. Pattern Recognit Lett 27(13):1495–1507CrossRef
go back to reference Kumar MA, Gopal M (2010) A hybrid SVM based decision tree. Pattern Recognit 43(12):3977–3987CrossRefMATH Kumar MA, Gopal M (2010) A hybrid SVM based decision tree. Pattern Recognit 43(12):3977–3987CrossRefMATH
go back to reference Kumar P, Jayaraman VK, Kulkarni BD (2007) Granular support vector machine based method for prediction of solubility of proteins on overexpression in Escherichia coli. Lecture Notes in Computer Science, Pattern Recognition and Machine Intelligence 4815:406–415CrossRef Kumar P, Jayaraman VK, Kulkarni BD (2007) Granular support vector machine based method for prediction of solubility of proteins on overexpression in Escherichia coli. Lecture Notes in Computer Science, Pattern Recognition and Machine Intelligence 4815:406–415CrossRef
go back to reference Lin KP, Pai PF (2010) A fuzzy support vector regression model for business cycle predictions. Expert Syst Appl 37(7):5430–5435CrossRef Lin KP, Pai PF (2010) A fuzzy support vector regression model for business cycle predictions. Expert Syst Appl 37(7):5430–5435CrossRef
go back to reference Niu XX, Ching YS (2012) A novel hybrid CNN-SVM classifier for recognizing handwritten digits. Pattern Recognit 45(4):1318–1325CrossRef Niu XX, Ching YS (2012) A novel hybrid CNN-SVM classifier for recognizing handwritten digits. Pattern Recognit 45(4):1318–1325CrossRef
go back to reference Osuna E, Freund R, Girosi F (1997) Training support vector machines: an application to face detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, Puerto Rico, pp 130–136 Osuna E, Freund R, Girosi F (1997) Training support vector machines: an application to face detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, Puerto Rico, pp 130–136
go back to reference Pang SN, Kasabov N (2008) R-SVMT: discovering the knowledge of association rule over SVM classification trees. In: Proceedings of the international joint conference on neural networks, pp 2486–2493 Pang SN, Kasabov N (2008) R-SVMT: discovering the knowledge of association rule over SVM classification trees. In: Proceedings of the international joint conference on neural networks, pp 2486–2493
go back to reference Pereira F, Gordon G (2006) The support vector decomposition machine. In: Proceedings of the 23rd international conference on machine learning, Pittsburgh, PA Pereira F, Gordon G (2006) The support vector decomposition machine. In: Proceedings of the 23rd international conference on machine learning, Pittsburgh, PA
go back to reference Platt J (1999) Fast training of support vector machines using sequential minimal optimization. In: Schölkopf B, Burges C, Smola A (eds) Advances in kernel methods-support vector learning. MIT Press, Cambridge Platt J (1999) Fast training of support vector machines using sequential minimal optimization. In: Schölkopf B, Burges C, Smola A (eds) Advances in kernel methods-support vector learning. MIT Press, Cambridge
go back to reference Ruan JH, Wang XP, Shi Y (2013) Developing fast predictors for large-scale time series using fuzzy granular support vector machines. Appl Soft Comput 13(9):3981–4000CrossRef Ruan JH, Wang XP, Shi Y (2013) Developing fast predictors for large-scale time series using fuzzy granular support vector machines. Appl Soft Comput 13(9):3981–4000CrossRef
go back to reference Ruan JH, Shi Y (2016a) Monitoring and assessing fruit freshness in IOT-based e-commerce delivery using scenario analysis and interval number approaches. Inf Sci 373:557–570CrossRef Ruan JH, Shi Y (2016a) Monitoring and assessing fruit freshness in IOT-based e-commerce delivery using scenario analysis and interval number approaches. Inf Sci 373:557–570CrossRef
go back to reference Ruan JH, Wang XP, Chan FTS et al (2016b) Optimizing the intermodal transportation of emergency medical supplies using balanced fuzzy clustering. Int J Prod Res 54(14):1–19CrossRef Ruan JH, Wang XP, Chan FTS et al (2016b) Optimizing the intermodal transportation of emergency medical supplies using balanced fuzzy clustering. Int J Prod Res 54(14):1–19CrossRef
go back to reference Shih PC, Liu CJ (2006) Face detection using discriminating feature analysis and support vector machine. Pattern Recognit 39(2):260–276CrossRef Shih PC, Liu CJ (2006) Face detection using discriminating feature analysis and support vector machine. Pattern Recognit 39(2):260–276CrossRef
go back to reference Tang YC, Jin B, Sun Y et al (2004) Granular support vector machines for medical binary classification problems. In: Proceedings of the IEEE CIBIB. IEEE Computational Intelligence Society, Piscataway, HJ, pp 73–78 Tang YC, Jin B, Sun Y et al (2004) Granular support vector machines for medical binary classification problems. In: Proceedings of the IEEE CIBIB. IEEE Computational Intelligence Society, Piscataway, HJ, pp 73–78
go back to reference Tang YC, Jin B, Zhang YQ (2005) Granular support vector machines with association rules mining for protein homology prediction. Artif Intell Med 35:121–134CrossRef Tang YC, Jin B, Zhang YQ (2005) Granular support vector machines with association rules mining for protein homology prediction. Artif Intell Med 35:121–134CrossRef
go back to reference Tang YC, Krasser S, Judge P et al (2006) Fast and effective spam sender detection with granular SVM on highly imbalanced mail server behavior data. In: Proceedings of 2nd international conference on collaborative computing: networking, applications and worksharing (CollaborateCom), Atlanta, Georgia, USA Tang YC, Krasser S, Judge P et al (2006) Fast and effective spam sender detection with granular SVM on highly imbalanced mail server behavior data. In: Proceedings of 2nd international conference on collaborative computing: networking, applications and worksharing (CollaborateCom), Atlanta, Georgia, USA
go back to reference Tang YC, Zhang YQ, Chawla NV et al (2009) SVMs modeling for highly for highly imbalanced classification. IEEE Trans Syst Man Cybern 39(1):281–288CrossRef Tang YC, Zhang YQ, Chawla NV et al (2009) SVMs modeling for highly for highly imbalanced classification. IEEE Trans Syst Man Cybern 39(1):281–288CrossRef
go back to reference Teng XY, Yuan J, Yu HY (2009) Probability density estimation based on SVM. In: Proceedings of the global mobile congress. IEEE, Shanghai, China, pp 1–4 Teng XY, Yuan J, Yu HY (2009) Probability density estimation based on SVM. In: Proceedings of the global mobile congress. IEEE, Shanghai, China, pp 1–4
go back to reference Tian YJ, Qi ZQ (2014) Review on: twin support vector machines. Ann Data Sci 1(2):253–277CrossRef Tian YJ, Qi ZQ (2014) Review on: twin support vector machines. Ann Data Sci 1(2):253–277CrossRef
go back to reference Tomar D, Agarwal S (2015) Twin support vector machine: a review from 2007 to 2014. Egypt Inf J 16(1):55–69CrossRef Tomar D, Agarwal S (2015) Twin support vector machine: a review from 2007 to 2014. Egypt Inf J 16(1):55–69CrossRef
go back to reference Tsang IW, Kwok JT, Cheung PM (2005) Core vector machines: fast SVM training on very large data sets. J Mach Learn Res 6:363–392MathSciNetMATH Tsang IW, Kwok JT, Cheung PM (2005) Core vector machines: fast SVM training on very large data sets. J Mach Learn Res 6:363–392MathSciNetMATH
go back to reference Wang WJ, Men CQ (2008) Online prediction model based on support vector machine. Neurocomputing 71:550–558CrossRef Wang WJ, Men CQ (2008) Online prediction model based on support vector machine. Neurocomputing 71:550–558CrossRef
go back to reference Wang WJ, Guo HS, Jia YF et al (2013) Granular support vector machine based on mixed measure. Neurocomputing 101:116–128CrossRef Wang WJ, Guo HS, Jia YF et al (2013) Granular support vector machine based on mixed measure. Neurocomputing 101:116–128CrossRef
go back to reference Xu H, Lemischka IR, Ma’Ayan A (2010) SVM classifier to predict genes important for self-renewal and pluripotency of mouse embryonic stem cells. BMC Syst Biol 4(1):3395–3407CrossRef Xu H, Lemischka IR, Ma’Ayan A (2010) SVM classifier to predict genes important for self-renewal and pluripotency of mouse embryonic stem cells. BMC Syst Biol 4(1):3395–3407CrossRef
go back to reference Yang MH, Abup N (2000) A geometric approach to train support vector machines. In: Proceedings of IEEE conference on computer vision and pattern recognition, Hilton Head Island, South Carolina, USA, pp 430–437 Yang MH, Abup N (2000) A geometric approach to train support vector machines. In: Proceedings of IEEE conference on computer vision and pattern recognition, Hilton Head Island, South Carolina, USA, pp 430–437
go back to reference Yao JT (2007) A ten year review of granular computing. In: Proceedings of 2007 IEEE international conference on granular computing, Silicon Valley, USA, pp 734–739 Yao JT (2007) A ten year review of granular computing. In: Proceedings of 2007 IEEE international conference on granular computing, Silicon Valley, USA, pp 734–739
go back to reference Yu H, Yang J, Han JW et al (2005) Making SVMs scalable to large data sets using hierarchical cluster indexing. Data Min Knowl Discov 11(3):295–321MathSciNetCrossRef Yu H, Yang J, Han JW et al (2005) Making SVMs scalable to large data sets using hierarchical cluster indexing. Data Min Knowl Discov 11(3):295–321MathSciNetCrossRef
go back to reference Yuan Y (2009) Research and application of minimum enclosing ball SVM algorithm. Nanjing University of Aeronautics and Astronautics, Nanjing Yuan Y (2009) Research and application of minimum enclosing ball SVM algorithm. Nanjing University of Aeronautics and Astronautics, Nanjing
go back to reference Zhang XG (1999) Using class-center vectors to build support vector machines. In: Proceedings of the IEEE conference on neural networks for signal processing, Wisconsin, USA, pp 3–11 Zhang XG (1999) Using class-center vectors to build support vector machines. In: Proceedings of the IEEE conference on neural networks for signal processing, Wisconsin, USA, pp 3–11
go back to reference Zhong C, Pedrycz W, Wang D et al (2016) Granular data imputation: a framework of granular computing. Appl Soft Comput 46:307–316CrossRef Zhong C, Pedrycz W, Wang D et al (2016) Granular data imputation: a framework of granular computing. Appl Soft Comput 46:307–316CrossRef
Metadata
Title
Granular support vector machine: a review
Authors
Husheng Guo
Wenjian Wang
Publication date
19-04-2017
Publisher
Springer Netherlands
Published in
Artificial Intelligence Review / Issue 1/2019
Print ISSN: 0269-2821
Electronic ISSN: 1573-7462
DOI
https://doi.org/10.1007/s10462-017-9555-5

Other articles of this Issue 1/2019

Artificial Intelligence Review 1/2019 Go to the issue

Premium Partner