Skip to main content
Erschienen in: Soft Computing 10/2015

01.10.2015 | Methodologies and Application

The binomial-neighbour instance-based learner on a multiclass performance measure scheme

verfasst von: Theodoros Theodoridis, Huosheng Hu

Erschienen in: Soft Computing | Ausgabe 10/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper presents a novel instance-based learning methodology the Binomial-Neighbour (B-N) algorithm. Unlike to other k-Nearest Neighbour algorithms, B-N employs binomial search through vectors of statistical features and distance primitives. The binomial combinations derived from the search with best classification accuracy are distinct primitives which characterise a pattern. The statistical features employ a twofold role; initially to model the data set in a dimensionality reduction preprocessing, and finally to exploit these attributes to recognise patterns. The paper introduces as well a performance measure scheme for multiclass problems using type error statistics. We harness this scheme to evaluate the B-N model on a benchmark human action dataset of normal and aggressive activities. Classification results are being compared with the standard IBk and IB1 models achieving significantly exceptional recognition performance.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
1
The expression \(e_i \ne a_i\) denotes a misclassified instance.
 
2
The expression \(e_i = -1\) denotes an out-of-scope misclassified instance (\(e_i \notin C\)).
 
3
The original statistical functions derived from performance metrics, which have been used for the multiclass problem, are included in the work of Sokolova et al. (2006).
 
4
All primitive abbreviations can be found in the primitive table presented in Theodoridis and Hu (2008).
 
Literatur
Zurück zum Zitat Aha DW, Kibler D, Albert MK (1991) Instance-based learning algorithms. Mach Learn 6(1):37–66 Aha DW, Kibler D, Albert MK (1991) Instance-based learning algorithms. Mach Learn 6(1):37–66
Zurück zum Zitat Alvarez SA (2002) An exact analytical relation among recall, precision and classification accuracy in information retrieval. Technical report, BCCS-02-01, Computer Science Department, Boston College Alvarez SA (2002) An exact analytical relation among recall, precision and classification accuracy in information retrieval. Technical report, BCCS-02-01, Computer Science Department, Boston College
Zurück zum Zitat Cheng W, Hüllermeier E (2009) Combining instance-based learning and logistic regression for multilabel classification. Mach Learn 76(2–3):211–225 Cheng W, Hüllermeier E (2009) Combining instance-based learning and logistic regression for multilabel classification. Mach Learn 76(2–3):211–225
Zurück zum Zitat Duda RO, Hart PE, Stork DG (2000) Pattern classification. Wiley, New York Duda RO, Hart PE, Stork DG (2000) Pattern classification. Wiley, New York
Zurück zum Zitat Hall M, Frank E, Holmes G, Pfahringer B, Reutemann P, Witten IH (2009) The weka data mining software: an update. SIGKDD Explor Newsl 11(1):10–18 Hall M, Frank E, Holmes G, Pfahringer B, Reutemann P, Witten IH (2009) The weka data mining software: an update. SIGKDD Explor Newsl 11(1):10–18
Zurück zum Zitat Lee YH, Wei CP, Cheng TH, Yang CT (2012) Nearest-neighbor-based approach to time-series classification. Decis Support Syst 53(1):207–217CrossRef Lee YH, Wei CP, Cheng TH, Yang CT (2012) Nearest-neighbor-based approach to time-series classification. Decis Support Syst 53(1):207–217CrossRef
Zurück zum Zitat Lessmann S (2004) Solving imbalanced classification problems with support vector machines. In: IC-AI, pp 214–220 Lessmann S (2004) Solving imbalanced classification problems with support vector machines. In: IC-AI, pp 214–220
Zurück zum Zitat Li Y, Yang J, Han J (2004) Continuous k-nearest neighbor search for moving objects. Scientific and Statistical Database Management, International Conference on 123 Li Y, Yang J, Han J (2004) Continuous k-nearest neighbor search for moving objects. Scientific and Statistical Database Management, International Conference on 123
Zurück zum Zitat Lughofer E (2011) Evolving fuzzy systems-methodologies, advanced concepts and applications. In: Studies in fuzziness and soft computing, vol 266. Springer, Verlag Berlin Heidelberg, p 456 Lughofer E (2011) Evolving fuzzy systems-methodologies, advanced concepts and applications. In: Studies in fuzziness and soft computing, vol 266. Springer, Verlag Berlin Heidelberg, p 456
Zurück zum Zitat Makhoul J, Kubala F, Schwartz R, Weischedel R (1999) Performance measures for information extraction. In: Proceedings of DARPA Broadcast News Workshop, pp 249–252 Makhoul J, Kubala F, Schwartz R, Weischedel R (1999) Performance measures for information extraction. In: Proceedings of DARPA Broadcast News Workshop, pp 249–252
Zurück zum Zitat Mitchell TM (1997) Machine learning. McGraw-Hill, Boston Massachusetts Mitchell TM (1997) Machine learning. McGraw-Hill, Boston Massachusetts
Zurück zum Zitat Nasibov EN, Peker S (2011) Time series labeling algorithms based on the k-nearest neighbors’ frequencies. Exp Syst Appl 38(5):5028–5035CrossRef Nasibov EN, Peker S (2011) Time series labeling algorithms based on the k-nearest neighbors’ frequencies. Exp Syst Appl 38(5):5028–5035CrossRef
Zurück zum Zitat Olson DL, Delen D (2008) Advanced data mining techniques. 1. Springer Berlin Heidelberg Olson DL, Delen D (2008) Advanced data mining techniques. 1. Springer Berlin Heidelberg
Zurück zum Zitat Ordez FJ, Iglesias JA, de Toledo P, Ledezma A, Sanchis A (2013) Online activity recognition using evolving classifiers. Exp Syst Appl 40:1248–1255CrossRef Ordez FJ, Iglesias JA, de Toledo P, Ledezma A, Sanchis A (2013) Online activity recognition using evolving classifiers. Exp Syst Appl 40:1248–1255CrossRef
Zurück zum Zitat Peter DT (1994) Theoretical analyses of cross-validation error and voting in instance-based learning. J Exp Theor Artif Intell 6:331–360 Peter DT (1994) Theoretical analyses of cross-validation error and voting in instance-based learning. J Exp Theor Artif Intell 6:331–360
Zurück zum Zitat Piegl LA, Tiller W (2002) Algorithm for finding all k nearest neighbors. Comput Aided Des 34(2):167–172MATHCrossRef Piegl LA, Tiller W (2002) Algorithm for finding all k nearest neighbors. Comput Aided Des 34(2):167–172MATHCrossRef
Zurück zum Zitat Qin MK, Ding Q, Perrizo W (2002) K-nearest neighbor classification on spatial data streams using p-trees. Springer pp 517–528 Qin MK, Ding Q, Perrizo W (2002) K-nearest neighbor classification on spatial data streams using p-trees. Springer pp 517–528
Zurück zum Zitat Rubio JJ, Vzquez DM, Mjica-Vargas D (2013) Acquisition system and approximation of brain signals. IET Sci Meas Technol 7(4):232–239CrossRef Rubio JJ, Vzquez DM, Mjica-Vargas D (2013) Acquisition system and approximation of brain signals. IET Sci Meas Technol 7(4):232–239CrossRef
Zurück zum Zitat Rubio G, Herrera LJ, Pomares H, Rojas I, Guillén A (2010) Design of specific-to-problem kernels and use of kernel weighted k-nearest neighbours for time series modelling. Neurocomputing 73(10–12):1965–1975 Rubio G, Herrera LJ, Pomares H, Rojas I, Guillén A (2010) Design of specific-to-problem kernels and use of kernel weighted k-nearest neighbours for time series modelling. Neurocomputing 73(10–12):1965–1975
Zurück zum Zitat Sokolova M, Japkowicz N, Szpakowicz S (2006) Beyond accuracy, f-score and roc: A family of discriminant measures for performance evaluation. Adv Artif Intel pp 1015–1021 Sokolova M, Japkowicz N, Szpakowicz S (2006) Beyond accuracy, f-score and roc: A family of discriminant measures for performance evaluation. Adv Artif Intel pp 1015–1021
Zurück zum Zitat Theodoridis T, Hu H (2008) A fuzzy-convolution model for physical action and behaviour pattern recognition of 3d time series. In: IEEE International Conference on Robotics and Biomimetics (ROBIO’08), pp 407–412 Theodoridis T, Hu H (2008) A fuzzy-convolution model for physical action and behaviour pattern recognition of 3d time series. In: IEEE International Conference on Robotics and Biomimetics (ROBIO’08), pp 407–412
Zurück zum Zitat Theodoridis T, Agapitos A, Hu H, Lucas SM (2008) Ubiquitous robotics in physical human action recognition a comparison between dynamic anns and gp. In: IEEE International Conference on Robotics and Automation (ICRA’08), pp 3064–3069 Theodoridis T, Agapitos A, Hu H, Lucas SM (2008) Ubiquitous robotics in physical human action recognition a comparison between dynamic anns and gp. In: IEEE International Conference on Robotics and Automation (ICRA’08), pp 3064–3069
Zurück zum Zitat Theodoridis T, Agapitos A, Hu H, Lucas SM (2009) Mechanical feature attributes for modeling and pattern classification of physical activities. In: IEEE International Conference on Information and Automation (ICIA09), pp 528–533 Theodoridis T, Agapitos A, Hu H, Lucas SM (2009) Mechanical feature attributes for modeling and pattern classification of physical activities. In: IEEE International Conference on Information and Automation (ICIA09), pp 528–533
Zurück zum Zitat Vzquez DM, Rubio JJ, Pacheco J (2012) Characterization framework for epileptic signals. IET Image Process 6(9):1227–1235CrossRefMathSciNet Vzquez DM, Rubio JJ, Pacheco J (2012) Characterization framework for epileptic signals. IET Image Process 6(9):1227–1235CrossRefMathSciNet
Metadaten
Titel
The binomial-neighbour instance-based learner on a multiclass performance measure scheme
verfasst von
Theodoros Theodoridis
Huosheng Hu
Publikationsdatum
01.10.2015
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 10/2015
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-014-1461-z

Weitere Artikel der Ausgabe 10/2015

Soft Computing 10/2015 Zur Ausgabe

Premium Partner