Skip to main content

2018 | OriginalPaper | Buchkapitel

A Boosting-Based Decision Fusion Method for Learning from Large, Imbalanced Face Data Set

verfasst von : Xiaohui Yuan, Mohamed Abouelenien, Mohamed Elhoseny

Erschienen in: Quantum Computing:An Environment for Intelligent Large Scale Real Application

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The acquisition of face images is usually limited due to policy and economy considerations, and hence the number of training examples of each subject varies greatly. The problem of face recognition with imbalanced training data has drawn attention of researchers and it is desirable to understand in what circumstances imbalanced data set affects the learning outcomes, and robust methods are needed to maximize the information embedded in the training data set without relying much on user introduced bias. In this article, we study the effects of uneven number of training images for automatic face recognition and proposed a boosting-based decision fusion method that suppresses the face recognition errors by training an ensemble with subsets of examples. By recovering the balance among classes in the subsets, our proposed multiBoost.imb method circumvents the class skewness and demonstrates improved performance. Experiments are conducted with four popular face data sets and two synthetic data sets. The results of our method exhibits superior performance in high imbalanced scenarios compared to AdaBoost.M1, SAMME, RUSboost, SMOTEboost, SAMME with SMOTE sampling and SAMME with random undersampling. Another advantage that comes with using subsets of examples is the significant gain in efficiency.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Liu, Y.-H., Chen, Y.-T.: Face recognition using total margin-based adaptive fuzzy support vector machines. IEEE Trans. Neural Netw. 18(1), 178–192 (2007)CrossRef Liu, Y.-H., Chen, Y.-T.: Face recognition using total margin-based adaptive fuzzy support vector machines. IEEE Trans. Neural Netw. 18(1), 178–192 (2007)CrossRef
2.
Zurück zum Zitat He, H., Edwardo, G.A.: Learning from imbalanced data. IEEE Trans. Knowl. Data Eng. 21(9), 1263–1284 (2009) He, H., Edwardo, G.A.: Learning from imbalanced data. IEEE Trans. Knowl. Data Eng. 21(9), 1263–1284 (2009)
3.
Zurück zum Zitat Freund, Y., Schapire, R.E.: A short introduction to boosting. J. Jpn. Soc. Artif. Intell. 14(5), 771–780 (1999) Freund, Y., Schapire, R.E.: A short introduction to boosting. J. Jpn. Soc. Artif. Intell. 14(5), 771–780 (1999)
4.
Zurück zum Zitat Zhang, Y., Zhou, Z.-H.: Cost-sensitive face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 32(10), 1758–1769 (2010)CrossRef Zhang, Y., Zhou, Z.-H.: Cost-sensitive face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 32(10), 1758–1769 (2010)CrossRef
5.
Zurück zum Zitat Lu, J., Tan, Y.-P.: A doubly weighted approach for appearance-based subspace learning methods. IEEE Trans. Inf. Forensic Secur. 5(1), 71–78 (2010)MathSciNetCrossRef Lu, J., Tan, Y.-P.: A doubly weighted approach for appearance-based subspace learning methods. IEEE Trans. Inf. Forensic Secur. 5(1), 71–78 (2010)MathSciNetCrossRef
6.
Zurück zum Zitat Liu, Y.-H., Chen, Y.-T., Lu, S.-S.: Face detection using kernel pca and imbalanced svm. In: Lecture Notes in Computer Science, International Conference on Natural Computation, vol. 4221, pp. 351–360 (2006) Liu, Y.-H., Chen, Y.-T., Lu, S.-S.: Face detection using kernel pca and imbalanced svm. In: Lecture Notes in Computer Science, International Conference on Natural Computation, vol. 4221, pp. 351–360 (2006)
7.
Zurück zum Zitat Allwein, E.L., Schapire, R.E., Singer, Y.: Reducing multiclass to binary: a unifying approach for margin classifiers. J. Mach. Learn. Res. 1, 113–141 (2000)MathSciNetMATH Allwein, E.L., Schapire, R.E., Singer, Y.: Reducing multiclass to binary: a unifying approach for margin classifiers. J. Mach. Learn. Res. 1, 113–141 (2000)MathSciNetMATH
8.
Zurück zum Zitat Freund, Y., Schapire, R.E.: A decision-theoretic generalization of on-line learning and an application to boosting. J. Comput. Syst. Sci. 55(1), 119–139 (1997)MathSciNetCrossRefMATH Freund, Y., Schapire, R.E.: A decision-theoretic generalization of on-line learning and an application to boosting. J. Comput. Syst. Sci. 55(1), 119–139 (1997)MathSciNetCrossRefMATH
9.
Zurück zum Zitat Schapire, R.E., Singer, Y.: Improved boosting algorithms using confidence-rated predictions. Machine Learning, pp. 80–91 (1999) Schapire, R.E., Singer, Y.: Improved boosting algorithms using confidence-rated predictions. Machine Learning, pp. 80–91 (1999)
10.
Zurück zum Zitat Dietterich, T.G., Bakiri, G.: Solving multiclass learning problems via error-correcting output codes. J. Artif. Intell. Res. 2, 263–286 (1995)MATH Dietterich, T.G., Bakiri, G.: Solving multiclass learning problems via error-correcting output codes. J. Artif. Intell. Res. 2, 263–286 (1995)MATH
11.
Zurück zum Zitat Schapire, R.E.: Using output codes to boost multi-class learning problems. In: Proceedings of the 14th International Conference on Machine Learning, pp. 313–321 (1997) Schapire, R.E.: Using output codes to boost multi-class learning problems. In: Proceedings of the 14th International Conference on Machine Learning, pp. 313–321 (1997)
12.
Zurück zum Zitat Guruswami, V., Sahai, A.: Multiclass learning, boosting, and error-correcting codes. In: Proceedings of the 12th Annual Conference on Computational Learning Theory, pp. 145–155 (1999) Guruswami, V., Sahai, A.: Multiclass learning, boosting, and error-correcting codes. In: Proceedings of the 12th Annual Conference on Computational Learning Theory, pp. 145–155 (1999)
14.
Zurück zum Zitat Mukherjee, I., Schapire, R.E.: A theory of multiclass boosting. In: Proceedings of Twenty-Fourth Annual Conference on Neural Information Processing Systems (2010) Mukherjee, I., Schapire, R.E.: A theory of multiclass boosting. In: Proceedings of Twenty-Fourth Annual Conference on Neural Information Processing Systems (2010)
15.
Zurück zum Zitat Karakoulas, G., Shawe-Taylor, J.: Optimizing classifiers for imbalanced training sets. In: Proceedings of the 1998 Conference on Advances in Neural Information Processing Systems II, pp. 253–259, Cambridge, MA, USA. MIT Press (1999) Karakoulas, G., Shawe-Taylor, J.: Optimizing classifiers for imbalanced training sets. In: Proceedings of the 1998 Conference on Advances in Neural Information Processing Systems II, pp. 253–259, Cambridge, MA, USA. MIT Press (1999)
16.
Zurück zum Zitat Sun, Y., Kamel, M.S., Wong, A.K.C., Wang, Y.: Cost-sensitive boosting for classification of imbalanced data. Pattern Recogn. 40, 3358–3378 (2007) Sun, Y., Kamel, M.S., Wong, A.K.C., Wang, Y.: Cost-sensitive boosting for classification of imbalanced data. Pattern Recogn. 40, 3358–3378 (2007)
17.
Zurück zum Zitat Wang, B.X., Japkowicz, N.: Boosting support vector machines for imbalanced data sets. In: Foundations of Intelligent Systems, pp. 38–47 (2008) Wang, B.X., Japkowicz, N.: Boosting support vector machines for imbalanced data sets. In: Foundations of Intelligent Systems, pp. 38–47 (2008)
18.
Zurück zum Zitat Fan, W., Stolfo, S.J., Zhang, J., Chan, P.K.: Adacost: misclassification cost-sensitive boosting. In: 16th International Conference on Machine Learning (1999) Fan, W., Stolfo, S.J., Zhang, J., Chan, P.K.: Adacost: misclassification cost-sensitive boosting. In: 16th International Conference on Machine Learning (1999)
19.
Zurück zum Zitat Joshi, M.V., Kumar, V., Agarwal, R.C.: Evaluating boosting algorithms to classify rare classes: comparison and improvements. In: First IEEE International Conference on Data Mining, pp. 257–264 (2001) Joshi, M.V., Kumar, V., Agarwal, R.C.: Evaluating boosting algorithms to classify rare classes: comparison and improvements. In: First IEEE International Conference on Data Mining, pp. 257–264 (2001)
20.
Zurück zum Zitat Chawla, N.V., Lazarevic, A., Hall, L.O., Bowyer. K.W.: Smoteboost: improving prediction of the minority. In: Seventh European Conference on Principles and Practice of Knowledge Discovery in Databases, pp. 107–119 (2003) Chawla, N.V., Lazarevic, A., Hall, L.O., Bowyer. K.W.: Smoteboost: improving prediction of the minority. In: Seventh European Conference on Principles and Practice of Knowledge Discovery in Databases, pp. 107–119 (2003)
21.
Zurück zum Zitat Guo, H., Viktor, H.L.: Learning from imbalanced data sets with boosting and data generation: the databoost-im approach. SIGKDD Explor. 6(1), 30–39 (2004) Guo, H., Viktor, H.L.: Learning from imbalanced data sets with boosting and data generation: the databoost-im approach. SIGKDD Explor. 6(1), 30–39 (2004)
22.
Zurück zum Zitat Geiler, O.J., Hong, L., Yue-Jian, G.: An adaptive sampling ensemble classifier for learning from imbalanced data sets. In: International MultiConference of Engineers and Computer Scientists, vol. 1, March 2010 Geiler, O.J., Hong, L., Yue-Jian, G.: An adaptive sampling ensemble classifier for learning from imbalanced data sets. In: International MultiConference of Engineers and Computer Scientists, vol. 1, March 2010
23.
Zurück zum Zitat Chen, S., He, H., Garcia, E.A.: RAMOBoost: ranked minority oversampling in boosting. IEEE Trans. Neural Netw. 21(10), 1624–1642 (2010)CrossRef Chen, S., He, H., Garcia, E.A.: RAMOBoost: ranked minority oversampling in boosting. IEEE Trans. Neural Netw. 21(10), 1624–1642 (2010)CrossRef
24.
Zurück zum Zitat Seiffert, C., Khoshgoftaar, T.M., Van Hulse, J., Napolitano, A.: RUSBoost: a hybrid approach to alleviating class imbalance. IEEE Trans. Syst. Man. Cybern. Part A Syst. Hum. 40(1), 185–197 (2010)CrossRef Seiffert, C., Khoshgoftaar, T.M., Van Hulse, J., Napolitano, A.: RUSBoost: a hybrid approach to alleviating class imbalance. IEEE Trans. Syst. Man. Cybern. Part A Syst. Hum. 40(1), 185–197 (2010)CrossRef
25.
Zurück zum Zitat Galar, M., Fernandez, A., Barrenechea, E., Francisco, H.: EUSBoost: enhancing ensembles for highly imbalanced data-sets by evolutionary undersampling. Pattern Recogn. 46(12), 3460–3471 (2013) Galar, M., Fernandez, A., Barrenechea, E., Francisco, H.: EUSBoost: enhancing ensembles for highly imbalanced data-sets by evolutionary undersampling. Pattern Recogn. 46(12), 3460–3471 (2013)
26.
Zurück zum Zitat Lu, J., Plataniotis, K.N., Venetsanopoulos, A.N., Li, S.Z.: Ensemble-based discriminant learning with boosting for face recognition. IEEE Trans. Neural Netw. 17(1), 166–178 (2006)CrossRef Lu, J., Plataniotis, K.N., Venetsanopoulos, A.N., Li, S.Z.: Ensemble-based discriminant learning with boosting for face recognition. IEEE Trans. Neural Netw. 17(1), 166–178 (2006)CrossRef
27.
Zurück zum Zitat Eibl, G., Pheiffer, K.-P.: Multiclass boosting for weak classifiers. J. Mach. Learn. Res. 6, 189–210 (2005) Eibl, G., Pheiffer, K.-P.: Multiclass boosting for weak classifiers. J. Mach. Learn. Res. 6, 189–210 (2005)
28.
Zurück zum Zitat Turk, M., Pentland, A.: Eigenfaces for recognition. J. Cogn. Neurosci. 3(1), 71–86 (1991)CrossRef Turk, M., Pentland, A.: Eigenfaces for recognition. J. Cogn. Neurosci. 3(1), 71–86 (1991)CrossRef
29.
Zurück zum Zitat Belhumeur, P., Hespanha, J., Kriegman, D.: Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997)CrossRef Belhumeur, P., Hespanha, J., Kriegman, D.: Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997)CrossRef
30.
Zurück zum Zitat Huang, G.B., Mattar, M., Lee, H., Learned-Miller, E.: Learning to align from scratch. In: Advances in Neural Information Processing Systems (NIPS), Lake Tahoe, Nevada, United States, December 3–6, 2012 Huang, G.B., Mattar, M., Lee, H., Learned-Miller, E.: Learning to align from scratch. In: Advances in Neural Information Processing Systems (NIPS), Lake Tahoe, Nevada, United States, December 3–6, 2012
Metadaten
Titel
A Boosting-Based Decision Fusion Method for Learning from Large, Imbalanced Face Data Set
verfasst von
Xiaohui Yuan
Mohamed Abouelenien
Mohamed Elhoseny
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-63639-9_18

Premium Partner