Skip to main content
Erschienen in: Neural Computing and Applications 5/2020

03.08.2018 | Original Article

Open-set single-sample face recognition in video surveillance using fuzzy ARTMAP

verfasst von: Wasseem N. Ibrahem Al-Obaydy, Shahrel Azmin Suandi

Erschienen in: Neural Computing and Applications | Ausgabe 5/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Single-sample face recognition has been investigated by a few researches over the past few decades. However, due to the demand of identity of interest searching from video surveillance in recent years, this system has been expanded to open-set face recognition (OSFR) scheme. The OSFR system provides the identity of registered subjects and rejects the unregistered ones using only single-sample reference. This is important in video surveillance applications in which both database members and non-members are expected to appear in the scene. In this paper, we propose to use fuzzy ARTMAP neural network to solve the problem of open-set single-sample face recognition in real-world video surveillance scenario. Our proposed approach can recognize faces in near-frontal views under various illumination and facial expression conditions. Facial features are extracted using histograms of oriented gradients and Gabor wavelets and then fused using canonical correlation analysis to yield feature vectors that are robust against the aforementioned conditions. The fuzzy ARTMAP classifier has been trained using only single sample per person. We have conducted experiments on three challenging benchmark datasets, namely AR, FRGC, and ChokePoint. The experimental results have shown that the proposed approach has a superior performance than the state-of-the-art approaches.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Scheirer WJ, de Rezende Rocha A, Sapkota A, Boult TE (2013) Toward open set recognition. IEEE Trans Pattern Anal Mach Intell 35(7):1757–1772CrossRef Scheirer WJ, de Rezende Rocha A, Sapkota A, Boult TE (2013) Toward open set recognition. IEEE Trans Pattern Anal Mach Intell 35(7):1757–1772CrossRef
2.
Zurück zum Zitat Zhang B, Hao H (2014) Open-set face recognition by transductive kernel associative memory. In: 2014 7th international congress on image and signal processing (CISP), pp 633–638. IEEE Zhang B, Hao H (2014) Open-set face recognition by transductive kernel associative memory. In: 2014 7th international congress on image and signal processing (CISP), pp 633–638. IEEE
3.
Zurück zum Zitat Chen C, Zhan Y, Wen C (2009) Hierarchical face recognition based on SVDD and SVM. In: International conference on environmental science and information application technology, 2009. ESIAT 2009, vol 2, pp 692–695. IEEE Chen C, Zhan Y, Wen C (2009) Hierarchical face recognition based on SVDD and SVM. In: International conference on environmental science and information application technology, 2009. ESIAT 2009, vol 2, pp 692–695. IEEE
4.
Zurück zum Zitat dos Santos Jr CE, Schwartz WR (2014) Extending face identification to open-set face recognition. In: 2014 27th SIBGRAPI conference on graphics, patterns and images (SIBGRAPI), pp 188–195. IEEE dos Santos Jr CE, Schwartz WR (2014) Extending face identification to open-set face recognition. In: 2014 27th SIBGRAPI conference on graphics, patterns and images (SIBGRAPI), pp 188–195. IEEE
5.
Zurück zum Zitat Qiu J, Zhang Y, Sun J(2013) Face recognition in open world environment. In: Visual communications and image processing (VCIP), 2013, pp 1–6. IEEE Qiu J, Zhang Y, Sun J(2013) Face recognition in open world environment. In: Visual communications and image processing (VCIP), 2013, pp 1–6. IEEE
6.
Zurück zum Zitat Kamgar-Parsi B, Lawson W, Kamgar-Parsi B (2011) Toward development of a face recognition system for watchlist surveillance. IEEE Trans Pattern Anal Mach Intell 33(10):1925–1937CrossRef Kamgar-Parsi B, Lawson W, Kamgar-Parsi B (2011) Toward development of a face recognition system for watchlist surveillance. IEEE Trans Pattern Anal Mach Intell 33(10):1925–1937CrossRef
7.
Zurück zum Zitat Ekenel H, Szasz-Toth L, Stiefelhagen R (2009) Open-set face recognition-based visitor interface system. Comput Vis Syst 5815:43–52CrossRef Ekenel H, Szasz-Toth L, Stiefelhagen R (2009) Open-set face recognition-based visitor interface system. Comput Vis Syst 5815:43–52CrossRef
8.
Zurück zum Zitat Toufiq R, Islam MdR (2014) Face recognition system using PCA-ANN technique with feature fusion method. In: 2014 international conference on electrical engineering and information and communication technology (ICEEICT), pp 1–5. IEEE Toufiq R, Islam MdR (2014) Face recognition system using PCA-ANN technique with feature fusion method. In: 2014 international conference on electrical engineering and information and communication technology (ICEEICT), pp 1–5. IEEE
9.
Zurück zum Zitat Zhang B (2012) Reliable face recognition by random subspace support vector machine ensemble. In: 2012 international conference on machine learning and cybernetics (ICMLC), vol 1, pp 415–420. IEEE Zhang B (2012) Reliable face recognition by random subspace support vector machine ensemble. In: 2012 international conference on machine learning and cybernetics (ICMLC), vol 1, pp 415–420. IEEE
10.
Zurück zum Zitat Theodorakopoulos I, Rigas I, Economou G, Fotopoulos S (2011) Face recognition via local sparse coding. In: 2011 IEEE international conference on computer vision (ICCV), pp 1647–1652. IEEE Theodorakopoulos I, Rigas I, Economou G, Fotopoulos S (2011) Face recognition via local sparse coding. In: 2011 IEEE international conference on computer vision (ICCV), pp 1647–1652. IEEE
11.
Zurück zum Zitat Chen J-C, Shi S-Y, Lien J-JJ (2010) Face recognition and unseen subject rejection in margin-enhanced space. In: 2010 international conference on system science and engineering (ICSSE), pp 631–636. IEEE Chen J-C, Shi S-Y, Lien J-JJ (2010) Face recognition and unseen subject rejection in margin-enhanced space. In: 2010 international conference on system science and engineering (ICSSE), pp 631–636. IEEE
12.
Zurück zum Zitat Nakamura K, Takano H (2007) Unregistered face discrimination by the face orientation and size recognition. In: International joint conference on neural networks, 2007. IJCNN 2007, pp 1924–1928. IEEE Nakamura K, Takano H (2007) Unregistered face discrimination by the face orientation and size recognition. In: International joint conference on neural networks, 2007. IJCNN 2007, pp 1924–1928. IEEE
13.
Zurück zum Zitat Li F, Wechsler H (2005) Open set face recognition using transduction. IEEE Trans Pattern Anal Mach Intell 27(11):1686–1697CrossRef Li F, Wechsler H (2005) Open set face recognition using transduction. IEEE Trans Pattern Anal Mach Intell 27(11):1686–1697CrossRef
14.
Zurück zum Zitat Tan X, Chen S, Zhou Z-H, Zhang F (2006) Face recognition from a single image per person: a survey. Pattern Recogn 39(9):1725–1745CrossRef Tan X, Chen S, Zhou Z-H, Zhang F (2006) Face recognition from a single image per person: a survey. Pattern Recogn 39(9):1725–1745CrossRef
15.
Zurück zum Zitat Pagano C, Granger E, Sabourin R, Marcialis GL, Roli F (2014) Adaptive ensembles for face recognition in changing video surveillance environments. Inf Sci 286:75–101CrossRef Pagano C, Granger E, Sabourin R, Marcialis GL, Roli F (2014) Adaptive ensembles for face recognition in changing video surveillance environments. Inf Sci 286:75–101CrossRef
16.
Zurück zum Zitat Haghighat M, Abdel-Mottaleb M, Alhalabi W (2016) Fully automatic face normalization and single sample face recognition in unconstrained environments. Expert Syst Appl 47:23–34CrossRef Haghighat M, Abdel-Mottaleb M, Alhalabi W (2016) Fully automatic face normalization and single sample face recognition in unconstrained environments. Expert Syst Appl 47:23–34CrossRef
17.
Zurück zum Zitat Pei T, Zhang L, Wang B, Li F, Zhang Z (2017) Decision pyramid classifier for face recognition under complex variations using single sample per person. Pattern Recogn 64:305–313CrossRef Pei T, Zhang L, Wang B, Li F, Zhang Z (2017) Decision pyramid classifier for face recognition under complex variations using single sample per person. Pattern Recogn 64:305–313CrossRef
18.
Zurück zum Zitat Ding C, Bao T, Karmoshi S, Zhu M (2017) Single sample per person face recognition with KPCANet and a weighted voting scheme. Signal Image Video Process 11(7):1213–1220CrossRef Ding C, Bao T, Karmoshi S, Zhu M (2017) Single sample per person face recognition with KPCANet and a weighted voting scheme. Signal Image Video Process 11(7):1213–1220CrossRef
19.
Zurück zum Zitat Junlin H (2017) Discriminative transfer learning with sparsity regularization for single-sample face recognition. Image Vis Comput 60:48–57CrossRef Junlin H (2017) Discriminative transfer learning with sparsity regularization for single-sample face recognition. Image Vis Comput 60:48–57CrossRef
20.
Zurück zum Zitat Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: IEEE computer society conference on computer vision and pattern recognition, 2005. CVPR 2005, vol 1, pp 886–893. IEEE Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: IEEE computer society conference on computer vision and pattern recognition, 2005. CVPR 2005, vol 1, pp 886–893. IEEE
21.
Zurück zum Zitat Liu C, Wechsler H (2002) Gabor feature based classification using the enhanced Fisher linear discriminant model for face recognition. IEEE Trans Image Process 11(4):467–476CrossRef Liu C, Wechsler H (2002) Gabor feature based classification using the enhanced Fisher linear discriminant model for face recognition. IEEE Trans Image Process 11(4):467–476CrossRef
22.
Zurück zum Zitat Turk M, Pentland A (1991) Eigenfaces for recognition. J Cogn Neurosci 3(1):71–86CrossRef Turk M, Pentland A (1991) Eigenfaces for recognition. J Cogn Neurosci 3(1):71–86CrossRef
23.
Zurück zum Zitat Sun Q-S, Zeng S-G, Liu Y, Heng P-A, Xia D-S (2005) A new method of feature fusion and its application in image recognition. Pattern Recogn 38(12):2437–2448CrossRef Sun Q-S, Zeng S-G, Liu Y, Heng P-A, Xia D-S (2005) A new method of feature fusion and its application in image recognition. Pattern Recogn 38(12):2437–2448CrossRef
24.
Zurück zum Zitat Carpenter GA, Grossberg S, Markuzon N, Reynolds JH, Rosen DB (1992) Fuzzy ARTMAP: a neural network architecture for incremental supervised learning of analog multidimensional maps. IEEE Trans Neural Netw 3(5):698–713CrossRef Carpenter GA, Grossberg S, Markuzon N, Reynolds JH, Rosen DB (1992) Fuzzy ARTMAP: a neural network architecture for incremental supervised learning of analog multidimensional maps. IEEE Trans Neural Netw 3(5):698–713CrossRef
25.
Zurück zum Zitat Carpenter GA, Grossberg S (2002) Adaptive resonance theory. In: Arbib MA (ed) The handbook of brain theory and neural networks, 2nd edn. MIT Press, London Carpenter GA, Grossberg S (2002) Adaptive resonance theory. In: Arbib MA (ed) The handbook of brain theory and neural networks, 2nd edn. MIT Press, London
26.
Zurück zum Zitat Martinez AM (1998) The AR face database. CVC Technical Report Martinez AM (1998) The AR face database. CVC Technical Report
27.
Zurück zum Zitat Phillips PJ, Flynn PJ, Scruggs T, Bowyer KW, Chang J, Hoffman K, Marques J, Min J, Worek W (2005) Overview of the face recognition grand challenge. In: IEEE computer society conference on computer vision and pattern recognition, 2005. CVPR 2005, vol 1, pp 947–954. IEEE Phillips PJ, Flynn PJ, Scruggs T, Bowyer KW, Chang J, Hoffman K, Marques J, Min J, Worek W (2005) Overview of the face recognition grand challenge. In: IEEE computer society conference on computer vision and pattern recognition, 2005. CVPR 2005, vol 1, pp 947–954. IEEE
28.
Zurück zum Zitat Wong Y, Chen S, Mau S, Sanderson C, Lovell BC (2011) Patch-based probabilistic image quality assessment for face selection and improved video-based face recognition. In: 2011 IEEE computer society conference on computer vision and pattern recognition workshops (CVPRW), pp 74–81. IEEE Wong Y, Chen S, Mau S, Sanderson C, Lovell BC (2011) Patch-based probabilistic image quality assessment for face selection and improved video-based face recognition. In: 2011 IEEE computer society conference on computer vision and pattern recognition workshops (CVPRW), pp 74–81. IEEE
30.
Zurück zum Zitat Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE computer society conference on computer vision and pattern recognition, 2001. CVPR 2001, vol 1, pp I–I. IEEE Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE computer society conference on computer vision and pattern recognition, 2001. CVPR 2001, vol 1, pp I–I. IEEE
Metadaten
Titel
Open-set single-sample face recognition in video surveillance using fuzzy ARTMAP
verfasst von
Wasseem N. Ibrahem Al-Obaydy
Shahrel Azmin Suandi
Publikationsdatum
03.08.2018
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 5/2020
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-018-3649-0

Weitere Artikel der Ausgabe 5/2020

Neural Computing and Applications 5/2020 Zur Ausgabe

AI and ML applied to Health Sciences (MLHS)

Design issues in Time Series dataset balancing algorithms