Skip to main content

2020 | OriginalPaper | Buchkapitel

Open-Set Face Recognition in Video Surveillance: A Survey

verfasst von : Wasseem N. Ibrahem Al-Obaydy, Shahrel Azmin Suandi

Erschienen in: InECCE2019

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Face recognition has received a substantial attention by the vision community over the past few decades. Most of the proposed frameworks have adopted the closed-set form of face recognition. However, when a novel unregistered face is presented to the system, the result will be misclassification. A more general and challenging open-set face recognition scheme is highly desirable due to its ability in dealing with the unknown persons which are not enrolled before. We observed that there is a shortage in survey papers that explore the research endeavors in open-set face recognition. In this paper, we present a literature survey of the open-set face recognition approaches that have been introduced for real-world scenarios focusing on video surveillance applications. Moreover, we discuss the current difficulties and suggest the promising directions for future research. The paper also describes the evaluation metrics and available benchmarking face video surveillance databases.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Jain AK, Li SZ (2011) Handbook of face recognition. Springer, Berlin Jain AK, Li SZ (2011) Handbook of face recognition. Springer, Berlin
2.
Zurück zum Zitat Pagano C, Granger E, Sabourin R, Gorodnichy DO (2012) Detector ensembles for face recognition in video surveillance. In: The 2012 international joint conference on neural networks (IJCNN), pp 1–8. IEEE Pagano C, Granger E, Sabourin R, Gorodnichy DO (2012) Detector ensembles for face recognition in video surveillance. In: The 2012 international joint conference on neural networks (IJCNN), pp 1–8. IEEE
3.
Zurück zum Zitat Bashbaghi S, Granger E, Sabourin R, Bilodeau GA (2017) Robust watch-list screening using dynamic ensembles of SVMs based on multiple face representations. Mach Vis Appl 28(1–2):219–241CrossRef Bashbaghi S, Granger E, Sabourin R, Bilodeau GA (2017) Robust watch-list screening using dynamic ensembles of SVMs based on multiple face representations. Mach Vis Appl 28(1–2):219–241CrossRef
4.
Zurück zum Zitat De-la Torre M, Granger E, Sabourin R, Gorodnichy DO (2015) An adaptive ensemble-based system for face recognition in person re-identification. Mach Vis Appl 26(6):741–773CrossRef De-la Torre M, Granger E, Sabourin R, Gorodnichy DO (2015) An adaptive ensemble-based system for face recognition in person re-identification. Mach Vis Appl 26(6):741–773CrossRef
5.
Zurück zum Zitat Gao H, Ekenel HK, Stiefelhagen R (2010) Robust open-set face recognition for small scale convenience applications. In: Joint pattern recognition symposium, pp 393–402. Springer, Berlin Gao H, Ekenel HK, Stiefelhagen R (2010) Robust open-set face recognition for small scale convenience applications. In: Joint pattern recognition symposium, pp 393–402. Springer, Berlin
6.
Zurück zum Zitat Grgic M, Delac K, Grgic S (2011) SCface-surveillance cameras face database. Multimedia Tools Appl 51(3):863–879CrossRef Grgic M, Delac K, Grgic S (2011) SCface-surveillance cameras face database. Multimedia Tools Appl 51(3):863–879CrossRef
7.
Zurück zum Zitat Kamgar-Parsi B, Lawson W, Kamgar-Parsi B (2011) Toward development of a face recognition system for watchlist surveillance. IEEE Trans Pattern Anal Mach Intell 33(10):1925–1937CrossRef Kamgar-Parsi B, Lawson W, Kamgar-Parsi B (2011) Toward development of a face recognition system for watchlist surveillance. IEEE Trans Pattern Anal Mach Intell 33(10):1925–1937CrossRef
8.
Zurück zum Zitat Abate AF, Nappi M, Riccio D, Sabatino G (2007) 2D and 3D face recognition: a survey. Pattern Recogn Lett 28(14):1885–1906CrossRef Abate AF, Nappi M, Riccio D, Sabatino G (2007) 2D and 3D face recognition: a survey. Pattern Recogn Lett 28(14):1885–1906CrossRef
9.
Zurück zum Zitat Chihaoui M, Elkefi A, Bellil W, Ben Amar C (2016) A survey of 2D face recognition techniques. Computers 5(4):21CrossRef Chihaoui M, Elkefi A, Bellil W, Ben Amar C (2016) A survey of 2D face recognition techniques. Computers 5(4):21CrossRef
10.
Zurück zum Zitat Tan X, Chen S, Zhou ZH, Zhang F (2006) Face recognition from a single image per person: a survey. Pattern Recogn 39(9):1725–1745CrossRef Tan X, Chen S, Zhou ZH, Zhang F (2006) Face recognition from a single image per person: a survey. Pattern Recogn 39(9):1725–1745CrossRef
11.
Zurück zum Zitat Zhao W, Chellappa R, Phillips PJ, Rosenfeld A (2003) Face recognition: a literature survey. ACM Comput Surv (CSUR) 35(4):399–458CrossRef Zhao W, Chellappa R, Phillips PJ, Rosenfeld A (2003) Face recognition: a literature survey. ACM Comput Surv (CSUR) 35(4):399–458CrossRef
12.
Zurück zum Zitat Dhifli W, Diallo AB (2016) Face recognition in the wild. Procedia Comput Sci 96:1571–1580CrossRef Dhifli W, Diallo AB (2016) Face recognition in the wild. Procedia Comput Sci 96:1571–1580CrossRef
13.
Zurück zum Zitat Sapkota A, Boult TE (2013) Large scale unconstrained open set face database. In: 2013 IEEE sixth international conference on biometrics: theory, applications and systems (BTAS), pp 1–8. IEEE Sapkota A, Boult TE (2013) Large scale unconstrained open set face database. In: 2013 IEEE sixth international conference on biometrics: theory, applications and systems (BTAS), pp 1–8. IEEE
14.
Zurück zum Zitat Wechsler H (2009) Reliable face recognition methods: system design, implementation and evaluation, vol 7. Springer Science & Business Media, Berlin Wechsler H (2009) Reliable face recognition methods: system design, implementation and evaluation, vol 7. Springer Science & Business Media, Berlin
15.
Zurück zum Zitat Scheirer WJ, de Rezende Rocha A, Sapkota A, Boult TE (2013) Toward open set recognition. IEEE Trans Pattern Anal Mach Intell 35(7):1757–1772CrossRef Scheirer WJ, de Rezende Rocha A, Sapkota A, Boult TE (2013) Toward open set recognition. IEEE Trans Pattern Anal Mach Intell 35(7):1757–1772CrossRef
16.
Zurück zum Zitat dos Santos CE Jr, Schwartz WR (2014) Extending face identification to open-set face recognition. In: 2014 27th SIBGRAPI conference on graphics, patterns and images (SIBGRAPI), pp 188–195. IEEE dos Santos CE Jr, Schwartz WR (2014) Extending face identification to open-set face recognition. In: 2014 27th SIBGRAPI conference on graphics, patterns and images (SIBGRAPI), pp 188–195. IEEE
17.
Zurück zum Zitat Stallkamp J, Ekenel HK, Stiefelhagen R (2007) Video-based face recognition on real-world data. In: IEEE 11th international conference on computer vision, ICCV 2007, pp 1–8. IEEE Stallkamp J, Ekenel HK, Stiefelhagen R (2007) Video-based face recognition on real-world data. In: IEEE 11th international conference on computer vision, ICCV 2007, pp 1–8. IEEE
18.
Zurück zum Zitat Li F, Wechsler H (2005) Open set face recognition using transduction. IEEE Trans Pattern Anal Mach Intell 27(11):1686–1697CrossRef Li F, Wechsler H (2005) Open set face recognition using transduction. IEEE Trans Pattern Anal Mach Intell 27(11):1686–1697CrossRef
19.
Zurück zum Zitat Tax DM, Duin RP (2008) Growing a multi-class classifier with a reject option. Pattern Recogn Lett 29(10):1565–1570CrossRef Tax DM, Duin RP (2008) Growing a multi-class classifier with a reject option. Pattern Recogn Lett 29(10):1565–1570CrossRef
20.
Zurück zum Zitat Qiu J, Zhang Y, Sun J (2013) Face recognition in open world environment. In: Visual communications and image processing (VCIP), pp 1–6. IEEE Qiu J, Zhang Y, Sun J (2013) Face recognition in open world environment. In: Visual communications and image processing (VCIP), pp 1–6. IEEE
21.
Zurück zum Zitat Kohir VV, Desai U (2000) Face recognition. In: The 2000 IEEE international symposium on circuits and systems, Proceedings, ISCAS 2000, Geneva, vol 5, pp 305–308. IEEE Kohir VV, Desai U (2000) Face recognition. In: The 2000 IEEE international symposium on circuits and systems, Proceedings, ISCAS 2000, Geneva, vol 5, pp 305–308. IEEE
22.
Zurück zum Zitat Hatami N, Ebrahimpour R, Ghaderi R (2008) ECOC-based training of neural networks for face recognition. In: 2008 IEEE conference on cybernetics and intelligent systems, pp 450–454. IEEE Hatami N, Ebrahimpour R, Ghaderi R (2008) ECOC-based training of neural networks for face recognition. In: 2008 IEEE conference on cybernetics and intelligent systems, pp 450–454. IEEE
23.
Zurück zum Zitat Paliy I, Sachenko A, Koval V, Kurylyak Y (2005) Approach to face recognition using neural networks. In: Intelligent data acquisition and advanced computing systems: technology and applications, IDAACS 2005, pp 112–115. IEEE Paliy I, Sachenko A, Koval V, Kurylyak Y (2005) Approach to face recognition using neural networks. In: Intelligent data acquisition and advanced computing systems: technology and applications, IDAACS 2005, pp 112–115. IEEE
24.
Zurück zum Zitat Ravi J, Tevaramani SS, Raja K (2012) Face recognition using DT-CWT and LBP features. In: 2012 international conference on computing, communication and applications (ICCCA), pp 1–6. IEEE Ravi J, Tevaramani SS, Raja K (2012) Face recognition using DT-CWT and LBP features. In: 2012 international conference on computing, communication and applications (ICCCA), pp 1–6. IEEE
25.
Zurück zum Zitat Sebastiao R, Silva JA, Padilha AJ (2006) Face recognition from spatially-morphed video sequences. In: International conference image analysis and recognition, pp 365–374. Springer, Berlin Sebastiao R, Silva JA, Padilha AJ (2006) Face recognition from spatially-morphed video sequences. In: International conference image analysis and recognition, pp 365–374. Springer, Berlin
26.
Zurück zum Zitat Sing JK, Basu DK, Nasipuri M, Kundu M (2007) Face recognition using point symmetry distance-based RBF network. Appl Soft Comput 7(1):58–70CrossRef Sing JK, Basu DK, Nasipuri M, Kundu M (2007) Face recognition using point symmetry distance-based RBF network. Appl Soft Comput 7(1):58–70CrossRef
27.
Zurück zum Zitat Theodorakopoulos I, Rigas I, Economou G, Fotopoulos S (2011) Face recognition via local sparse coding. In: 2011 IEEE international conference on computer vision (ICCV), pp 1647–1652. IEEE Theodorakopoulos I, Rigas I, Economou G, Fotopoulos S (2011) Face recognition via local sparse coding. In: 2011 IEEE international conference on computer vision (ICCV), pp 1647–1652. IEEE
28.
Zurück zum Zitat Vareto RH, Silva S, de Oliveira Costa F, Schwartz WR (2017) Towards open-set face recognition using hashing functions. In: 2017 IEEE international joint conference on biometrics (IJCB), pp 634–641. IEEE Vareto RH, Silva S, de Oliveira Costa F, Schwartz WR (2017) Towards open-set face recognition using hashing functions. In: 2017 IEEE international joint conference on biometrics (IJCB), pp 634–641. IEEE
29.
Zurück zum Zitat Zhang B, Hao H (2014) Open-set face recognition by transductive kernel associative memory. In: 2014 7th international congress on image and signal processing (CISP), pp 633–638. IEEE Zhang B, Hao H (2014) Open-set face recognition by transductive kernel associative memory. In: 2014 7th international congress on image and signal processing (CISP), pp 633–638. IEEE
30.
Zurück zum Zitat Zhang H, Patel VM (2017) Sparse representation-based open set recognition. IEEE Trans Pattern Anal Mach Intell 39(8):1690–1696CrossRef Zhang H, Patel VM (2017) Sparse representation-based open set recognition. IEEE Trans Pattern Anal Mach Intell 39(8):1690–1696CrossRef
31.
Zurück zum Zitat Tjahyadi R, Liu W, An S, Venkatesh S (2005) Face recognition based on ordinal correlation approach. In: Proceedings of the 2005 international conference on intelligent sensors, sensor networks and information processing conference, pp 349–354. IEEE Tjahyadi R, Liu W, An S, Venkatesh S (2005) Face recognition based on ordinal correlation approach. In: Proceedings of the 2005 international conference on intelligent sensors, sensor networks and information processing conference, pp 349–354. IEEE
32.
Zurück zum Zitat Khan SS, Madden MG (2009) A survey of recent trends in one class classification. In: Irish conference on artificial intelligence and cognitive science, pp 188–197. Springer, Berlin Khan SS, Madden MG (2009) A survey of recent trends in one class classification. In: Irish conference on artificial intelligence and cognitive science, pp 188–197. Springer, Berlin
33.
Zurück zum Zitat Moeini A, Faez K, Moeini H, Safai AM (2017) Open-set face recognition across look-alike faces in real-world scenarios. Image Vis Comput 57:1–14CrossRef Moeini A, Faez K, Moeini H, Safai AM (2017) Open-set face recognition across look-alike faces in real-world scenarios. Image Vis Comput 57:1–14CrossRef
34.
Zurück zum Zitat Kato H, Chakraborty G, Ogata N, Chakraborty B (2011) A real-time angle aware face recognition system based on artificial neural network. In: 2011 3rd international conference on awareness science and technology (iCAST), pp 521–526. IEEE Kato H, Chakraborty G, Ogata N, Chakraborty B (2011) A real-time angle aware face recognition system based on artificial neural network. In: 2011 3rd international conference on awareness science and technology (iCAST), pp 521–526. IEEE
35.
Zurück zum Zitat Chen C, Zhan Y, Wen C (2009) Hierarchical face recognition based on SVDD and SVM. In: International conference on environmental science and information application technology, ESIAT 2009, vol 2, pp 692–695. IEEE Chen C, Zhan Y, Wen C (2009) Hierarchical face recognition based on SVDD and SVM. In: International conference on environmental science and information application technology, ESIAT 2009, vol 2, pp 692–695. IEEE
36.
Zurück zum Zitat Tax DM, Duin RP (2002) Using two-class classifiers for multiclass classification. In: 16th international conference on pattern recognition. Proceedings, vol 2, pp 124–127. IEEE Tax DM, Duin RP (2002) Using two-class classifiers for multiclass classification. In: 16th international conference on pattern recognition. Proceedings, vol 2, pp 124–127. IEEE
37.
Zurück zum Zitat Ekenel HK, Szasz-Toth L, Stiefelhagen R (2009) Open-set face recognition-based visitor interface system. In: International conference on computer vision systems, pp 43–52. Springer, Berlin Ekenel HK, Szasz-Toth L, Stiefelhagen R (2009) Open-set face recognition-based visitor interface system. In: International conference on computer vision systems, pp 43–52. Springer, Berlin
38.
Zurück zum Zitat Hsu GSJ (2009) Fusion classifier for open-set face recognition with pose variations. Int J Comput Electr Autom Control Inf Eng 3(8):2099–2105 Hsu GSJ (2009) Fusion classifier for open-set face recognition with pose variations. Int J Comput Electr Autom Control Inf Eng 3(8):2099–2105
39.
Zurück zum Zitat Xue S, Zhu H (2019) Low-resolution and open-set face recognition via recursive label propagation based on statistical classification. Int J Wavelets Multiresolut Inf Process 17(02):1940002MathSciNetCrossRef Xue S, Zhu H (2019) Low-resolution and open-set face recognition via recursive label propagation based on statistical classification. Int J Wavelets Multiresolut Inf Process 17(02):1940002MathSciNetCrossRef
41.
Zurück zum Zitat Xie H, Du Y, Yu H, Chang Y, Xu Z, Tang Y (2018) Open set face recognition with deep transfer learning and extreme value statistics. Int J Wavelets Multiresolut Inf Process 16(04):1850034MathSciNetCrossRef Xie H, Du Y, Yu H, Chang Y, Xu Z, Tang Y (2018) Open set face recognition with deep transfer learning and extreme value statistics. Int J Wavelets Multiresolut Inf Process 16(04):1850034MathSciNetCrossRef
42.
Zurück zum Zitat Toufiq R, Islam MR (2014) Face recognition system using PCA-ANN technique with feature fusion method. In: 2014 international conference on electrical engineering and information & communication technology (ICEEICT), pp 1–5. IEEE Toufiq R, Islam MR (2014) Face recognition system using PCA-ANN technique with feature fusion method. In: 2014 international conference on electrical engineering and information & communication technology (ICEEICT), pp 1–5. IEEE
43.
Zurück zum Zitat Zhang B (2012) Reliable face recognition by random subspace support vector machine ensemble. In: 2012 International conference on machine learning and cybernetics (ICMLC), vol 1, pp 415–420. IEEE Zhang B (2012) Reliable face recognition by random subspace support vector machine ensemble. In: 2012 International conference on machine learning and cybernetics (ICMLC), vol 1, pp 415–420. IEEE
44.
Zurück zum Zitat Pankaj DS, Wilscy M (2011) Face recognition using fuzzy neural network classifier. In: Advances in parallel distributed computing, vol 203, pp 53–62. Springer, Berlin Pankaj DS, Wilscy M (2011) Face recognition using fuzzy neural network classifier. In: Advances in parallel distributed computing, vol 203, pp 53–62. Springer, Berlin
45.
Zurück zum Zitat Chen JC, Shi SY, Lien JJJ (2010) Face recognition and unseen subject rejection in margin-enhanced space. In: 2010 international conference on system science and engineering (ICSSE), pp 631–636. IEEE Chen JC, Shi SY, Lien JJJ (2010) Face recognition and unseen subject rejection in margin-enhanced space. In: 2010 international conference on system science and engineering (ICSSE), pp 631–636. IEEE
46.
Zurück zum Zitat Nakamura K, Takano H (2007) Unregistered face discrimination by the face orientation and size recognition. In: International joint conference on neural networks, IJCNN 2007, pp 1924–1928. IEEE Nakamura K, Takano H (2007) Unregistered face discrimination by the face orientation and size recognition. In: International joint conference on neural networks, IJCNN 2007, pp 1924–1928. IEEE
47.
Zurück zum Zitat Mu X, Artiklar M, Watta P, Hassoun MH (2006) An RCE-based associative memory with application to human face recognition. Neural Process Lett 23(3):257–271CrossRef Mu X, Artiklar M, Watta P, Hassoun MH (2006) An RCE-based associative memory with application to human face recognition. Neural Process Lett 23(3):257–271CrossRef
48.
Zurück zum Zitat Seow MJ, Gottumukkal R, Valaparla D, Asari K (2004) A robust face recognition system for real time surveillance. In: International conference on information technology: coding and computing, Proceedings, ITCC 2004, vol 1, pp 631–635. IEEE Seow MJ, Gottumukkal R, Valaparla D, Asari K (2004) A robust face recognition system for real time surveillance. In: International conference on information technology: coding and computing, Proceedings, ITCC 2004, vol 1, pp 631–635. IEEE
50.
Zurück zum Zitat Salka TD, Hanafi M, Mashohor S, Ahamad SMS (2015) Large variability surveillance camera face database. In: 2015 seventh international conference on computational intelligence, modelling and simulation (CIMSim), pp 108–112. IEEE Salka TD, Hanafi M, Mashohor S, Ahamad SMS (2015) Large variability surveillance camera face database. In: 2015 seventh international conference on computational intelligence, modelling and simulation (CIMSim), pp 108–112. IEEE
51.
Zurück zum Zitat Wong Y, Chen S, Mau S, Sanderson C, Lovell BC (2011) Patch-based probabilistic image quality assessment for face selection and improved video-based face recognition. In: 2011 IEEE computer society conference on computer vision and pattern recognition workshops (CVPRW), pp 74–81. IEEE Wong Y, Chen S, Mau S, Sanderson C, Lovell BC (2011) Patch-based probabilistic image quality assessment for face selection and improved video-based face recognition. In: 2011 IEEE computer society conference on computer vision and pattern recognition workshops (CVPRW), pp 74–81. IEEE
Metadaten
Titel
Open-Set Face Recognition in Video Surveillance: A Survey
verfasst von
Wasseem N. Ibrahem Al-Obaydy
Shahrel Azmin Suandi
Copyright-Jahr
2020
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-15-2317-5_36