Skip to main content

2015 | OriginalPaper | Buchkapitel

A Wearable Face Recognition System Built into a Smartwatch and the Blind and Low Vision Users

verfasst von : Laurindo de Sousa Britto Neto, Vanessa Regina Margareth Lima Maike, Fernando Luiz Koch, Maria Cecília Calani Baranauskas, Anderson de Rezende Rocha, Siome Klein Goldenstein

Erschienen in: Enterprise Information Systems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Assistive technologies need to be affordable, ergonomic and easy to use. In this work we argue that smartwatches could be assistive devices for the visually impaired, if they have the potential to run complex applications. Hence, in this paper we propose a face recognition system to show that it’s technically possible to develop a real-time computer vision system in a wearable device with limited hardware, since such systems generally require powerful hardware. A case study is presented using the first generation Samsung Galaxy Gear smartwatch. The system runs only on the watch’s hardware and consists in a face detection and recognition software that emits an audio feedback so that visually impaired users know who is around them. The case study includes an evaluation of the proposal with users. Results are shown and discussed validating the technological aspects of the proposal and pointing out room for improving the aspects of interaction.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ahonen, T., Hadid, A., Pietikainen, M.: Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2037–2041 (2006)CrossRef Ahonen, T., Hadid, A., Pietikainen, M.: Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2037–2041 (2006)CrossRef
2.
Zurück zum Zitat Astler, D., Chau, H., Hsu, K., Hua, A., Kannan, A., Lei, L., Nathanson, M., Paryavi, E., Rosen, M., Unno, H., Wang, C., Zaidi, K., Zhang, X., Tang, C.: Increased accessibility to nonverbal communication through facial and expression recognition technologies for blind/visually impaired subjects. In: 13th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 259–260 (2011) Astler, D., Chau, H., Hsu, K., Hua, A., Kannan, A., Lei, L., Nathanson, M., Paryavi, E., Rosen, M., Unno, H., Wang, C., Zaidi, K., Zhang, X., Tang, C.: Increased accessibility to nonverbal communication through facial and expression recognition technologies for blind/visually impaired subjects. In: 13th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 259–260 (2011)
3.
Zurück zum Zitat Britto Neto, L.S., Maike, V.R.M.L., Koch, F.L., Baranauskas, M.C.C., Rocha, A.R., Goldenstein, S.K.: A wearable face recognition system built into smartwatch and the visually impaired user. In: 17th International Conference on Enterprise Information Systems, vol. 3, pp. 5–12. Scitepress (2015) Britto Neto, L.S., Maike, V.R.M.L., Koch, F.L., Baranauskas, M.C.C., Rocha, A.R., Goldenstein, S.K.: A wearable face recognition system built into smartwatch and the visually impaired user. In: 17th International Conference on Enterprise Information Systems, vol. 3, pp. 5–12. Scitepress (2015)
4.
Zurück zum Zitat Belhumeur, P., Hespanha, J., Kriegman, D.: Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997)CrossRef Belhumeur, P., Hespanha, J., Kriegman, D.: Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997)CrossRef
5.
Zurück zum Zitat Chen, X., Flynn, P., Bowyer, K.: PCA-based face recognition in infrared imagery: baseline and comparative studies. In: IEEE International Workshop on Analysis and Modeling of Faces and Gestures, pp. 127–134 (2003) Chen, X., Flynn, P., Bowyer, K.: PCA-based face recognition in infrared imagery: baseline and comparative studies. In: IEEE International Workshop on Analysis and Modeling of Faces and Gestures, pp. 127–134 (2003)
6.
Zurück zum Zitat Cover, T., Hart, P.: Nearest neighbor pattern classification. IEEE Trans. Inf. Theory 13(1), 21–27 (1967)CrossRefMATH Cover, T., Hart, P.: Nearest neighbor pattern classification. IEEE Trans. Inf. Theory 13(1), 21–27 (1967)CrossRefMATH
7.
Zurück zum Zitat Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 886–893 (2005) Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 886–893 (2005)
9.
Zurück zum Zitat Fusco, G., Noceti, N., Odone, F.: Combining retrieval and classification for real-time face recognition. In: 10th IEEE International Conference on Advanced Video and Signal Based Surveillance, pp. 276–281 (2012) Fusco, G., Noceti, N., Odone, F.: Combining retrieval and classification for real-time face recognition. In: 10th IEEE International Conference on Advanced Video and Signal Based Surveillance, pp. 276–281 (2012)
10.
Zurück zum Zitat Gordon, G.: Face recognition based on depth maps and surface curvature. In: SPIE1570, Geometric methods in Computer Vision, pp. 234–247 (1991) Gordon, G.: Face recognition based on depth maps and surface curvature. In: SPIE1570, Geometric methods in Computer Vision, pp. 234–247 (1991)
11.
Zurück zum Zitat Hadid, A., Li, S.Z., Pietikäinen, M.: Learning Personal Specific Facial Dynamics for Face Recognition from Videos. In: Zhou, S., Zhao, W., Tang, X., Gong, S. (eds.) AMFG 2007. LNCS, vol. 4778, pp. 1–15. Springer, Heidelberg (2007)CrossRef Hadid, A., Li, S.Z., Pietikäinen, M.: Learning Personal Specific Facial Dynamics for Face Recognition from Videos. In: Zhou, S., Zhao, W., Tang, X., Gong, S. (eds.) AMFG 2007. LNCS, vol. 4778, pp. 1–15. Springer, Heidelberg (2007)CrossRef
12.
Zurück zum Zitat Jain, A. K., Chandrasekaran, B.: Dimensionality and sample size considerations in pattern recognition practice. In Handbook of Statistics, pp. 835–855 (1982) Jain, A. K., Chandrasekaran, B.: Dimensionality and sample size considerations in pattern recognition practice. In Handbook of Statistics, pp. 835–855 (1982)
13.
Zurück zum Zitat Kistler, D., Wightman, F.: A model of head-related transfer functions based on principal components analysis and minimum-phase reconstruction. J. Acoust. Soc. Am. 91(3), 1637–1647 (1992)CrossRef Kistler, D., Wightman, F.: A model of head-related transfer functions based on principal components analysis and minimum-phase reconstruction. J. Acoust. Soc. Am. 91(3), 1637–1647 (1992)CrossRef
14.
Zurück zum Zitat Kramer, K., Hedin, D., Rolkosky, D.: Smartphone based face recognition tool for the blind. In: 32nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 4538–4541 (2010) Kramer, K., Hedin, D., Rolkosky, D.: Smartphone based face recognition tool for the blind. In: 32nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 4538–4541 (2010)
15.
Zurück zum Zitat Krishna, S., Little, G., Black, J., Panchanathan, S.: A Wearable face recognition system for individuals with visual impairments. In: 7th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 106–113 (2005) Krishna, S., Little, G., Black, J., Panchanathan, S.: A Wearable face recognition system for individuals with visual impairments. In: 7th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 106–113 (2005)
16.
Zurück zum Zitat Li, B., Mian, A., L., W., and Krishna, A.: Using kinect for face recognition under varying poses, expressions, illumination and disguise. In: IEEE Workshop on Applications of Computer Vision, pp. 186–192 (2013) Li, B., Mian, A., L., W., and Krishna, A.: Using kinect for face recognition under varying poses, expressions, illumination and disguise. In: IEEE Workshop on Applications of Computer Vision, pp. 186–192 (2013)
18.
Zurück zum Zitat Manduchi, R., Coughlan, J.: Computer vision without sight. Commun. ACM 55(1), 96–104 (2012)CrossRef Manduchi, R., Coughlan, J.: Computer vision without sight. Commun. ACM 55(1), 96–104 (2012)CrossRef
19.
Zurück zum Zitat Martínez, A.M.: Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class. IEEE Trans. Pattern Anal. Mach. Intell. 24(6), 748–762 (2002)CrossRef Martínez, A.M.: Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class. IEEE Trans. Pattern Anal. Mach. Intell. 24(6), 748–762 (2002)CrossRef
21.
Zurück zum Zitat Porzi, L., Messelodi, S., Modena, C. M., Ricci, E.: A smart watch-based gesture recognition system for assisting people with visual impairments. In: 3rd ACM International Workshop on Interactive Multimedia on Mobile, pp. 19–24 (2013) Porzi, L., Messelodi, S., Modena, C. M., Ricci, E.: A smart watch-based gesture recognition system for assisting people with visual impairments. In: 3rd ACM International Workshop on Interactive Multimedia on Mobile, pp. 19–24 (2013)
22.
Zurück zum Zitat Pun, T., Roth, P., Bologna, G., Moustakas, K., Tzovaras, D.: Image and video processing for visually handicapped people. EURASIP J. Image Video Process. 025214(5), 4:1–4:12 (2007) Pun, T., Roth, P., Bologna, G., Moustakas, K., Tzovaras, D.: Image and video processing for visually handicapped people. EURASIP J. Image Video Process. 025214(5), 4:1–4:12 (2007)
23.
Zurück zum Zitat Schwartz, W., Guo, H., Choi, J., Davis, L.: Face Identification Using Large Feature Sets. IEEE Trans. Image Process. 21(4), 2245–2255 (2012)CrossRefMathSciNet Schwartz, W., Guo, H., Choi, J., Davis, L.: Face Identification Using Large Feature Sets. IEEE Trans. Image Process. 21(4), 2245–2255 (2012)CrossRefMathSciNet
24.
Zurück zum Zitat Tan, X., Chen, S., Zhou, Z., Zhang, F.: Face recognition from a single image per person: a survey. J. Pattern Recogn. 39(9), 1725–1745 (2006). Elsevier, New YorkCrossRefMATH Tan, X., Chen, S., Zhou, Z., Zhang, F.: Face recognition from a single image per person: a survey. J. Pattern Recogn. 39(9), 1725–1745 (2006). Elsevier, New YorkCrossRefMATH
25.
Zurück zum Zitat Tanveer, M., Anam, A., Rahman, A., Ghosh, S., Yeasin, M.: FEPS: A sensory substitution system for the blind to perceive facial expressions. In: 14th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 207–208 (2012) Tanveer, M., Anam, A., Rahman, A., Ghosh, S., Yeasin, M.: FEPS: A sensory substitution system for the blind to perceive facial expressions. In: 14th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 207–208 (2012)
26.
Zurück zum Zitat Tistarelli, M., Grosso, E.: Human face analysis: from identity to emotion and intention recognition. In: Kumar, A., Zhang, D. (eds.) ICEB 2010. LNCS, vol. 6005, pp. 76–88. Springer, Heidelberg (2010)CrossRef Tistarelli, M., Grosso, E.: Human face analysis: from identity to emotion and intention recognition. In: Kumar, A., Zhang, D. (eds.) ICEB 2010. LNCS, vol. 6005, pp. 76–88. Springer, Heidelberg (2010)CrossRef
27.
Zurück zum Zitat Turk, M., Pentland, A.: Eigenfaces for recognition. J. Cogn. Neurosci. 3(1), 71–86 (1991)CrossRef Turk, M., Pentland, A.: Eigenfaces for recognition. J. Cogn. Neurosci. 3(1), 71–86 (1991)CrossRef
28.
Zurück zum Zitat Viola, P., Jones, M.: Robust real-time face detection. Int. J. Comput. Vision 57(2), 137–154 (2004)CrossRef Viola, P., Jones, M.: Robust real-time face detection. Int. J. Comput. Vision 57(2), 137–154 (2004)CrossRef
29.
Zurück zum Zitat Watanabe, H., Terada, T., Tsukamoto, M.: A sound-based lifelog system using ultrasound. In: 5th Augmented Human International Conference, pp. 59:1–59:2 (2014) Watanabe, H., Terada, T., Tsukamoto, M.: A sound-based lifelog system using ultrasound. In: 5th Augmented Human International Conference, pp. 59:1–59:2 (2014)
30.
Zurück zum Zitat Wilder, J., Phillips, P.J., Jiang, C., Wiener, S.: Comparison of visible and infra-red imagery for face recognition. In: 2nd International Conference on Automatic Face and Gesture Recognition, pp. 182–187 (1996) Wilder, J., Phillips, P.J., Jiang, C., Wiener, S.: Comparison of visible and infra-red imagery for face recognition. In: 2nd International Conference on Automatic Face and Gesture Recognition, pp. 182–187 (1996)
31.
Zurück zum Zitat Wiscott, L., Fellous, J., Malsburg, C.: Face recognition by elastic bunch graph matching. IEEE Trans. Pattern Anal. Mach. Intell. 19(1), 775–779 (1997)CrossRef Wiscott, L., Fellous, J., Malsburg, C.: Face recognition by elastic bunch graph matching. IEEE Trans. Pattern Anal. Mach. Intell. 19(1), 775–779 (1997)CrossRef
33.
Zurück zum Zitat Yan, H., Lu, J., Zhou, X., Shang, Y.: Multi-feature multi-manifold learning for single-sample face recognition. NeuroComputing 143, 134–143 (2014). ElsevierCrossRef Yan, H., Lu, J., Zhou, X., Shang, Y.: Multi-feature multi-manifold learning for single-sample face recognition. NeuroComputing 143, 134–143 (2014). ElsevierCrossRef
34.
Zurück zum Zitat Zhao, G., Pietikainen, M.: Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Trans. Pattern Anal. Mach. Intell. 29(6), 915–928 (2007)CrossRef Zhao, G., Pietikainen, M.: Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Trans. Pattern Anal. Mach. Intell. 29(6), 915–928 (2007)CrossRef
35.
Zurück zum Zitat Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face recognition: a literature survey. ACM Comput. Surv. 35(4), 399–458 (2003)CrossRef Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face recognition: a literature survey. ACM Comput. Surv. 35(4), 399–458 (2003)CrossRef
Metadaten
Titel
A Wearable Face Recognition System Built into a Smartwatch and the Blind and Low Vision Users
verfasst von
Laurindo de Sousa Britto Neto
Vanessa Regina Margareth Lima Maike
Fernando Luiz Koch
Maria Cecília Calani Baranauskas
Anderson de Rezende Rocha
Siome Klein Goldenstein
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-29133-8_25

Premium Partner