Skip to main content

2016 | OriginalPaper | Buchkapitel

Person Profiling Using Image and Facial Attributes Analyses on Unconstrained Images Retrieved from Online Sources

verfasst von : Elisabeth Wetzinger, Michael Atanasov, Martin Kampel

Erschienen in: Image Analysis and Recognition

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With the existence and growth of Social Network Services (SNS), they have become focus in data and image processing research and concerning their potential to describe persons based on online available information. In this paper we propose a novel approach for person profiling solely based on images for children and adolescents of age 10+. The application acquires pictures from search engines and SNS and performs image-based analysis focusing on facial attributes. Image analysis results using different image datasets are presented showing that image analytics faces challenges of its application unconstrained datasets, but has the potential to push SNS analytics to a new level of detail in people profiling. The applications aims at improving the target users’ media literacy, raising their awareness for risks and consequences and at encouraging them in dealing responsibly with pictures online.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Bekios-Calfa, J., Buenaposada, J.M., Baumela, L.: Revisiting linear discriminant techniques in gender recognition. IEEE Trans. Pattern Anal. Mach. Intell. 33(4), 858–864 (2011)CrossRef Bekios-Calfa, J., Buenaposada, J.M., Baumela, L.: Revisiting linear discriminant techniques in gender recognition. IEEE Trans. Pattern Anal. Mach. Intell. 33(4), 858–864 (2011)CrossRef
3.
Zurück zum Zitat Bloess, M., Kim, H.N., Rawashdeh, M., El Saddik, A.: Knowing who you are and who you know: harnessing social networks to identify people via mobile devices. In: Li, S., El Saddik, A., Wang, M., Mei, T., Sebe, N., Yan, S., Hong, R., Gurrin, C. (eds.) MMM 2013, Part I. LNCS, vol. 7732, pp. 130–140. Springer, Heidelberg (2013)CrossRef Bloess, M., Kim, H.N., Rawashdeh, M., El Saddik, A.: Knowing who you are and who you know: harnessing social networks to identify people via mobile devices. In: Li, S., El Saddik, A., Wang, M., Mei, T., Sebe, N., Yan, S., Hong, R., Gurrin, C. (eds.) MMM 2013, Part I. LNCS, vol. 7732, pp. 130–140. Springer, Heidelberg (2013)CrossRef
4.
Zurück zum Zitat Borgatti, S., Everett, M., Johnson, J.: Analyzing Social Networks. SAGE Publications, Thousand Oaks (2013) Borgatti, S., Everett, M., Johnson, J.: Analyzing Social Networks. SAGE Publications, Thousand Oaks (2013)
5.
Zurück zum Zitat Burt, R.S., Kilduff, M., Tasselli, S.: Social network analysis: foundations and fron-tiers on advantage. Ann. Rev. Psychol. 64, 527–547 (2013)CrossRef Burt, R.S., Kilduff, M., Tasselli, S.: Social network analysis: foundations and fron-tiers on advantage. Ann. Rev. Psychol. 64, 527–547 (2013)CrossRef
6.
Zurück zum Zitat Catanese, S., De Meo, P., Ferrara, E., Fiumara, G., Provetti, A.: Crawling facebook for social network analysis purposes, pp. 1–7 (2011) Catanese, S., De Meo, P., Ferrara, E., Fiumara, G., Provetti, A.: Crawling facebook for social network analysis purposes, pp. 1–7 (2011)
7.
Zurück zum Zitat Cheney, J., Klein, B., Jain, A.K., Klare, B.F.: Unconstrained face detection: state of the art baseline and challenges. In: 2015 International Conference on Biometrics (ICB), pp. 229–236. IEEE (2015) Cheney, J., Klein, B., Jain, A.K., Klare, B.F.: Unconstrained face detection: state of the art baseline and challenges. In: 2015 International Conference on Biometrics (ICB), pp. 229–236. IEEE (2015)
10.
Zurück zum Zitat Eidinger, E., Enbar, R., Hassner, T.: Age and gender estimation of unltered faces. Trans. Inf. Forensic Secur. 9(12), 2170–2179 (2014)CrossRef Eidinger, E., Enbar, R., Hassner, T.: Age and gender estimation of unltered faces. Trans. Inf. Forensic Secur. 9(12), 2170–2179 (2014)CrossRef
11.
Zurück zum Zitat Ekman, P., Friesen, W.V.: Facial action coding system (1977) Ekman, P., Friesen, W.V.: Facial action coding system (1977)
12.
Zurück zum Zitat Feret, C.: Facial image database. Image Group, Information Access Division, ITL, National Institute of Standards and Technology (2003) Feret, C.: Facial image database. Image Group, Information Access Division, ITL, National Institute of Standards and Technology (2003)
13.
Zurück zum Zitat Friesen, W.V., Ekman, P.: Emfacs-7: Emotional facial action coding system. Unpublished manuscript, University of California at San Francisco, vol. 2, p. 36 (1983) Friesen, W.V., Ekman, P.: Emfacs-7: Emotional facial action coding system. Unpublished manuscript, University of California at San Francisco, vol. 2, p. 36 (1983)
14.
Zurück zum Zitat Fu, Y., Guo, G., Huang, T.S.: Age synthesis and estimation via faces: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 32(11), 1955–1976 (2010)CrossRef Fu, Y., Guo, G., Huang, T.S.: Age synthesis and estimation via faces: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 32(11), 1955–1976 (2010)CrossRef
15.
Zurück zum Zitat Ghorab, M.R., Zhou, D., O’Connor, A., Wade, V.: Personalised Information re-trieval: survey and classiffication. User Model. User Adap. Inter. 23, 381–443 (2012)CrossRef Ghorab, M.R., Zhou, D., O’Connor, A., Wade, V.: Personalised Information re-trieval: survey and classiffication. User Model. User Adap. Inter. 23, 381–443 (2012)CrossRef
19.
Zurück zum Zitat Irani, D., Webb, S., Li, K., Pu, C.: Large online social footprints an emerging threat. In: International Conference on Computational Science and Engineering, CSE 2009, vol. 3, pp. 271–276. IEEE (2009) Irani, D., Webb, S., Li, K., Pu, C.: Large online social footprints an emerging threat. In: International Conference on Computational Science and Engineering, CSE 2009, vol. 3, pp. 271–276. IEEE (2009)
20.
Zurück zum Zitat Klare, B.: Spectrally sampled structural subspace features (4sf). Michigan State University Technical report, MSU-CSE-11-16 (2011) Klare, B.: Spectrally sampled structural subspace features (4sf). Michigan State University Technical report, MSU-CSE-11-16 (2011)
21.
Zurück zum Zitat Klontz, J.C., Klare, B.F., Klum, S., Jain, A.K., Burge, M.J.: Open source biometric recognition. In: IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS), pp. 1–8. IEEE (2013) Klontz, J.C., Klare, B.F., Klum, S., Jain, A.K., Burge, M.J.: Open source biometric recognition. In: IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS), pp. 1–8. IEEE (2013)
22.
Zurück zum Zitat Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The extended cohnkanade dataset (ck+): a complete dataset for action unit and emotion specied expression. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 94–101. IEEE (2010) Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The extended cohnkanade dataset (ck+): a complete dataset for action unit and emotion specied expression. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 94–101. IEEE (2010)
23.
Zurück zum Zitat Malhotra, A., Totti, L., Meira, W., Kumaraguru, P., Almeida, V.: Studying user footprints in different online social networks. In: Proceedings of the 2012 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2012, pp. 1065–1070 (2012) Malhotra, A., Totti, L., Meira, W., Kumaraguru, P., Almeida, V.: Studying user footprints in different online social networks. In: Proceedings of the 2012 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2012, pp. 1065–1070 (2012)
24.
Zurück zum Zitat Mavridis, N., Kazmi, W., Toulis, P.: Friends with faces: how social networks can enhance face recognition and vice versa. In: Abraham, A., Hassanien, A.-E., Snáel, V. (eds.) Computational Social Network Analysis. Computer Communications and Networks. Springer, London (2010) Mavridis, N., Kazmi, W., Toulis, P.: Friends with faces: how social networks can enhance face recognition and vice versa. In: Abraham, A., Hassanien, A.-E., Snáel, V. (eds.) Computational Social Network Analysis. Computer Communications and Networks. Springer, London (2010)
26.
Zurück zum Zitat Nefian, A.V., Hayes III, M.H.: Hidden markov models for face recognition. Choice 1, 6 (1998) Nefian, A.V., Hayes III, M.H.: Hidden markov models for face recognition. Choice 1, 6 (1998)
27.
Zurück zum Zitat Ricanek Jr., K., Tesafaye, T.: Morph: A longitudinal image database of normal adult age progression. In: 7th International Conference on Automatic Face and Gesture Recognition, pp. 341–345. IEEE (2006) Ricanek Jr., K., Tesafaye, T.: Morph: A longitudinal image database of normal adult age progression. In: 7th International Conference on Automatic Face and Gesture Recognition, pp. 341–345. IEEE (2006)
28.
Zurück zum Zitat Saragih, J.M., Lucey, S., Cohn, J.F.: Face alignment through subspace constrained mean shifts. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 1034–1041. IEEE (2009) Saragih, J.M., Lucey, S., Cohn, J.F.: Face alignment through subspace constrained mean shifts. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 1034–1041. IEEE (2009)
29.
Zurück zum Zitat Scott, J.: Social Network Analysis. Sage, Thousand Oaks (2012) Scott, J.: Social Network Analysis. Sage, Thousand Oaks (2012)
31.
Zurück zum Zitat Viola, P., Jones, M.J.: Robust real time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)CrossRef Viola, P., Jones, M.J.: Robust real time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)CrossRef
32.
Zurück zum Zitat Walecki, R., Rudovic, O., Pavlovic, V., Pantic, M.: Variable state latent conditional random fields for facial expression recognition and action unit detection. In: 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), 2015, vol. 1, pp. 1–8. IEEE (2015) Walecki, R., Rudovic, O., Pavlovic, V., Pantic, M.: Variable state latent conditional random fields for facial expression recognition and action unit detection. In: 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), 2015, vol. 1, pp. 1–8. IEEE (2015)
Metadaten
Titel
Person Profiling Using Image and Facial Attributes Analyses on Unconstrained Images Retrieved from Online Sources
verfasst von
Elisabeth Wetzinger
Michael Atanasov
Martin Kampel
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-41501-7_7