Skip to main content

2016 | OriginalPaper | Buchkapitel

Faceless Person Recognition: Privacy Implications in Social Media

verfasst von : Seong Joon Oh, Rodrigo Benenson, Mario Fritz, Bernt Schiele

Erschienen in: Computer Vision – ECCV 2016

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

As we shift more of our lives into the virtual domain, the volume of data shared on the web keeps increasing and presents a threat to our privacy. This works contributes to the understanding of privacy implications of such data sharing by analysing how well people are recognisable in social media data. To facilitate a systematic study we define a number of scenarios considering factors such as how many heads of a person are tagged and if those heads are obfuscated or not. We propose a robust person recognition system that can handle large variations in pose and clothing, and can be trained with few training samples. Our results indicate that a handful of images is enough to threaten users’ privacy, even in the presence of obfuscation. We show detailed experimental results, and discuss their implications.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Narayanan, A., Shmatikov, V.: Myths and fallacies of personally identifiable information. Commun. ACM 53(6), 24–26 (2010)CrossRef Narayanan, A., Shmatikov, V.: Myths and fallacies of personally identifiable information. Commun. ACM 53(6), 24–26 (2010)CrossRef
2.
Zurück zum Zitat Narayanan, A., Shmatikov, V.: De-anonymizing social networks. In: IEEE Symposium on Security and Privacy (2009) Narayanan, A., Shmatikov, V.: De-anonymizing social networks. In: IEEE Symposium on Security and Privacy (2009)
3.
Zurück zum Zitat Zheleva, E., Getoor, L.: To join or not to join: the illusion of privacy in social networks with mixed public and private user profiles. In: International Conference on World Wide Web (2009) Zheleva, E., Getoor, L.: To join or not to join: the illusion of privacy in social networks with mixed public and private user profiles. In: International Conference on World Wide Web (2009)
4.
Zurück zum Zitat Mislove, A., Viswanath, B., Gummadi, K.P., Druschel, P.: You are who you know: inferring user profiles in online social networks. In: International Conference on Web Search and Data Mining (2010) Mislove, A., Viswanath, B., Gummadi, K.P., Druschel, P.: You are who you know: inferring user profiles in online social networks. In: International Conference on Web Search and Data Mining (2010)
5.
Zurück zum Zitat Ahern, S., Eckles, D., Good, N.S., King, S., Naaman, M., Nair, R.: Over-exposed? Privacy patterns and considerations in online and mobile photo sharing. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2007) Ahern, S., Eckles, D., Good, N.S., King, S., Naaman, M., Nair, R.: Over-exposed? Privacy patterns and considerations in online and mobile photo sharing. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2007)
6.
Zurück zum Zitat Besmer, A., Richter Lipford, H.: Moving beyond untagging: photo privacy in a tagged world. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1563–1572. ACM (2010) Besmer, A., Richter Lipford, H.: Moving beyond untagging: photo privacy in a tagged world. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1563–1572. ACM (2010)
7.
Zurück zum Zitat Kee, E., Johnson, M.K., Farid, H.: Digital image authentication from JPEG headers. Trans. Inf. Forensics Secur. 6(3), 1066–1075 (2011)CrossRef Kee, E., Johnson, M.K., Farid, H.: Digital image authentication from JPEG headers. Trans. Inf. Forensics Secur. 6(3), 1066–1075 (2011)CrossRef
8.
Zurück zum Zitat Dirik, A.E., Sencar, H.T., Memon, N.: Digital single lens reflex camera identification from traces of sensor dust. Trans. Inf. Forensics Secur. 3, 539–552 (2008)CrossRef Dirik, A.E., Sencar, H.T., Memon, N.: Digital single lens reflex camera identification from traces of sensor dust. Trans. Inf. Forensics Secur. 3, 539–552 (2008)CrossRef
9.
Zurück zum Zitat Chen, M., Fridrich, J., Goljan, M., Lukáš, J.: Determining image origin and integrity using sensor noise. Trans. Inf. Forensics Secur. 3, 74–90 (2008)CrossRef Chen, M., Fridrich, J., Goljan, M., Lukáš, J.: Determining image origin and integrity using sensor noise. Trans. Inf. Forensics Secur. 3, 74–90 (2008)CrossRef
10.
Zurück zum Zitat Huang, G.B., Ramesh, M., Berg, T., Learned-Miller, E.: Labeled faces in the wild: a database for studying face recognition in unconstrained environments. Technical report, UMass (2007) Huang, G.B., Ramesh, M., Berg, T., Learned-Miller, E.: Labeled faces in the wild: a database for studying face recognition in unconstrained environments. Technical report, UMass (2007)
11.
Zurück zum Zitat Benfold, B., Reid, I.: Guiding visual surveillance by tracking human attention. In: BMVC (2009) Benfold, B., Reid, I.: Guiding visual surveillance by tracking human attention. In: BMVC (2009)
12.
Zurück zum Zitat Bedagkar-Gala, A., Shah, S.K.: A survey of approaches and trends in person re-identification. Image Vis. Comput. 32, 270–286 (2014)CrossRef Bedagkar-Gala, A., Shah, S.K.: A survey of approaches and trends in person re-identification. Image Vis. Comput. 32, 270–286 (2014)CrossRef
13.
Zurück zum Zitat Guillaumin, M., Verbeek, J., Schmid, C.: Is that you? Metric learning approaches for face identification. In: ICCV (2009) Guillaumin, M., Verbeek, J., Schmid, C.: Is that you? Metric learning approaches for face identification. In: ICCV (2009)
14.
Zurück zum Zitat Chen, D., Cao, X., Wen, F., Sun, J.: Blessing of dimensionality: high-dimensional feature and its efficient compression for face verification. In: CVPR (2013) Chen, D., Cao, X., Wen, F., Sun, J.: Blessing of dimensionality: high-dimensional feature and its efficient compression for face verification. In: CVPR (2013)
15.
Zurück zum Zitat Cao, X., Wipf, D., Wen, F., Duan, G.: A practical transfer learning algorithm for face verification. In: ICCV (2013) Cao, X., Wipf, D., Wen, F., Duan, G.: A practical transfer learning algorithm for face verification. In: ICCV (2013)
16.
Zurück zum Zitat Lu, C., Tang, X.: Surpassing human-level face verification performance on lfw with gaussianface. arXiv (2014) Lu, C., Tang, X.: Surpassing human-level face verification performance on lfw with gaussianface. arXiv (2014)
17.
Zurück zum Zitat Li, W., Wang, X.: Locally aligned feature transforms across views. In: CVPR (2013) Li, W., Wang, X.: Locally aligned feature transforms across views. In: CVPR (2013)
18.
Zurück zum Zitat Zhao, R., Ouyang, W., Wang, X.: Person re-identification by salience matching. In: ICCV (2013) Zhao, R., Ouyang, W., Wang, X.: Person re-identification by salience matching. In: ICCV (2013)
19.
Zurück zum Zitat Bak, S., Kumar, R., Bremond, F.: Brownian descriptor: a rich meta-feature for appearance matching. In: WACV (2014) Bak, S., Kumar, R., Bremond, F.: Brownian descriptor: a rich meta-feature for appearance matching. In: WACV (2014)
20.
Zurück zum Zitat Taigman, Y., Yang, M., Ranzato, M., Wolf, L.: Deepface: closing the gap to human-level performance in face verification. In: CVPR (2014) Taigman, Y., Yang, M., Ranzato, M., Wolf, L.: Deepface: closing the gap to human-level performance in face verification. In: CVPR (2014)
21.
Zurück zum Zitat Li, W., Zhao, R., Xiao, T., Wang, X.: DeepReID: deep filter pairing neural network for person re-identification. In: CVPR (2014) Li, W., Zhao, R., Xiao, T., Wang, X.: DeepReID: deep filter pairing neural network for person re-identification. In: CVPR (2014)
22.
Zurück zum Zitat Yi, D., Lei, Z., Li, S.Z.: Deep metric learning for practical person re-identification. In: ICPR (2014) Yi, D., Lei, Z., Li, S.Z.: Deep metric learning for practical person re-identification. In: ICPR (2014)
23.
Zurück zum Zitat Hu, Y., Yi, D., Liao, S., Lei, Z., Li, S.Z.: Cross dataset person re-identification. In: Shan, S., Jawahar, C.V., Jawahar, C.V. (eds.) ACCV 2014 Workshops. LNCS, vol. 9010, pp. 650–664. Springer, Heidelberg (2015) Hu, Y., Yi, D., Liao, S., Lei, Z., Li, S.Z.: Cross dataset person re-identification. In: Shan, S., Jawahar, C.V., Jawahar, C.V. (eds.) ACCV 2014 Workshops. LNCS, vol. 9010, pp. 650–664. Springer, Heidelberg (2015)
24.
Zurück zum Zitat Zhou, E., Cao, Z., Yin, Q.: Naive-deep face recognition: touching the limit of lfw benchmark or not? arXiv (2015) Zhou, E., Cao, Z., Yin, Q.: Naive-deep face recognition: touching the limit of lfw benchmark or not? arXiv (2015)
25.
Zurück zum Zitat Parkhi, O.M., Vedaldi, A., Zisserman, A.: Deep face recognition. BMVC 1(3), 6 (2015) Parkhi, O.M., Vedaldi, A., Zisserman, A.: Deep face recognition. BMVC 1(3), 6 (2015)
26.
Zurück zum Zitat Schroff, F., Kalenichenko, D., Philbin, J.: Facenet: a unified embedding for face recognition and clustering. In: CVPR (2015) Schroff, F., Kalenichenko, D., Philbin, J.: Facenet: a unified embedding for face recognition and clustering. In: CVPR (2015)
27.
Zurück zum Zitat Sun, Y., Wang, X., Tang, X.: Deeply learned face representations are sparse, selective, and robust. In: CVPR (2015) Sun, Y., Wang, X., Tang, X.: Deeply learned face representations are sparse, selective, and robust. In: CVPR (2015)
28.
Zurück zum Zitat Gallagher, A., Chen, T.: Clothing cosegmentation for recognizing people. In: CVPR (2008) Gallagher, A., Chen, T.: Clothing cosegmentation for recognizing people. In: CVPR (2008)
29.
Zurück zum Zitat Zhang, N., Paluri, M., Taigman, Y., Fergus, R., Bourdev, L.: Beyond frontal faces: improving person recognition using multiple cues. In: CVPR (2015) Zhang, N., Paluri, M., Taigman, Y., Fergus, R., Bourdev, L.: Beyond frontal faces: improving person recognition using multiple cues. In: CVPR (2015)
30.
Zurück zum Zitat Oh, S.J., Benenson, R., Fritz, M., Schiele, B.: Person recognition in personal photo collections. In: ICCV (2015) Oh, S.J., Benenson, R., Fritz, M., Schiele, B.: Person recognition in personal photo collections. In: ICCV (2015)
31.
Zurück zum Zitat Gong, S., Cristani, M., Yan, S., Loy, C.C. (eds.): Person Re-identification. Springer, Heidelberg (2014) Gong, S., Cristani, M., Yan, S., Loy, C.C. (eds.): Person Re-identification. Springer, Heidelberg (2014)
32.
Zurück zum Zitat Wu, L., Shen, C., van den Hengel, A.: Personnet: person re-identification with deep convolutional neural networks. In: arXiv (2016) Wu, L., Shen, C., van den Hengel, A.: Personnet: person re-identification with deep convolutional neural networks. In: arXiv (2016)
33.
Zurück zum Zitat Cui, J., Wen, F., Xiao, R., Tian, Y., Tang, X.: Easyalbum: an interactive photo annotation system based on face clustering and re-ranking. In: SIGCHI (2007) Cui, J., Wen, F., Xiao, R., Tian, Y., Tang, X.: Easyalbum: an interactive photo annotation system based on face clustering and re-ranking. In: SIGCHI (2007)
34.
Zurück zum Zitat Mathialagan, C.S., Gallagher, A.C., Batra, D.: VIP: finding important people in images. In: CVPR (2015) Mathialagan, C.S., Gallagher, A.C., Batra, D.: VIP: finding important people in images. In: CVPR (2015)
35.
Zurück zum Zitat Everingham, M., Sivic, J., Zisserman, A.: Hello! My name is... buffy-automatic naming of characters in TV video. In: BMVC (2006) Everingham, M., Sivic, J., Zisserman, A.: Hello! My name is... buffy-automatic naming of characters in TV video. In: BMVC (2006)
36.
Zurück zum Zitat Everingham, M., Sivic, J., Zisserman, A.: Taking the bite out of automated naming of characters in TV video. IVC 27, 545–559 (2009)CrossRef Everingham, M., Sivic, J., Zisserman, A.: Taking the bite out of automated naming of characters in TV video. IVC 27, 545–559 (2009)CrossRef
37.
Zurück zum Zitat Ding, C., Tao, D.: A comprehensive survey on pose-invariant face recognition. In: arXiv (2015) Ding, C., Tao, D.: A comprehensive survey on pose-invariant face recognition. In: arXiv (2015)
38.
Zurück zum Zitat Cheng, D.S., Cristani, M., Stoppa, M., Bazzani, L., Murino, V.: Custom pictorial structures for re-identification. In: BMVC (2011) Cheng, D.S., Cristani, M., Stoppa, M., Bazzani, L., Murino, V.: Custom pictorial structures for re-identification. In: BMVC (2011)
39.
Zurück zum Zitat Gandhi, V., Ronfard, R.: Detecting and naming actors in movies using generative appearance models. In: CVPR (2013) Gandhi, V., Ronfard, R.: Detecting and naming actors in movies using generative appearance models. In: CVPR (2013)
40.
Zurück zum Zitat Kumar, N., Berg, A.C., Belhumeur, P.N., Nayar, S.K.: Attribute and simile classifiers for face verification. In: CVPR (2009) Kumar, N., Berg, A.C., Belhumeur, P.N., Nayar, S.K.: Attribute and simile classifiers for face verification. In: CVPR (2009)
41.
Zurück zum Zitat Layne, R., Hospedales, T.M., Gong, S., Mary, Q.: Person re-identification by attributes. In: BMVC (2012) Layne, R., Hospedales, T.M., Gong, S., Mary, Q.: Person re-identification by attributes. In: BMVC (2012)
42.
Zurück zum Zitat Gallagher, A.C., Chen, T.: Using group prior to identify people in consumer images. In: CVPR (2007) Gallagher, A.C., Chen, T.: Using group prior to identify people in consumer images. In: CVPR (2007)
43.
Zurück zum Zitat Stone, Z., Zickler, T., Darrell, T.: Autotagging facebook: social network context improves photo annotation. In: CVPR Workshops (2008) Stone, Z., Zickler, T., Darrell, T.: Autotagging facebook: social network context improves photo annotation. In: CVPR Workshops (2008)
44.
Zurück zum Zitat Garg, R., Seitz, S.M., Ramanan, D., Snavely, N.: Where’s waldo: matching people in images of crowds. In: CVPR (2011) Garg, R., Seitz, S.M., Ramanan, D., Snavely, N.: Where’s waldo: matching people in images of crowds. In: CVPR (2011)
45.
Zurück zum Zitat Lin, D., Kapoor, A., Hua, G., Baker, S.: Joint people, event, and location recognition in personal photo collections using cross-domain context. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part I. LNCS, vol. 6311, pp. 243–256. Springer, Heidelberg (2010)CrossRef Lin, D., Kapoor, A., Hua, G., Baker, S.: Joint people, event, and location recognition in personal photo collections using cross-domain context. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part I. LNCS, vol. 6311, pp. 243–256. Springer, Heidelberg (2010)CrossRef
46.
Zurück zum Zitat Shi, J., Liao, R., Jia, J.: Codel: a human co-detection and labeling framework. In: ICCV (2013) Shi, J., Liao, R., Jia, J.: Codel: a human co-detection and labeling framework. In: ICCV (2013)
47.
Zurück zum Zitat Wilber, M.J., Shmatikov, V., Belongie, S.J.: Can we still avoid automatic face detection? arXiv (2016) Wilber, M.J., Shmatikov, V., Belongie, S.J.: Can we still avoid automatic face detection? arXiv (2016)
48.
Zurück zum Zitat Gopalan, R., Taheri, S., Turaga, P., Chellappa, R.: A blur-robust descriptor with applications to face recognition. PAMI 34, 1220–1226 (2012)CrossRef Gopalan, R., Taheri, S., Turaga, P., Chellappa, R.: A blur-robust descriptor with applications to face recognition. PAMI 34, 1220–1226 (2012)CrossRef
49.
Zurück zum Zitat Punnappurath, A., Rajagopalan, A.N., Taheri, S., Chellappa, R., Seetharaman, G.: Face recognition across non-uniform motion blur, illumination, and pose. IEEE Trans. Image Process. 24, 2067–2082 (2015)MathSciNetCrossRef Punnappurath, A., Rajagopalan, A.N., Taheri, S., Chellappa, R., Seetharaman, G.: Face recognition across non-uniform motion blur, illumination, and pose. IEEE Trans. Image Process. 24, 2067–2082 (2015)MathSciNetCrossRef
50.
Zurück zum Zitat Vu, T., Osokin, A., Laptev, I.: Context-aware CNNs for person head detection. In: International Conference on Computer Vision (ICCV) (2015) Vu, T., Osokin, A., Laptev, I.: Context-aware CNNs for person head detection. In: International Conference on Computer Vision (ICCV) (2015)
51.
Zurück zum Zitat Hayder, Z., He, X., Salzmann, M.: Structural kernel learning for large scale multiclass object co-detection. In: 2015 IEEE International Conference on Computer Vision (ICCV), pp. 2632–2640. IEEE (2015) Hayder, Z., He, X., Salzmann, M.: Structural kernel learning for large scale multiclass object co-detection. In: 2015 IEEE International Conference on Computer Vision (ICCV), pp. 2632–2640. IEEE (2015)
52.
Zurück zum Zitat Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: NIPS (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: NIPS (2012)
53.
Zurück zum Zitat Müller, A.C., Behnke, S.: PyStruct – learning structured prediction in python. J. Mach. Learn. Res. 15, 2055–2060 (2014)MathSciNetMATH Müller, A.C., Behnke, S.: PyStruct – learning structured prediction in python. J. Mach. Learn. Res. 15, 2055–2060 (2014)MathSciNetMATH
Metadaten
Titel
Faceless Person Recognition: Privacy Implications in Social Media
verfasst von
Seong Joon Oh
Rodrigo Benenson
Mario Fritz
Bernt Schiele
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-46487-9_2