Skip to main content

2020 | OriginalPaper | Buchkapitel

Algorithm Bias Detection and Mitigation in Lenovo Face Recognition Engine

verfasst von : Sheng Shi, Shanshan Wei, Zhongchao Shi, Yangzhou Du, Wei Fan, Jianping Fan, Yolanda Conyers, Feiyu Xu

Erschienen in: Natural Language Processing and Chinese Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With the advancement of Artificial Intelligence (AI), algorithms brings more fairness challenges in ethical, legal, psychological and social levels. People should start to face these challenges seriously in dealing with AI products and AI solutions. More and more companies start to recognize the importance of Diversity and Inclusion (D&I) due to AI algorithms and take corresponding actions. This paper introduces Lenovo AI’s Vision on D&I, specially, the efforts of mitigating algorithm bias in human face processing technology. Latest evaluation shows that Lenovo face recognition engine achieves better performance of racial fairness over competitors in terms of multiple metrics. In addition, it also presents post-processing strategy of improving fairness according to different considerations and criteria.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
3.
Zurück zum Zitat Muheidat, F., Tawalbeh, L.: Team based learning: the role of equity, diversity, and inclusion in team formation. In: 2018 Research on Equity and Sustained Participation in Engineering, Computing, and Technology (RESPECT), pp. 1–2 (2018) Muheidat, F., Tawalbeh, L.: Team based learning: the role of equity, diversity, and inclusion in team formation. In: 2018 Research on Equity and Sustained Participation in Engineering, Computing, and Technology (RESPECT), pp. 1–2 (2018)
4.
Zurück zum Zitat Hespanhol, L., Davis, H., Fredericks, J., Caldwell, G.A., Hoggenmueller, M.: Digital outreach: designing technologies for diversity, participation and social inclusion, pp. 648–650, November 2017 Hespanhol, L., Davis, H., Fredericks, J., Caldwell, G.A., Hoggenmueller, M.: Digital outreach: designing technologies for diversity, participation and social inclusion, pp. 648–650, November 2017
5.
Zurück zum Zitat Siau, K.: How can AI help to enhance diversity and inclusion? In: 25th Americas Conference on Information Systems, AMCIS, August 2019 Siau, K.: How can AI help to enhance diversity and inclusion? In: 25th Americas Conference on Information Systems, AMCIS, August 2019
6.
Zurück zum Zitat Narayanan, A.: Translation tutorial: 21 fairness definitions and their politics. In: Conference on Fairness, Accountability, and Transparency (2018) Narayanan, A.: Translation tutorial: 21 fairness definitions and their politics. In: Conference on Fairness, Accountability, and Transparency (2018)
7.
Zurück zum Zitat Kleinberg, J.M., Mullainathan, S., Raghavan, M.: Inherent trade-offs in the fair determination of risk scores. CoRR, abs/1609.05807 (2016) Kleinberg, J.M., Mullainathan, S., Raghavan, M.: Inherent trade-offs in the fair determination of risk scores. CoRR, abs/1609.05807 (2016)
8.
Zurück zum Zitat Friedler, S.A., Scheidegger, C., Venkatasubramanian, S., Choudhary, S., Hamilton, E.P., Roth, D.: A comparative study of fairness-enhancing interventions in machine learning. In: Proceedings of the Conference on Fairness, Accountability, and Transparency (2019) Friedler, S.A., Scheidegger, C., Venkatasubramanian, S., Choudhary, S., Hamilton, E.P., Roth, D.: A comparative study of fairness-enhancing interventions in machine learning. In: Proceedings of the Conference on Fairness, Accountability, and Transparency (2019)
11.
Zurück zum Zitat Bantilan, N.: Themis-ml: a fairness-aware machine learning interface for end-to-end discrimination discovery and mitigation. CoRR, abs/1710.06921 (2017) Bantilan, N.: Themis-ml: a fairness-aware machine learning interface for end-to-end discrimination discovery and mitigation. CoRR, abs/1710.06921 (2017)
14.
Zurück zum Zitat Speicher, T., et al.: A unified approach to quantifying algorithmic unfairness: measuring individual & group unfairness via inequality indices. CoRR, abs/1807.00787 (2018) Speicher, T., et al.: A unified approach to quantifying algorithmic unfairness: measuring individual & group unfairness via inequality indices. CoRR, abs/1807.00787 (2018)
16.
Zurück zum Zitat Alessandro, B., ONeil, C., Laatta, T.: Conscientious classification: a data scientists guide to discrimination-aware classification. Big Data 5, 120–134 (2017)CrossRef Alessandro, B., ONeil, C., Laatta, T.: Conscientious classification: a data scientists guide to discrimination-aware classification. Big Data 5, 120–134 (2017)CrossRef
17.
Zurück zum Zitat Kamiran, F., Calders, T.: Data preprocessing techniques for classification without discrimination. Knowl. Inf. Syst. 33(1), 1–33 (2011)CrossRef Kamiran, F., Calders, T.: Data preprocessing techniques for classification without discrimination. Knowl. Inf. Syst. 33(1), 1–33 (2011)CrossRef
18.
Zurück zum Zitat Calmon, F., Wei, D., Vinzamuri, B., Ramamurthy, K.N., Varshney, K.R.: Optimized pre-processing for discrimination prevention. In: Guyon, I., et al. (eds.) Advances in Neural Information Processing Systems, vol. 30, pp. 3992–4001. Curran Associates Inc. (2017) Calmon, F., Wei, D., Vinzamuri, B., Ramamurthy, K.N., Varshney, K.R.: Optimized pre-processing for discrimination prevention. In: Guyon, I., et al. (eds.) Advances in Neural Information Processing Systems, vol. 30, pp. 3992–4001. Curran Associates Inc. (2017)
19.
Zurück zum Zitat Feldman, M., Friedler, S.A., Moeller, J., Scheidegger, C., Venkatasubramanian, S.: Certifying and removing disparate impact. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Association for Computing Machinery, New York (2015) Feldman, M., Friedler, S.A., Moeller, J., Scheidegger, C., Venkatasubramanian, S.: Certifying and removing disparate impact. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Association for Computing Machinery, New York (2015)
20.
Zurück zum Zitat Zhang, B.H., Lemoine, B., Mitchell, M.: Mitigating unwanted biases with adversarial learning. CoRR, abs/1801.07593 (2018) Zhang, B.H., Lemoine, B., Mitchell, M.: Mitigating unwanted biases with adversarial learning. CoRR, abs/1801.07593 (2018)
22.
Zurück zum Zitat Hardt, M., Price, E., Srebro, N.: Equality of opportunity in supervised learning. CoRR, abs/1610.02413 (2016) Hardt, M., Price, E., Srebro, N.: Equality of opportunity in supervised learning. CoRR, abs/1610.02413 (2016)
23.
Zurück zum Zitat Pleiss, G., Raghavan, M., Wu, F., Kleinberg, J., Weinberger, K.Q.: On fairness and calibration. In: Guyon, I., et al. (eds.) Advances in Neural Information Processing Systems, vol. 30, pp. 5680–5689. Curran Associates Inc. (2017) Pleiss, G., Raghavan, M., Wu, F., Kleinberg, J., Weinberger, K.Q.: On fairness and calibration. In: Guyon, I., et al. (eds.) Advances in Neural Information Processing Systems, vol. 30, pp. 5680–5689. Curran Associates Inc. (2017)
24.
Zurück zum Zitat Kamiran, F., Karim, A., Zhang, X.: Decision theory for discrimination-aware classification. In: 2012 IEEE 12th International Conference on Data Mining, pp. 924–929 (2012) Kamiran, F., Karim, A., Zhang, X.: Decision theory for discrimination-aware classification. In: 2012 IEEE 12th International Conference on Data Mining, pp. 924–929 (2012)
25.
Zurück zum Zitat Wang, M., Deng, W., Hu, J., Tao, X., Huang, Y.: Racial faces in the wild: Reducing racial bias by information maximization adaptation network. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 692–702 (2019) Wang, M., Deng, W., Hu, J., Tao, X., Huang, Y.: Racial faces in the wild: Reducing racial bias by information maximization adaptation network. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 692–702 (2019)
Metadaten
Titel
Algorithm Bias Detection and Mitigation in Lenovo Face Recognition Engine
verfasst von
Sheng Shi
Shanshan Wei
Zhongchao Shi
Yangzhou Du
Wei Fan
Jianping Fan
Yolanda Conyers
Feiyu Xu
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-60457-8_36

Premium Partner