Morgan Klaus Scheuerman
Jacob M. Paul
Jed R. Brubaker
Skip Abstract Section
Abstract
Investigations of facial analysis (FA) technologies-such as facial detection and facial recognition-have been central to discussions about Artificial Intelligence's (AI) impact on human beings. Research on automatic gender recognition, the classification of gender by FA technologies, has raised potential concerns around issues of racial and gender bias. In this study, we augment past work with empirical data by conducting a systematic analysis of how gender classification and gender labeling in computer vision services operate when faced with gender diversity. We sought to understand how gender is concretely conceptualized and encoded into commercial facial analysis and image labeling technologies available today. We then conducted a two-phase study: (1) a system analysis of ten commercial FA and image labeling services and (2) an evaluation of five services using a custom dataset of diverse genders using self-labeled Instagram images. Our analysis highlights how gender is codified into both classifiers and data standards. We found that FA services performed consistently worse on transgender individuals and were universally unable to classify non-binary genders. In contrast, image labeling often presented multiple gendered concepts. We also found that user perceptions about gender performance and identity contradict the way gender performance is encoded into the computer vision infrastructure. We discuss our findings from three perspectives of gender identity (self-identity, gender performativity, and demographic identity) and how these perspectives interact across three layers: the classification infrastructure, the third-party applications that make use of that infrastructure, and the individuals who interact with that software. We employ Bowker and Star's concepts of "torque" and "residuality" to further discuss the social implications of gender classification. We conclude by outlining opportunities for creating more inclusive classification infrastructures and datasets, as well as with implications for policy.
- 2019. Amazon Rekognition -- Video and Image - AWS. https://aws.amazon.com/rekognition/Google Scholar
- 2019. Clarifai. https://clarifai.com/Google Scholar
- 2019. Face API - Facial Recognition Software | Microsoft Azure. https://azure.microsoft.com/en-us/services/ cognitive-services/face/Google Scholar
- 2019. Face++ Cognitive Services - Leading Facial Recognition Technology. https://www.faceplusplus.com/Google Scholar
- 2019. Vision API - Image Content Analysis | Cloud Vision API | Google Cloud. https://cloud.google.com/vision/Google Scholar
- 2019. Watson Visual Recognition. https://www.ibm.com/watson/services/visual-recognition/Google Scholar
- Yaman Akbulut, Abdulkadir Sengur, and Sami Ekici. 2017. Gender recognition from face images with deep learning. In 2017 International Artificial Intelligence and Data Processing Symposium (IDAP). IEEE, 1--4. https://doi.org/10.1109/ idap.2017.8090181Google ScholarCross Ref
- Tawfiq Ammari, Sarita Schoenebeck, and Silvia Lindtner. 2017. The Crafting of DIY Fatherhood. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing - CSCW '17. ACM Press, New York, New York, USA, 1109--1122. https://doi.org/10.1145/2998181.2998270Google ScholarDigital Library
- Ankan Bansal, Anirudh Nanduri, Carlos D. Castillo, Rajeev Ranjan, and Rama Chellappa. 2018. UMDFaces: An annotated face dataset for training deep networks. In IEEE International Joint Conference on Biometrics, IJCB 2017, Vol. 2018-Janua. IEEE, 464--473. https://doi.org/10.1109/BTAS.2017.8272731Google Scholar
- Shaowen Bardzell. 2010. Feminist HCI: taking stock and outlining an agenda for design. In Proceedings of the 28th international conference on Human factors in computing systems - CHI '10. ACM Press, New York, New York, USA, 1301. https://doi.org/10.1145/1753326.1753521Google ScholarDigital Library
- Kyla Bender-Baird. 2015. Peeing under surveillance: bathrooms, gender policing, and hate violence. Gender, Place & Culture 23, 7 (jul 2015), 983--988. https://doi.org/10.1080/0966369x.2015.1073699Google Scholar
- Sebastian Benthall and Bruce D. Haynes. 2019. Racial categories in machine learning. In Proceedings of the Conference on Fairness, Accountability, and Transparency - FAT* '19. ACM Press, New York, New York, USA, 289--298. https: //doi.org/10.1145/3287560.3287575 arXiv:1811.11668Google ScholarDigital Library
- Talia Mae Bettcher. 2007. Evil Deceivers and Make-Believers: On Transphobic Violence and the Politics of Illusion. Hypatia 22, 3 (aug 2007), 43--65. https://doi.org/10.1111/j.1527--2001.2007.tb01090.xGoogle Scholar
- Rena Bivens. 2014. The Gender Binary Will Not Be Deprogrammed: Facebook's Antagonistic Relationship to Gender. SSRN Electronic Journal (dec 2014). https://doi.org/10.2139/ssrn.2431443Google Scholar
- Rena Bivens and Oliver L. Haimson. 2016. Baking Gender Into Social Media Design: How Platforms Shape Categories for Users and Advertisers. Social Media + Society 2, 4 (nov 2016), 1--12. https://doi.org/10.1177/2056305116672486Google Scholar
- Lindsay Blackwell, Jill Dimond, Sarita Schoenebeck, and Cliff Lampe. 2017. Classification and Its Consequences for Online Harassment: Design Insights from HeartMob ACM Reference format. Proc. ACM Hum.-Comput. Interact. Proc. ACM Hum.-Comput. Interact. Article Proc. ACM Hum.-Comput. Interact 1, 2 (2017), 1--19. https://doi.org/10.1145/ 3134659Google ScholarDigital Library
- Brad Smith. 2018. Facial recognition: It's time for action. https://blogs.microsoft.com/on-the-issues/2018/12/06/ facial-recognition-its-time-for-action/Google Scholar
- Jed R. Brubaker and Gillian R. Hayes. 2011. SELECT * FROM USER: infrastructure and socio-technical representation. In Proceedings of the ACM 2011 conference on Computer supported cooperative work - CSCW '11. ACM Press, New York, New York, USA, 369. https://doi.org/10.1145/1958824.1958881Google Scholar
- Joy Buolamwini and Timnit Gebru. 2018. Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification *. Technical Report. 1--15 pages. http://proceedings.mlr.press/v81/buolamwini18a/buolamwini18a.pdfGoogle Scholar
- Robin Burke, Nasim Sonboli, and Aldo Ordonez-Gauger. 2018. Balanced Neighborhoods for Multi-sided Fairness in Recommendation. , 202--214 pages. http://proceedings.mlr.press/v81/burke18a.htmlGoogle Scholar
- Judith Butler. 1988. Performative Acts and Gender Constitution: An Essay in Phenomenology and Feminist Theory. Theatre Journal 40, 4 (dec 1988), 519. https://doi.org/10.2307/3207893Google ScholarCross Ref
- Ting Chen, Wei Li Han, Hai Dong Wang, Yi Xun Zhou, Bin Xu, and Bin Yu Zang. 2007. Content recommendation system based on private dynamic user profile. In Proceedings of the Sixth International Conference on Machine Learning and Cybernetics, ICMLC 2007, Vol. 4. IEEE, 2112--2118. https://doi.org/10.1109/ICMLC.2007.4370493Google ScholarCross Ref
- John Cheney-Lippold. 2011. A New Algorithmic Identity: Soft Biopolitics and the Modulation of Control. Theory, Culture & Society 28, 6 (nov 2011), 164--181. https://doi.org/10.1177/0263276411424420Google Scholar
- Sam Corbett-Davies and Sharad Goel. 2018. The Measure and Mismeasure of Fairness: A Critical Review of Fair Machine Learning. (jul 2018). https://doi.org/10.1063/1.3627170 arXiv:1808.00023Google Scholar
- Critical Art Ensemble. 1998. Flesh Machine. http://critical-art.net/flesh-machine-1997--98/Google Scholar
- Paisley Currah and Tara Mulqueen. 2011. Securitizing Gender: Identity, Biometrics, and Transgender Bodies at the Airport. Social Research 78, 2 (2011), 557--582. https://doi.org/10.1353/sor.2011.0030Google ScholarCross Ref
- Ya E. Dai, Hong Wu Ye, and Song Jie Gong. 2009. Personalized recommendation algorithm using user demography information. In Proceedings - 2009 2nd International Workshop on Knowledge Discovery and Data Mining, WKKD 2009. IEEE, 100--103. https://doi.org/10.1109/WKDD.2009.156Google ScholarDigital Library
- Avery Dame. 2016. Making a name for yourself: tagging as transgender ontological practice on Tumblr. Critical Studies in Media Communication 33, 1 (jan 2016), 23--37. https://doi.org/10.1080/15295036.2015.1130846Google ScholarCross Ref
- Scott Dance. 2019. Maryland set to add 'X' gender designation to driver's licenses under bill by General Assembly. https://www.baltimoresun.com/news/maryland/politics/bs-md-drivers-licenses-20190313-story.htmlGoogle Scholar
- Heath Fogg Davis. 2017. Beyond Trans: Does Gender Matter? https://books.google.com/books?id= uHA4DQAAQBAJ{&}source=gbs{_}navlinks{_}sGoogle ScholarCross Ref
- Zak Doffman. 2019. Is Microsoft AI Helping To Deliver China's 'Shameful' Xinjiang Surveillance State? https://www.forbes.com/sites/zakdoffman/2019/03/15/ microsoft-denies-new-links-to-chinas-surveillance-state-but-its-complicated/{#}4cb624f73061Google Scholar
- Grant Duwe and Ki Deuk Kim. 2017. Out With the Old and in With the New? An Empirical Comparison of Supervised Learning Algorithms to Predict Recidivism. Criminal Justice Policy Review 28, 6 (jul 2017), 570--600. https://doi.org/10.1177/0887403415604899Google ScholarCross Ref
- Brianna Dym, Jed Brubaker, and Casey Fielser. 2018. "they're all trans sharon": Authoring Gender in Video Game Fan Fiction. Game Studies 3, 18 (2018). http://gamestudies.org/1803/articles/brubaker{_}dym{_}fieslerhttp://gamestudies. org/1701/articles/andersonGoogle Scholar
- W. Keith Edwards, MarkW. Newman, and Erika Shehan Poole. 2010. The infrastructure problem in HCI. In Proceedings of the 28th international conference on Human factors in computing systems - CHI '10. ACM Press, New York, New York, USA, 423. https://doi.org/10.1145/1753326.1753390Google ScholarDigital Library
- Elise Schmelzer. 2018. Colorado to allow use of X as sex identifier on driver's licenses starting this month.Google Scholar
- Erik Carter. 2019. Facial recognition's 'dirty little secret': Millions of online photos scraped without consent. https:// www.nbcnews.com/tech/internet/facial-recognition-s-dirty-little-secret-millions-online-photos-scraped-n981921Google Scholar
- Erik H. (Erik Homburger) Erikson and Joan M. (Joan Mowat) Erikson. 1982. The life cycle completed. (1982), 134. https://www.worldcat.org/title/life-cycle-completed/oclc/916049006Google Scholar
- Melanie Feinberg, Daniel Carter, and Julia Bullard. 2014. A Story Without End : Writing the Residual into Descriptive Infrastructure. DIS '14 Proceedings of the Designing Interactive Systems Conference (2014), 385--394. https://doi.org/10. 1145/2598510.2598553Google ScholarDigital Library
- Casey Fiesler and Nicholas Proferes. 2018. "Participant" Perceptions of Twitter Research Ethics. Social Media and Society 4, 1 (jan 2018), 205630511876336. https://doi.org/10.1177/2056305118763366Google Scholar
- Brian Joseph Gilley. 2016. Imagining Transgender: An Ethnography of a Category. David Valentine. In Journal of Anthropological Research. Vol. 65. Duke University Press, Chapter Imagining, 516--517. https://doi.org/10.1086/jar.65. 3.25608249Google Scholar
- Erving. Goffman. 1956. The Presentation of Self in Everyday Life. The Production of Reality: Essays and Readings on Social Interaction (1956), 262. https://books.google.com/books/about/ The{_}Presentation{_}of{_}Self{_}in{_}Everyday{_}Lif.html?id=Sdt-cDkV8pQCGoogle Scholar
- Patrick Grother, Mei Ngan, Kayee Hanaoka, and Wilbur L Ross. 2018. Ongoing Face Recognition Vendor Test (FRVT) Part 2: Identification. NIST Interagency/Internal Report (NISTIR) (nov 2018). https://doi.org/10.6028/NIST.IR.8238Google ScholarCross Ref
- Oliver L. Haimson, Jed R. Brubaker, Lynn Dombrowski, and Gillian R. Hayes. 2015. Disclosure, Stress, and Support During Gender Transition on Facebook. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15). ACM Press, New York, New York, USA, 1176--1190. https://doi.org/10.1145/ 2675133.2675152Google ScholarDigital Library
- Oliver L. Haimson and Anna Lauren Hoffmann. 2016. Constructing and enforcing "authentic" identity online: Facebook, real names, and non-normative identities. First Monday 21, 6 (jun 2016). https://doi.org/10.5210/fm.v21i6.6791Google ScholarCross Ref
- Jack Halberstam. 1998. Female Masculinity. https://books.google.com/books/about/Female{_}Masculinity.html?id= 5BqOswEACAAJ{&}source=kp{_}book{_}descriptionGoogle Scholar
- Foad Hamidi, Morgan Klaus Scheuerman, and Stacy M Branham. 2018. Gender Recognition or Gender Reductionism? The Social Implications of Automatic Gender Recognition Systems. In 2018 CHI Conference on Human Factors in Computing Systems (CHI '18).Google ScholarDigital Library
- D. Fox Harrell. 2009. Computational and cognitive infrastructures of stigma. In Proceeding of the seventh ACM conference on Creativity and cognition - C&C '09. ACM Press, New York, New York, USA, 49. https://doi.org/10.1145/ 1640233.1640244Google Scholar
- Jody L Herman. 2013. Gendered restrooms and minority stress: The public regulation of gender and its impact on transgender people's lives. Journal of Public Management and Social Policy (2013), 65--80. https://williamsinstitute. law.ucla.edu/wp-content/uploads/Herman-Gendered-Restrooms-and-Minority-Stress-June-2013.pdfGoogle Scholar
- Marie Hicks. 2019. Hacking the Cis-tem: Transgender Citizens and the Early Digital State. IEEE Annals of the History of Computing 41, 1 (jan 2019), 1--1. https://doi.org/10.1109/mahc.2019.2897667Google ScholarCross Ref
- Sandy E. James, Jody L. Herman, Susan Rankin, Mara Keisling, Lisa Mottet, and Ma'ayan Anafi. 2016. The Report of the 2015 U.S. Transgender Survey. Technical Report. National Center for Transgender Equality. 298 pages. http://www.transequality.org/sites/default/files/docs/usts/USTSFullReport-FINAL1.6.17.pdfGoogle Scholar
- James Vincent. 2017. Transgender YouTubers had their videos grabbed to train facial recognition software. https: //www.theverge.com/2017/8/22/16180080/transgender-youtubers-ai-facial-recognition-datasetGoogle Scholar
- James Vincent. 2019. AI researchers tell Amazon to stop selling ?flawed' facial recognition to the police. https://www.theverge.com/2019/4/3/18291995/ amazon-facial-recognition-technology-rekognition-police-ai-researchers-ban-flawed?fbclid= IwAR2BE5ObzjkVeq5W6hlPVobNsyEYCfAvIYZV6Jq-0I0HlErQkxniHpHoDIcGoogle Scholar
- Stephanie Julia Kapusta. 2016. Misgendering and Its Moral Contestability. Hypatia 31, 3 (aug 2016), 502--519. https://doi.org/10.1111/hypa.12259Google ScholarCross Ref
- Soon-Gyo Jung, Jisun An, Haewoon Kwak, Joni Salminen, and Bernard Jim Jansen. 2018. Assessing the Accuracy of Four Popular Face Recognition Tools for Inferring Gender, Age, and Race. In Proceedings of the Twelfth International AAAI Conference on Web and Social Media. 624--627. https://www.cnet.com/news/google-apologizes-for-algorithm-https: //aaai.org/ocs/index.php/ICWSM/ICWSM18/paper/view/17839Google Scholar
- Yannis Kalantidis, Munmun De Choudhury, Jessica A. Pater, Stevie Chancellor, and David A. Shamma. 2017. Multimodal Classification of Moderated Online Pro-Eating Disorder Content. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17. ACM Press, New York, New York, USA, 3213--3226. https://doi.org/10.1145/3025453.3025985Google Scholar
- Jakko Kemper and Daan Kolkman. 2018. Transparent to whom? No algorithmic accountability without a critical audience., 16 pages. https://doi.org/10.1080/1369118X.2018.1477967Google Scholar
- Os Keyes. 2018. The Misgendering Machines: Trans/HCI Implications of Automatic Gender Recognition. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (nov 2018), 1--22. https://doi.org/10.1145/3274357Google ScholarDigital Library
- Liza Khan. 2011. Transgender Health at the Crossroads: Legal Norms, Insurance Markets, and the Threat of Healthcare Reform. Yale Journal of Health Policy, Law & Ethics 11, c (2011), 375--418. https://heinonline.org/HOL/Page?handle= hein.journals/yjhple11{&}id=381{&}collection=journals{&}index=Google Scholar
- Sajid Ali Khan, Maqsood Ahmad, Muhammad Nazir, and Naveed Riaz. 2013. A comparative analysis of gender classification techniques. International Journal of Bio-Science and Bio-Technology 5, 4 (2013), 223--243. https: //doi.org/10.5829/idosi.mejsr.2014.20.01.11434Google Scholar
- Anja Lambrecht and Catherine E. Tucker. 2016. Algorithmic Bias? An Empirical Study into Apparent Gender-Based Discrimination in the Display of STEM Career Ads. (2016). https://doi.org/10.2139/ssrn.2852260Google Scholar
- Alex Leavitt. 2015. "This is a Throwaway Account": Temporary Technical Identities and Perceptions of Anonymity in a Massive Online Community. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing - CSCW '15. ACM Press, New York, New York, USA, 317--327. https://doi.org/10.1145/2675133. 2675175Google ScholarDigital Library
- Hongjun Li and Ching Y. Suen. 2016. Robust face recognition based on dynamic rank representation. Pattern Recognition 60, C (dec 2016), 13--24. https://doi.org/10.1016/j.patcog.2016.05.014Google Scholar
- Stan Z. Li and Anil K. Jain. 2011. Handbook of Face Recognition. https://doi.org/10.1007/978-0--85729--932--1Google Scholar
- Yang Li, Suhang Wang, Jiliang Tang, Quan Pan, and Tao Yang. 2017. Price Recommendation on Vacation Rental Websites. In Proceedings of the 2017 SIAM International Conference on Data Mining. 399--407. https://doi.org/10.1137/ 1.9781611974973.45Google ScholarCross Ref
- Lindsay Schrupp. 2019. Why We Created a Gender-Inclusive Stock Photo Library. https://broadly.vice.com/en{_}us/article/qvyq8p/transgender-non-binary-stock-photos-gender-spectrum-collectionGoogle Scholar
- Ziwei Liu, Ping Luo, XiaogangWang, and Xiaoou Tang. 2015. Deep learning face attributes in the wild. In Proceedings of the IEEE International Conference on Computer Vision, Vol. 2015 Inter. 3730--3738. https://doi.org/10.1109/ICCV.2015.425 arXiv:1411.7766Google ScholarDigital Library
- Xiaoguang Lu and Anil K Jain. 2004. Ethnicity Identification from Face Images. Proceedings of SPIE 5404 (2004), 114--123. https://doi.org/10.1117/12.542847Google Scholar
- Gayathri Mahalingam and Karl Ricanek. 2013. Is the eye region more reliable than the face? A preliminary study of face-based recognition on a transgender dataset. In IEEE 6th International Conference on Biometrics: Theory, Applications and Systems (BTAS 2013). IEEE, 1--7. https://doi.org/10.1109/BTAS.2013.6712710Google ScholarCross Ref
- Makena Kelly. 2019. Pressure mounts on Google, Microsoft, and Amazon's facial recognition tech. https://www.theverge.com/2019/1/15/18183789/google-amazon-microsoft-pressure-facial-recognition-jedi-pentagon-defense-governmentGoogle Scholar
- James E Marcia. 1966. Development and Validation of Ego-Identity Status. Ph.D. Dissertation. https://pdfs.semanticscholar.org/f145/f3fbada1eb7a01052255f586094301669287.pdfGoogle Scholar
- Annette Markham. 2012. Fabrication as ethical practice: Qualitative inquiry in ambiguous Internet contexts. Information Communication and Society 15, 3 (apr 2012), 334--353. https://doi.org/10.1080/1369118X.2011.641993Google ScholarCross Ref
- Matthew Gault. 2019. Facial Recognition Software Regularly Misgenders Trans People. https://motherboard.vice. com/en{_}us/article/7xnwed/facial-recognition-software-regularly-misgenders-trans-peopleGoogle Scholar
- John D. McKinnon and Jeff Horwitz. 2019. HUD Action Against Facebook Signals Trouble for Other Platforms. https://www.wsj.com/articles/u-s-charges-facebook-with-violating-fair-housing-laws-11553775078Google Scholar
- Kevin A. McLemore. 2015. Experiences with Misgendering: Identity Misclassification of Transgender Spectrum Individuals. Self and Identity 14, 1 (jan 2015), 51--74. https://doi.org/10.1080/15298868.2014.950691Google ScholarCross Ref
- Cade Metz. 2019. Is Ethical A.I. Even Possible? https://www.nytimes.com/2019/03/01/business/ ethics-artificial-intelligence.htmlhttps://www.nytimes.com/2019/03/01/business/ethics-artificial-intelligence. html?utm{_}source=Benedict{%}27s+newsletter{&}utm{_}campaign=a333b6b622-Benedict{%}27s+ Newsletter{_}COPY{_}01{&}utm{_}Google Scholar
- Vidya Muthukumar, Tejaswini Pedapati, Nalini Ratha, Prasanna Sattigeri, Chai-Wah Wu, Brian Kingsbury, Abhishek Kumar, Samuel Thomas, Aleksandra Mojsilovic, and Kush R Varshney. 2018. Understanding Unequal Gender Classification Accuracy from Face Images. (2018). arXiv:1812.00099 https://github.com/ox-vgg/vgg{_}face2http: //arxiv.org/abs/1812.00099Google Scholar
- Viviane K. Namaste. 2006. Invisible Lives: The Erasure of Transsexual and Transgendered People. Contemporary Sociology 31, 3 (2006), 264. https://doi.org/10.2307/3089651Google Scholar
- Natalia Drozdiak. 2019. Microsoft Seeks to Restrict Abuse of its Facial Recognition AI. https://www.bloomberg.com/news/articles/2019-01--23/microsoft-seeks-to-restrict-abuse-of-its-facial-recognition-aiGoogle Scholar
- A.J. Neuman Wipfler. 2016. Identity Crisis: the Limitations of Expanding Government Recognition of Gender Identity and the Possibility of Genderless Identity Documents. Harvard Journal of Law and Gender 39, 2 (2016), 401--464. https://heinonline.org/HOL/Page?handle=hein.journals/hwlj39{&}id=505{&}collection=journals{&}index=Google Scholar
- Choon Boon Ng, Yong Haur Tay, and Bok Min Goi. 2015. A review of facial gender recognition. Pattern Analysis and Applications 18, 4 (nov 2015), 739--755. https://doi.org/10.1007/s10044-015-0499--6Google ScholarDigital Library
- Mei Ngan and Patrick Grother. 2015. Face Recognition Vendor Test (FRVT) - Performance of Automated Gender Classification Algorithms. Technical Report. https://doi.org/10.6028/NIST.IR.8052Google Scholar
- Ziad Obermeyer and Sendhil Mullainathan. 2019. Dissecting Racial Bias in an Algorithm that Guides Health Decisions for 70 Million People. In Proceedings of the Conference on Fairness, Accountability, and Transparency - FAT* '19. ACM Press, New York, New York, USA, 89--89. https://doi.org/10.1145/3287560.3287593Google ScholarDigital Library
- Sara Ashley O'Brien. [n. d.]. What is Amazon's responsibility over its facial recognition tech? https://money.cnn. com/2018/07/26/technology/amazon-facial-recognition/index.htmlGoogle Scholar
- Joseph O'Sullivan. 2019. Washington Senate approves consumer-privacy bill to place restrictions on facial recognition. https://www.seattletimes.com/seattle-news/politics/senate-passes-bill-to-create-a-european-style-consumer-data-privacy-law-in-washington/Google Scholar
- J. Marc Overhage and Jeffery G. Suico. 2013. Sorting Things Out: Classification and Its Consequences. Annals of Internal Medicine 135, 10 (2013), 934. https://doi.org/10.7326/0003--4819--135--10--200111200-00030 arXiv:arXiv:1011.1669v3Google ScholarCross Ref
- P Jonathon Phillips, Abhijit Narvekar, Alice J. O'Toole, Fang Jiang, and Julianne Ayyad. 2011. An other-race effect for face recognition algorithms. ACM Transactions on Applied Perception 8, 2 (2011), 1--11. https://doi.org/10.1145/ 1870076.1870082Google ScholarDigital Library
- Mark Poster. 2013. The Mode of Information: Poststructuralism and Social Context. Polity Press. https://doi.org/10.5860/crl_52_03_300Google Scholar
- Rachel Metz. 2019. Amazon shareholders want it to stop selling facial-recognition tech to the government. https://www.cnn.com/2019/01/17/tech/amazon-shareholders-facial-recognition/index.htmlGoogle Scholar
- Inioluwa Deborah Raji and Joy Buolamwini. 2019. Actionable Auditing: Investigating the Impact of Publicly Naming Biased Performance Results of Commercial AI Products. Technical Report. 7 pages. www.aaai.orgGoogle ScholarDigital Library
- Arnaud Ramey and Miguel A. Salichs. 2014. Morphological Gender Recognition by a Social Robot and Privacy Concerns. Proceedings of the 2014 ACM/IEEE Iternational conference on Human-Robot Interaction (HRI '14) (2014), 272--273. https://doi.org/10.1145/2559636.2563714Google ScholarDigital Library
- Andrew G Reece and Christopher M Danforth. 2017. Instagram photos reveal predictive markers of depression. EPJ Data Science 6, 1 (dec 2017), 15. https://doi.org/10.1140/epjds/s13688-017-0110-z arXiv:1608.03282Google Scholar
- Jennifer A Rode. 2011. A theoretical agenda for feminist HCI. Interacting with Computers 23, 5 (2011), 393--400. https://doi.org/10.1016/j.intcom.2011.04.005Google ScholarDigital Library
- Pau Rodríguez, Guillem Cucurull, Josep M. Gonfaus, F. Xavier Roca, and Jordi Gonzàlez. 2017. Age and gender recognition in the wild with deep attention. Pattern Recognition 72 (dec 2017), 563--571. https://doi.org/10.1016/J.PATCOG.2017.06.028Google Scholar
- Janus Rose. 2019. I'm a trans woman -- here's why algorithms scare me | Dazed. https://www.dazeddigital.com/science-tech/article/43211/1/trans-algorithm-machine-learning-bias-discrimination-chelsea-manning-editGoogle Scholar
- Gayle Rubin. 2013. Literary theory: an anthology. In Choice Reviews Online, Julie Rivkin and Michael Ryan (Eds.). Vol. 35. Chapter The Traffi, 35--5478--35--5478. https://doi.org/10.5860/choice.35--5478Google Scholar
- Russell Brandom. 2019. Crucial biometric privacy law survives Illinois court fight. https://www.theverge.com/2019/1/26/18197567/six-flags-illinois-biometric-information-privacy-act-facial-recognitionGoogle Scholar
- Manisha M. Sawant and Kishor M. Bhurchandi. 2018. Age invariant face recognition: a survey on facial aging databases, techniques and effect of aging. Artificial Intelligence Review (oct 2018), 1--28. https://doi.org/10.1007/s10462-018--9661-zGoogle Scholar
- Morgan Klaus Scheuerman, Stacy M Branham, and Foad Hamidi. 2018. Safe Spaces and Safe Places: Unpacking Technology-Mediated Experiences of Safety and Harm with Transgender People. Proceedings of the ACM on Human- Computer Interaction 2 (2018), 29.Google ScholarDigital Library
- Ari Schlesinger, Christina A. Masden, Rebecca E. Grinter, Eshwar Chandrasekharan, W. Keith Edwards, and Amy S. Bruckman. 2017. Situated Anonymity: Impacts of Anonymity, Ephemerality, and Hyper-Locality on Social Media. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17. ACM Press, New York, New York, USA, 6912--6924. https://doi.org/10.1145/3025453.3025682Google Scholar
- Sidney Fussell. 2019. San Francisco Wants to Ban Government Face Recognition. https://www.theatlantic.com/technology/archive/2019/02/san-francisco-proposes-ban-government-face-recognition/581923/Google Scholar
- Jacob Snow. 2018. Amazon's Face Recognition Falsely Matched 28 Members of Congress With Mugshots.Google Scholar
- Brooke Sopelsa. 2018. Gender 'X': New York City to add third gender option to birth certificates. https://www.nbcnews.com/feature/nbc-out/gender-x-new-york-city-add-third-gender-option-birth-n909021Google Scholar
- Susan Stryker. 2006. (De)subjugated Knowledges: An Introduction to Transgender Studies. In The Transgender Studies Reader. Routledge, 1--15. https://doi.org/10.4324/9780203955055--7Google Scholar
- G Subbalakshmi. 2011. Decision Support in Heart Disease Prediction System using Naive Bayes. Indian Journal of Computer... (2011). http://www.ijcse.com/docs/IJCSE11-02-02--56.pdfGoogle Scholar
- Tom Simonite. 2019. Microsoft Wants Rules for Facial Recognition-Just Not These. https://www.wired.com/story/ microsoft-wants-rules-facial-recognition-just-not-these/Google Scholar
- E. B. Towle. 2005. ROMANCING THE TRANSGENDER NATIVE: Rethinking the Use of the "Third Gender" Concept. GLQ: A Journal of Lesbian and Gay Studies 8, 4 (jan 2005), 469--497. https://doi.org/10.1215/10642684--8--4--469Google Scholar
- Jacques Veron, Samuel H. Preston, Patrick. Heuveline, and Michel Guillot. 2006. Demography: Measuring and Modeling Population Processes. Population (French Edition) 57, 3 (2006), 591. https://doi.org/10.2307/1535065Google ScholarCross Ref
- Shui HuaWang, Preetha Phillips, Zheng Chao Dong, and Yu Dong Zhang. 2018. Intelligent facial emotion recognition based on stationary wavelet entropy and Jaya algorithm. Neurocomputing 272 (jan 2018), 668--676. https://doi.org/10. 1016/j.neucom.2017.08.015Google Scholar
- Yilin Wang, Neil O'Hare, Baoxin Li, Yali Wan, Jiliang Tang, Jundong Li, Clayton Mellina, and Yi Chang. 2017. Understanding and Discovering Deliberate Self-harm Content in Social Media. In Proceedings of the 26th International Conference on World Wide Web - WWW '17. ACM Press, New York, New York, USA, 93--102. https://doi.org/10.1145/ 3038912.3052555Google ScholarDigital Library
- Laurel Westbrook and Kristen Schilt. 2013. Doing Gender, Determining Gender. Gender & Society 28, 1 (feb 2013), 32--57. https://doi.org/10.1177/0891243213503203Google Scholar
- Will Knight. 2018. Facial recognition has to be regulated to protect the public, says AI report. https://www. technologyreview.com/s/612552/facial-recognition-has-to-be-regulated-to-protect-the-public-says-ai-report/Google Scholar
- O. Wilson. 2013. Violence and Mental Health in the Transgender Community. December (2013). https://search.proquest.com/docview/1647175438?pq-origsite=gscholarGoogle Scholar
- Stelios C. Wilson, Shane D. Morrison, Lavinia Anzai, Jonathan P. Massie, Grace Poudrier, Catherine C. Motosko, and Alexes Hazen. 2018. Masculinizing Top Surgery: A Systematic Review of Techniques and Outcomes. , 679--683 pages. https://doi.org/10.1097/SAP.0000000000001354Google Scholar
- Aimee Wodda and Vanessa Panfil. 2015. "Don't talk to me about deception": The necessary erosion of the trans* panic defense. Albany Law Review 78, 3 (2015), 927--971. https://doi.org/10.1017/CBO9781107415324.004 arXiv:arXiv:1011.1669v3Google Scholar
- Steve Woolgar and Lucy Alice. Suchman. 1989. Plans and Situated Actions: The Problem of Human Machine Communication. Contemporary Sociology 18, 3 (1989), 414. https://doi.org/10.2307/2073874Google ScholarCross Ref
- Billy Yapriady and Alexandra L. Uitdenbogerd. 2010. Combining Demographic Data with Collaborative Filtering for Automatic Music Recommendation. Springer, Berlin, Heidelberg, 201--207. https://doi.org/10.1007/11554028_29Google Scholar
- Ni Zhuang, Yan Yan, Si Chen, Hanzi Wang, and Chunhua Shen. 2018. Multi-label learning based deep transfer neural network for facial attribute classification. Pattern Recognition 80 (2018), 225--240. https://doi.org/10.1016/j.patcog.2018.03.018 arXiv:arXiv:1805.01282v1Google ScholarCross Ref
- Indre Zliobaite and Bart Custers. 2016. Using sensitive personal data may be necessary for avoiding discrimination in data-driven decision models. Artificial Intelligence and Law 24, 2 (jun 2016), 183--201. https://doi.org/10.1007/s10506-016--9182--5Google ScholarDigital Library
Index Terms
- How Computers See Gender: An Evaluation of Gender Classification in Commercial Facial Analysis Services
Recommendations
How We've Taught Algorithms to See Identity: Constructing Race and Gender in Image Databases for Facial Analysis
CSCWRace and gender have long sociopolitical histories of classification in technical infrastructures-from the passport to social media. Facial analysis technologies are particularly pertinent to understanding how identity is operationalized in new technical ...
Intersections of gender and sexual minority status
The present study refined existing bullying literature by examining differences in risk of three types of bullying victimization (offline only, cyberbullying only, and co-occurring victimization) for four different gender-sexual minority status groups ...
Gender, Simulation, and Gaming: Research Review and Redirections
This review of gender and gameplay research over the past three decades documents a set of persistent methodological repetitions that have systematically impeded its progress since the inception of this trajectory of research. The first is, in fact, a ...
Comments