Deirdre K. Mulligan
Richmond Y. Wong
Skip Abstract Section
Abstract
The explosion in the use of software in important sociotechnical systems has renewed focus on the study of the way technical constructs reflect policies, norms, and human values. This effort requires the engagement of scholars and practitioners from many disciplines. And yet, these disciplines often conceptualize the operative values very differently while referring to them using the same vocabulary. The resulting conflation of ideas confuses discussions about values in technology at disciplinary boundaries. In the service of improving this situation, this paper examines the value of shared vocabularies, analytics, and other tools that facilitate conversations about values in light of these disciplinary specific conceptualizations, the role such tools play in furthering research and practice, outlines different conceptions of "fairness" deployed in discussions about computer systems, and provides an analytic tool for interdisciplinary discussions and collaborations around the concept of fairness. We use a case study of risk assessments in criminal justice applications to both motivate our effort--describing how conflation of different concepts under the banner of "fairness" led to unproductive confusion--and illustrate the value of the fairness analytic by demonstrating how the rigorous analysis it enables can assist in identifying key areas of theoretical, political, and practical misunderstanding or disagreement, and where desired support alignment or collaboration in the absence of consensus.
- Aws Albarghouthi, Loris D'Antoni, Samuel Drews, and Aditya Nori. 2016. Fairness as a program property. arXiv preprint arXiv:1610.06067 (2016).Google Scholar
- Elizabeth S Anderson. 1999. What is the Point of Equality? Ethics, Vol. 109, 2 (1999), 287--337.Google ScholarCross Ref
- Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2016. Machine Bias. ProPublica (23 May 2016).Google Scholar
- Kenneth J Arrow. 1950. A difficulty in the concept of social welfare. Journal of political economy, Vol. 58, 4 (1950), 328--346.Google ScholarCross Ref
- Chelsea Barabas, Karthik Dinakar, Joichi Ito Virza, Jonathan Zittrain, et al. 2018. Interventions over predictions: Reframing the ethical debate for actuarial risk assessment. Conference on Fairness, Accountability, and Transparency (2018).Google Scholar
- Charles R Beitz. 1989. Political equality: An essay in democratic theory .Princeton University Press.Google Scholar
- Jeremy Bentham. 1789. An introduction to the principles of morals and legislation .Google Scholar
- Richard Berk. 2019. Machine Learning Risk Assessments in Criminal Justice Settings .Springer.Google Scholar
- Richard Berk, Hoda Heidari, Shahin Jabbari, Michael Kearns, and Aaron Roth. 2018. Fairness in criminal justice risk assessments: The state of the art. Sociological Methods & Research (2018), 0049124118782533.Google ScholarCross Ref
- Matthew J Bietz and Charlotte P Lee. 2009. Collaboration in metagenomics: Sequence databases and the organization of scientific work. In ECSCW 2009. Springer, 243--262.Google ScholarCross Ref
- Reuben Binns, Max Van Kleek, Michael Veale, Ulrik Lyngs, Jun Zhao, and Nigel Shadbolt. 2018. 'It's Reducing a Human Being to a Percentage': Perceptions of Justice in Algorithmic Decisions. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 377.Google ScholarDigital Library
- Gabriela Bodea, Kristina Karanikolova, Deirdre K. Mulligan, and Jael Makagon. 2018. Automated decision-making on the basis of personal data that has been transferred from the EU to companies certified under the EU-U.S. Privacy Shield: Fact-finding and assessment of safeguards provided by U.S. law. Technical Report. European Commission. https://ec.europa.eu/info/sites/info/files/independent_study_on_automated_decision-making.pdfGoogle Scholar
- Francisco Bonchi, Carlos Castillo, and Sara Hajian. 2016. Algorithmic bias: from discrimination discovery to fairness-aware data mining. Knowledge Discovery and Data Mining, Tutorials Track.Google Scholar
- Geoffrey C Bowker, Karen Baker, Florence Millerand, and David Ribes. 2009. Toward information infrastructure studies: Ways of knowing in a networked environment. In International handbook of internet research. 97--117.Google Scholar
- Geoffrey C Bowker, C Geoffrey, W Bernard Carlson, et al. 1994. Science on the run: Information management and industrial geophysics at Schlumberger, 1920--1940. MIT press.Google Scholar
- Geoffrey C Bowker and Susan Leigh Star. 2000. Sorting things out: Classification and its consequences .MIT press.Google ScholarDigital Library
- John Broome. 1990. Fairness. In Proceedings of the Aristotelian Society, Vol. 91. JSTOR, 87--101.Google Scholar
- Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on Fairness, Accountability and Transparency. 77--91.Google Scholar
- Alexandra Chouldechova. 2017. Fair prediction with disparate impact: A study of bias in recidivism prediction instruments. Big data, Vol. 5, 2 (2017), 153--163.Google Scholar
- Alexandra Chouldechova, Diana Benavides-Prado, Oleksandr Fialko, and Rhema Vaithianathan. 2018. A case study of algorithm-assisted decision making in child maltreatment hotline screening decisions. In Conference on Fairness, Accountability and Transparency. 134--148.Google Scholar
- Angèle Christin. 2017. Algorithms in practice: Comparing web journalism and criminal justice. Big Data & Society, Vol. 4, 2 (2017).Google ScholarCross Ref
- David D Clark, John Wroclawski, Karen R Sollins, and Robert Braden. 2002. Tussle in cyberspace: defining tomorrow's internet. In ACM SIGCOMM Computer Communication Review, Vol. 32:4. ACM, 347--356.Google ScholarDigital Library
- Computing Community Consortium. 2015. Privacy by Design--Engineering Privacy: Workshop 3 Report. https://cra.org/ccc/wp-content/uploads/sites/2/2015/12/PbD3-Workshop-Report-v2.pdf .Google Scholar
- Computing Community Consortium. 2015. Privacy by Design--Privacy Enabling Design: Workshop 2 Report. https://cra.org/ccc/wp-content/uploads/sites/2/2015/05/PbD2-Report-v5.pdf .Google Scholar
- Computing Community Consortium. 2015. Privacy by Design-State of Research and Practice: Workshop 1 Report. https://cra.org/ccc/wp-content/uploads/sites/2/2015/02/PbD-Workshop-1-Report-.pdf .Google Scholar
- Brice Cooke, Binta Zahra Diop, Alissa Fishbane, Jonathan Hayes, Aurelie Ouss, and Anuj Shah. 2018. Using Behavioral Science to Improve Criminal Justice Outcomes.Google Scholar
- Alissa Cooper, Hannes Tschofenig, Bernard Aboba, Jon Peterson, J. Morris, Marit Hansen, and Rhys Smith. 2013. RFC 6973: Privacy considerations for Internet protocols. Internet Engineering Task Force, https://tools.ietf.org/html/rfc6973 .Google Scholar
- Sam Corbett-Davies and Sharad Goel. 2018. The measure and mismeasure of fairness: A critical review of fair machine learning. arXiv preprint arXiv:1808.00023 (2018).Google Scholar
- Sam Corbett-Davies, Emma Pierson, Avi Feller, and Sharad Goel. 2016. A computer program used for bail and sentencing decisions was labeled biased against blacks. It's actually not that clear. Washington Post.Google Scholar
- Sam Corbett-Davies, Emma Pierson, Avi Feller, Sharad Goel, and Aziz Huq. 2017. Algorithmic decision making and the cost of fairness. In ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 797--806.Google ScholarDigital Library
- Thomas H Cormen, Charles E Leiserson, Ronald L Rivest, and Clifford Stein. 2009. Introduction to algorithms .MIT press.Google Scholar
- California Judicial Council. 2019. Judicial Council Funds 16 Pretrial Pilot Programs. https://newsroom.courts.ca.gov/news/judicial-council-funds-16-pretrial-pilot-programsGoogle Scholar
- Bo Cowgill. 2018. The impact of algorithms on judicial discretion: Evidence from regression discontinuities. Technical Report. Working paper.Google Scholar
- Kimberle Crenshaw. 1990. Mapping the margins: Intersectionality, identity politics, and violence against women of color. Stan. L. Rev., Vol. 43 (1990), 1241.Google ScholarCross Ref
- Nicholas Diakopoulos. 2015. Algorithmic accountability: Journalistic investigation of computational power structures. Digital Journalism, Vol. 3, 3 (2015).Google ScholarCross Ref
- William Dieterich, Christina Mendoza, and Tim Brennan. 2016. COMPAS risk scales: Demonstrating accuracy equity and predictive parity.Google Scholar
- Julia Dressel and Hany Farid. 2018. The accuracy, fairness, and limits of predicting recidivism. Science advances, Vol. 4, 1 (2018), eaao5580.Google Scholar
- Cynthia Dwork, Moritz Hardt, Toniann Pitassi, Omer Reingold, and Richard Zemel. 2012. Fairness through awareness. In Proceedings of the 3rd innovations in theoretical computer science conference. ACM, 214--226.Google ScholarDigital Library
- Ronald Dworkin. 2013. Taking rights seriously .Bloomsbury Academic.Google Scholar
- Jessica M Eaglin. 2017. Constructing recidivism risk. Emory Law Journal, Vol. 67 (2017), 59.Google Scholar
- Virginia Eubanks. 2018. Automating inequality: How high-tech tools profile, police, and punish the poor .St. Martin's Press.Google ScholarDigital Library
- Federal Trade Commision (FTC). 2016. Big Data: A tool for inclusion or exclusion? Technical Report. Federal Trade Commission. https://www.ftc.gov/system/files/documents/reports/big-data-tool-inclusion-or-exclusion-understanding-issues/160106big-data-rpt.pdfGoogle Scholar
- Mary Flanagan, Daniel C. Howe, and Helen Nissenbaum. 2005. Values at Play: Design Tradeoffs in Socially-oriented Game Design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '05). ACM, New York, NY, USA, 751--760. https://doi.org/10.1145/1054972.1055076Google ScholarDigital Library
- Mary Flanagan, Daniel C Howe, and Helen Nissenbaum. 2008. Embodying values in technology: Theory and practice. Information technology and moral philosophy, Vol. 322 (2008).Google Scholar
- Anthony W Flores, Kristin Bechtel, and Christopher T Lowenkamp. 2016. False Positives, False Negatives, and False Analyses: A Rejoinder to Machine Bias: There's Software Used across the Country to Predict Future Criminals. And It's Biased against Blacks. Fed. Probation, Vol. 80 (2016), 38.Google Scholar
- Batya Friedman. 1996. Value-sensitive design. interactions, Vol. 3, 6 (1996), 16--23. https://doi.org/10.1145/242485.242493Google Scholar
- Batya Friedman, Peter H. Kahn, and Alan Borning. 2008. Value Sensitive Design and Information Systems. In The Handbook of Information and Computer Ethics, Kenneth Einar Himma and Herman T. Tavani (Eds.). John Wiley & Sons, Inc., Chapter 4, 69--101.Google Scholar
- Batya Friedman and Helen Nissenbaum. 1996. Bias in computer systems. ACM Transactions on Information Systems (TOIS), Vol. 14, 3 (1996).Google ScholarDigital Library
- Walter Bryce Gallie. 1955. Essentially contested concepts. In Proceedings of the Aristotelian society, Vol. 56. 167--198.Google Scholar
- Brandon L Garrett and John Monahan. Forthcoming. Judging Risk. Cal. L. Rev. ( Forthcoming).Google Scholar
- Allan Gibbard. 1973. Manipulation of voting schemes: a general result. Econometrica: journal of the Econometric Society (1973), 587--601.Google Scholar
- Sharad Goel, Ravi Shroff, Jennifer L Skeem, and Christopher Slobogin. 2019. The Accuracy, Equity, and Jurisprudence of Criminal Risk Assessment. In Research Handbook on Big Data Law .Google Scholar
- Charles AE Goodhart. 1984. Problems of monetary management: the UK experience. In Monetary Theory and Practice. Springer, 91--121.Google Scholar
- Ben Green and Yiling Chen. 2019. Disparate interactions: An algorithm-in-the-loop analysis of fairness in risk assessments. In Proceedings of the Conference on Fairness, Accountability, and Transparency. ACM, 90--99.Google ScholarDigital Library
- Moritz Hardt and Solon Barocas. 2017. Fairness in Machine Learning. Neural Information Processing Symposium, Tutorials Track.Google Scholar
- Moritz Hardt, Solon Barocas, and Arvind Narayanan. 2018. Fairness in Machine Learning: Limitations and Opportunities .Google Scholar
- Moritz Hardt, Nimrod Megiddo, Christos Papadimitriou, and Mary Wootters. 2016. Strategic classification. In Proceedings of the 2016 ACM conference on innovations in theoretical computer science. ACM, 111--122.Google ScholarDigital Library
- Moritz Hardt, Eric Price, and Nathan Srebro. 2016. Equality of Opportunity in Supervised Learning. Neural Information Processing Symposium (2016).Google Scholar
- Herbert Lionel Adolphus Hart. 1961. The concept of law .Oxford University Press.Google Scholar
- Deborah Hellman. 2008. When is discrimination wrong? Harvard University Press.Google Scholar
- Melanie Herschel, Ralf Diestelkamper, and Houssem Ben Lahmar. 2017. A survey on provenance: What for? What form? What from? The VLDB Journal, Vol. 26, 6 (2017), 881--906.Google ScholarDigital Library
- Thomas Hobbes. 1651. Leviathan. (1651).Google Scholar
- Anna Lauren Hoffmann. 2017. Data, technology, and gender: Thinking about (and from) trans lives. In Spaces for the Future. Routledge, 3--13. https://doi.org/10.4324/9780203735657--1Google Scholar
- Kenneth Holstein, Jennifer Wortman Vaughan, Hal Daumé III, Miro Dudik, and Hanna Wallach. 2019. Improving fairness in machine learning systems: What do industry practitioners need?. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 600.Google ScholarDigital Library
- Lara Houston, Steven J Jackson, Daniela K Rosner, Syed Ishtiaque Ahmed, Meg Young, and Laewoo Kang. 2016. Values in Repair. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16. ACM Press, New York, New York, USA, 1403--1414. https://doi.org/10.1145/2858036.2858470Google ScholarDigital Library
- Lily Hu, Nicole Immorlica, and Jennifer Wortman Vaughan. 2018. The Disparate Effects of Strategic Manipulation. arXiv preprint arXiv:1808.08646 (2018).Google Scholar
- Jeremy Hunsinger, Lisbeth Klastrup, and Matthew Allen. 2010. International handbook of internet research .Springer.Google Scholar
- Lilly Irani and M. Six Silberman. 2014. From critical design to critical infrastructure. Interactions, Vol. 21, 4 (2014), 32--35. https://doi.org/10.1145/2627392Google ScholarDigital Library
- Steven J. Jackson, Tarleton Gillespie, and Sandy Payette. 2014. The Policy Knot: Re-integrating Policy, Practice and Design in Cscw Studies of Social Computing. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '14). ACM, New York, NY, USA, 588--602. https://doi.org/10.1145/2531602.2531674Google ScholarDigital Library
- Abigail Z. Jacobs and Hanna Wallach. 2018. Measurement and Fairness. Manuscript, on file with authors (2018).Google Scholar
- Nassim JafariNaimi, Lisa Nathan, and Ian Hargraves. 2015. Values as Hypotheses: Design, Inquiry, and the Service of Values. Design Issues, Vol. 31, 4 (oct 2015), 91--104. https://doi.org/10.1162/DESI_a_00354Google ScholarCross Ref
- Paul Jeffrey. 2003. Smoothing the waters: Observations on the process of cross-disciplinary research collaboration. Social Studies of Science, Vol. 33, 4 (2003), 539--562.Google ScholarCross Ref
- Os Keyes. 2018. The Misgendering Machines: Trans/HCI Implications of Automatic Gender Recognition. Proceedings of the ACM on Human-Computer Interaction, Vol. 2, CSCW (nov 2018), 1--22. https://doi.org/10.1145/3274357Google ScholarDigital Library
- Jon Kleinberg, Sendhil Mullainathan, and Manish Raghavan. 2016. Inherent trade-offs in the fair determination of risk scores. arXiv preprint arXiv:1609.05807 (2016).Google Scholar
- Daniel Kluttz, Jenna Burrell, Deirdre Mulligan, Joshua A. Kroll, Amit Elazari, and Andrew Smart. 2018. Report from the First AFOG Summer Workshop. https://afog.berkeley.edu/2018/08/13/report-from-the-first-afog-summer-workshop/.Google Scholar
- Cory Knobel and Geoffrey C. Bowker. 2011. Values in design. Commun. ACM, Vol. 54 (2011), 26. https://doi.org/10.1145/1965724.1965735Google ScholarDigital Library
- Donald Ervin Knuth. 1968. The art of computer programming: fundamental algorithms. Vol. 1. Pearson Education.Google Scholar
- Issa Kohler-Hausmann. 2018. Eddie Murphy and the Dangers of Counterfactual Causal Thinking About Detecting Racial Discrimination. Available at SSRN, https://ssrn.com/abstract=3050650 (2018).Google Scholar
- Nitin Kohli and Paul Laskowski. 2018. Epsilon Voting: Mechanism Design for Parameter Selection in Differential Privacy. In 2018 IEEE Symposium on Privacy-Aware Computing (PAC). IEEE, 19--30.Google Scholar
- Christine M Korsgaard. 1996. Creating the kingdom of ends .Cambridge University Press.Google Scholar
- Christine M Korsgaard, Christine Marion Korsgaard, Gerald Allan Cohen, Raymond Geuss, Thomas Nagel, and Bernard Williams. 1996. The sources of normativity .Cambridge University Press.Google Scholar
- Joshua A. Kroll. 2015. Accountable Algorithms. Ph.D. Dissertation. Princeton University.Google Scholar
- Joshua A. Kroll, Joanna Huey, Solon Barocas, Edward W. Felten, Joel R. Reidenberg, David G. Robinson, and Harlan Yu. 2017. Accountable Algorithms. University of Pennsylvania Law Review, Vol. 165, 3 (2017).Google Scholar
- Joshua A. Kroll, Nitin Kohli, and Deirdre Mulligan. 2018. Common Pitfalls for Studying the Human Side of Machine Learning. Tutorial at the Neural Information Processing Symposium (NeurIPS).Google Scholar
- Joshua A. Kroll and Emmanuel Moss. 2019. Conceptions, Definitions, and Practices of Fair, Transparent, and Accountable AI. Partnership on AI (2019).Google Scholar
- Matt J Kusner, Joshua Loftus, Chris Russell, and Ricardo Silva. 2017. Counterfactual fairness. In Advances in Neural Information Processing Systems. 4066--4076.Google Scholar
- Bruno Latour. 1989. The moral dilemmas of a safety belt. Alliage 1 (1989), 21--27. Originally published as "La ceinture de sécurité". Unpublished English translation by Lydia Davis.Google Scholar
- Bruno Latour. 1992. Where Are the Missing Masses? The Sociology of a Few Mundane Artifacts. In Shaping Technology/Building Society: Studies in Sociotechnical Change, Wiebe Bijker and John Law (Eds.). MIT Press, 225--258.Google Scholar
- Law Review Editors. 2017. State v. Loomis. 130 Harvard Law Review 1530, https://harvardlawreview.org/2017/03/state-v-loomis/.Google Scholar
- Christopher A. Le Dantec, Erika Shehan Poole, and Susan P. Wyche. 2009. Values as lived experience: Evolving value sensitive design in support of value discovery. In Proceedings of the 27th international conference on Human factors in computing systems - CHI 09. ACM Press, New York, New York, USA, 1141. https://doi.org/10.1145/1518701.1518875Google ScholarDigital Library
- Charlotte P Lee. 2005. Between chaos and routine: Boundary negotiating artifacts in collaboration. In ECSCW 2005. Springer, 387--406.Google ScholarCross Ref
- Min Kyung Lee and Su Baykal. 2017. Algorithmic Mediation in Group Decisions: Fairness Perceptions of Algorithmically Mediated vs. Discussion-Based Social Division. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 1035--1048. https://doi.org/10.1145/2998181.2998230Google ScholarDigital Library
- Zeus Leonardo. 2004. The Color of Supremacy: Beyond the discourse of 'white privilege'. Educational Philosophy and Theory, Vol. 36, 2 (2004), 137--152. https://doi.org/10.1111/j.1469--5812.2004.00057.xGoogle ScholarCross Ref
- Lawrence Lessig. 1999. Code: And other laws of cyberspace. Basic Books, New York.Google ScholarDigital Library
- Zachary C Lipton, Alexandra Chouldechova, and Julian McAuley. 2017. Does mitigating ML's impact disparity require treatment disparity? arXiv preprint arXiv:1711.07076 (2017).Google Scholar
- Kenneth O May. 1952. A set of independent necessary and sufficient conditions for simple majority decision. Econometrica: Journal of the Econometric Society (1952), 680--684.Google Scholar
- Peggy McIntosh. 2001. White privilege and male privilege: A personal account of coming to see correspondences through work in Women's studies (1988). Race, class, and gender: An anthology (2001).Google Scholar
- Samuel Messick. 1987. Validity. ETS Research Report Series, Vol. 1987, 2 (1987), i--208.Google ScholarCross Ref
- John Stuart Mill. 1861. Utilitarianism.Google Scholar
- Smitha Milli, John Miller, Anca D Dragan, and Moritz Hardt. 2018. The Social Cost of Strategic Classification. arXiv preprint arXiv:1808.08460 (2018).Google Scholar
- Shira Mitchell, Eric Potash, and Solon Barocas. 2018. Prediction-Based Decisions and Fairness: A Catalogue of Choices, Assumptions, and Definitions. arXiv preprint: 1811.07867 (2018).Google Scholar
- Shira Mitchell and Jackie Shadlen. 2018. Mirror, Mirror: Reflections on Quantitative Fairness. shiramitchell.github.io/fairness .Google Scholar
- Hervé Moulin. 1980. On strategy-proofness and single peakedness. Public Choice, Vol. 35, 4 (1980), 437--455.Google ScholarCross Ref
- Deirdre K Mulligan and Kenneth A Bamberger. 2018. Saving Governance-by-Design. California Law Review, Vol. 106, 101 (2018).Google Scholar
- Deirdre K Mulligan, Colin Koopman, and Nick Doty. 2016. Privacy is an essentially contested concept: a multi-dimensional analytic for mapping privacy. Phil. Trans. R. Soc. A, Vol. 374, 2083 (2016), 20160118.Google ScholarCross Ref
- Arvind Narayanan. 2018. 21 Definitions of Fairness and Their Politics. Tutorial Presented at the First Conference on Fairness, Accountability, and Transparency (FAT$^*$) .Google Scholar
- New York City Press Office. 2018. Mayor de Blasio Announces First-In-Nation Task Force To Examine Automated Decision Systems Used By The City. https://www1.nyc.gov/office-of-the-mayor/news/251--18/mayor-de-blasio-first-in-nation-task-force-examine-automated-decision-systems-used-byGoogle Scholar
- Helen Nissenbaum. 2001. How computer systems embody values. Computer, Vol. 34, 3 (mar 2001), 120--119. https://doi.org/10.1109/2.910905Google ScholarDigital Library
- Helen Nissenbaum. 2005. Values in technical design. In Encyclopedia of science, technology, and ethics. Macmillan New York, NY, 66--70.Google Scholar
- Merel Noorman. 2017. Justice. In The Stanford Encyclopedia of Philosophy, Edward N. Zalta (Ed.). https://plato.stanford.edu/archives/fall2017/entries/justice/Google Scholar
- Martha C Nussbaum. 1986. The fragility of goodness: Luck and ethics in Greek tragedy and philosophy. Cambridge University Press.Google Scholar
- Martha C Nussbaum. 1999. Virtue ethics: a misleading category? The Journal of Ethics, Vol. 3, 3 (1999), 163--201.Google ScholarCross Ref
- Partnership on AI. 2019. Report on Algorithmic Risk Assessment Tools in the U.S. Criminal Justice System. https://www.partnershiponai.org/report-on-machine-learning-in-risk-assessment-tools-in-the-u-s-criminal-justice-system/. (2019).Google Scholar
- Samir Passi and Steven Jackson. 2017. Data Vision: Learning to See Through Algorithmic Abstraction. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing - CSCW '17. ACM Press, New York, New York, USA, 2436--2447. https://doi.org/10.1145/2998181.2998331Google ScholarDigital Library
- Samir Passi and Steven J Jackson. 2018. Trust in Data Science: Collaboration, Translation, and Accountability in Corporate Data Science Projects. Proceedings of the ACM on Human-Computer Interaction, Vol. 2, CSCW (nov 2018), 1--28. https://doi.org/10.1145/3274405Google ScholarDigital Library
- Beatriz Pérez, Julio Rubio, and Carlos Sáenz-Adán. 2018. A systematic review of provenance systems. Knowledge and Information Systems (2018), 1--49.Google Scholar
- Fred L Pincus. 1996. Discrimination comes in many forms: Individual, institutional, and structural. American Behavioral Scientist, Vol. 40, 2 (1996), 186--194.Google ScholarCross Ref
- Zachary Piso. 2016. Integration, Values, and Well-Ordered Interdisciplinary Science. the pluralist, Vol. 11, 1 (2016), 49--57.Google Scholar
- Ariel D Procaccia. 2015. Cake cutting algorithms. In Handbook of Computational Social Choice, chapter 13 .Google Scholar
- Kevin M Quinn, Burt L Monroe, Michael Colaresi, Michael H Crespin, and Dragomir R Radev. 2010. How to analyze political attention with minimal assumptions and costs. American Journal of Political Science, Vol. 54, 1 (2010), 209--228.Google ScholarCross Ref
- Jeffrey J Rachlinski, Sheri Lynn Johnson, Andrew J Wistrich, and Chris Guthrie. 2008. Does unconscious racial bias affect trial judges. Notre Dame L. Rev., Vol. 84 (2008), 1195.Google Scholar
- John Rawls. 2001. Justice as fairness: A restatement .Harvard University Press.Google Scholar
- John Rawls. 2009. A theory of justice .Harvard university press.Google Scholar
- Joel R Reidenberg. 1997. Lex informatica: The formulation of information policy rules through technology. Tex. L. Rev., Vol. 76 (1997), 553.Google Scholar
- Daniela K. Rosner and Morgan Ames. 2014. Designing for repair?: infrastructures and materialities of breakdown. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing - CSCW '14. ACM Press, Baltimore, 319--331. https://doi.org/10.1145/2531602.2531692Google Scholar
- Jean-Jacques Rousseau. 1762. The social contract.Google Scholar
- Alan Ryan. 2006. Fairness and philosophy. social research (2006), 597--606.Google Scholar
- Christian Sandvig. 2015. Seeing the sort: The aesthetic and industrial defense of "the algorithm". Journal of the New Media Caucus (2015).Google Scholar
- Mark Allen Satterthwaite. 1975. Strategy-proofness and Arrow's conditions: Existence and correspondence theorems for voting procedures and social welfare functions. Journal of economic theory, Vol. 10, 2 (1975), 187--217.Google ScholarCross Ref
- Thomas Scanlon. 1998. What we owe to each other .Harvard University Press.Google ScholarCross Ref
- Thomas Scanlon. 2004. When does equality matter? unpublished paper (2004), 15.Google Scholar
- Arthur Schopenhauer. 1840. On the basis of morality.Google Scholar
- Nick Seaver. 2017. Algorithms as culture: Some tactics for the ethnography of algorithmic systems. Big Data & Society, Vol. 4, 2 (2017).Google Scholar
- Andrew D Selbst, Danah Boyd, Sorelle A Friedler, Suresh Venkatasubramanian, and Janet Vertesi. 2019. Fairness and abstraction in sociotechnical systems. In Proceedings of the Conference on Fairness, Accountability, and Transparency. ACM, 59--68.Google ScholarDigital Library
- Katie Shilton. 2018. Values and Ethics in Human-Computer Interaction. Foundations and Trends in Human-Computer Interaction, Vol. 12, 2 (2018), 107--171. https://doi.org/10.1561/1100000073Google ScholarDigital Library
- Katie Shilton, Jes A. Koepfler, and Kenneth R. Fleischmann. 2014. How to see values in social computing: Methods for Studying Values Dimensions. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '14). 426--435. https://doi.org/10.1145/2531602.2531625Google ScholarDigital Library
- Walter Sinnott-Armstrong. 2003. Consequentialism. (2003).Google Scholar
- Alicia Solow-Niederman, YooJung Choi, and Guy Van den Broeck. 2019. The Institutional Life of Algorithmic Risk Assessment. Berkeley Technology Law Journal (2019).Google Scholar
- Susan Leigh Star and Karen Ruhleder. 1994. Steps towards an ecology of infrastructure: complex problems in design and access for large-scale collaborative systems. In Proceedings of the 1994 ACM conference on Computer supported cooperative work. ACM, 253--264.Google ScholarDigital Library
- Susan Leigh Star and Karen Ruhleder. 1996. Steps toward an ecology of infrastructure: Design and access for large information spaces. Information systems research, Vol. 7, 1 (1996), 111--134.Google ScholarDigital Library
- Stephanie B Steinhardt. 2016. Breaking Down While Building Up: Design and Decline in Emerging Infrastructures. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16. ACM Press, New York, New York, USA, 2198--2208. https://doi.org/10.1145/2858036.2858420Google ScholarDigital Library
- Stephanie B Steinhardt and Steven J Jackson. 2014. Reconciling rhythms: Plans and Temporal Alignment in Collaborative Scientific Work. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing - CSCW '14. ACM Press, New York, New York, USA, 134--145. https://doi.org/10.1145/2531602.2531736Google ScholarDigital Library
- Megan Stevenson. 2018. Assessing risk assessment in action. Minn. L. Rev., Vol. 103 (2018), 303.Google Scholar
- Patrick Tomlin. 2012. Can I be a Luck Egalitarian and a Rawlsian? Ethical Perspectives, Vol. 19, 3 (2012), 371.Google Scholar
- Manuel Velasquez, Claire Andre, T Shanks, and Michael J Meyer. 2014. Justice and fairness. Issues in Ethics, Vol. 3, 2 (2014).Google Scholar
- Sahil Verma and Julia Rubin. 2018. Fairness definitions explained. In 2018 IEEE/ACM International Workshop on Software Fairness (FairWare). IEEE, 1--7.Google ScholarDigital Library
- Sandra Wachter and Brent Mittelstadt. 2019. A right to reasonable inferences: re-thinking data protection law in the age of big data and AI. Columbia Business Law Review (2019).Google Scholar
- Susann Wagenknecht, Min Lee, Caitlin Lustig, Jacki O'Neill, and Himanshu Zade. 2016. Algorithms at Work: Empirical Diversity, Analytic Vocabularies, Design Implications. In Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion - CSCW '16 Companion. ACM Press, New York, New York, USA, 536--543. https://doi.org/10.1145/2818052.2855519Google Scholar
- Langdon Winner. 1980. Do Artifacts Have Politics? Daedalus, Vol. 109, 1 (1980), 121--136.Google Scholar
- Christine T Wolf, Haiyi Zhu, Julia Bullard, Min Kyung Lee, and Jed R Brubaker. 2018. The Changing Contours of "Participation" in Data-driven, Algorithmic Ecosystems: Challenges, Tactics, and an Agenda. In Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing - CSCW '18. ACM Press, New York, New York, USA, 377--384. https://doi.org/10.1145/3272973.3273005Google ScholarDigital Library
- Tim Wu. 2003. Network neutrality, broadband discrimination. J. on Telecomm. & High Tech. L., Vol. 2 (2003), 141.Google Scholar
- Haiyi Zhu, Bowen Yu, Aaron Halfaker, and Loren Terveen. 2018. Value-Sensitive Algorithm Design: Method, Case Study, and Lessons. Proceedings of the ACM on Human-Computer Interaction, Vol. 2, CSCW (nov 2018), 1--23. https://doi.org/10.1145/3274463Google ScholarDigital Library
- Malte Ziewitz. 2017. A not quite random walk: Experimenting with the ethnomethods of the algorithm. Big Data & Society, Vol. 4, 2 (2017).Google Scholar
Index Terms
- This Thing Called Fairness: Disciplinary Confusion Realizing a Value in Technology
Recommendations
Airtime Fairness for IEEE 802.11 Multirate Networks
Under a multi rate network scenario, the IEEE 802.11 DCF MAC fails to provide air-time fairness for all competing stations since the protocol is designed for ensuring max-min throughput fairness and the maximum achievable throughput by any station gets ...
Music & Soundscapes of our everyday lives: Music & Sound-making, meaning-making, and self-making
AbstractThe aim of this professional Doctor of Creative Industries (DCI) Research Project was to investigate music-making practice and self as a practitioner in the process of creating and producing a DIY music artefact, specifically to investigate why I ...
Fairness in multi-hop wireless backhaul networks: a dynamic estimation approach
QShine '08: Proceedings of the 5th International ICST Conference on Heterogeneous Networking for Quality, Reliability, Security and RobustnessIn this work, we consider the problem of fairness for Transit Access Points (TAP) in multi-hop wireless backhaul networks. Existing approaches are not practical due to the requirement for modifications to the MAC layer or queueing operations of TAPs, or ...
Comments