Kathryn Zyskowski
Meredith Ringel Morris
Shaun K. Kane
ABSTRACT
We present the first formal study of crowdworkers who have disabilities via in-depth open-ended interviews of 17 people (disabled crowdworkers and job coaches for people with disabilities) and a survey of 631 adults with disabilities. Our findings establish that people with a variety of disabilities currently participate in the crowd labor marketplace, despite challenges such as crowdsourcing workflow designs that inadvertently prohibit participation by, and may negatively affect the worker reputations of, people with disabilities. Despite such challenges, we find that crowdwork potentially offers different opportunities for people with disabilities relative to the normative office environment, such as job flexibility and lack of a need to rely on public transit. We close by identifying several ways in which crowd labor platform operators and/or individual task requestors could improve the accessibility of this increasingly important form of employment.
- Abberley, P. (1999). The significance of work for the citizenship of disabled people. University College Dublin.Google Scholar
- Allen, S. M. M., & Carlson, G. M. (2003). To conceal or disclose a disabling condition? A dilemma of employment transition. Journal of Vocational Rehabilitation, 10, 19--30.Google Scholar
- Bigham, J.P., Jayant, C., Ji, H., Little, G., Miller, A., Miller, R.C., Miller, R., Tatarowicz, A., White, B., White, S., and Yeh, T. VizWiz: Nearly Real-Time Answers to Visual Questions. Proceedings of UIST 2010. Google ScholarDigital Library
- Bigham, J.P. and Cavender, A.C. Evaluating Existing Audio CAPTCHAs and an Interface Optimized for Non-Visual Use. Proceedings of CHI 2009. Google ScholarDigital Library
- Brady, E. L., Zhong, Y., Morris, M. R., & Bigham, J. P. Investigating the appropriateness of social network question asking as a resource for blind users. Proceedings of CSCW 2013. Google ScholarDigital Library
- Breckenridge, C. A., & Vogler, C. A. (2001). The critical limits of embodiment: reflections on disability criticism. Durham, N.C.: Duke University Press.Google Scholar
- Bruyere, S.M. and Barringtron, L. (2012) "Employment and Work." In Disability: Key Issues and Future Directions (G.L. Albrecht, ed.). SAGE Publications, Inc.Google Scholar
- Burton, M. A., Brady, E., Brewer, R., Neylan, C., Bigham, J. P., & Hurst, A. Crowdsourcing subjective fashion advice using VizWiz: challenges and opportunities. Proceedings of ASSETS 2012. Google ScholarDigital Library
- Devlin, R. F., & Pothier, D. (2006). Critical disability theory essays in philosophy, politics, policy, and law. Vancouver, B.C.: UBC Press.Google Scholar
- Diament, M. (2014, March 25). Feds Move Forward with Disability Hiring Mandate - Disability Scoop. Retrieved from http://www.disabilityscoop.com/2014/03/25/feds-disability-hiring-mandate/19222/Google Scholar
- Emerson, R. M., Fretz, R. I., & Shaw, L. L. (2011). Writing ethnographic fieldnotes. Chicago: The University of Chicago Press.Google ScholarCross Ref
- Folbre, N. The Unregulated Work of Mechanical Turk. (2013). Economix Blog, New York Times.Google Scholar
- Goggin, G., & Newell, C. (2003). Digital disability: the social construction of disability in new media. Lanham {Md.}: Rowman & Littlefield. Google ScholarDigital Library
- Hara, K., Azenkot, S., Campbell, M., Bennett, C., Le, V., Panella, S., Moore, R., Minckler, K.,Ng, R., and Froehlich, J. Improving Public Transit Accessibility for Blind Riders by Crowdsourcing Bus Stop Landmark Locations with Google Street View. Proceedings of ASSETS 2013. Google ScholarDigital Library
- Hara, K., Le, V., and Froehlich, J. Combining Crowdsourcing and Google Street View to Identify Street-level Accessibility Problems. Proceedings of CHI 2013. Google ScholarDigital Library
- Hong, H., Yarosh, S., Kim, J.G., Abowd, G.D., and Arriaga, R.I. Investigating the Use of Circles in Social Networks to Support Independence of Individuals with Autism. Proceedings of CHI 2013. Google ScholarDigital Library
- Ipeirotis, P. G. (2010). Demographics of Mechanical Turk (Working Paper). New York, NY, USA. Retrieved from http://archive.nyu.edu/handle/2451/29585Google Scholar
- Ipeirotis, P.G. Analyzing the Amazon Mechanical Turk Marketplace. ACM XRDS, Winter 2010.Google ScholarDigital Library
- Kittur, A., Nickerson, J.V., Bernstein, M.S., Gerber, E.M., Shaw, A., Zimmerman, J., Lease, M., and Horton, J.J. The Future of Crowd Work. Proceedings of CSCW 2013. Google ScholarDigital Library
- Kruse, D., Schur, L., & Ali, M. (2010, March 2). Projecting Potential Demand for Workers with Disabilities. Monthly Labor Review.Google Scholar
- Lasecki, W.S., Miller, C.D., Sadilek, A., Abumoussa, A., Borrello, D., Kushalnagar, R., and Bigham, J.P. Real-Time Captioning by Groups of Non-Experts. Proceedings of UIST 2013. Google ScholarDigital Library
- Mankoff, J., Hayes, G. R., & Kasnitz, D. Disability Studies as a Source of Critical Inquiry for the Field of Assistive Technology. Proceedings of ASSETS 2010. Google ScholarDigital Library
- Martin, D., Hanrahan, B. V., O'Neill, J., & Gupta, N. Being A Turker. Proceedings of CSCW 2014. Google ScholarDigital Library
- Marvit, M. Z. (2014, February 4). How Crowdworkers Became the Ghosts in the Digital Machine. The Nation.Google Scholar
- McDermott, R., & Varenne, H. (1995). Culture as Disability. Anthropology & Education Quarterly, 26(3), 324--348.Google ScholarCross Ref
- Notte, J. (2013, June 21). Goodwill pays disabled workers pennies an hour. Msn.com.Google Scholar
- Ross, J., Irani, L., Silberman, M. S., Zaldivar, A., & Tomlinson, B. Who Are the Crowdworkers?: Shifting Demographics in Mechanical Turk. Extended Abstracts of CHI 2010. Google ScholarDigital Library
- Rush, C. L. (2012). Amending the Americans with Disabilities Act Shifting Equal Employment Opportunity Obligations in Public Human Resource Management. Review of Public Personnel Administration, 32(1), 75--86.Google ScholarCross Ref
- Rzeszotarski, J. M., Chi, E., Paritosh, P., & Dai, P.. Inserting Micro-Breaks into Crowdsourcing Workflows. Proceedings of HCOMP 2013.Google Scholar
- Suzanne, L (2014). Some companies see opportunity in autism. CBS News. Retrieved May 10, 2014, from http://www.cbsnews.com/news/some-companies-see-opportunity-in-autism/.Google Scholar
- Teodoro, R., Ozturk, P., Naaman, M., Mason, W., & Lindqvist, J.. The Motivations and Experiences of the On-demand Mobile Workforce. Proceedings of CSCW 2014. Google ScholarDigital Library
- von Ahn, L. and Dabbish, L. Labeling images with a computer game. Proceedings of CHI 2004. Google ScholarDigital Library
- Weiss, R. S. (1995). Learning from strangers: the art and method of qualitative interview studies. New York: Free Press.Google Scholar
- Strauss, A. L., & Corbin, J. M. (1998). Basics of qualitative research: techniques and procedures for developing grounded theory (2nd ed.). Thousand Oaks: Sage Publications.Google Scholar
Index Terms
- Accessible Crowdwork?: Understanding the Value in and Challenge of Microtask Employment for People with Disabilities
Recommendations
Investigating the Accessibility of Crowdwork Tasks on Mechanical Turk
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing SystemsCrowdwork can enable invaluable opportunities for people with disabilities, not least the work flexibility and the ability to work from home, especially during the current Covid-19 pandemic. This paper investigates how engagement in crowdwork tasks is ...
Understanding the Microtask Crowdsourcing Experience for Workers with Disabilities: A Comparative View
CSCWMicrotask crowdsourcing holds great potential as an employment opportunity with the flexibility and anonymity that individuals with disability may require. Though prior research has explored the accessibility of crowd work, the lived crowd work ...
Evaluating the accessibility of crowdsourcing tasks on Amazon's mechanical turk
ASSETS '14: Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibilityCrowd work web sites such as Amazon Mechanical Turk enable individuals to work from home, which may be useful for people with disabilities. However, the web sites for finding and performing crowd work tasks must be accessible if people with disabilities ...
Comments