Vera Khovanskaya
Lynn Dombrowski
Phoebe Sengers
Skip Abstract Section
Abstract
At the same time that workers' rights are generally declining in the United States (US), workplace computing systems gather more data about workers and their activities than ever before. The rise of large scale labor analytics raises questions about how and whether workers could use such data to advocate for their own goals. Here, we analyze the historical development of workplace technology design methods in CSCW to show how mid-20th century labor responses to scientific management can inform directions in contemporary digital labor advocacy. First, we demonstrate how specific methodological tendencies from industrial scientific management were adapted to work in CSCW, and then subsequently altered in crowd work and social computing research to more closely resemble industrial approaches. Next, we show how three tactics used by labor unions to strategically engage with industrial scientific management in the mid-20th century can inform data-driven worker advocacy in platform-mediated work. Finally, we discuss how this history shapes our understanding of worker participation and the implications of using worker data for contemporary advocacy goals.
- Dan Diaper and Neville A. Stanton (Eds.). 2004. The handbook of task analysis for human-computer interaction. Lawrence Erlbaum.Google Scholar
- Adam Abruzzi. 1951. Objective Procedures for Estimating Industrial Productivity. ILR Review, Vol. 5, 1 (1951), 108--117. https://doi.org/10.1177/001979395100500108Google ScholarCross Ref
- Mark S. Ackerman. 2000. The Intellectual Challenge of CSCW: The Gap Between Social Requirements and Technical Feasibility. Hum.-Comput. Interact., Vol. 15, 2 (2000), 179--203. https://doi.org/10.1207/S15327051HCI1523_5Google ScholarDigital Library
- Charlotte Alexander. 2015. Transparency and Transmission: Theorizing Information's Role in Regulatory and Market Responses to Workplace Problems. Connecticut Law Review, Vol. 48, 1 (2015), 177. https://papers.ssrn.com/abstract=2757759Google Scholar
- Ali Alkhatib, Michael S. Bernstein, and Margaret Levi. 2017. Examining Crowd Work and Gig Work Through The Historical Lens of Piecework. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17. ACM Press, Denver, Colorado, USA, 4599--4616. https://doi.org/10.1145/3025453.3025974Google ScholarDigital Library
- Ali Alkhatib, Justin Cranshaw, and Andrés Monroy-Hernández. 2018. Laying the Groundwork for a Worker-Centric Peer Economy. arXiv:1807.08189 [cs] (2018). arxiv: 1807.08189 http://arxiv.org/abs/1807.08189Google Scholar
- John Annett. 2003. Hierarchical Task Analysis. In E. Hollnagel (Ed)., Handbook of Cognitive Task Design. Lawrence Erlbaum Associates, Inc., 17--35.Google Scholar
- J. Annett and K. D. Duncan. 1967. Task Analysis and Training Design. (1967), 22. https://eric.ed.gov/?id=ED019566Google Scholar
- Peter M Asaro. 2000. Transforming society by transforming technology: the science and politics of participatory design. AMIT Accounting, Management and Information Technologies, Vol. 10, 4 (2000), 257--290. OCLC: 4930455050.Google ScholarCross Ref
- Frank Leslie Bailey, International Union, United Automobile, Aerospace, and Agricultural Implement Workers of America, Wallace-Murray Corporation, and Stevenson, Inc, Jordan & Harrison. 1942. Production standards from time study analysis by labor and management. Local no. 2, U.A.W.-C.I.O., and the Murray Corp. of America. OCLC: 3717079.Google Scholar
- Liam Bannon. 2011. Reimagining HCI: Toward a More Human-centered Perspective. Interactions, Vol. 18, 4 (2011), 50--57. https://doi.org/10.1145/1978822.1978833Google ScholarDigital Library
- Liam J Bannon and Kjeld Schmidt. 1989. CSCW - Four Characters in Search of a Context. DPB DAIMI Report Series, Vol. 18, 289 (1989), 378--382. OCLC: 7083123381.Google Scholar
- Solomon Barkin. 1953. Concepts in the Measurement of Human Application. Industrial and Labor Relations Review, Vol. 7, 1 (1953), 103--118. OCLC: 5544326559.Google ScholarCross Ref
- Solomon Barkin. 1970. Arbitrator's Headache--Wage Incentive Cases. Compensation & Benefits Review, Vol. 2, 2 (1970), 60--64. OCLC: 5723624789.Google ScholarCross Ref
- Gordon Baxter and Ian Sommerville. 2011. Socio-technical systems: From design methods to systems engineering. INTCOM Interacting with Computers, Vol. 23, 1 (2011), 4--17. OCLC: 5900602211.Google ScholarDigital Library
- Alan Benson, Aaron Sojourner, and Akhmed Umyarov. 2019. Can Reputation Discipline the Gig Economy?: Experimental Evidence From an Online Labor Market. https://papers.ssrn.com/abstract=3313550Google Scholar
- Ethan S. Bernstein. 2017. Making Transparency Transparent: The Evolution of Observation in Management Theory. Academy of Management Annals, Vol. 11, 1 (2017), 217--266. https://doi.org/10.5465/annals.2014.0076Google ScholarCross Ref
- Michael S. Bernstein, Joel Brandt, Robert C. Miller, and David R. Karger. 2011. Crowds in Two Seconds: Enabling Realtime Crowd-powered Interfaces. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, Santa Barbara, California, USA, 33--42. https://doi.org/10.1145/2047196.2047201Google ScholarDigital Library
- Michael S. Bernstein, Greg Little, Robert C. Miller, Björn Hartmann, Mark S. Ackerman, David R. Karger, David Crowell, and Katrina Panovich. 2010. Soylent: A Word Processor with a Crowd Inside. In Proceedings of the 23Nd Annual ACM Symposium on User Interface Software and Technology (UIST '10). ACM, New York, NY, USA, 313--322. https://doi.org/10.1145/1866029.1866078Google ScholarDigital Library
- Jeffrey P. Bigham, Chandrika Jayant, Hanjie Ji, Greg Little, Andrew Miller, Robert C. Miller, Robin Miller, Aubrey Tatarowicz, Brandyn White, Samual White, and Tom Yeh. 2010. VizWiz: Nearly Real-time Answers to Visual Questions. In Proceedings of the 23Nd Annual ACM Symposium on User Interface Software and Technology (UIST '10). ACM, New York, New York, USA, 333--342. https://doi.org/10.1145/1866029.1866080Google ScholarDigital Library
- Jeanette Blomberg, Lucy Suchman, and Randall Trigg. 1997. Computers and Design in Context. MIT Press, 267--287. http://dl.acm.org/citation.cfm?id=270318.270328Google Scholar
- Susanne Bødker, Pelle Ehn, Dan Sjögren, and Yngve Sundblad. 2000. Co-operative Design -- perspectives on 20 years with `the Scandinavian IT Design Model'. In proceedings of NordiCHI, Vol. 2000. 22--24.Google Scholar
- Geoffrey C Bowker and Susan Leigh Star. 2000. Sorting things out: classification and its consequences .Massachusetts Institute of Technology.Google ScholarDigital Library
- Harry Braverman. 1998. Labor and monopoly capital: the degradation of work in the twentieth century .Monthly Review Press.Google Scholar
- Kate Bronfenbrenner and Tom Juravich. 1998. It takes more than house calls: Organizing to win with a comprehensive union-building strategy [Electronic version]. In Articles & Chapters,, K. Bronfenbrenner, S. Friedman, R. W. Hurd, R. A. Oswald, and R.L. Seeber (Eds.). ILR Press, 187. http://digitalcommons.ilr.cornell.edu/articles/187/Google Scholar
- Alexia Fernández Campbell. 2019. The worldwide Uber strike is a key test for the gig economy. https://www.vox.com/2019/5/8/18535367/uber-drivers-strike-2019-citiesGoogle Scholar
- Bilma Canales. 2018. Closing the Federal Gender Pay Gap Through Wage Transparency. Houston law review, Vol. 55, 4 (2018), 969--998. OCLC: 7669015462.Google Scholar
- Stuart K Card, Thomas P Moran, and Allen Newell. 1983. The psychology of human-computer interaction .L. Erlbaum Associates. OCLC: 9042220.Google ScholarDigital Library
- John M. Carroll. 1996. Encountering Others: Reciprocal Openings in Participatory Design and User-Centered Design. Human-Computer Interaction, Vol. 11, 3 (1996), 285--290. https://doi.org/10.1207/s15327051hci1103_5Google ScholarDigital Library
- John M. Carroll. 2010. Conceptualizing a possible discipline of human-computer interaction. Interacting with Computers, Vol. 22, 1 (2010), 3--12. https://doi.org/10.1016/j.intcom.2009.11.008Google ScholarDigital Library
- Phil Carroll Jr. 1941. One view of labor's participation in time and motion study. Advanced Management: Quarterly Journal, Vol. 6 (1941), 75--80. //catalog.hathitrust.org/Record/005336789Google Scholar
- Melissa Cefkin, Obinna Anya, Steve Dill, Robert Moore, Susan Stucky, and Osariemo Omokaro. 2014. Back to the future of organizational work: crowdsourcing and digital work marketplaces. In Proceedings of the companion publication of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing - CSCW Companion '14. ACM Press, Baltimore, Maryland, USA, 313--316. https://doi.org/10.1145/2556420.2558858Google ScholarDigital Library
- Dana Chandler and Adam Kapelner. 2013. Breaking monotony with meaning: Motivation in crowdsourcing markets. Journal of Economic Behavior & Organization, Vol. 90 (2013), 123--133. https://doi.org/10.1016/j.jebo.2013.03.003Google ScholarCross Ref
- Justin Cheng, Jaime Teevan, and Michael S. Bernstein. 2015. Measuring Crowdsourcing Effort with Error-Time Curves. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 1365--1374. https://doi.org/10.1145/2702123.2702145Google Scholar
- Chun-Wei Chiang, Anna Kasunic, and Saiph Savage. 2018. Crowd Coach: Peer Coaching for Crowd Workers' Skill Growth. Proceedings of the ACM on Human-Computer Interaction -- CSCW, Vol. 2 (2018), 37:1--37:17. Issue CSCW. https://doi.org/10.1145/3274306Google ScholarDigital Library
- Lydia B. Chilton, Greg Little, Darren Edge, Daniel S. Weld, and James A. Landay. 2013. Cascade: Crowdsourcing Taxonomy Creation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 1999--2008. https://doi.org/10.1145/2470654.2466265Google Scholar
- Lydia B. Chilton, Clayton T. Sims, Max Goldman, Greg Little, and Robert C. Miller. 2009. Seaweed: A Web Application for Designing Economic Games. In Proceedings of the ACM SIGKDD Workshop on Human Computation (HCOMP '09). ACM, New York, NY, USA, 34--35. https://doi.org/10.1145/1600150.1600162Google Scholar
- Richard A. Cloward and Frances Fox Piven. 1999. Disruptive dissensus : people and power in the industrial age. In Reflections on community organization: enduring themes and critical issues,, Jack Rothman (Ed.). F.E. Peacock Publishers. OCLC: 607382229.Google Scholar
- Richard W. Collins. 1995. CSCW: An Opportunity for Action Research. In Proceedings of Conference on Organizational Computing Systems (COCS '95). ACM, New York, NY, USA, 162--167. https://doi.org/10.1145/224019.224035Google ScholarDigital Library
- Coworker.org. 2019. About Us. https://home.coworker.org/about-us/Google Scholar
- R. Crawley. 1982. Predicting air traffic controller reaction to computer assistance: a follow-up study. AP Report, Vol. 105 (1982).Google Scholar
- Abe Crystal and Beth Ellington. 2004. Task analysis and human-computer interaction: approaches, techniques, and levels of analysis. AMCIS 2004 Proceedings (2004), 391. https://aisel.aisnet.org/amcis2004/391Google Scholar
- Peng Dai, Jeffrey M. Rzeszotarski, Praveen Paritosh, and Ed H. Chi. 2015. And Now for Something Completely Different: Improving Crowdsourcing Workflows with Micro-Diversions. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15). ACM, New York, NY, USA, 628--638. https://doi.org/10.1145/2675133.2675260Google Scholar
- Valerio De Stefano. 2015. The Rise of the Just-in-Time Workforce: On-Demand Work, Crowdwork, and Labor Protection in the Gig-Economy. Comparative Labor Law & Policy Journal, Vol. 37 (2015), 471--504. https://heinonline.org/HOL/P?h=hein.journals/cllpj37&i=507Google Scholar
- Dan Diaper. 2006. Task Analysis at the Heart of Human-Computer Interaction. In Encyclopedia of Human Computer Interaction. IGI Global, 579--587.Google Scholar
- Lynn Dombrowski, Adriana Alvarado Garcia, and Jessica Despard. 2017. Low-Wage Precarious Workers' Sociotechnical Practices Working Towards Addressing Wage Theft. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 4585--4598. https://doi.org/10.1145/3025453.3025633Google ScholarDigital Library
- Steven Dow, Anand Kulkarni, Scott Klemmer, and Björn Hartmann. 2012. Shepherding the Crowd Yields Better Work. In Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work (CSCW '12). ACM, New York, NY, USA, 1013--1022. https://doi.org/10.1145/2145204.2145355Google ScholarDigital Library
- Joseph Stephen Dwyer. 1949. An analysis of motion and time study training as given by colleges and industrial organizations. OCLC: 881274693.Google Scholar
- Pelle Ehn. 1988. Work-oriented design of computer artifacts .Arbetslivscentrum : International distribution, Almqvist & Wiksell International.Google Scholar
- Pelle Ehn, Peter Botsman, and Peter Rawlinson. 1986. Negotiating Change: New Technology and Trade Unions : an Interview with Pelle Ehn .Local Consumption.Google Scholar
- Motahhare Eslami, Kristen Vaccaro, Karrie Karahalios, and Kevin Hamilton. 2017. “Be Careful; Things Can Be Worse than They Appear”: Understanding Biased Algorithms and Users' Behavior Around Them in Rating Platforms. https://www.aaai.org/ocs/index.php/ICWSM/ICWSM17/paper/view/15697Google Scholar
- Cynthia Estlund. 2011. Just the Facts: The Case for Workplace Transparency. Stanford Law Review, Vol. 63, 2 (2011), 351--407. OCLC: 7781107254.Google Scholar
- Cynthia Estlund. 2017. Extending the Case for Workplace Transparency to Information About Pay. UC Irvine Law Review, Vol. 4, 2 (2017). OCLC: 8092013097.Google Scholar
- Frederick Evans and Kjell Eric Magnusson. 1966. M™-2 student manual, etc. Warrington. OCLC: 558851380.Google Scholar
- Oluwaseyi Feyisetan, Elena Simperl, Max Van Kleek, and Nigel Shadbolt. 2015. Improving Paid Microtasks through Gamification and Adaptive Furtherance Incentives. In Proceedings of the 24th International Conference on World Wide Web - WWW '15. ACM Press, Florence, Italy, 333--343. https://doi.org/10.1145/2736277.2741639Google ScholarDigital Library
- Laura Forlano and Megan Halpern. 2015. FCJ-189 Reimagining Work: Entanglements and Frictions around Future of Work Narratives. The Fibreculture Journal 26 (2015), 32--59. https://doi.org/10.15307/fcj.26.189.2015Google ScholarCross Ref
- Sarah E. Fox, Kiley Sobel, and Daniela K. Rosner. 2019. Managerial Visions: Stories of Upgrading and Maintaining the Public Restroom with IoT. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, Glasgow, Scotland Uk, 493:1--493:15. https://doi.org/10.1145/3290605.3300723Google Scholar
- Georges Friedmann. 1955. Industrial society; the emergence of the human problems of automation (Problèmes humains du machinisme industriel) .Free Press. OCLC: 830944.Google Scholar
- Snehalkumar (Neil) S. Gaikwad, Mark E. Whiting, Dilrukshi Gamage, Catherine A. Mullings, Dinesh Majeti, Shirish Goyal, Aaron Gilbee, Nalin Chhibber, Adam Ginzberg, Angela Richmond-Fuller, Sekandar Matin, Vibhor Sehgal, Tejas Seshadri Sarma, Ahmed Nasser, Alipta Ballav, Jeff Regino, Sharon Zhou, Kamila Mananova, Preethi Srinivas, Karolina Ziulkoski, Dinesh Dhakal, Alexander Stolzoff, Senadhipathige S. Niranga, Mohamed Hashim Salih, Akshansh Sinha, Rajan Vaish, and Michael S. Bernstein. 2017. The Daemo Crowdsourcing Marketplace. In Companion of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17 Companion). ACM, New York, NY, USA, 1--4. https://doi.org/10.1145/3022198.3023270Google Scholar
- Krzysztof Gajos, Katharina Reinecke, and Charles Herrmann. 2012. Accurate Measurements of Pointing Performance from in Situ Observations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 3157--3166. https://doi.org/10.1145/2207676.2208733Google ScholarDigital Library
- Lillian M Gilbreth. 1925. TRAINING EMPLOYES IN PRODUCTION WORK. saetransactions SAE Transactions, Vol. 20 (1925), 735--760. OCLC: 7851216721.Google Scholar
- April Glaser. 2019. The Ride-Hail Strike Got Just Enough Attention to Terrify Uber. https://slate.com/technology/2019/05/uber-strike-impact-gig-worker-protest.htmlGoogle Scholar
- Evelyn Nakano Glenn and Roslyn L. Feldberg. 1977. Degraded and Deskilled: The Proletarianization of Clerical Work. Social Problems, Vol. 25, 1 (1977), 52--64. https://doi.org/10.2307/800467Google ScholarCross Ref
- William Gomberg. 1947. A labor union manual on job evaluation, the relationship of industrial engineering techniques to collective bargaining. Labor Education Division, Roosevelt College. OCLC: 831726.Google Scholar
- William Gomberg. 1948. The validity of time study techniques. Science Research Associates. OCLC: 2046699.Google Scholar
- William Gomberg. 1955 a. A trade union analysis of time study .Prentice-Hall. OCLC: 562377.Google Scholar
- William Gomberg. 1955 b. Trade Unions and Industrial Engineering (Section 17). In Ireson and Grant. 1118--1183.Google Scholar
- William Gomberg. 1966. The trouble with democratic management. Trans-action, Vol. 3, 5 (1966), 30--35. https://doi.org/10.1007/BF02804548Google Scholar
- Mary L. Gray, Siddharth Suri, Syed Shoaib Ali, and Deepti Kulkarni. 2016. The Crowd is a Collaborative Network. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). ACM, New York, NY, USA, 134--147. https://doi.org/10.1145/2818048.2819942Google ScholarDigital Library
- Jonathan Grudin. 2017. From tool to partner: the evolution of human-computer interaction. Number 35 in Synthesis lectures on human-centered informatics. Morgan & Claypool.Google Scholar
- Jonathan Grudin and Rebecca E Grinter. 1994. Ethnography and design. Comput Supported Coop Work Computer Supported Cooperative Work (CSCW), Vol. 3, 1 (1994), 55--59. OCLC: 5655046678.Google ScholarDigital Library
- Karin Hansson, Tanja Aitamurto, and Thomas Ludwig. 2017. From alienation to relation: Examining the modes of production in crowdsourcing. (2017). https://doi.org/10.18420/ecscw2017--13Google Scholar
- Ellie Harmon and M. Six Silberman. 2018. Rating Working Conditions on Digital Labor Platforms. Comput. Supported Coop. Work, Vol. 27, 3 (2018), 1275--1324. https://doi.org/10.1007/s10606-018--9313--5Google ScholarDigital Library
- Richard Harper and Kathleen Carter. 1993. Keeping people apart. Computer Supported Cooperative Work (CSCW), Vol. 2, 3 (1993), 199--207. https://doi.org/10.1007/BF00749017Google ScholarCross Ref
- Kenji Hata, Ranjay Krishna, Li Fei-Fei, and Michael S. Bernstein. 2017. A Glimpse Far into the Future: Understanding Long-term Crowd Worker Quality. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 889--901. https://doi.org/10.1145/2998181.2998248Google Scholar
- Frederick Herzberg. 1973. Work and the nature of man. New American Library. OCLC: 975249.Google Scholar
- Sarah Holder. 2019. The Gig-Work Bill That Has Uber and Lyft Spooked. https://www.citylab.com/transportation/2019/06/gig-economy-employment-law-california-bill-ab-5-uber-lyft/591565/Google Scholar
- Karen Holtzblatt and Hugh Beyer. 1996. Contextual Design: Using Customer Work Models to Drive Systems Design. In Conference Companion on Human Factors in Computing Systems (CHI '96). ACM, New York, NY, USA, 373--374. https://doi.org/10.1145/257089.257379Google ScholarDigital Library
- John Joseph Horton and Lydia B. Chilton. 2010. The labor economics of paid crowdsourcing. In Proceedings of the 11th ACM conference on Electronic commerce - EC '10. ACM Press, Cambridge, Massachusetts, USA, 209. https://doi.org/10.1145/1807342.1807376Google Scholar
- Edwin Hutchins and Leysia Palen. 1997. Constructing Meaning from Space, Gesture, and Speech. In Discourse, Tools and Reasoning: Essays on Situated Cognition, Lauren B. Resnick, Roger Säljö, Clotilde Pontecorvo, and Barbara Burge (Eds.). Springer Berlin Heidelberg, 23--40. https://doi.org/10.1007/978--3--662-03362--3_2Google Scholar
- International Association of Machinists and Research Department. 1954. What's wrong with job evaluation; a trade union manual. OCLC: 5154416.Google Scholar
- International Metalworkers' Federation. 1963. Wage systems and the metal unions: a trade union training manual .International Metalworkers' Federation.Google Scholar
- Allied Industrial Workers of America International Union. 1967. Work measurement; a guide for local union bargaining committees and stewards. OCLC: 1093011.Google Scholar
- International Union, United Automobile, Aerospace, and Agricultural Implement Workers of America. 1947. The UAW-CIO looks at time study; a guide for union negotiators in plants where time study methods are used ... OCLC: 17660798.Google Scholar
- Lilly C. Irani and M. Six Silberman. 2013. Turkopticon: Interrupting Worker Invisibility in Amazon Mechanical Turk. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 611--620. https://doi.org/10.1145/2470654.2470742Google ScholarDigital Library
- Lilly C. Irani and M. Six Silberman. 2016. Stories We Tell About Labor: Turkopticon and the Trouble with "Design". In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 4573--4586. https://doi.org/10.1145/2858036.2858592Google Scholar
- Shagun Jhaver, Yoni Karpfen, and Judd Antin. 2018. Algorithmic Anxiety and Coping Strategies of Airbnb Hosts. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, 421:1--421:12. https://doi.org/10.1145/3173574.3173995Google ScholarDigital Library
- Bonnie E. John and David E. Kieras. 1996 a. The GOMS Family of User Interface Analysis Techniques: Comparison and Contrast. ACM Trans. Comput.-Hum. Interact., Vol. 3, 4 (1996), 320--351. https://doi.org/10.1145/235833.236054Google ScholarDigital Library
- Bonnie E. John and David E. Kieras. 1996 b. Using GOMS for User Interface Design and Evaluation: Which Technique? ACM Trans. Comput.-Hum. Interact., Vol. 3, 4 (1996), 287--319. https://doi.org/10.1145/235833.236050Google ScholarDigital Library
- Bonnie E. John and Steven J. Marks. 1997. Tracking the effectiveness of usability evaluation methods. Behaviour & Information Technology, Vol. 16, 4 (1997), 188--202. https://doi.org/10.1080/014492997119789Google ScholarCross Ref
- Bonnie E. John, Konstantine Prevas, Dario D. Salvucci, and Ken Koedinger. 2004. Predictive Human Performance Modeling Made Easy. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). ACM, New York, NY, USA, 455--462. https://doi.org/10.1145/985692.985750Google ScholarDigital Library
- J Kallinikos. 2007. The Consequences of Information: Institutional Implications of Technological Change. Edward Elgar Pub. http://public.eblib.com/choice/publicfullrecord.aspx?p=283325Google Scholar
- Van Dusen Kennedy. 1945. Union policy and incentive wage methods, .Columbia University Press; P.S. King & Staples, Ltd. OCLC: 400261.Google Scholar
- Dara Kerr. 2018. Uber's first driver meeting: Behind closed doors. https://www.cnet.com/news/ubers-driver-advisory-forum-meeting-behind-closed-doors/Google Scholar
- Aniket Kittur, Ed H. Chi, and Bongwon Suh. 2008. Crowdsourcing User Studies with Mechanical Turk. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 453--456. https://doi.org/10.1145/1357054.1357127Google ScholarDigital Library
- Aniket Kittur, Jeffrey V. Nickerson, Michael Bernstein, Elizabeth Gerber, Aaron Shaw, John Zimmerman, Matt Lease, and John Horton. 2013. The Future of Crowd Work. In Proceedings of the 2013 Conference on Computer Supported Cooperative Work (CSCW '13). ACM, New York, NY, USA, 1301--1318. https://doi.org/10.1145/2441776.2441923Google ScholarDigital Library
- Aniket Kittur, Boris Smus, Susheel Khamkar, and Robert E. Kraut. 2011. CrowdForge: Crowdsourcing Complex Work. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, NY, USA, 43--52. https://doi.org/10.1145/2047196.2047202Google Scholar
- William H. Knowles. 1952. The Nature of Industrial Cooperation. Southern Economic Journal, Vol. 18, 3 (1952), 350--361. https://doi.org/10.2307/1054450Google ScholarCross Ref
- Steven Komarov, Katharina Reinecke, and Krzysztof Z. Gajos. 2013. Crowdsourcing Performance Evaluations of User Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 207--216. https://doi.org/10.1145/2470654.2470684Google Scholar
- Anand Kulkarni, Matthew Can, and Björn Hartmann. 2012. Collaboratively Crowdsourcing Workflows with Turkomatic. In Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work (CSCW '12). ACM, New York, NY, USA, 1003--1012. https://doi.org/10.1145/2145204.2145354Google ScholarDigital Library
- Walter S. Lasecki, Rachel Wesley, Jeffrey Nichols, Anand Kulkarni, James F. Allen, and Jeffrey P. Bigham. 2013. Chorus: A Crowd-powered Conversational Assistant. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, New York, NY, USA, 151--162. https://doi.org/10.1145/2501988.2502057Google Scholar
- Sage Lazzaro. 2016. Uber Drivers Plan Boycott After Fare Cuts Slash Their Earnings to Below Minimum Wage. https://observer.com/2016/01/uber-drivers-plan-boycott-after-fare-cuts-slash-their-earnings-to-below-minimum-wage/Google Scholar
- Min Kyung Lee, Daniel Kusbit, Evan Metsky, and Laura Dabbish. 2015. Working with Machines: The Impact of Algorithmic and Data-Driven Management on Human Workers. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, Seoul, Republic of Korea, 1603--1612. https://doi.org/10.1145/2702123.2702548Google ScholarDigital Library
- Nelson Lichtenstein. 2002. State of the Union: a century of American labor .Princeton University Press.Google Scholar
- Chavie Lieber. 2019 a. Grocery startup Instacart says it's fixed its payment problems. This gig worker says it hasn't. https://www.vox.com/the-goods/2019/5/14/18566237/instacart-shopper-tip-grocery-delivery-paymentGoogle Scholar
- Chavie Lieber. 2019 b. Some delivery apps pocket their workers' tips. A new bill aims to expose the practice. https://www.vox.com/the-goods/2019/4/24/18513559/tipping-policies-doordash-instacart-amazon-flex-new-york-billGoogle Scholar
- Sebastian B. Littauer and Adam Abruzzi. 1949. Experimental criteria for evaluating workers and operations. ILR Review, Vol. 2, 4 (1949), 502--526.Google ScholarCross Ref
- Craig R. Littler. 1978. Understanding Taylorism. The British Journal of Sociology, Vol. 29, 2 (1978), 185--202. https://doi.org/10.2307/589888Google ScholarCross Ref
- Z. Liu, Y. Wang, M. Dontcheva, M. Hoffman, S. Walker, and A. Wilson. 2017. Patterns and Sequences: Interactive Exploration of Clickstreams to Understand Common Visitor Paths. IEEE Transactions on Visualization and Computer Graphics, Vol. 23, 1 (2017), 321--330. https://doi.org/10.1109/TVCG.2016.2598797Google ScholarDigital Library
- Mitchell Lokiec. 1977. Productivity and incentives .Bobbin Publications.Google Scholar
- Brenton J Malin and Curry Chandler. 2017. Free to Work Anxiously: Splintering Precarity Among Drivers for Uber and Lyft. Communication, Culture & Critique, Vol. 10, 2 (2017), 382--400. OCLC: 7736345469.Google ScholarCross Ref
- Peter Mambrey, Gloria Mark, Gloria Mark, and Uta Pankoke-Babatz. 1998. User Advocacy in Participatory Design: Designers' Experiences with a New Communication Channel. Comput. Supported Coop. Work, Vol. 7, 3 (1998), 291--313. https://doi.org/10.1023/A:1008687122083Google ScholarDigital Library
- Giuseppe Mantovani. 1996. Social context in HCl: A new framework for mental models, cooperation, and communication. Cognitive Science, Vol. 20, 2 (1996), 237--269. https://doi.org/10.1016/S0364-0213(99)80007-XGoogle ScholarCross Ref
- David Martin, Benjamin V. Hanrahan, Jacki O'Neill, and Neha Gupta. 2014. Being a Turker. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '14). ACM, New York, NY, USA, 224--235. https://doi.org/10.1145/2531602.2531663Google ScholarDigital Library
- Harold B Maynard. 1956. Industrial engineering handbook. McGraw-Hill. OCLC: 562114.Google Scholar
- Harold B Maynard. 1971. Industrial engineering handbook .McGraw-Hill. OCLC: 206045.Google Scholar
- Melissa Mazmanian and Christine M. Beckman. 2018. "Making" Your Numbers: Engendering Organizational Control Through a Ritual of Quantification. Organization Science, Vol. 29, 3 (2018), 357--379. https://doi.org/10.1287/orsc.2017.1185Google ScholarDigital Library
- John McCarthy. 2000. The paradox of understanding work for design. International Journal of Human-Computer Studies, Vol. 53, 1 (2000), 197--219. OCLC: 361007530.Google ScholarDigital Library
- Brian McInnis, Dan Cosley, Chaebong Nam, and Gilly Leshed. 2016. Taking a HIT: Designing Around Rejection, Mistrust, Risk, and Workers' Experiences in Amazon Mechanical Turk. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 2271--2282. https://doi.org/10.1145/2858036.2858539Google ScholarDigital Library
- Laura G. Militello and Robert JB Hutton. 1998. Applied cognitive task analysis (ACTA): a practitioner's toolkit for understanding cognitive task demands. Ergonomics, Vol. 41, 11 (1998), 1618--1641.Google ScholarCross Ref
- Michelle Miller and Eric Harris Bernstein. 2017. New Frontiers of Worker Power: Challenges and Opportunities in the Modern Economy., bibinfonumpages23 pages. http://rooseveltinstitute.org/wp-content/uploads/2017/02/NewFrontiers_Feb17.pdfGoogle Scholar
- M. Scott Myers. 1968. Every employee a manager. California Management Review, Vol. 10, 3 (1968), 9--20.Google ScholarCross Ref
- Gerald Nadler. 1963. Work design. R.D. Irwin. OCLC: 229620.Google Scholar
- Milton J Nadworny. 1955. Scientific management and the unions, 1900--1932; a historical analysis. Harvard University Press. OCLC: 233696.Google Scholar
- Bonnie A Nardi. 1996. Context and consciousness: activity theory and human-computer interaction .MIT Press.Google ScholarDigital Library
- Sara O'Brien. 2019. On-demand workers are protesting -- using the apps they work for - CNN. https://www.cnn.com/2019/06/14/tech/postmates-blitz-up-worker-protest/index.htmlGoogle Scholar
- Kathleen H. Pine and Max Liboiron. 2015. The Politics of Measurement and Action. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, Seoul, Republic of Korea, 3147--3156. https://doi.org/10.1145/2702123.2702298Google ScholarDigital Library
- Noopur Raval and Paul Dourish. 2016. Standing Out from the Crowd: Emotional Labor, Body Labor, and Temporal Labor in Ridesharing. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). ACM, New York, NY, USA, 97--107. https://doi.org/10.1145/2818048.2820026Google ScholarDigital Library
- Daniela Retelny, Michael S. Bernstein, and Melissa A. Valentine. 2017. No Workflow Can Ever Be Enough: How Crowdsourcing Workflows Constrain Complex Work. Proc. ACM Hum.-Comput. Interact., Vol. 1 (2017), 89:1--89:23. Issue CSCW. https://doi.org/10.1145/3134724Google Scholar
- Daniela Retelny, Sébastien Robaszkiewicz, Alexandra To, Walter S. Lasecki, Jay Patel, Negar Rahmati, Tulsee Doshi, Melissa Valentine, and Michael S. Bernstein. 2014. Expert Crowdsourcing with Flash Teams. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 75--85. https://doi.org/10.1145/2642918.2647409Google Scholar
- Jakob Rogstadius, Vassilis Kostakos, Aniket Kittur, Boris Smus, Jim Laredo, and Maja Vukovic. 2011. An Assessment of Intrinsic and Extrinsic Motivation on Task Performance in Crowdsourcing Markets. In Fifth International AAAI Conference on Weblogs and Social Media. https://www.aaai.org/ocs/index.php/ICWSM/ICWSM11/paper/view/2778Google Scholar
- Kevin Roose. 2019. After Uproar, Instacart Backs Off Controversial Tipping Policy. The New York Times (2019). https://www.nytimes.com/2019/02/06/technology/instacart-doordash-tipping-deliveries.htmlGoogle Scholar
- Alex Rosenblat and Luke Stark. 2016. Algorithmic labor and information asymmetries: A case study of Uber's drivers. International Journal of Communication, Vol. 10 (2016), 3758--3784. https://doi.org/1932--8036/20160005Google Scholar
- Emilie M. Roth and Randall J. Mumaw. 1995. Using Cognitive Task Analysis to Define Human Interface Requirements for First-of-A-Kind Systems. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 39, 9 (1995), 520--524. OCLC: 5725488007.Google Scholar
- Jeffrey Rzeszotarski and Aniket Kittur. 2012. CrowdScape: interactively visualizing user behavior and output. In Proceedings of the 25th annual ACM symposium on User interface software and technology - UIST '12. ACM Press, Cambridge, Massachusetts, USA, 55. https://doi.org/10.1145/2380116.2380125Google ScholarDigital Library
- Jeffrey M. Rzeszotarski and Aniket Kittur. 2011. Instrumenting the Crowd: Using Implicit Behavioral Measures to Predict Task Performance. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, NY, USA, 13--22. https://doi.org/10.1145/2047196.2047199Google Scholar
- Niloufar Salehi, Lilly Irani, Ali Al Khatib, and Michael Bernstein. 2014. Dynamo: Designing Interactive Technology to Support Social Movements in Digital Labor. Future of Work Project (Open Society Foundations, 2014) (2014).Google Scholar
- Niloufar Salehi, Lilly C. Irani, Michael S. Bernstein, Ali Alkhatib, Eva Ogbe, Kristy Milland, and Clickhappier. 2015. We Are Dynamo: Overcoming Stalling and Friction in Collective Action for Crowd Workers. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 1621--1630. https://doi.org/10.1145/2702123.2702508Google ScholarDigital Library
- Graham Sewell. 1998. The Discipline of Teams: The Control of Team-Based Industrial Work Through Electronic and Peer Surveillance. Administrative Science Quarterly, Vol. 43, 2 (1998), 397. https://doi.org/10.2307/2393857Google ScholarCross Ref
- Graham Sewell and Barry Wilkinson. 1992. `Someone to Watch Over Me': Surveillance, Discipline and the Just-in-Time Labour Process. sociology Sociology, Vol. 26, 2 (1992), 271--289. OCLC: 5792440034.Google Scholar
- Andrew Shepherd. 2001. Hierarchical task analysis .Taylor & Francis.Google Scholar
- Faiz Siddiqui. 2019. Uber and Lyft drivers strike for pay transparency--after algorithms made it harder to understand. Washington Post (2019). https://www.washingtonpost.com/technology/2019/05/08/uber-lyft-drivers-strike-pay-transparency-after-algorithms-made-it-harder-understand/Google Scholar
- Ludwig Siegele. 2018. Technology may help to revive organised labour. The Economist (2018). https://www.economist.com/briefing/2018/11/15/technology-may-help-to-revive-organised-labourGoogle Scholar
- M. Six Silberman and I. G. Metall. 2017. Fifteen criteria for a fairer gig economy. In Towards a Fairer Gig Economy,, M. Graham and J. Shaw (Eds.). Meatspace Press, 16--19.Google Scholar
- Jesper Simonsen and Finn Kensing. 1997. Using Ethnography in Contextural Design. Commun. ACM, Vol. 40, 7 (1997), 82--88. https://doi.org/10.1145/256175.256190Google ScholarDigital Library
- Susan Leigh Star and Anselm Strauss. 1999. Layers of Silence, Arenas of Voice: The Ecology ofVisible and Invisible Work. Comput. Supported Coop. Work, Vol. 8, 1 (1999), 9--30. https://doi.org/10.1023/A:1008651105359Google ScholarDigital Library
- Arthur L Stinchcombe. 1990. Information and organizations .University of California Press.Google Scholar
- Lucy Suchman. 1995. Making Work Visible. Commun. ACM, Vol. 38, 9 (1995), 56--64. https://doi.org/10.1145/223248.223263Google ScholarDigital Library
- Chloe Taylor. 2018. Uber drivers strike across the UK in protest over workers' rights. https://www.cnbc.com/2018/10/09/uber-drivers-strike-across-the-uk-in-protest-over-workers-rights.htmlGoogle Scholar
- Frederick Winslow Taylor. 1911. The principles of scientific management .Harper & brothers. OCLC: 2937172.Google Scholar
- Frederick Winslow Taylor. 1947. Scientific management, comprising Shop management, the principles of scientific management [and] Testimony before the Special House Committee .Harper. OCLC: 37887689.Google Scholar
- Molly Tran and Rosemary K. Sokas. 2017. The gig economy and contingent work: An occupational health assessment. Journal of occupational and environmental medicine, Vol. 59, 4 (2017), e63. https://doi.org/10.1097/JOM.0000000000000977Google ScholarCross Ref
- United Electrical, Radio and Machine Workers of America. 1943. U.E. guide to wage payment plans, time study, and job evaluation 2d. ed. ed.). United Electrical, Radio and Machine Workers of America.Google Scholar
- United for Respect. 2019. Who We Are. http://www.ourrespect.org/who-we-areGoogle Scholar
- Gerrit C. Van Der Veer, Bert F. Lenting, and Bas AJ Bergevoet. 1996. GTA: Groupware task analysis--Modeling complexity. Acta psychologica, Vol. 91, 3 (1996), 297--322.Google Scholar
- Martijn van Welie, Gerrit C. van der Veer, and Anton Eliöns. 1998. An Ontology for Task World Models. In Design, Specification and Verification of Interactive Systems '98 (Eurographics),, Panos Markopoulos and Peter Johnson (Eds.). Springer Vienna, 57--70.Google Scholar
- Mark E. Whiting, Dilrukshi Gamage, Snehalkumar (Neil) S. Gaikwad, Aaron Gilbee, Shirish Goyal, Alipta Ballav, Dinesh Majeti, Nalin Chhibber, Angela Richmond-Fuller, Freddie Vargus, Tejas Seshadri Sarma, Varshine Chandrakanthan, Teogenes Moura, Mohamed Hashim Salih, Gabriel Bayomi Tinoco Kalejaiye, Adam Ginzberg, Catherine A. Mullings, Yoni Dayan, Kristy Milland, Henrique Orefice, Jeff Regino, Sayna Parsi, Kunz Mainali, Vibhor Sehgal, Sekandar Matin, Akshansh Sinha, Rajan Vaish, and Michael S. Bernstein. 2017. Crowd Guilds: Worker-led Reputation and Feedback on Crowdsourcing Platforms. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 1902--1913. https://doi.org/10.1145/2998181.2998234Google Scholar
- Lauren C. Williams. 2016. More Than 60 Percent Of Uber Drivers Are Thinking About Quitting. https://thinkprogress.org/more-than-60-percent-of-uber-drivers-are-thinking-about-quitting-d2f460d3daf5/Google Scholar
- Working Washington. 2019 a. Delivering Inequality: What Instacart really pays, and how the company shifts costs to workers. https://payup.wtf/instacart/delivering-inequalityGoogle Scholar
- Working Washington. 2019 b. Instacart: Here's our 22 cents--no more tip theft, low pay, and black-box pay algorithms. https://medium.com/@workingwa/instacart-heres-our-22-cents-no-more-tip-theft-low-pay-and-black-box-pay-algorithms-8ff1d7c6b66Google Scholar
- Jian Zhao, Zhicheng Liu, Mira Dontcheva, Aaron Hertzmann, and Alan Wilson. 2015. MatrixWave: Visual Comparison of Event Sequence Data. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 259--268. https://doi.org/10.1145/2702123.2702419Google ScholarDigital Library
- Shoshana Zuboff. 1988. In the age of the smart machine: the future of work and power .Basic Books.Google Scholar
Index Terms
- The Tools of Management: Adapting Historical Union Tactics to Platform-Mediated Labor
Recommendations
Data Rhetoric and Uneasy Alliances: Data Advocacy in US Labor History
DIS '19: Proceedings of the 2019 on Designing Interactive Systems ConferenceTo gain historical perspective on the role of technical expertise in the labor movement, we explore the data-driven practices of mid-century American labor unionists who appropriated techniques from scientific management to advocate for workers. ...
Migrant Farmworkers' Experiences of Agricultural Technologies: Implications for Worker Sociality and Desired Change
CHI '24: Proceedings of the CHI Conference on Human Factors in Computing SystemsThis mixed method study situated in Ontario, Canada, investigates how migrant farmworkers’ experiences with agricultural technologies (agtech) affect their attitudes, conditions, and expectations of work, and how workers envision technologies serving as ...
Wage Theft and Technology in the Home Care Context
CSCWHome care workers (HCWs) are professionals who provide care to older adults and people with disabilities at home. However, HCWs are vulnerable and especially susceptible to wage theft, or not being paid their legally-entitled wages in full by their ...
Comments