Kinga Skorupska
Skip Abstract Section
Abstract
In this paper we describe the insights from an exploratory qualitative pilot study testing the feasibility of a solution that would encourage older adults to participate in online crowdsourcing tasks in a non-computer scenario. Therefore, we developed an Android TV application using Amara API to retrieve subtitles for TEDx talks which allows the participants to detect and categorize errors to support the quality of the translation and transcription processes. It relies on the older adults' innate skills as long-time native language users and the motivating factors of this socially and personally beneficial task. The study allowed us to verify the underlying concept of using Smart TVs as interfaces for crowdsourcing, as well as possible barriers, including the interface, configuration issues, topics and the process itself. We have also assessed the older adults' interaction and engagement with this TV-enabled online crowdsourcing task and we are convinced that the design of our setup addresses some key barriers to crowdsourcing by older adults. It also validates avenues for further research in this area focused on such considerations as autonomy and freedom of choice, familiarity, physical and cognitive comfort as well as building confidence and the edutainment value.
- 2014. Measuring Digital Skills across the EU: EU wide indicators of Digital Competence. https://ec.europa.eu/ digital-single-market/en/news/measuring-digital-skills-across-eu-eu-wide-indicators-digital-competence. (2014).Google Scholar
- 2015. World Population Aging 2015. Technical Report. United Nations Department of Economic and Social Affairs. 9--39 pages.Google Scholar
- 2017. Population structure and ageing. http://ec.europa.eu/eurostat/statistics-explained/index.php/Population_ structure_and_ageing. (2017).Google Scholar
- 2017. Turning to Education for Fun. (Dec 2017). Retrieved August 20, 2018 from https://www.nytimes.com/2015/03/ 20/education/turning-to-education-for-fun.htmlGoogle Scholar
- M. Alaoui and M. Lewkowicz. 2015. Practical issues related to the implication of elderlies in the design process -- The case of a Living Lab approach for designing and evaluating social TV services. IRBM 36, 5 (2015), 259--265.Google ScholarCross Ref
- Mike Armstrong. 2013. The Development of a Methodology to Evaluate the Perceived Quality of Live TV Subtitles. Technical Report. British Broadcasting Company.Google Scholar
- Anne Aula. 2004. Learning to use computers at a later age. In HCI and the Older Population. University of Glasgow, Leeds, UK, 3--5.Google Scholar
- Purya Baghaei and Mona Tabatabaee. 2015. The C-Test: An integrative measure of crystallized intelligence. Journal of Intelligence 3, 2 (2015), 46--58.Google ScholarCross Ref
- Bartomiej Balcerzak, Wieslaw Kopec, Radoslaw Nielek, Sebastian Kruk, Kamil Warpechowski, Mateusz Wasik, and Marek Wegrzyn. 2017. Press F1 for Help: Participatory Design for Dealing with On-line and Real Life Security of Older Adults. In Proceedings of the 12th International Scientific and Technical Conference on Computer Sciences and Information Technologies, CSIT 2017, Vol. 1. IEEE, 240--243.Google ScholarCross Ref
- Bartlomiej Balcerzak, Wieslaw Kopec, Radoslaw Nielek, Kamil Warpechowski, and Agnieszka Czajka. 2018. From Close the Door to Do not Click and Back. Security by Design for Older Adults. In Advances in Intelligent Systems and Computing II. Springer, 40--53.Google Scholar
- Robin Brewer, Meredith Ringel Morris, and Anne Marie Piper. 2016. Why would anybody do this?: Understanding Older Adults' Motivations and Challenges in Crowd Work. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 2246--2257. Google ScholarDigital Library
- L Cámara de la Fuente. 2014. Multilingual Crowdsourcing Motivation on Global Social Media, Case Study: TED OTP. Sendebar 25 (2014), 197--218.Google Scholar
- Alex Carmichael. 1999. Style guide for the design of interactive television services for elderly viewers. (1999).Google Scholar
- John Carroll, Gregorio Convertino, Umer Farooq, and Mary Beth Rosson. 2012. The firekeepers: Aging considered as a resource. Universal Access in the Information Society 11, 1 (03 2012), 7--15. Google ScholarDigital Library
- Gabriel Culbertson, Solace Shen, Erik Andersen, and Malte Jung. 2017. Have your cake and eat it too: Foreign language learning with a crowdsourced video captioning system. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 286--296. Google ScholarDigital Library
- Sara J Czaja, Neil Charness, Arthur D Fisk, Christopher Hertzog, Sankaran N Nair, Wendy A Rogers, and Joseph Sharit. 2006. Factors predicting the use of technology: Findings from the center for research and education on aging and technology enhancement (CREATE). Psychology and aging 21, 2 (2006), 333.Google Scholar
- Sara J Czaja and Chin Chin Lee. 2009. Information technology and older adults. Human-computer interaction: Designing for diverse users and domains (2009), 18--30.Google Scholar
- Sebastian Deterding, Dan Dixon, Rilla Khaled, and Lennart Nacke. 2011. From game design elements to gamefulness: defining gamification. In Proceedings of the 15th international academic MindTrek conference: Envisioning future media environments. ACM, 9--15. Google ScholarDigital Library
- Anna Dickinson, John Arnott, and Suzanne Prior. 2007. Methods for human-computer interaction research with older people. Behaviour & Information Technology 26, 4 (2007), 343--352. Google ScholarDigital Library
- Zineb Djoub. 2013. ICT education and motivating elderly people. In Ariadna; cultura, educación y tecnología, Vol. 1. 88--92.Google Scholar
- Thierry Etchegoyhen, Lindsay Bywood, Mark Fishel, Panayota Georgakopoulou, Jie Jiang, Gerard Van Loenhout, Arantza Del Pozo, Mirjam Sepesy Maucec, Anja Turner, and Martin Volk. 2014. Machine Translation for Subtitling: A Large-Scale Evaluation.. In LREC. 46--53.Google Scholar
- Anusca Ferrari. 2013. DIGCOMP: A framework for developing and understanding digital competence in Europe. Technical Report.Google Scholar
- A.D. Fisk, S.J. Czaja, W.A. Rogers, N. Charness, and J. Sharit. 2009. Designing for Older Adults: Principles and Creative Human Factors Approaches, Second Edition. CRC Press.Google Scholar
- Emily A Greenfield and Nadine F Marks. 2004. Formal volunteering as a protective factor for older adults' psychological well-being. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences 59, 5 (2004), S258--S264.Google ScholarCross Ref
- Yanni Hao. 2008. Productive activities and psychological well-being among older adults. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences 63, 2 (2008), S64--S72.Google ScholarCross Ref
- Toshinari Itoko, Shoma Arita, Masatomo Kobayashi, and Hironobu Takagi. 2014. Involving senior workers in crowdsourced proofreading. In International Conference on Universal Access in Human-Computer Interaction. Springer, 106--117. Google ScholarDigital Library
- Dean Jansen, Aleli Alcala, and Francisco Guzman. 2014. Amara: A sustainable, global solution for accessibility, powered by communities of volunteers. In International Conference on Universal Access in Human-Computer Interaction. Springer, 401--411.Google ScholarCross Ref
- Aniket Kittur, Jeffrey V Nickerson, Michael Bernstein, Elizabeth Gerber, Aaron Shaw, John Zimmerman, Matt Lease, and John Horton. 2013. The future of crowd work. In Proceedings of the 2013 conference on Computer supported cooperative work. ACM, 1301--1318. Google ScholarDigital Library
- Bran Knowles and Vicki L. Hanson. 2018. Older Adults' Deployment of 'Distrust'. ACM Trans. Comput.-Hum. Interact. 25, 4, Article 21 (Aug. 2018), 25 pages. Google ScholarDigital Library
- Bran Knowles and Vicki L. Hanson. 2018. The Wisdom of Older Technology (Non)Users. Commun. ACM 61, 3 (Feb. 2018), 72--77. Google ScholarDigital Library
- Wieslaw Kopec, Katarzyna Abramczuk, Bartlomiej Balcerzak, Marta Juzwin, Katarzyna Gniadzik, Grzegorz Kowalik, and Radoslaw Nielek. 2017. A Location-Based Game for Two Generations: Teaching Mobile Technology to the Elderly with the Support of Young Volunteers. In eHealth 360. Springer, 84--91.Google Scholar
- Wieslaw Kopec, Bartlomiej Balcerzak, Radoslaw Nielek, Grzegorz Kowalik, Adam Wierzbicki, and Fabio Casati. 2018. Older Adults and Hackathons: A Qualitative Study. Empirical Software Engineering 23, 4 (2018), 1895--1930. Google ScholarDigital Library
- Wieslaw Kopec, Radoslaw Nielek, and Adam Wierzbicki. 2018. Guidelines Towards Better Participation of Older Adults in Software Development Processes using a new SPIRAL Method and Participatory Approach. In Proceedings of the CHASE'18: International Workshop on Cooperative and Human Aspects of Software (ICSE '18). ACM, New York, NY, USA. Google ScholarDigital Library
- Wieslaw Kopec, Kinga Skorupska, Anna Jaskulska, Katarzyna Abramczuk, Radoslaw Nielek, and Adam Wierzbicki. 2017. LivingLab PJAIT: Towards Better Urban Participation of Seniors. In Proceedings of the International Conference on Web Intelligence (WI '17). ACM, New York, NY, USA, 1085--1092. Google ScholarDigital Library
- Anna Kötteritzsch, Michael Koch, and Fritjof Lemân. 2014. Adaptive training for older adults based on dynamic diagnosis of mild cognitive impairments and dementia. In International Workshop on Ambient Assisted Living. Springer, 364--368.Google ScholarCross Ref
- J. Lave and E. Wenger. 1991. Situated Learning: Legitimate Peripheral Participation. Cambridge University Press.Google ScholarCross Ref
- Terry Y Lum and Elizabeth Lightfoot. 2005. The effects of volunteering on the physical and mental health of older people. Research on aging 27, 1 (2005), 31--55.Google Scholar
- John J McArdle, Fumiaki Hamagami, William Meredith, and Katherine P Bradway. 2000. Modeling the dynamic hypotheses of Gf--Gc theory using longitudinal life-span data. Learning and Individual Differences 12, 1 (2000), 53--79.Google ScholarCross Ref
- Nancy Morrow-Howell. 2010. Volunteering in later life: Research frontiers. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences 65, 4 (2010), 461--469.Google ScholarCross Ref
- Nancy Morrow-Howell, Jim Hinterlong, Philip A Rozario, and Fengyan Tang. 2003. Effects of volunteering on the well-being of older adults. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences 58, 3 (2003), S137--S145.Google ScholarCross Ref
- Radoslaw Nielek, Miroslaw Ciastek, and Wieslaw Kopec. 2017. Emotions Make Cities Live: Towards Mapping Emotions of Older Adults on Urban Space. In Proceedings of the International Conference on Web Intelligence (WI '17). ACM, New York, NY, USA, 1076--1079. Google ScholarDigital Library
- Radoslaw Nielek, Marta Lutosta'ska, Wieslaw Kopec, and Adam Wierzbicki. 2017. Turned 70?: It is Time to Start Editing Wikipedia. In Proceedings of the International Conference on Web Intelligence (WI '17). ACM, New York, NY, USA, 899--906. Google ScholarDigital Library
- Francisco Nunes, Maureen Kerwin, and Paula Alexandra Silva. 2012. Design Recommendations for TV User Interfaces for Older Adults: Findings from the eCAALYX Project. In Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '12). ACM, New York, NY, USA, 41--48. Google ScholarDigital Library
- Jennifer M Ortman, Victoria A Velkoff, Howard Hogan, et al. 2014. An aging nation: the older population in the United States. Washington, DC: US Census Bureau (2014), 25--1140.Google Scholar
- Dorota Orzeszek, Wieslaw Kopec, Marcin Wichrowski, Radoslaw Nielek, Bartlomiej Balcerzak, Grzegorz Kowalik, and Malwina Puchalska-Kaminska. 2017. Beyond Participatory Design: Towards a Model for Teaching Seniors Application Design. In Proceedings of the ER Forum 2017 co-located with the 36th International Conference on Conceptual Modelling (ER 2017), Valencia, Spain, - November 6--9, 2017. (CEUR Workshop Proceedings), Vol. 1979. 29--43.Google Scholar
- R. Pak and A. McLaughlin. 2010. Designing Displays for Older Adults. CRC Press.Google Scholar
- Zhengxiang Pan, Chunyan Miao, Han Yu, Cyril Leung, and Jing Jih Chin. 2015. The effects of familiarity design on the adoption of wellness games by the elderly. In 2015 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT), Vol. 2. IEEE, 387--390. Google ScholarDigital Library
- Kowit Rapeepisarn, Kok Wai Wong, Chun Che Fung, and Arnold Depickere. 2006. Similarities and differences between learn through play and edutainment. In Proceedings of the 3rd Australasian conference on Interactive entertainment. Murdoch University, 28--32. Google ScholarDigital Library
- Pablo Romero-Fresco and Franz Pöchhacker. 2017. Quality assessment in interlingual live subtitling: The NTR Model. 16 (01 2017), 149--167.Google Scholar
- Richard M Ryan and Edward L Deci. 2000. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American psychologist 55, 1 (2000), 68.Google Scholar
- Jatinder Sandhu, Leela Damodaran, and Leonie Ramondt. 2013. ICT Skills Acquisition by Older People: Motivations for learning and barriers to progression. International Journal of Education and Ageing 3, 1 (2013), 25--42.Google Scholar
- Paula Alexandra Silva, Francisco Nunes, Ana Vasconcelos, Maureen Kerwin, Ricardo Moutinho, and Pedro Teixeira. 2013. Using the Smartphone Accelerometer to Monitor Fall Risk while Playing a Game: The Design and Usability Evaluation of Dance! Don't Fall. 8027 (07 2013), 754--763.Google Scholar
- Hsin-yi Sandy Tsai, Ruth Shillair, Shelia R Cotten, Vicki Winstead, and Elizabeth Yost. 2015. Getting grandma online: Are tablets the answer for increasing digital inclusion for Older Adults in the US? Educational gerontology 41, 10 (2015), 695--709.Google Scholar
- Robert J Vallerand and Brian P O'Connor. 1989. Motivation in the elderly: A theoretical framework and some promising findings. Canadian Psychology/Psychologie canadienne 30, 3 (1989), 538.Google Scholar
- John Vines, Mark Blythe, Paul Dunphy, and Andrew Monk. 2011. Eighty something: banking for the older old. In Proceedings of the 25th BCS Conference on Human-Computer Interaction. British Computer Society, 64--73. Google ScholarDigital Library
- John Vines, Gary Pritchard, Peter Wright, Patrick Olivier, and Katie Brittain. 2015. An Age-Old Problem: Examining the Discourses of Ageing in HCI and Strategies for Future Research. ACM Trans. Comput.-Hum. Interact. 22, 1, Article 2 (Feb. 2015), 27 pages. Google ScholarDigital Library
- Bettina von Helversen, Katarzyna Abramczuk, Wies?aw Kopec, and Radoslaw Nielek. 2018. Influence of Consumer Reviews on Online Purchasing Decisions in Older and Younger Adults. Decision Support Systems 113 (2018), 1--10.Google ScholarCross Ref
- Jing-Jen Wang and Alan S Kaufman. 1993. Changes in fluid and crystallized intelligence across the 20-to 90-year age range on the K-BIT. Journal of Psychoeducational Assessment 11, 1 (1993), 29--37.Google ScholarCross Ref
- Natalie E Wolfson, Thomas M Cavanagh, and Kurt Kraiger. 2014. Older adults and technology-based instruction: Optimizing learning outcomes and transfer. Academy of Management Learning & Education 13, 1 (2014), 26--44.Google ScholarCross Ref
- Heng-Li Yang and Cheng-Yu Lai. 2010. Motivations of Wikipedia content contributors. Computers in Human Behavior 26, 6 (2010), 1377--1383. Google ScholarDigital Library
- Lixiu Yu, Paul André, Aniket Kittur, and Robert Kraut. 2014. A comparison of social, learning, and financial strategies on crowd engagement and output quality. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. ACM, 967--978. Google ScholarDigital Library
- Haiyi Zhu, Steven P Dow, Robert E Kraut, and Aniket Kittur. 2014. Reviewing versus doing: Learning and performance in crowd assessment. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. ACM, 1445--1455. Google ScholarDigital Library
- Gabe Zichermann and Christopher Cunningham. 2011. Gamification by design: Implementing game mechanics in web and mobile apps (1st ed.). " O'Reilly Media, Inc.". Google ScholarDigital Library
Index Terms
- Older Adults and Crowdsourcing: Android TV App for Evaluating TEDx Subtitle Quality
Recommendations
A Comparative Study of Younger and Older Adults’ Interaction with a Crowdsourcing Android TV App for Detecting Errors in TEDx Video Subtitles
Human-Computer Interaction – INTERACT 2019AbstractIn this paper we report the results of a pilot study comparing the older and younger adults’ interaction with an Android TV application which enables users to detect errors in video subtitles. Overall, the interaction with the TV-mediated ...
Recruiting Older Adults in the Wild: Reflections on Challenges and Lessons Learned from Research Experience
PervasiveHealth '18: Proceedings of the 12th EAI International Conference on Pervasive Computing Technologies for HealthcareIt is important to understand the older adults prior to the design process. The understanding can better facilitate design conversations between the researchers and the older adults. In this paper, we discussed our experiences of building a relationship ...
Older adults’ experiences and perceptions of digital technology: (Dis)empowerment, wellbeing, and inclusion
Highlights- Policy should account for barriers to digital technology use in older adults.
- ...
AbstractAs more and more of the business of society is transferred and conducted online, older adults frequently find themselves without the skills to participate effectively. This is frequently confounded by limited physical mobility and a ...
Comments