ABSTRACT
Some organizations have begun to implement more unproctored mobile talent assessment methods in addition to traditional computer-based assessment, requiring new human-computer interaction constructs, methods, and approaches. Usability testing and assessments of user satisfaction and mental workload and the technology's effectiveness and efficiency are critical before implementing new methods of assessments. Initial results of this study provide some initial positive implications for organizations to adopt the use of well-designed mobile-based talent assessments.
Supplemental Material
Available for Download
Zip file containing a PDF of the Accompanying Poster
- Tippins, N. T. Internet alternatives to traditional proctored testing: Where are we now? Industrial and Organizational Psychology: Perspectives on Science and Practice, 2, 1 (2009), 2--10.Google ScholarCross Ref
- Golubovich, J., & Boyce, A.S. Hiring tests: Trends in mobile device usage. In A.J. Illingworth (Chair) Mobile Devices in Talent Assessment: Where Are We Now? Society for Industrial and Organizational Psychology 2013, 2013.Google Scholar
- Pew Internet and American Life Project. Home broadband 2013. http://pewinternet.org/Reports/ 2013/Broadband.aspxGoogle Scholar
- Pew Internet and American Life Project. Cell internet use 2012. http://www.pewinternet.org/ Reports/2012/Cell-Internet-Use-2012.aspxGoogle Scholar
- Pew Internet and American Life Project. Mobile access 2010. http://www.pewinternet.org/Reports/ 2010/Mobile-Access-2010/Summary-ofFindings.aspxGoogle Scholar
- ISO 9241. International Organization for Standardization (ISO) Ergonomics of Human System Interaction, 1992, 1996.Google Scholar
- Shneiderman, B., & Plaisant, C. Designing the User Interface (5th Ed.) Reading, MA: AddisonWesley Publishing Company, 2005.Google Scholar
- Buskirk, T.D., & Andrus, C. Online surveys aren't just for computers anymore! Exploring potential mode effects between smartphone and computer-based online surveys. Survey Research Methods Section, American Statistical Association, 2012.Google Scholar
- Nielsen, J.M. Mobile Usability Update (2011). http://www.nngroup.com/articles/mobileusability-update/Google Scholar
- Peytchev, A., Couper, M.P., McCabe, S.D. Crawford, S.E. Web survey design: Paging versus scrolling. Public Opinion Quarterly, 70 (2006), 596--607.Google ScholarCross Ref
- Tourangeau, R., Couper, M.P., & Conrad, F. Spacing, position, and order -- Interpretive heuristics for visual features of survey questions. Public Opinion Quarterly, 68 (2004), 368--393.Google ScholarCross Ref
- Amazon.com, Inc. (2005--2014). Amazon Mechanical Turk (mTurk). https://www.mturk.com/Google Scholar
- Landers, R. N., Reddock, C. M., Cavanaugh, K. J. & Proaps, A. B. Talent assessment using mobile devices. In T. Kantrowitz & C. M. Reddock (Chairs), Shaping the future of mobile assessment: Research and practice update. Symposium presented at the 29th Annual Conference of the Society for Industrial and Organizational Psychology, 2014.Google Scholar
- Hart, S. G., & Staveland, L. E. Development of a multi-dimensional workload rating scale: Results of empirical and theoretical research. In P. A. Hancock & N. Meshkati (Eds.), Human mental workload. Amsterdam, The Netherlands: Elsevier, 1988, 139--183.Google Scholar
- Chin, J. P., Diehl, V. A. & Norman, K. L. Development of an instrument measuring user satisfaction of the human-computer interface. SIGCHI '88 (1988), 213--218. Google ScholarDigital Library
Index Terms
- Mobile and computer-based talent assessments: implications of workload and usability
Recommendations
The comparison of mobile devices to computers for web-based assessments
Used a questionnaire that was not optimized for the device used to complete it.Assessed web-based assessment using score, usability ratings, and time.Smart phones took longer to complete than computers.Smart phones were rated as less usable than ...
Are separate interfaces inherently unequal?: an evaluation with blind users of the usability of two interfaces for a social networking platform
iConference '11: Proceedings of the 2011 iConferenceWith the increasing use of web-based applications in the workplace, it is imperative that all users can equally access those applications. It has been previously reported that blind users have problems accessing Facebook, but little empirical data on ...
Management of security policies for mobile devices
InfoSecCD '07: Proceedings of the 4th annual conference on Information security curriculum developmentThis paper discusses management of security policies for mobile devices. The increasing use of mobile devices in the workplace is covered, as well as new software applications that allow employees to use their mobile devices to increase their ...
Comments