ABSTRACT
Cognition-aware systems acquire physiological data to derive implications about physical and mental states. Pupil dilation has recently attracted attention in the HCI community as an indicator for mental workload. The impact of mental workload on pupillary behavior has been extensively examined. However, systems making use of these measurements to alleviate mental workload have been scarcely evaluated. Our work investigates the expediency of task complexity adaption based on pupillary data in real-time. By conducting math tasks with different complexities, we calibrate a complexity adjustment system. In a pilot study (N=6), we evaluate the feasibility of changing task complexity using two different complexities. Our findings show less perceived mental workload during task complexity adaptation compared to presenting high task complexities only. We show the potential of pupil dilation as a valid metric for assessing mental workload as a modality for cognition-aware user interfaces.
- Mark H Ashcraft and Elizabeth P Kirk. 2001. The relationships among working memory, math anxiety, and performance. Journal of experimental psychology: General 130, 2 (2001), 224.Google ScholarCross Ref
- Mark H Ashcraft and Jeremy A Krause. 2007. Working memory, math performance, and math anxiety. Psychonomic bulletin & review 14, 2 (2007), 243--248.Google Scholar
- Simone Benedetto, Marco Pedrotti, Luca Minin, Thierry Baccino, Alessandra Re, and Roberto Montanari. 2011. Driver workload and eye blink duration. Transportation research part F: traffic psychology and behaviour 14, 3 (2011), 199--208.Google Scholar
- Andreas Bulling, Ulf Blanke, and Bernt Schiele. 2014. A tutorial on human activity recognition using bodyworn inertial sensors. CSUR 46, 3 (2014), 33. Google ScholarDigital Library
- Andreas Bulling and Thorsten O Zander. 2014. Cognition-aware computing. IEEE Pervasive Computing 13, 3 (2014), 80--83.Google ScholarCross Ref
- Benedikt Gollan, Michael Haslgrübler, and Alois Ferscha. 2016. Demonstrator for Extracting Cognitive Load from Pupil Dilation for Attention Management Services. In UbiComp'16. ACM, New York, NY, USA, 1566--1571. Google ScholarDigital Library
- Sandra G Hart. 2006. NASA-task load index (NASATLX); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 50. Sage Publications, 904--908.Google ScholarCross Ref
- Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in psychology 52 (1988), 139--183.Google Scholar
- Richard P Heitz, Josef C Schrock, Tabitha W Payne, and Randall W Engle. 2008. Effects of incentive on working memory capacity: Behavioral and pupillometric data. Psychophysiology 45, 1 (2008), 119--129.Google Scholar
- Eckhard H Hess and James M Polt. 1964. Pupil size in relation to mental activity during simple problemsolving. Science 143, 3611 (1964), 1190--1192.Google Scholar
- Daniel Kahneman and Jackson Beatty. 1966. Pupil diameter and load on memory. Science 154, 3756 (1966).Google Scholar
- Peter Kiefer, Ioannis Giannopoulos, Andrew Duchowski, and Martin Raubal. 2016. Measuring cognitive load for map tasks through pupil diameter. In International Conference on Geographic Information Science. Springer, 323--337.Google ScholarCross Ref
- Annie Pauzié. 2008. A method to assess the driver mental workload: The driving activity load index (DALI). IET Intelligent Transport Systems 2, 4 (2008), 315--322.Google ScholarCross Ref
- Bastian Pfleging, Drea K Fekety, Albrecht Schmidt, and Andrew L Kun. 2016. A Model Relating Pupil Diameter to Mental Workload and Lighting Conditions. In CHI'16. ACM, 5776--5788. Google ScholarDigital Library
- Jianhua Tao and Tieniu Tan. 2005. Affective computing: A review. In International Conference on Affective Computing and Intelligent Interaction. Springer. Google ScholarDigital Library
- N Jane Zbrodoff and Gordon D Logan. 2005. What everyone finds: The problem-size effect. (2005).Google Scholar
Index Terms
- Look into my Eyes: Using Pupil Dilation to Estimate Mental Workload for Task Complexity Adaptation
Recommendations
Your Eyes Tell: Leveraging Smooth Pursuit for Assessing Cognitive Workload
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsA common objective for context-aware computing systems is to predict how user interfaces impact user performance regarding their cognitive capabilities. Existing approaches such as questionnaires or pupil dilation measurements either only allow for ...
Beyond gaze: preliminary analysis of pupil dilation and blink rates in an fMRI study of program comprehension
EMIP '18: Proceedings of the Workshop on Eye Movements in ProgrammingResearchers have been employing psycho-physiological measures to better understand program comprehension, for example simultaneous fMRI and eye tracking to validate top-down comprehension models. In this paper, we argue that there is additional value in ...
Eye tracking as an MT evaluation technique
Eye tracking has been used successfully as a technique for measuring cognitive load in reading, psycholinguistics, writing, language acquisition etc. for some time now. Its application as a technique for measuring the reading ease of MT output has not ...
Comments