skip to main content
10.1145/3170427.3188643acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
abstract

Look into my Eyes: Using Pupil Dilation to Estimate Mental Workload for Task Complexity Adaptation

Published:20 April 2018Publication History

ABSTRACT

Cognition-aware systems acquire physiological data to derive implications about physical and mental states. Pupil dilation has recently attracted attention in the HCI community as an indicator for mental workload. The impact of mental workload on pupillary behavior has been extensively examined. However, systems making use of these measurements to alleviate mental workload have been scarcely evaluated. Our work investigates the expediency of task complexity adaption based on pupillary data in real-time. By conducting math tasks with different complexities, we calibrate a complexity adjustment system. In a pilot study (N=6), we evaluate the feasibility of changing task complexity using two different complexities. Our findings show less perceived mental workload during task complexity adaptation compared to presenting high task complexities only. We show the potential of pupil dilation as a valid metric for assessing mental workload as a modality for cognition-aware user interfaces.

References

  1. Mark H Ashcraft and Elizabeth P Kirk. 2001. The relationships among working memory, math anxiety, and performance. Journal of experimental psychology: General 130, 2 (2001), 224.Google ScholarGoogle ScholarCross RefCross Ref
  2. Mark H Ashcraft and Jeremy A Krause. 2007. Working memory, math performance, and math anxiety. Psychonomic bulletin & review 14, 2 (2007), 243--248.Google ScholarGoogle Scholar
  3. Simone Benedetto, Marco Pedrotti, Luca Minin, Thierry Baccino, Alessandra Re, and Roberto Montanari. 2011. Driver workload and eye blink duration. Transportation research part F: traffic psychology and behaviour 14, 3 (2011), 199--208.Google ScholarGoogle Scholar
  4. Andreas Bulling, Ulf Blanke, and Bernt Schiele. 2014. A tutorial on human activity recognition using bodyworn inertial sensors. CSUR 46, 3 (2014), 33. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Andreas Bulling and Thorsten O Zander. 2014. Cognition-aware computing. IEEE Pervasive Computing 13, 3 (2014), 80--83.Google ScholarGoogle ScholarCross RefCross Ref
  6. Benedikt Gollan, Michael Haslgrübler, and Alois Ferscha. 2016. Demonstrator for Extracting Cognitive Load from Pupil Dilation for Attention Management Services. In UbiComp'16. ACM, New York, NY, USA, 1566--1571. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Sandra G Hart. 2006. NASA-task load index (NASATLX); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 50. Sage Publications, 904--908.Google ScholarGoogle ScholarCross RefCross Ref
  8. Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in psychology 52 (1988), 139--183.Google ScholarGoogle Scholar
  9. Richard P Heitz, Josef C Schrock, Tabitha W Payne, and Randall W Engle. 2008. Effects of incentive on working memory capacity: Behavioral and pupillometric data. Psychophysiology 45, 1 (2008), 119--129.Google ScholarGoogle Scholar
  10. Eckhard H Hess and James M Polt. 1964. Pupil size in relation to mental activity during simple problemsolving. Science 143, 3611 (1964), 1190--1192.Google ScholarGoogle Scholar
  11. Daniel Kahneman and Jackson Beatty. 1966. Pupil diameter and load on memory. Science 154, 3756 (1966).Google ScholarGoogle Scholar
  12. Peter Kiefer, Ioannis Giannopoulos, Andrew Duchowski, and Martin Raubal. 2016. Measuring cognitive load for map tasks through pupil diameter. In International Conference on Geographic Information Science. Springer, 323--337.Google ScholarGoogle ScholarCross RefCross Ref
  13. Annie Pauzié. 2008. A method to assess the driver mental workload: The driving activity load index (DALI). IET Intelligent Transport Systems 2, 4 (2008), 315--322.Google ScholarGoogle ScholarCross RefCross Ref
  14. Bastian Pfleging, Drea K Fekety, Albrecht Schmidt, and Andrew L Kun. 2016. A Model Relating Pupil Diameter to Mental Workload and Lighting Conditions. In CHI'16. ACM, 5776--5788. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Jianhua Tao and Tieniu Tan. 2005. Affective computing: A review. In International Conference on Affective Computing and Intelligent Interaction. Springer. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. N Jane Zbrodoff and Gordon D Logan. 2005. What everyone finds: The problem-size effect. (2005).Google ScholarGoogle Scholar

Index Terms

  1. Look into my Eyes: Using Pupil Dilation to Estimate Mental Workload for Task Complexity Adaptation

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems
      April 2018
      3155 pages
      ISBN:9781450356213
      DOI:10.1145/3170427

      Copyright © 2018 Owner/Author

      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 20 April 2018

      Check for updates

      Qualifiers

      • abstract

      Acceptance Rates

      CHI EA '18 Paper Acceptance Rate1,208of3,955submissions,31%Overall Acceptance Rate6,164of23,696submissions,26%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader