Saskia Koldijk
Suzan Verberne
Mark A. Neerincx
Wessel Kraaij
ABSTRACT
This paper describes the new multimodal SWELL knowledge work (SWELL-KW) dataset for research on stress and user modeling. The dataset was collected in an experiment, in which 25 people performed typical knowledge work (writing reports, making presentations, reading e-mail, searching for information). We manipulated their working conditions with the stressors: email interruptions and time pressure. A varied set of data was recorded: computer logging, facial expression from camera recordings, body postures from a Kinect 3D sensor and heart rate (variability) and skin conductance from body sensors. The dataset made available not only contains raw data, but also preprocessed data and extracted features. The participants' subjective experience on task load, mental effort, emotion and perceived stress was assessed with validated questionnaires as a ground truth. The resulting dataset on working behavior and affect is a valuable contribution to several research fields, such as work psychology, user modeling and context aware systems.
Supplemental Material
- M. M. Bradley and P. J. Lang. Measuring emotion: the self-assessment manikin and the semantic differential. Journal of behavior therapy and experimental psychiatry, 25(1):49--59, 1994.Google Scholar
- E. Demerouti, A. B. Bakker, S. A. Geurts, and T. W. Taris. Daily recovery from work-related effort during non-work time. Research in Occupational Stress and Well-being, 7:85--123, 2009.Google ScholarCross Ref
- E. Demerouti, A. B. Bakker, F. Nachreiner, and W. B. Schaufeli. The job demands-resources model of burnout. Journal of Applied psychology, 86(3):499, 2001.Google ScholarCross Ref
- D. F. Dinges, R. L. Rider, J. Dorrian, E. L. McGlinchey, N. L. Rogers, Z. Cizman, S. K. Goldenstein, C. Vogler, S. Venkataraman, and D. N. Metaxas. Optical computer recognition of facial expressions associated with stress induced by performance demands. Aviation, space, and environmental medicine, 76(Supplement 1):B172--B182, 2005.Google Scholar
- P. C. Duttweiler. The internal control index: A newly developed measure of locus of control. Educational and Psychological Measurement, 44(2):209--221, 1984.Google ScholarCross Ref
- S. G. Hart and L. E. Staveland. Development of nasa-tlx (task load index): Results of empirical and theoretical research. Advances in psychology, 52:139--183, 1988.Google ScholarCross Ref
- A. Kapoor and R. W. Picard. Multimodal affect recognition in learning environments. In Proceedings of the 13th annual ACM international conference on Multimedia, pages 677--682. ACM, 2005. Google ScholarDigital Library
- S. Koldijk. Automatic recognition of context and stress to support knowledge workers. In Proceedings of the 30th European Conference on Cognitive Ergonomics, pages D20--D23. ACM, 2012. Google ScholarDigital Library
- S. Koldijk, M. Sappelli, M. Neerincx, and W. Kraaij. Unobtrusive monitoring of knowledge workers for stress self-regulation. In User Modeling, Adaptation, and Personalization, pages 335--337. Springer, 2013.Google Scholar
- S. Koldijk, M. van Staalduinen, M. Neerincx, and W. Kraaij. Real-time task recognition based on knowledge workers' computer activities. In Proceedings of the 30th European Conference on Cognitive Ergonomics, pages 152--159. ACM, 2012. Google ScholarDigital Library
- L. Koppes, E. d. Vroome, G. Mars, B. Janssen, M. Zwieten, and S. v. d. Bossche. Nationale enquete arbeidsomstandigheden 2012: Methodologie en globale resultaten, 2012.Google Scholar
- K. Kraan, S. Dhondt, I. Houtman, R. Nelemans, and E. d. Vroome. Handleiding nova-weba: Hernieuwde versie., 2000.Google Scholar
- G. Mark, D. Gudith, and U. Klocke. The cost of interrupted work: more speed and stress. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems, pages 107--110. ACM, 2008. Google ScholarDigital Library
- F. Mokhayeri, M.-R. Akbarzadeh-T, and S. Toosizadeh. Mental stress detection using physiological signals based on soft computing techniques. In Biomedical Engineering (ICBME), 2011 18th Iranian Conference of, pages 232--237. IEEE, 2011.Google ScholarCross Ref
- A. Riera, A. Soria-Frisch, A. Albajes-Eizagirre, P. Cipresso, C. Grau, S. Dunne, G. Ruffini, and S. aStarlab Barcelona. Electro-physiological data fusion for stress detection. Studies in health technology and informatics, 181:228--32, 2012.Google Scholar
- J. Ruff. Information overload: Causes, symptoms and solutions. Harvard Graduate School of Education, pages 1--13, 2002.Google Scholar
- M. Sappelli, S. Verberne, S. Koldijk, and W. Kraaij. Collecting a dataset of information behaviour in context. In Proceedings of the 4th Workshop on Context-awareness in Retrieval and Recommendation, 2014. Google ScholarDigital Library
- M. Soleymani, J. Lichtenauer, T. Pun, and M. Pantic. A multimodal database for affect recognition and implicit tagging. Affective Computing, IEEE Transactions on, 3(1):42--55, 2012. Google ScholarDigital Library
- L. M. Vizer, L. Zhou, and A. Sears. Automated stress detection using keystroke and linguistic features: An exploratory study. International Journal of Human-Computer Studies, 67(10):870--886, 2009. Google ScholarDigital Library
- D. Zapf. Stress-oriented analysis of computerized office work. The European Work and Organizational Psychologist, 3(2):85--100, 1993.Google ScholarCross Ref
- F. Zijlstra and L. van Doorn. The construction of a scale to measure subjective effort. Technical report, Delft University of Technology, 1985.Google Scholar
Index Terms
- The SWELL Knowledge Work Dataset for Stress and User Modeling Research
Recommendations
Affectiva-MIT Facial Expression Dataset (AM-FED): Naturalistic and Spontaneous Facial Expressions Collected "In-the-Wild"
CVPRW '13: Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition WorkshopsComputer classification of facial expressions requires large amounts of data and this data needs to reflect the diversity of conditions seen in real applications. Public datasets help accelerate the progress of research by providing researchers with a ...
Self-efficacy & stress in senior computer interaction
ECCE '10: Proceedings of the 28th Annual European Conference on Cognitive ErgonomicsMotivation -- To gather an understanding about the relation between system complexity, self-efficacy and stress in senior computer interaction.
Research approach -- An empirical study was employed in which 30 seniors performed a number of tasks on a low ...
An integrated psychophysiological research on the intervention of red colour for the stress-induced bodily reaction
An integrated psychophysiological study was made for investigating the impact of 'red colour' on bodily reaction induced by stress. With regard to the psychophysiological measures, we assayed salivary-secreted substances such as hormones and immune ...
Comments