Top

Published in:

2020 | OriginalPaper | Chapter

Ambient UX Research: User Experience Investigation Through Multimodal Quadrangulation

Authors : Marco Mandolfo, Milica Pavlovic, Margherita Pillan, Lucio Lamberti

Published in: Distributed, Ambient and Pervasive Interactions

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Cyber-physical systems refer to environments that are sensitive and responsive to people, where users’ activities in a physical environment are enhanced by digitized services, thus calling for an Ambient UX design approach. Designing for experiences in such complex systems implies facing UX investigation in a holistic manner. The present work encompasses an initial overview of the methods employed to investigate systematically different facets of UX by actively involving users and based on experiments involving biometrics monitoring and other solutions to collect data. Investigation approaches are conceived as belonging to four layers of analysis, namely (i) physiological, (ii) behavioural, (iii) self-reported, and (iv) expert evaluation. The major contribution of the current research lies in the methodological integration firstly adopting a theoretical stance for UX investigation through multimodal quadrangulation, and secondly in a discussion on the applications of the approach as performed in a multidisciplinary research laboratory.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Extended User Interface: NFC-Enabled Product Packaging for Enhanced User Experience

next chapter Dynamic Consent: Physical Switches and Feedback to Adjust Consent to IoT Data Collection

Bier, H., Liu Cheng, A., Mostafavi, S., Anton, A., Bodea, S.: Robotic building as integration of design-to-robotic-production and -operation. In: Bier, H. (ed.) Robotic Building. SSAE, pp. 97–120. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-70866-9_5CrossRef

Pavlovic, M.: Designing for ambient UX: design framework for managing user experience within cyber-physical systems. Unpublished doctoral dissertation (2020)

Norman, D.: Emotional Design: Why We Love (or Hate) Everyday Things. Basic Books, New York (2004)

Hassenzahl, M.: The thing and I: understanding the relationship between user and product. In: Blythe, M.A., Overbeeke, K., Monk, A.F., Wright, P.C. (eds.) Funology. HCIS, vol. 3, pp. 31–42. Springer, Dordrecht (2003). https://doi.org/10.1007/1-4020-2967-5_4CrossRef

Desmet, P.: A Multilayered Model of Product Emotions Resilient@work: development of an application for a more positive outlook on life View project. Artic. Des. J. 6, 4–13 (2003)

MacDonald, C.M., Atwood, M.E.: Changing perspectives on evaluation in HCI: past, present, and future. In: Conference on Human Factors in Computing Systems – Proceedings, pp. 1969–1978. Association for Computing Machinery (2013)

Kim, J.H., Gunn, D.V., Schuh, E., Phillips, B.C., Pagulayan, R.J., Wixon, D.: Tracking real-time user experience (TRUE): a comprehensive instrumentation solution for complex systems. In: Conference on Human Factors in Computing Systems – Proceedings, pp. 443–451 (2008)

Kalbach, J.: Mapping Experiences: A Complete Guide to Creating Value Through Journeys, Blueprints, and Diagrams. O’Reilly, Sebastopol (2016)

Buxton, B.: Sketching User Experiences – Getting Right Design, and Getting the Design Right. Morgan Kaufman, San Francisco (2007)

10.

Stickdorn, M., Hormess, M., Lawrence, A., Schneider, J.: This is Service Design Doing: Applying Service Design Thinking in the Real World. O’Reilly (2018)

11.

Tullis, T., Albert, W.: Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics. Morgan Kaufman, San Francisco (2013)

12.

Rowland, C., Goodman, E., Charlier, M., Light, A., Lui, A.: Designing Connected Products: UX for the Consumer Internet of Things. O’Reilly (2015)

13.

Kreibig, S.D.: Autonomic nervous system activity in emotion: a review. Biol. Psychol. 84(3), 394–421 (2010)CrossRef

14.

Green, E.E., Green, A.M., Walters, E.D.: Voluntary control of internal states: psychological and physiological. J. Transpers. Psychol. 2, 1 (1970)

15.

James, W.: Discussion: the physical basis of emotion. Psychol. Rev. 1(5), 516 (1894)CrossRef

16.

Kroeber-Riel, W.: Psychobiology and consumer research: a problem of construct validity: rejoinder. J. Consum. Res. 7, 96 (1980)CrossRef

17.

Weinberg, P., Gottwald, W.: Impulsive consumer buying as a result of emotions. J. Bus. Res. 10(1), 43–57 (1982)CrossRef

18.

Plassmann, H., Ramsøy, T.Z., Milosavljevic, M.: Branding the brain: a critical review and outlook. J. Consum. Psychol. 22, 18–36 (2012)CrossRef

19.

Mather, M., Cacioppo, J.T., Kanwisher, N.: How fMRI can inform cognitive theories. Perspect. Psychol. Sci. 8, 108–113 (2013)CrossRef

20.

Plassmann, H., Venkatraman, V., Huettel, S., Yoon, C.: Consumer neuroscience: applications, challenges, and possible solutions. J. Mark. Res. 52, 427–435 (2015)CrossRef

21.

Lim, M.: Demystifying neuromarketing. J. Bus. Res. 91, 205–220 (2018)CrossRef

22.

Dimoka, A., Pavlou, P.A., Davis, F.D.: NeuroIS: the potential of cognitive neuroscience for information systems research. Inf. Syst. Res. 22, 687–702 (2011)CrossRef

23.

Ariely, D., Berns, G.S.: Neuromarketing: the hope and hype of neuroimaging in business. Nat. Rev. Neurosci. 11, 284 (2010)CrossRef

24.

Chai, J., et al.: Application of frontal EEG asymmetry to user experience research. In: Harris, D. (ed.) EPCE 2014. LNCS (LNAI), vol. 8532, pp. 234–243. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07515-0_24CrossRef

25.

Stevens, R.H., Galloway, T., Berka, C.: EEG-related changes in cognitive workload, engagement and distraction as students acquire problem solving skills. In: Conati, C., McCoy, K., Paliouras, G. (eds.) UM 2007. LNCS (LNAI), vol. 4511, pp. 187–196. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-73078-1_22CrossRef

26.

Foxe, J.J., Snyder, A.C.: The role of alpha-band brain oscillations as a sensory suppression mechanism during selective attention. Front. Psychol. 2, 154 (2011)CrossRef

27.

Sabatinelli, D., Bradley, M.M., Fitzsimmons, J.R., Lang, P.J.: Parallel amygdala and inferotemporal activation reflect emotional intensity and fear relevance. Neuroimage 24, 1265–1270 (2005)CrossRef

28.

Zola-Morgan, S., Squire, L.R.: Neuroanatomy of memory. Annu. Rev. Neurosci. 16, 547–563 (1993)CrossRef

29.

Sutton, S.K., Davidson, R.J.: Prefrontal brain asymmetry: a biological substrate of the behavioral approach and inhibition systems. Psychol. Sci. 8, 204–210 (1997)CrossRef

30.

Venkatraman, V., et al.: Predicting advertising success beyond traditional measures: new insights from neurophysiological methods and market response modeling. J. Mark. Res. 52, 436–452 (2015)CrossRef

31.

Depaulo, B.M., Lindsay, J.J., Malone, B.E., Muhlenbruck, L., Charlton, K., Cooper, H.: Cues to deception. Psychol. Bull. 129, 74–118 (2003)CrossRef

32.

Keltner, D., Kring, A.M.: Emotion, social function, and psychopathology. Rev. Gen. Psychol. 2, 320–342 (1998)CrossRef

33.

Sundaram, D., Webster, C.: The role of nonverbal communication in service encounters. J Serv Mark. 14(5), 378–391 (2000)

34.

Ekman, P., Friesen, W.: The repertoire of nonverbal behavior: categories, origins, usage, and coding. Semiotica 1, 49–98 (1969)CrossRef

35.

Mehrabian, A.: Nonverbal betrayal of feeling. J. Exp. Res. Personal. 5, 64–73 (1971)

36.

Mehrabian, A.: Some referents and measures of nonverbal behavior. Behav. Res. Methods Instrum. 1, 203–207 (1968). https://doi.org/10.3758/BF03208096CrossRef

37.

Ekman, P.: An argument for basic emotions. Cogn. Emot. 6, 169–200 (1992)CrossRef

38.

Van Der Stigchel, S., Meeter, M., Theeuwes, J.: Eye movement trajectories and what they tell us. Neurosci. Biobehav. Rev. 30, 666–679 (2006)CrossRef

39.

Djamasbi, S.: Eye tracking and web experience. AIS Trans. Hum. Comput. Interact. 6(2), 37–54 (2014)CrossRef

40.

Sharma, N., Gedeon, T.: Objective measures, sensors and computational techniques for stress recognition and classification: a survey. Comput. Methods Programs Biomed. 108, 1287–1301 (2012)CrossRef

41.

Ang, J., Dhillon, R., Krupski, A., Shriberg, E., Stolcke, A.: Prosody-based automatic detection of annoyance and frustration in human-computer dialog. In: Interspeech (2002)

42.

Hopkins, C.S., Ratley, R.J., Benincasa, D.S., Grieco, J.J.: Evaluation of voice stress analysis technology. In: System Sciences, HICSS 2005 (2005)

43.

Arksey, H., Knight, P.: Interviewing for Social Scientists: An Introductory Resource with Examples. SAGE Publications, Thousand Oaks (1999)CrossRef

44.

Lune, H., Berg, B.L.: Qualitative Research Methods for the Social Sciences. Pearson Higher Education, Boston (2016)

45.

Nardi, P.: Doing Survey Research: A Guide to Quantitative Methods. Routledge, Abingdon (2018)CrossRef

46.

Fontana, A., Frey, J.: The Art of Science. The Handbook of Qualitative Research. Thousand Oaks (1994)

47.

Van-Someren, M., Barnard, Y., Sandberg, J.: The Think Aloud Method: A Practical Approach to Modelling Cognitive Processes. Academic Press, London (1994)

48.

Morgan, D.: Focus Groups as Qualitative Research. Sage Publications, Thousand Oaks (1997)CrossRef

49.

Nielsen, J., Molich, R.: Heuristic evaluation of user interfaces. In: Conference on Human Factors in Computing Systems – Proceedings, pp. 249–256. Association for Computing Machinery (1990)

50.

Nielsen, J.: Heuristic evaluation. In: Usability Inspection Methods (1994)

51.

Dykstra, D.: A comparison of heuristic evaluation and usability testing: the efficacy of a domain-specific heuristic checklist. Ph.D. dissertation, Department of Industrial Engineering, Texas A&M University, College Station, TX (1993)

52.

Mandolfo, M., Bettiga, D., Lolatto, R., Reali, P.: Would you bet on your physiological response? An analysis of the physiological and behavioral characteristics of online electronic gaming machines players. In: NeuroPsychoEconomics Conference, p. 28 (2019)

53.

Mandolfo, M., Bettiga, D.: Better off alone? An analysis of behavioral characteristics of electronic gaming machine players. In: Riunione Scientifica Annuale AiIG (2018)

Title: Ambient UX Research: User Experience Investigation Through Multimodal Quadrangulation
Authors: Marco Mandolfo
Milica Pavlovic
Margherita Pillan
Lucio Lamberti
Publisher: Springer International Publishing
Book: Distributed, Ambient and Pervasive Interactions
Print ISBN: 978-3-030-50343-7

Electronic ISBN: 978-3-030-50344-4

Copyright Year: 2020
DOI: https://doi.org/10.1007/978-3-030-50344-4_22

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner