Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
A Task-Based View on the Visual Analysis of Eye-Tracking Data Read chapter Read first chapter

2017 | OriginalPaper | Chapter

Capturing You Watching You: Characterizing Visual-Motor Dynamics in Touchscreen Interactions

Authors : Leslie M. Blaha, Joseph W. Houpt, Mary E. Frame, Jacob A. Kern

Published in: Eye Tracking and Visualization

Publisher: Springer International Publishing

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The relationship between where people look and where people reach has been studied since the dawn of experimental psychology. This relationship has implications for the designs of interactive visualizations, particularly for applications involving touchscreens. We present a new visual-motor analytics dashboard for the joint study of eye movement and hand/finger movement dynamics. Our modular approach combines real-time playback of gaze and finger-dragging behavior together with statistical models quantifying the dynamics of both modalities. To aid in visualization and inference with these data, we apply Gaussian process regression models which capture the similarities and differences between eye and finger movements, while providing a statistical model of the observed functional data. Smooth estimates of the dynamics are included in the dashboard to enable visual-analytic exploration of visual-motor behaviors on touchscreen interfaces.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter Gaze Visualization for Immersive Video
next chapter Visualizing Eye Movements in Formal Cognitive Models
Footnotes
2
Note that the eye data is continuously recorded, and the sharp rising slopes occur as an artifact of the sudden shift in target position. The finger data are disjoint, reflecting the finger being lifted from the screen between movements.
 
3
This approach is effectively the same as a constrained maximum likelihood fit with soft-constraints.
 
Literature
1.
Abrams, R.A., Meyer, D.E., Kornblum, S.: Speed and accuracy of saccadic eye movements: characteristics of impulse variability in the oculomotor system. J. Exp. Psychol. Hum. Percept. Perform. 15 (3), 529–543 (1989)CrossRef
2.
Abrams, R.A., Meyer, D.E., Kornblum, S.: Eye-hand coordination: oculomotor control in rapid aimed limb movements. J. Exp. Psychol. Hum. Percept. Perform. 16 (2):248–267 (1990)CrossRef
3.
Blaha, L., Schill, M.T.: Modeling touch interactions on very large touchscreens. In: Proceedings of the 36th Annual Meeting of the Cognitive Science Society, Quebec City (2014)
4.
Binsted, G., Chua, R., Helsen, W., Elliott, D.: Eye-hand coordination in goal-directed aiming. Hum. Mov. Sci. 20 (4), 563–585 (2001)CrossRef
5.
Bizzi, E., Kalil, R.E., Tagliasco, V.: Eye-head coordination in monkeys: evidence for centrally patterned organization. Science 173 (3995), 452–454 (1971)CrossRef
6.
Bock, O.: Contribution of retinal versus extraretinal signals towards visual localization in goal-directed movements. Exp. Brain Res. 64 (3), 476–482 (1986)CrossRef
7.
Bostock, M., Ogievetsky, V., Heer, J.: D3: data driven documents. IEEE Trans. Visual. Comput. Graph. 17 (12), 2301–2309 (2011)CrossRef
8.
Cöltekin, A., Demsar, U., Brychtová, A., Vandrol, J.: Eye-hand coordination during visual search on geographic displays. In: Proceedings of the 2nd International Workshop on Eye Tracking for Spatial Research (ET4S 2014). ACM, New York (2014)
9.
De Leeuw, J.R.: jsPsych: a JavaScript library for creating behavioral experiments in a web browser. Behav. Res. Methods 47 (1), 1–12 (2015)
10.
Demšar, U., Çöltekin, A.: Quantifying the interactions between eye and mouse movements on spatial visual interfaces through trajectory visualisations. In: Workshop on analysis of movement data at GIScience, Vienna, pp. 23–26 (2014)
11.
Epelboim, J., Steinman, R.M., Kowler, E., Edwards, M., Pizlo, Z., Erkelens, C.J., Collewijn, H.: The function of visual search and memory in sequential looking tasks. Vis. Res. 35 (23), 3401–3422 (1995)CrossRef
12.
Fitts, P.M.: The information capacity of the human motor system in controlling amplitude of movement. J. Exp. Psycholo. 47, 381–391 (1954)CrossRef
13.
Franco-Watkins, A.M., Johnson, J.G.: Applying the decision moving window to risky choice: comparison of eye-tracking and mouse-tracing methods. Judgm. Decis. Making 6 (8), 740–749 (2011)
14.
Freeman, J.B., Ambady, N.: MouseTracker: software for studying real-time mental processing using a computer mouse-tracking method. Behav. Res. Methods 42 (1), 226–241 (2010)CrossRef
15.
Han, J.Y.: Low-cost multi-touch sensing through frustrated total internal reflection. In: Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology, pp. 115–118. ACM, Seattle (2005)
16.
Hayhoe, M., Ballard, D.: Eye movements in natural behavior. Trends Cogn. Sci. 9 (4), 188–194 (2005)CrossRef
17.
ISO9241-400: Ergonomics of Human-System Interaction – Part 400: Principles and Requirements for Physical Input Devices, Geneva (2007)
18.
Jagacinski, R.J., Flach, J.M.: Control Theory for Humans: Quantitative Approaches to Modeling Performance. CRC Press, Mahwah (2003)
19.
Land, M.F., Hayhoe, M.: In what ways do eye movements contribute to everyday activities? Vis. Res. 41 (25), 3559–3565 (2001)CrossRef
20.
Li, X., Cöltekin, A., Kraak, M.-J.: Visual exploration of eye movement data using the space-time-cube. In: Geographic Information Science, pp. 295–309. Springer, Berlin (2010)
21.
McKinstry, C., Dale, R., Spivey, M.J.: Action dynamics reveal parallel competition in decision making. Psychol. Sci. 19 (1), 22–24 (2008)CrossRef
22.
Patterson, R.E., Blaha, L.M., Grinstein, G.G., Liggett, K.K., Kaveney, D.E., Sheldon, K.C., Havig, P.R., Moore, J.A.: A human cognition framework for information visualization. Comput. Graph. 42, 42–58 (2014)CrossRef
23.
Pelz, J., Hayhoe, M., Loeber, R.: The coordination of eye, head, and hand movements in a natural task. Exp. Brain Res. 139 (3), 266–277 (2001)CrossRef
24.
Prablanc, C., Desmurget, M., Gréa, H.: Neural control of on-line guidance of hand reaching movements. Prog. Brain Res. 142, 155–170 (2003)CrossRef
25.
Prablanc, C., Echallier, J., Jeannerod, M., Komilis, E.: Optimal response of eye and hand motor systems in pointing at a visual target. I. Spatio-temporal characteristics of eye and hand movements and their relationship when varying the amount of visual information. Biol. Cybern. 35 (3), 113–124 (1978)
26.
R Development Core Team: R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna (2011)
27.
Rasmussen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning. The MIT Press, Cambridge (2006)MATH
28.
Richardson, D.C., Dale, R.: Looking to understand: the coupling between speakers’ and listeners’ eye movements and its relationship to discourse comprehension. Cogn. Sci. 29 (6), 1045–1060 (2005)CrossRef
29.
Song, J.-H., Nakayama, K.: Hidden cognitive states revealed in choice reaching tasks. Trends Cogn. Sci. 13 (8), 360–366 (2009)CrossRef
30.
Soukoreff, R.W., MacKenzie, I.S.: Towards a standard for pointing device evaluation: perspectives on 27 years of Fitts’ law research in HCI. Int. J. Hum. Comput. Stud. 61 (6), 751–789 (2004)
31.
Spivey, M.J., Dale, R.: Continuous dynamics in real-time cognition. Curr. Dir. Psychol. Sci. 15 (5), 207–211 (2006)CrossRef
32.
Vanhatalo, J., Riihimäki, J., Hartikainen, J., Jylänki, P., Tolvanen, V., Vehtari, A.: GPstuff: Bayesian modeling with gaussian processes. J. Mach. Learn. Res. 14 (1), 1175–1179 (2013)MathSciNetMATH
33.
Woodworth, R.S.: Accuracy of voluntary movement. Psychol. Rev. Monogr. Suppl. 3 (3), i (1899)
Metadata
Title
Capturing You Watching You: Characterizing Visual-Motor Dynamics in Touchscreen Interactions
Authors
Leslie M. Blaha
Joseph W. Houpt
Mary E. Frame
Jacob A. Kern
Copyright Year
2017
Book
Eye Tracking and Visualization

Print ISBN: 978-3-319-47023-8

Electronic ISBN: 978-3-319-47024-5

Copyright Year: 2017

DOI
https://doi.org/10.1007/978-3-319-47024-5_5

Premium Partner

    Image Credits