Skip to main content

2018 | OriginalPaper | Buchkapitel

8. Perceiving, Interacting and Playing with Multimedia Delays

verfasst von : Ragnhild Eg, Kjetil Raaen

Erschienen in: MediaSync

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Just like interactions with the physical world, humans prefer to interact with computers without noticeable delay. However, in the digital world, the time between cause and effect can far exceed what we are accustomed to in real life. System processes, network transmission and rendering all add to the delay between an input action and an output response. While we expect and accept a computer system to process a request within a period of time, the duration of this period is dependent on the nature of the task. Highly interactive tasks, such as control systems, computer games, design software and even word processing have stringent temporal requirements, where any sustained delay can be detrimental to performance. The research interest for the human capability to operate with delay has grown over the past decades, and it has grown in at least three separate fields. In this chapter, we review relevant work from cognitive psychology, human-computer interaction and multimedia research.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Illustration by Ivar Kjellmo.
 
2
see Footnote 1
 
Literatur
1.
Zurück zum Zitat Beigbeder, T., Coughlan, R., Lusher, C., Plunkett, J., Agu, E., Claypool, M.: The effects of loss and latency on user performance in unreal tournament 2003. In: Proceedings of 3rd Workshop on Network and system support for games (NetGames), pp. 144–151 (2004) Beigbeder, T., Coughlan, R., Lusher, C., Plunkett, J., Agu, E., Claypool, M.: The effects of loss and latency on user performance in unreal tournament 2003. In: Proceedings of 3rd Workshop on Network and system support for games (NetGames), pp. 144–151 (2004)
2.
Zurück zum Zitat Chen, K.T., Lei, C.L.: Are all games equally cloud-gaming-friendly? an electromyographic approach. In: 11th Annual Workshop on Network and Systems Support for Games (NetGames), pp. 1–6 (2012) Chen, K.T., Lei, C.L.: Are all games equally cloud-gaming-friendly? an electromyographic approach. In: 11th Annual Workshop on Network and Systems Support for Games (NetGames), pp. 1–6 (2012)
3.
Zurück zum Zitat Chen, K.T, Huang, P., Wang, G.S., Huang, C.Y., Lei, C.L.: On the sensitivity of online game playing time to network Qos. Proceedings of IEEE INFOCOM (2006) Chen, K.T, Huang, P., Wang, G.S., Huang, C.Y., Lei, C.L.: On the sensitivity of online game playing time to network Qos. Proceedings of IEEE INFOCOM (2006)
4.
Zurück zum Zitat Claypool, M.: The effect of latency on user performance in real-time strategy games. Comput. Netw. 49(1), 52–70 (2005)CrossRef Claypool, M.: The effect of latency on user performance in real-time strategy games. Comput. Netw. 49(1), 52–70 (2005)CrossRef
5.
Zurück zum Zitat Claypool, M., Claypool, K.: Latency and player interaction in online games. Commun. ACM 49(11), 40–45 (2006)CrossRef Claypool, M., Claypool, K.: Latency and player interaction in online games. Commun. ACM 49(11), 40–45 (2006)CrossRef
6.
Zurück zum Zitat Claypool, M., Eg, R., Raaen, K.: Modeling user performance for moving target selection with a delayed mouse. In: Amsaleg, L.,Gudmundsson, G., Gurrin, C., Jonsson, B., Satoh, S. (eds.). Lecture Notes in Computer Science, pp. 226–237. Springer (2017) Claypool, M., Eg, R., Raaen, K.: Modeling user performance for moving target selection with a delayed mouse. In: Amsaleg, L.,Gudmundsson, G., Gurrin, C., Jonsson, B., Satoh, S. (eds.). Lecture Notes in Computer Science, pp. 226–237. Springer (2017)
7.
Zurück zum Zitat Cunningham, D.W., Billock, V.A., Tsou, B.H.: Sensorimotor adaptation to violations of temporal contiguity. Psychol. Sci. 12(6), 532–535 (2001)CrossRef Cunningham, D.W., Billock, V.A., Tsou, B.H.: Sensorimotor adaptation to violations of temporal contiguity. Psychol. Sci. 12(6), 532–535 (2001)CrossRef
8.
Zurück zum Zitat Davis, S., Nesbitt, K., Nalivaiko, E.: A systematic review of cybersickness. In: Proceedings of the Conference on Interactive Entertainment (2014) Davis, S., Nesbitt, K., Nalivaiko, E.: A systematic review of cybersickness. In: Proceedings of the Conference on Interactive Entertainment (2014)
9.
Zurück zum Zitat Dick, M., Wellnitz, O., Wolf, L.: Analysis of factors affecting players’ performance and perception in multiplayer games. In: Proceedings of 4th Workshop on Network and System Support for Games (NetGames), pp. 1–7 (2005) Dick, M., Wellnitz, O., Wolf, L.: Analysis of factors affecting players’ performance and perception in multiplayer games. In: Proceedings of 4th Workshop on Network and System Support for Games (NetGames), pp. 1–7 (2005)
10.
Zurück zum Zitat Eagleman, D.M., Holcombe, A.O.: Causation and the perception of time. Trends Cogn. Sci. 6(8), 323–325 (2002)CrossRef Eagleman, D.M., Holcombe, A.O.: Causation and the perception of time. Trends Cogn. Sci. 6(8), 323–325 (2002)CrossRef
11.
Zurück zum Zitat Ebert, J.P., Wegner, D.M.: Time warp: authorship shapes the perceived timing of actions and events. Conscious. Cogn. 19(1), 481–489 (2010)CrossRef Ebert, J.P., Wegner, D.M.: Time warp: authorship shapes the perceived timing of actions and events. Conscious. Cogn. 19(1), 481–489 (2010)CrossRef
12.
Zurück zum Zitat Eg, R., Raaen, K.: How to demonstrate delay? let’s play! In: Proceedings of the 7th International Conference on Multimedia Systems, MMSys ’16, pp. 1–28 (2016) Eg, R., Raaen, K.: How to demonstrate delay? let’s play! In: Proceedings of the 7th International Conference on Multimedia Systems, MMSys ’16, pp. 1–28 (2016)
13.
Zurück zum Zitat Fritsch, T., Ritter, H., Schiller, J.: The effect of latency and network limitations on MMORPGs: a field study of everquest2. In: Proceedings of 4th workshop on Network and system support for games (NetGames) (2005) Fritsch, T., Ritter, H., Schiller, J.: The effect of latency and network limitations on MMORPGs: a field study of everquest2. In: Proceedings of 4th workshop on Network and system support for games (NetGames) (2005)
14.
Zurück zum Zitat Fujisaki, W., Nishida, S.: Audio-tactile superiority over visuo-tactile and audio-visual combinations in the temporal resolution of synchrony perception. Exp. Brain Res. 198(2–3), 245–259 (2009)CrossRef Fujisaki, W., Nishida, S.: Audio-tactile superiority over visuo-tactile and audio-visual combinations in the temporal resolution of synchrony perception. Exp. Brain Res. 198(2–3), 245–259 (2009)CrossRef
15.
Zurück zum Zitat Haggard, P., Chambon, V.: Sense of agency. Curr. Biol. 22(10), R390–R392 (2012)CrossRef Haggard, P., Chambon, V.: Sense of agency. Curr. Biol. 22(10), R390–R392 (2012)CrossRef
16.
Zurück zum Zitat Heron, J., Hanson, J.V.M., Whitaker, D.: Effect before cause: supramodal recalibration of sensorimotor timing. PLoS One 4(11), e7681 (2009)CrossRef Heron, J., Hanson, J.V.M., Whitaker, D.: Effect before cause: supramodal recalibration of sensorimotor timing. PLoS One 4(11), e7681 (2009)CrossRef
17.
Zurück zum Zitat International Telecommunication Union (ITU-T) (2014) Methods for the subjective assessment of small impairments in audio systems bs series. Recommendation BS1116-2 2 International Telecommunication Union (ITU-T) (2014) Methods for the subjective assessment of small impairments in audio systems bs series. Recommendation BS1116-2 2
18.
Zurück zum Zitat Jota, R., Ng, A., Dietz, P., Wigdor, D.: How fast is fast enough? a study of the effects of latency in direct-touch pointing tasks. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2291–2300 (2013) Jota, R., Ng, A., Dietz, P., Wigdor, D.: How fast is fast enough? a study of the effects of latency in direct-touch pointing tasks. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2291–2300 (2013)
19.
Zurück zum Zitat Libet, B.: Unconscious cerebral initiative and the role of conscious will in voluntary action. Behav. Brain Sci. 8(04), 529–539 (1985)CrossRef Libet, B.: Unconscious cerebral initiative and the role of conscious will in voluntary action. Behav. Brain Sci. 8(04), 529–539 (1985)CrossRef
20.
Zurück zum Zitat Limerick, H., Coyle, D., Moore, J.W.: The experience of agency in human-computer interactions: a review. Front. Hum. Neurosci. 8(3), 643 (2014) Limerick, H., Coyle, D., Moore, J.W.: The experience of agency in human-computer interactions: a review. Front. Hum. Neurosci. 8(3), 643 (2014)
21.
Zurück zum Zitat Metcalfe, J., Eich, T.S., Castel, A.D.: Metacognition of agency across the lifespan. Cognition 116(2), 267–282 (2010)CrossRef Metcalfe, J., Eich, T.S., Castel, A.D.: Metacognition of agency across the lifespan. Cognition 116(2), 267–282 (2010)CrossRef
22.
Zurück zum Zitat Moore, J.W., Obhi, S.S.: Intentional binding and the sense agency: a review. Conscious. Cogn. 21, 546–561 (2012)CrossRef Moore, J.W., Obhi, S.S.: Intentional binding and the sense agency: a review. Conscious. Cogn. 21, 546–561 (2012)CrossRef
23.
Zurück zum Zitat Moore, J.W., Lagnado, D., Deal, D.C., Haggard, P.: Feelings of control: contingency determines experience of action. Cognition 110(2), 279–283 (2009)CrossRef Moore, J.W., Lagnado, D., Deal, D.C., Haggard, P.: Feelings of control: contingency determines experience of action. Cognition 110(2), 279–283 (2009)CrossRef
24.
Zurück zum Zitat Nichols, J., Claypool, M.: The effects of latency on online madden NFL football. In: Proceedings of the 14th International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV), pp 146–151 (2004) Nichols, J., Claypool, M.: The effects of latency on online madden NFL football. In: Proceedings of the 14th International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV), pp 146–151 (2004)
25.
Zurück zum Zitat Noel, J., Wallace, M., Orchard-Mills, E., Alais, D., van der Burg, E.: True and perceived synchrony are preferentially associated with particular sensory pairings. Sci. Rep. 5 (2015) Noel, J., Wallace, M., Orchard-Mills, E., Alais, D., van der Burg, E.: True and perceived synchrony are preferentially associated with particular sensory pairings. Sci. Rep. 5 (2015)
26.
Zurück zum Zitat Occelli, V., Spence, C., Zampini, M.: Audiotactile interactions in temporal perception. Psychon. Bull. Rev. 18(3), 429–454 (2011)CrossRef Occelli, V., Spence, C., Zampini, M.: Audiotactile interactions in temporal perception. Psychon. Bull. Rev. 18(3), 429–454 (2011)CrossRef
27.
Zurück zum Zitat Pantel, L., Wolf, L.C.: On the impact of delay on real-time multiplayer games. In: Proceedings of the 12th International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV ’02, pp. 23–29 (2002) Pantel, L., Wolf, L.C.: On the impact of delay on real-time multiplayer games. In: Proceedings of the 12th International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV ’02, pp. 23–29 (2002)
28.
Zurück zum Zitat Quax, P., Monsieurs, P., Lamotte, W., De Vleeschauwer, D., Degrande, N.: Objective and subjective evaluation of the influence of small amounts of delay and jitter on a recent first person shooter game. In: Proceedings of 3rd Workshop on Network and System Support For Games (NetGames), pp. 152–156 (2004) Quax, P., Monsieurs, P., Lamotte, W., De Vleeschauwer, D., Degrande, N.: Objective and subjective evaluation of the influence of small amounts of delay and jitter on a recent first person shooter game. In: Proceedings of 3rd Workshop on Network and System Support For Games (NetGames), pp. 152–156 (2004)
29.
Zurück zum Zitat Raaen, K., Eg, R.: Instantaneous human-computer interactions : button causes and screen effects. Int. Conf. Hum. Comput. Interact. 2015, 1–12 (2015) Raaen, K., Eg, R.: Instantaneous human-computer interactions : button causes and screen effects. Int. Conf. Hum. Comput. Interact. 2015, 1–12 (2015)
30.
Zurück zum Zitat Raaen, K., Eg, R., Griwodz, C.: Can gamers detect cloud delay? In: Proceedings of the 13th Annual Workshop on Network and Systems Support for Games (NetGames), vol. 200 (2014) Raaen, K., Eg, R., Griwodz, C.: Can gamers detect cloud delay? In: Proceedings of the 13th Annual Workshop on Network and Systems Support for Games (NetGames), vol. 200 (2014)
31.
Zurück zum Zitat Rohde, M., Ernst, M.O.: To lead and to lag-forward and backward recalibration of perceived visuo-motor simultaneity. Front. Psychol. 3, 1–8 (2013)CrossRef Rohde, M., Ernst, M.O.: To lead and to lag-forward and backward recalibration of perceived visuo-motor simultaneity. Front. Psychol. 3, 1–8 (2013)CrossRef
32.
Zurück zum Zitat Rohde, M., Scheller, M., Ernst, M.O.: Effects can precede their cause in the sense of agency. Neuropsychologia 65, 191–196 (2014)CrossRef Rohde, M., Scheller, M., Ernst, M.O.: Effects can precede their cause in the sense of agency. Neuropsychologia 65, 191–196 (2014)CrossRef
33.
Zurück zum Zitat Seow, S.C.: Designing and Engineering Time. Addison-Wesley (2008) Seow, S.C.: Designing and Engineering Time. Addison-Wesley (2008)
34.
Zurück zum Zitat Sheldon, N., Girard, E., Borg, S., Claypool, M., Agu, E.: The effect of latency on user performance in warcraft iii. In: Proceedings of the 2nd Workshop on Network and System Support for Games (NetGames), pp. 3–14 (2003) Sheldon, N., Girard, E., Borg, S., Claypool, M., Agu, E.: The effect of latency on user performance in warcraft iii. In: Proceedings of the 2nd Workshop on Network and System Support for Games (NetGames), pp. 3–14 (2003)
35.
Zurück zum Zitat Sheridan T, Ferrell W (1963) Remote manipulative control with transmission delay. IEEE Trans. Hum. Factors Electro. HFE 4(1), 25–29 Sheridan T, Ferrell W (1963) Remote manipulative control with transmission delay. IEEE Trans. Hum. Factors Electro. HFE 4(1), 25–29
36.
Zurück zum Zitat Spence, C.: Crossmodal correspondences: a tutorial review. Atten. Percept. Psychophys. 73(4), 971–995 (2011)CrossRef Spence, C.: Crossmodal correspondences: a tutorial review. Atten. Percept. Psychophys. 73(4), 971–995 (2011)CrossRef
37.
Zurück zum Zitat Spence, C., Baddeley, R., Zampini, M., James, R., Shore, D.I.: Multisensory temporal order judgments: when two locations are better than one. Percept. Psychophys. 65(2), 318–328 (2003)CrossRef Spence, C., Baddeley, R., Zampini, M., James, R., Shore, D.I.: Multisensory temporal order judgments: when two locations are better than one. Percept. Psychophys. 65(2), 318–328 (2003)CrossRef
38.
Zurück zum Zitat Stetson, C., Cui, X., Montague, P.R., Eagleman, D.M.: Motor-sensory recalibration leads to an illusory reversal of action and sensation. Neuron 51(5), 651–659 (2006)CrossRef Stetson, C., Cui, X., Montague, P.R., Eagleman, D.M.: Motor-sensory recalibration leads to an illusory reversal of action and sensation. Neuron 51(5), 651–659 (2006)CrossRef
39.
Zurück zum Zitat Stuckel, D., Gutwin, C.: The effects of local lag on tightly-coupled interaction in distributed groupware. In: Proceedings of the 2008 ACM Conference on Computer Supported Cooperative Work (CSCW), pp. 447–456 (2008) Stuckel, D., Gutwin, C.: The effects of local lag on tightly-coupled interaction in distributed groupware. In: Proceedings of the 2008 ACM Conference on Computer Supported Cooperative Work (CSCW), pp. 447–456 (2008)
40.
Zurück zum Zitat Sugano, Y., Keetels, M., Vroomen, J.: Adaptation to motor-visual and motor-auditory temporal lags transfer across modalities. Exp. Brain Res. 201(3), 393–399 (2010)CrossRef Sugano, Y., Keetels, M., Vroomen, J.: Adaptation to motor-visual and motor-auditory temporal lags transfer across modalities. Exp. Brain Res. 201(3), 393–399 (2010)CrossRef
41.
Zurück zum Zitat Weber, F., Haering, C., Thomaschke, R.: Improving the human computer dialogue with increased temporal predictability. Hum. Factors J. Hum. Factors Ergonomics 55, 881–892 (2013)CrossRef Weber, F., Haering, C., Thomaschke, R.: Improving the human computer dialogue with increased temporal predictability. Hum. Factors J. Hum. Factors Ergonomics 55, 881–892 (2013)CrossRef
42.
Zurück zum Zitat Welch, R.B., Warren, D.H.: Immediate perceptual response to intersensory discrepancy. Psychol. Bull. 88(3), 638–667 (1980)CrossRef Welch, R.B., Warren, D.H.: Immediate perceptual response to intersensory discrepancy. Psychol. Bull. 88(3), 638–667 (1980)CrossRef
43.
Zurück zum Zitat Winter, R., Harrar, V., Gozdzik, M., Harris, L.R.: The relative timing of active and passive touch. Brain Res. 1242, 54–58 (2008)CrossRef Winter, R., Harrar, V., Gozdzik, M., Harris, L.R.: The relative timing of active and passive touch. Brain Res. 1242, 54–58 (2008)CrossRef
Metadaten
Titel
Perceiving, Interacting and Playing with Multimedia Delays
verfasst von
Ragnhild Eg
Kjetil Raaen
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-65840-7_8

Neuer Inhalt