nach oben

Erschienen in:

2021 | OriginalPaper | Buchkapitel

Narrative Cognition in Mixed Reality Systems: Towards an Empirical Framework

verfasst von : Luis Emilio Bruni, Hossein Dini, Aline Simonetti

Erschienen in: Virtual, Augmented and Mixed Reality

Verlag: Springer International Publishing

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

In this paper, we propose an interdisciplinary theoretical and empirical framework to investigate the particular faculties related to human “narrative cognition”, in general, and in relation to MRT in particular. In order to contextualize our approach, we shortly review the cognitive turn in narratology, as well as state of the art in different domains that have undertaken psychophysiological studies that either characterize aspects that are relevant to narrative cognition, or which investigate mixed reality experiences. The idea is to bring together knowledge and insights from narratology, different branches of semiotics and cognitive sciences, with empirical strategies that bridge the gap between first-person phenomenological approaches and psychophysiological and behavioural methods. We propose a rationale in order to combine tools and techniques from MRT/VR/AR, interactive digital narratives and storytelling, with a suite of integrated psychophysiological methods (such as EEG, HR, GSR and eye tracking) and phenomenological-subjective approaches.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Nächstes Kapitel Exploratory Study on the Use of Augmentation for Behavioural Control in Shared Spaces

Broniatowski, D.A., Reyna, V.F.: Gist and verbatim in narrative memory. In: Finlayson, M.A., Fisseni, B., Löwe, B., Meister, J.C. (eds.) 2013 Workshop on Computational Models of Narrative, pp. 43–51. Schloss Dagstuhl--Leibniz-Zentrum fuer Informatik, Dagstuhl (2013). https://doi.org/10.4230/OASIcs.CMN.2013.43

Bolioli, A., Casu, M., Lana, M., Roda, R.: Exploring the betrothed lovers. In: Finlayson, M.A., Fisseni, B., Löwe, B., Meister, J.C. (eds.) 2013 Workshop on Computational Models of Narrative, pp. 30–35. Schloss Dagstuhl--Leibniz-Zentrum fuer Informatik, Dagstuhl (2013). https://doi.org/10.4230/OASIcs.CMN.2013.30

Bhatt, M., Suchan, J., Schultz, C.: Cognitive interpretation of everyday activities: toward perceptual narrative based visuo-spatial scene interpretation. In: Workshop on Computational Models of Narrative, pp. 24–29. Leibniz-Zentrum für Informatik (2013). https://doi.org/10.4230/OASIcs.CMN.2013.24

Damiano, R., Lieto, A.: Ontological representations of narratives: a case study on stories and actions. In: Proceedings of 2013 Workshop on Computational Models of Narrative, pp. 76–93 (2013). https://doi.org/10.4230/OASIcs.CMN.2013.76

Dumas, J.E., Szilas, N., Richle, U., Boggini, T.: Interactive simulations to help teenagers cope when a parent has a traumatic brain injury. Comput. Entertain. 8, 1–3 (2011). https://doi.org/10.1145/1899687.1899692CrossRef

Szilas, N.: Interactive drama on computer: beyond linear narrative. In: AAAI Fall Symposium on Narrative Intelligence, pp. 150–156 (1999)

Schoenau-Fog, H., Bruni, L.E., Khalil, F.F., Faizi, J.: First person victim: developing a 3D interactive dramatic experience. In: Aylett, R., Lim, M.Y., Louchart, S., Petta, P., Riedl, M. (eds) Interactive Storytelling, ICIDS 2010, Lecture Notes in Computer Science, vol. 6432. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-16638-9_32

Baceviciute, S., Rützou Albæk, K.R., Arsovski, A., Bruni, L.E.: Digital interactive narrative tools for facilitating communication with children during counseling: a case for audiology. In: Oyarzun, D., Peinado, F., Young, R.M., Elizalde, A., Méndez, G. (eds) Interactive Storytelling, ICIDS 2012, Lecture Notes in Computer Science, vol. 7648. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-34851-8_5

Mulholland, P., Wolff, A., Zdrahal, Z., Li, N., Corneli, J.: Constructing and connecting storylines to tell museum stories. In: Koenitz, H., Sezen, T.I., Ferri, G., Haahr, M., Sezen, D., Çatak, G. (eds) Interactive Storytelling, ICIDS 2013, Lecture Notes in Computer Science, vol. 8230. Springer, Cham (2013). https://doi.org/10.1007/978-3-319-02756-2_14

10.

Kalogeras, S.: Media-education convergence: applying transmedia storytelling edutainment in e-learning environments. Int. J. Inf. Commun. Technol. Educ. 9, 1–11 (2013)CrossRef

11.

Marsh, T., Nickole, L.Z., Klopfer, E., Xuejin, C., Osterweil, S., Haas, J.: Fun and learning: blending design and development dimensions in serious games through narrative and characters. In: Ma, M., Oikonomou, A., Jain, L. (eds.) Serious Games and Edutainment Applications. Springer, London (2011). https://doi.org/10.1007/978-1-4471-2161-9_14

12.

Heiden, W., Räder, M., Fassbender, E.: Interactive storytelling in academic teaching. In: Aylett, R., Lim, M.Y., Louchart, S., Petta, P., Riedl, M. (eds.) Interactive Storytelling, pp. 216–221. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-16638-9_27CrossRef

13.

Guger, C., Holzner, C., Grönegress, C., Edlinger, G., Slater, M.: Control of a Smart Home with a Brain-Computer Interface (2008)

14.

Si, M., Marsella, S., Miller, L.: Interactive stories for health interventions. In: Aylett, R., Lim, M.Y., Louchart, S., Petta, P., Riedl, M. (eds.) Interactive Storytelling, pp. 291–292. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-16638-9_46CrossRef

15.

Szilas, N., Richle, U., Boggini, T., Dumas, J.: Using highly interactive drama to help young people cope with traumatic situations. In: Aylett, R., Lim, M.Y., Louchart, S., Petta, P., Riedl, M. (eds.) Interactive Storytelling, pp. 279–282. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-16638-9_42CrossRef

16.

Barthes, R., Duisit, L.: An introduction to the structural analysis of narrative. New Lit. Hist. 6, 237 (1975). https://doi.org/10.2307/468419CrossRef

17.

Bruner, J.: Acts of Meaning. Harvard University Press, Cambridge (1990)

18.

Polkinghorne, D.E.: Narrative Knowing and the Human Sciences. Suny Press, Albany (1988)

19.

Ricoeur, P.: Time and Narrative. University of Chicago Press, Chicago (1984)

20.

Finlayson, M.A., et al.: Workshop on computational models of narrative. In: CMN 2013, Saarbrücken/WadernSchloss Dagstuhl-Leibniz-Zentrum für Informatik, Hamburg (2013)

21.

Sanford, A.J., Emmott, C.: Mind, Brain and Narrative. Cambridge University Press, Cambridge (2012)CrossRef

22.

Ryan, M.-L.: Narrative as Virtual Reality: Immersion and Interactivity in Literature and Electronic Media. Johns Hopkins University Press, Baltimore (2001)

23.

Ryan, M.-L.: Avatars of Story. U of Minnesota Press, Minneapolis (2006)

24.

Herman, D.: Cognitive narratology. In: Handbook of Narratology, pp. 46–64. de Gruyter, Berlin (2009)

25.

Jahn, M.: Frames, preferences, and the reading of third-person narratives: towards a cognitive narratology. Poet. Today. 18, 441 (1997). https://doi.org/10.2307/1773182CrossRef

26.

Cobley, P.: Narrative. Routledge, London (2014)

27.

Zlatev, J.: Cognitive semiotics: an emerging field for the transdisciplinary study of meaning. Public J. Semiot. 4, 2–24 (2012). https://doi.org/10.37693/pjos.2012.4.8837CrossRef

28.

Ranta, M.: Stories in pictures (and non-pictorial objects): a narratological and cognitive psychological approach. Contemp. Aesthetics 9, 6 (2011)

29.

Matuk, C.F.: Narratives in mind and media: a cognitive semiotic account of novices interpreting visual science media (2010)

30.

Lee, Y.: Narrative cognition and modeling in new media communication from Peirce’s semiotic perspective. Semiotica 2012, 181–195 (2012). https://doi.org/10.1515/sem-2012-0029CrossRef

31.

Bruni, L.E.: Heterarchical semiosis: from signal transduction to narrative intelligibility. In: Trifonas, P.P. (ed.) International Handbook of Semiotics, pp. 1079–1097. Springer, Netherlands (2015). https://doi.org/10.1007/978-94-017-9404-6_49

32.

Bruni, L.E., Baceviciute, S.: On the embedded cognition of non-verbal narratives. Sign. Syst. Stud. 42, 359–375 (2014). https://doi.org/10.12697/SSS.2014.42.2-3.09CrossRef

33.

Ryan, M.L.: Narratology and cognitive science: a problematic relation. Style. 44, 469–495 (2010)

34.

Defense Advanced Research Projects Agency: Narrative Networks. https://www.darpa.mil/program/narrative-networks. Accessed 10 Feburary 2020

35.

Bruni, L.E., Baceviciute, S., Arief, M.: Narrative cognition in interactive systems: suspense-surprise and the P300 ERP component. In: Mitchell, A., Fernández-Vara, C., Thue, D. (eds.) Lecture Notes in Computer Science, pp. 164–175. Springer International Publishing, Cham (2014). https://doi.org/10.1007/978-3-319-12337-0_17

36.

Speer, N.K., Reynolds, J.R., Swallow, K.M., Zacks, J.M.: Reading stories activates neural representations of visual and motor experiences. Psychol. Sci. 20, 989–999 (2009). https://doi.org/10.1111/j.1467-9280.2009.02397.xCrossRef

37.

Yarkoni, T., Speer, N.K., Zacks, J.M.: Neural substrates of narrative comprehension and memory. Neuroimage 41, 1408–1425 (2008). https://doi.org/10.1016/j.neuroimage.2008.03.062CrossRef

38.

Mar, R.A.: The neuropsychology of narrative: story comprehension, story production and their interrelation. Neuropsychologia 42, 1414–1434 (2004). https://doi.org/10.1016/j.neuropsychologia.2003.12.016CrossRef

39.

Zacks, J.M., Speer, N.K., Swallow, K.M., Maley, C.J.: The brain’s cutting-room floor: segmentation of narrative cinema. Front. Hum. Neurosci. 4 (2010). https://doi.org/10.3389/fnhum.2010.00168

40.

Lambrecht, J., Spring, D.K., Münte, T.F.: The focus of attention at the virtual cocktail party—electrophysiological evidence. Neurosci. Lett. 489, 53–56 (2011). https://doi.org/10.1016/j.neulet.2010.11.066CrossRef

41.

Münte, T.F., Spring, D.K., Szycik, G.R., Noesselt, T.: Electrophysiological attention effects in a virtual cocktail-party setting. Brain Res. 1307, 78–88 (2010). https://doi.org/10.1016/j.brainres.2009.10.044CrossRef

42.

Nager, W., Dethlefsen, C., Münte, T.F.: Attention to human speakers in a virtual auditory environment: Brain potential evidence. Brain Res. 1220, 164–170 (2008). https://doi.org/10.1016/j.brainres.2008.02.058CrossRef

43.

Jaeger, M., Mirkovic, B., Bleichner, M.G., Debener, S.: Decoding the attended speaker from EEG using adaptive evaluation intervals captures fluctuations in attentional listening. Front. Neurosci. 14, 1–16 (2020). https://doi.org/10.3389/fnins.2020.00603CrossRef

44.

Stuldreher, I.V., Thammasan, N., van Erp, J.B.F., Brouwer, A.-M.: Physiological synchrony in EEG, electrodermal activity and heart rate detects attentionally relevant events in time. Front. Neurosci. 14, 1–11 (2020). https://doi.org/10.3389/fnins.2020.575521CrossRef

45.

Shavit-Cohen, K., Zion Golumbic, E.: The dynamics of attention shifts among concurrent speech in a naturalistic multi-speaker virtual environment. Front. Hum. Neurosci. 13, 1–12 (2019). https://doi.org/10.3389/fnhum.2019.00386

46.

Di Liberto, G.M., Nie, J., Yeaton, J., Khalighinejad, B., Shamma, S.A., Mesgarani, N.: Neural representation of linguistic feature hierarchy reflects second-language proficiency. Neuroimage 227, 117586 (2021). https://doi.org/10.1016/j.neuroimage.2020.117586CrossRef

47.

Jospe, K., Genzer, S., Klein Selle, N., Ong, D., Zaki, J., Perry, A.: The contribution of linguistic and visual cues to physiological synchrony and empathic accuracy. Cortex. 132, 296–308 (2020). https://doi.org/10.1016/j.cortex.2020.09.001

48.

Ju, Y.S., Hwang, J.S., Kim, S.J., Suk, H.J.: Study of eye gaze and presence effect in virtual reality. In: Communications in Computer and Information Science, pp. 446–449. Springer International Publishing, Heidelberg (2019). https://doi.org/10.1007/978-3-030-23528-4_60

49.

Bruni, L.E., Baceviciute, S.: Narrative intelligibility and closure in interactive systems. In: Koenitz, H., Sezen, T.I., Ferri, G., Haahr, M., Sezen, D., Çatak, G. (eds.) Interactive Storytelling, pp. 13–24. Springer International Publishing, Cham (2013). https://doi.org/10.1007/978-3-319-02756-2_2

50.

Duncan, C.C., et al.: Event-related potentials in clinical research: guidelines for eliciting, recording, and quantifying mismatch negativity, P300, and N400. Clin. Neurophysiol. 120, 1883–1908 (2009). https://doi.org/10.1016/j.clinph.2009.07.045CrossRef

51.

McPherson, W.B., Holcomb, P.J.: An electrophysiological investigation of semantic priming with pictures of real objects. Psychophysiology 36, 53–65 (1999). https://doi.org/10.1017/S0048577299971196CrossRef

52.

West, W.C., Holcomb, P.J.: Event-related potentials during discourse-level semantic integration of complex pictures. Cogn. Brain Res. 13, 363–375 (2002). https://doi.org/10.1016/S0926-6410(01)00129-XCrossRef

53.

Proverbio, A.M., Riva, F.: RP and N400 ERP components reflect semantic violations in visual processing of human actions. Neurosci. Lett. 459, 142–146 (2009). https://doi.org/10.1016/j.neulet.2009.05.012CrossRef

54.

Sitnikova, T., Holcomb, P.J., Kiyonaga, K.A., Kuperberg, G.R.: Two neurocognitive mechanisms of semantic integration during the comprehension of visual real-world events. J. Cogn. Neurosci. 20, 2037–2057 (2008). https://doi.org/10.1162/jocn.2008.20143CrossRef

55.

Hein, G., Doehrmann, O., Muller, N.G., Kaiser, J., Muckli, L., Naumer, M.J.: Object familiarity and semantic congruency modulate responses in cortical audiovisual integration areas. J. Neurosci. 27, 7881–7887 (2007). https://doi.org/10.1523/JNEUROSCI.1740-07.2007CrossRef

56.

Federmeier, K.: Picture the difference: electrophysiological investigations of picture processing in the two cerebral hemispheres. Neuropsychologia 40, 730–747 (2002). https://doi.org/10.1016/S0028-3932(01)00193-2CrossRef

57.

Wu, Y.C., Coulson, S.: Meaningful gestures: electrophysiological indices of iconic gesture comprehension. Psychophysiology 42, 654–667 (2005). https://doi.org/10.1111/j.1469-8986.2005.00356.xCrossRef

58.

Sitnikova, T., Kuperberg, G., Holcomb, P.J.: Semantic integration in videos of real–world events: an electrophysiological investigation. Psychophysiology 40, 160–164 (2003). https://doi.org/10.1111/1469-8986.00016CrossRef

59.

Chao, L.L., Nielsen-Bohlman, L., Knight, R.T.: Auditory event-related potentials dissociate early and late memory processes. Electroencephalogr. Clin. Neurophysiol. Potentials Sect. 96, 157–168 (1995). https://doi.org/10.1016/0168-5597(94)00256-E.

60.

Cohn, N., Paczynski, M., Holcomb, P., Jackendoff, R., Kuperberg, G.: Comics on the brain: structure and meaning in sequential image comprehension. In: Proceedings of the Annual Meeting of the Cognitive Science Society (2011)

61.

Cohn, N., Paczynski, M., Jackendoff, R., Holcomb, P.J., Kuperberg, G.R.: (Pea)nuts and bolts of visual narrative: structure and meaning in sequential image comprehension. Cogn. Psychol. 65, 1–38 (2012). https://doi.org/10.1016/j.cogpsych.2012.01.003CrossRef

62.

Barrett, S.E., Rugg, M.D.: Event-related potentials and the semantic matching of pictures. Brain Cogn. 14, 201–212 (1990). https://doi.org/10.1016/0278-2626(90)90029-NCrossRef

63.

Hamm, J.P., Johnson, B.W., Kirk, I.J.: Comparison of the N300 and N400 ERPs to picture stimuli in congruent and incongruent contexts. Clin. Neurophysiol. 113, 1339–1350 (2002). https://doi.org/10.1016/S1388-2457(02)00161-XCrossRef

64.

Gilroy, S.W., et al.: A brain-computer interface to a plan-based narrative. In: Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence, pp. 1997–2005. AAAI Press (2013)

65.

Ekman, I., et al.: Review on psychophysiological methods in game research. In: Proceedings of the 2010 International DiGRA Nordic Conference: Experiencing Games: Games, Play, and Players, DiGRA Nordic 2010 (2010)

66.

Nijholt, A.: BCI for games: a ‘state of the art’ survey. In: Stevens, S.M., Saldamarco, S.J. (eds.) Lecture Notes in Computer Science, pp. 225–228. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-89222-9_29

67.

Gjøl, B.A., Jørgensen, N.V., Thomsen, M.R., Bruni, L.E.: Predictability and plausibility in interactive narrative constructs: a case for an ERP study. In: Rouse, R., Koenitz, H., Haahr, M. (eds.) Interactive Storytelling, pp. 121–133. Springer International Publishing, Cham (2018). https://doi.org/10.1007/978-3-030-04028-4_9

68.

Coderre, E.L., O’Donnell, E., O’Rourke, E., Cohn, N.: Predictability modulates neurocognitive semantic processing of non-verbal narratives. Sci. Rep. 10, 10326 (2020). https://doi.org/10.1038/s41598-020-66814-zCrossRef

69.

Coco, M.I., Araujo, S., Petersson, K.M.: Disentangling stimulus plausibility and contextual congruency: electro-physiological evidence for differential cognitive dynamics. Neuropsychologia 96, 150–163 (2017). https://doi.org/10.1016/j.neuropsychologia.2016.12.008CrossRef

70.

Ki, J.J., Kelly, S.P., Parra, L.C.: Attention strongly modulates reliability of neural responses to naturalistic narrative stimuli. J. Neurosci. 36, 3092–3101 (2016). https://doi.org/10.1523/JNEUROSCI.2942-15.2016CrossRef

71.

Cohen, S.S., Parra, L.C.: Memorable audiovisual narratives synchronize sensory and supramodal neural responses. Eneuro. 3, ENEURO.0203–16.2016 (2016). https://doi.org/10.1523/ENEURO.0203-16.2016

72.

Wang, R.W.Y., Chang, Y.-C., Chuang, S.-W.: EEG spectral dynamics of video commercials: impact of the narrative on the branding product preference. Sci. Rep. 6, 36487 (2016). https://doi.org/10.1038/srep36487CrossRef

73.

Chun, C., Park, B., Shi, C.: Re-living suspense: emotional and cognitive responses during repeated exposure to suspenseful film. Front. Psychol. 11, 2786 (2020). https://doi.org/10.3389/fpsyg.2020.558234CrossRef

74.

Foulsham, T., Wybrow, D., Cohn, N.: Reading without words: eye movements in the comprehension of comic strips. Appl. Cogn. Psychol. 30, 566–579 (2016). https://doi.org/10.1002/acp.3229CrossRef

75.

Barraza, J.A., Alexander, V., Beavin, L.E., Terris, E.T., Zak, P.J.: The heart of the story: peripheral physiology during narrative exposure predicts charitable giving. Biol. Psychol. 105, 138–143 (2015). https://doi.org/10.1016/j.biopsycho.2015.01.008CrossRef

76.

Jääskeläinen, I.P., Sams, M., Glerean, E., Ahveninen, J.: Movies and narratives as naturalistic stimuli in neuroimaging. Neuroimage 224, 117445 (2021). https://doi.org/10.1016/j.neuroimage.2020.117445CrossRef

77.

Rothe, S., Hollerer, T., Hubmann, H.: CVR-analyzer: a tool for analyzing cinematic virtual reality viewing patterns. In: 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), pp. 403–404. IEEE (2018). https://doi.org/10.1109/ISMAR-Adjunct.2018.00117

78.

Rothe, S., Pothmann, P., Drewe, H., Hussmann, H.: Interaction techniques for cinematic virtual reality. In: 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 1733–1737. IEEE (2019). https://doi.org/10.1109/VR.2019.8798189

79.

Rothe, S., L. Chuang, L.: Implications of eye tracking research to cinematic virtual reality. In: Symposium on Eye Tracking Research and Applications, pp. 1–3. ACM, New York (2020). https://doi.org/10.1145/3379157.3391658

80.

Ding, N., Zhou, W., Fung, A.Y.H.: Emotional effect of cinematic VR compared with traditional 2D film. Telematics Inform. 35, 1572–1579 (2018). https://doi.org/10.1016/j.tele.2018.04.003CrossRef

81.

Marwecki, S., Wilson, A.D., Ofek, E., Gonzalez Franco, M., Holz, C.: Mise-unseen: using eye-tracking to hide virtual reality scene changes in plain sight. In: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology, pp. 777–789. ACM, New York (2019). https://doi.org/10.1145/3332165.3347919

82.

Škola, F., et al.: Virtual reality with 360-video storytelling in cultural heritage: study of presence, engagement, and immersion. Sensors. 20, 5851 (2020). https://doi.org/10.3390/s20205851CrossRef

83.

Kwok, T.C.K., Kiefer, P., Schinazi, V.R., Adams, B., Raubal, M.: Gaze-guided narratives. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–12. ACM, New York (2019). https://doi.org/10.1145/3290605.3300721

84.

Bee, N., et al.: Discovering eye gaze behavior during human-agent conversation in an interactive storytelling application. In: International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction on - ICMI-MLMI 2010, p. 1. ACM Press, New York (2010). https://doi.org/10.1145/1891903.1891915

85.

Gere, C.: Digital Culture. Reaktion Books, London (2009)

86.

Rhumbo. http://rhumbo.eu/webs/rhumbo/. Accessed 01 Feburary 2021

87.

Bruni, L.E.: Hierarchical categorical perception in sensing and cognitive processes. Biosemiotics 1, 113–130 (2008). https://doi.org/10.1007/s12304-008-9001-9CrossRef

88.

Bruni, L.E.: Semiotic freedom: emergence and teleology in biological and cognitive interfaces. Am. J. Semiot. 24, 57–73 (2008). https://doi.org/10.5840/ajs2008241/35CrossRef

89.

Vincent, D., Perrin, L.: On the narrative vs non-narrative functions of reported speech: a socio-pragmatic study. J. Socioling. 3, 291–313 (1999). https://doi.org/10.1111/1467-9481.00080CrossRef

90.

Goodman, N.: Twisted tales: story, study and symphony. In: Mitchell, W.J.T. (ed.) Narrative, Chicago (1981)

91.

Hutto, D.D.: Narrative and understanding persons. R. Inst. Philos. Suppl. 60, 1–16 (2007). https://doi.org/10.1017/S135824610700001XCrossRef

92.

Strawson, G.: Against narrativity. Ratio 17, 428–452 (2004). https://doi.org/10.1111/j.1467-9329.2004.00264.xCrossRef

93.

Herman, D.: Basic Elements of Narrative. Wiley, New York (2009)CrossRef

94.

Goodson, I., Gill, S.R.: Narrative Pedagogy: Life History and Learning. Peter Lang, Bern (2011)

95.

White, M., Wijaya, M., White, M.K., Epston, D.: Narrative Means to Therapeutic Ends. WW Norton & Company, New York (1990)

96.

Kleinreesink, E., Moelker, R., Richardson, R.: Books and Bikes. Amsterdam University Press, Amsterdam (2012)CrossRef

97.

Corman, S.R.: Narrating the Exit from Afghanistan. Tempe: Center for Strategic Communication (2013)

98.

Varela, F.J., Rosch, E., Thompson, E.: The Embodied Mind. MIT Press, Cambridge (1993)

Titel: Narrative Cognition in Mixed Reality Systems: Towards an Empirical Framework
verfasst von: Luis Emilio Bruni
Hossein Dini
Aline Simonetti
Verlag: Springer International Publishing
Buch: Virtual, Augmented and Mixed Reality
Print ISBN: 978-3-030-77598-8

Electronic ISBN: 978-3-030-77599-5

Copyright-Jahr: 2021
DOI: https://doi.org/10.1007/978-3-030-77599-5_1

Neuer Inhalt

Bildnachweise

VDI-Icon, Profil Icon, inhalt2, Springer Professional Modul/© Springer Fachmedien Wiesbaden GmbH, Die Gewinner und Laudatoren des Sustainability Award in Automotive 2024/© Uli Regenscheit | ATZlive, Search Icon, Banner Hanser, Dinko Eror/© Red Hat GmbH, Suresh Vittal/© Alteryx, Additiv gefertigte Teile/© Marina_Skoropadskaya | Getty Images | iStock, Zeitschrift Wissensmanagement Cover, PatentFit-Logo/© Springer Fachmedien Wiesbaden GmbH, ATZ-Webinar: Prototypenfreie Entwicklung durch Offline- und Driver-in-the-Loop-HiL-Tests /© (c) VI-grade, chassis.tech plus 2023/© [M] ATZlive / TÜV SÜD PRODUCT SERVICE GMBH, adäsion-Webinar-Matinee/© krystiannawrocki_ Getty Images

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Neuer Inhalt

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.