Skip to main content

2018 | OriginalPaper | Buchkapitel

The Semiotics of Space and Time in Interaction Design

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Since the 1960s artists have been experimenting with the multiple dimensions of electronic art. Their art can inform other disciplines, including interaction design. Digital art has led to new semantic structures that can be applied to human-computer interface design. This paper presents an analysis of the semiotics of the digital image and interaction design, and the new semantic structures that are defined by digital art research and praxis, kinesthetic design, cognitive mapping, and cross-modal perception. The paper also proposes the development of new software tools for designing and visualizing the information architecture, navigation, and cognitive and sensory relationships in a virtual information space. These tools can facilitate the exploration of the unique semantic dimensions that define these interactive environments.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
7.
Zurück zum Zitat Search, P.: HyperGlyphs: using design and language to define hypermedia navigation. J. Educ. Multimed. Hypermed. 2(4), 369–380 (1993) Search, P.: HyperGlyphs: using design and language to define hypermedia navigation. J. Educ. Multimed. Hypermed. 2(4), 369–380 (1993)
8.
Zurück zum Zitat Search, P.: HyperGlyphs: new multiliteracy models for interactive computing. In: Cope, B., Kalantzis, M. (eds.) International Journal of Learning 8, pp. 1–19. Common Ground Publishing, Melbourne (2001) Search, P.: HyperGlyphs: new multiliteracy models for interactive computing. In: Cope, B., Kalantzis, M. (eds.) International Journal of Learning 8, pp. 1–19. Common Ground Publishing, Melbourne (2001)
9.
Zurück zum Zitat Search, P.: The metastructual dynamics of interactive electronic design. Vis. Lang. Cult. Dimens. Vis. Commun. 37(2), 146–165 (2003) Search, P.: The metastructual dynamics of interactive electronic design. Vis. Lang. Cult. Dimens. Vis. Commun. 37(2), 146–165 (2003)
10.
Zurück zum Zitat Search, P.: Using new media art and multisensory design for information and data representation. In: Tiradentes Souto, V., Spinillo, C., Portugal, C., Fadel, L. (eds.) Selected Readings of the 7th Information Design International Conference, pp. 179–190. The Brazilian Society of Information Design, Basilia (2016) Search, P.: Using new media art and multisensory design for information and data representation. In: Tiradentes Souto, V., Spinillo, C., Portugal, C., Fadel, L. (eds.) Selected Readings of the 7th Information Design International Conference, pp. 179–190. The Brazilian Society of Information Design, Basilia (2016)
13.
Zurück zum Zitat Collins, A.M., Loftus, E.F.: A spreading-activation theory of semantic processing. Psychol. Rev. 82(6), 407–428 (1975)CrossRef Collins, A.M., Loftus, E.F.: A spreading-activation theory of semantic processing. Psychol. Rev. 82(6), 407–428 (1975)CrossRef
15.
Zurück zum Zitat Hopfield, J.J.: Neural networks and physical systems with emergent collective computational abilities. Proc. Nat. Acad. Sci. 79(8), 2554–2558 (1982)MathSciNetCrossRef Hopfield, J.J.: Neural networks and physical systems with emergent collective computational abilities. Proc. Nat. Acad. Sci. 79(8), 2554–2558 (1982)MathSciNetCrossRef
16.
Zurück zum Zitat Rumelhart, D.E., Todd, P.M.: Learning and connectionist representations. In: Meyer, D.E., Kornblum, S. (eds.) Attention and Performance XIV: Synergies in Experimental Psychology, Artificial Intelligence, and Cognitive Neuroscience, pp. 3–30. MIT Press, Cambridge (1993) Rumelhart, D.E., Todd, P.M.: Learning and connectionist representations. In: Meyer, D.E., Kornblum, S. (eds.) Attention and Performance XIV: Synergies in Experimental Psychology, Artificial Intelligence, and Cognitive Neuroscience, pp. 3–30. MIT Press, Cambridge (1993)
17.
Zurück zum Zitat Jones, M., Willits, J., Dennis, S.: Models of semantic memory. In: Busemeyer, J., Wang, Z., Townsend, J., Eidels, A. (eds.) The Oxford Handbook of Computational and Mathematical Psychology, 232-254. Oxford University Press, New York (2015) Jones, M., Willits, J., Dennis, S.: Models of semantic memory. In: Busemeyer, J., Wang, Z., Townsend, J., Eidels, A. (eds.) The Oxford Handbook of Computational and Mathematical Psychology, 232-254. Oxford University Press, New York (2015)
18.
Zurück zum Zitat Rogers, T.T., McClelland, J.L.: Semantic Cognition. MIT Press, Cambridge (2006) Rogers, T.T., McClelland, J.L.: Semantic Cognition. MIT Press, Cambridge (2006)
19.
Zurück zum Zitat Minsky, M.: The Society of Mind. Simon and Shuster, New York (1988) Minsky, M.: The Society of Mind. Simon and Shuster, New York (1988)
20.
Zurück zum Zitat Bergman, A.: Auditory Scene Analysis. MIT Press, Cambridge (1994) Bergman, A.: Auditory Scene Analysis. MIT Press, Cambridge (1994)
21.
Zurück zum Zitat Hartley, T., Burgess, N.: Models of spatial cognition. In: Nadel, L. (ed.) MacMillan Encyclopaedia of Cognitive Science, pp. 111–119. Nature Publishing Group, London (2002) Hartley, T., Burgess, N.: Models of spatial cognition. In: Nadel, L. (ed.) MacMillan Encyclopaedia of Cognitive Science, pp. 111–119. Nature Publishing Group, London (2002)
25.
Zurück zum Zitat Freides, D.: Human information processing and sensory modality: cross-modal functions, information complexity, memory, and deficit. Psychol. Bull. 81(5), 284–310 (1974)CrossRef Freides, D.: Human information processing and sensory modality: cross-modal functions, information complexity, memory, and deficit. Psychol. Bull. 81(5), 284–310 (1974)CrossRef
26.
Zurück zum Zitat MacLeod, A., Summerfield, Q.: A procedure for measuring auditory and audio-visual speech-reception thresholds for sentences in noise: rationale, evaluation, and recommendations for use. Br. J. Audiol. 24(1), 29–43 (1990)CrossRef MacLeod, A., Summerfield, Q.: A procedure for measuring auditory and audio-visual speech-reception thresholds for sentences in noise: rationale, evaluation, and recommendations for use. Br. J. Audiol. 24(1), 29–43 (1990)CrossRef
27.
Zurück zum Zitat Stein, B.E., Meredith, M.A.: The Merging of Senses. MIT Press, Cambridge (1993) Stein, B.E., Meredith, M.A.: The Merging of Senses. MIT Press, Cambridge (1993)
28.
Zurück zum Zitat Chen, Y.-C., Spence, C.: When hearing the bark helps to identify the dog: semantically-congruent sounds modulate the identification of masked pictures. Cognition 114(3), 389–404 (2010)CrossRef Chen, Y.-C., Spence, C.: When hearing the bark helps to identify the dog: semantically-congruent sounds modulate the identification of masked pictures. Cognition 114(3), 389–404 (2010)CrossRef
29.
Zurück zum Zitat Molholm, S., Ritter, W., Murray, M.M., Javitt, D.C., Schroeder, C.E., Foxe, J.J.: Multisensory auditory–visual interactions during early sensory processing in humans: a high-density electrical mapping study. Cogn. Brain Res. 14(1), 115–128 (2002)CrossRef Molholm, S., Ritter, W., Murray, M.M., Javitt, D.C., Schroeder, C.E., Foxe, J.J.: Multisensory auditory–visual interactions during early sensory processing in humans: a high-density electrical mapping study. Cogn. Brain Res. 14(1), 115–128 (2002)CrossRef
30.
Zurück zum Zitat Brunel, L., Labeye, E., Lesourd, M., Versace, R.: The sensory nature of episodic memory: sensory priming effects due to memory trace activation. J. Exp. Psychol. Learn. Mem. Cogn. 35(4), 1081–1088 (2009)CrossRef Brunel, L., Labeye, E., Lesourd, M., Versace, R.: The sensory nature of episodic memory: sensory priming effects due to memory trace activation. J. Exp. Psychol. Learn. Mem. Cogn. 35(4), 1081–1088 (2009)CrossRef
31.
Zurück zum Zitat Brunel, L., Lesourd, M., Labeye, E., Versace, R.: The sensory nature of knowledge: sensory priming effects in semantic categorization. Q. J. Exp. Psychol. 63(5), 955–964 (2010)CrossRef Brunel, L., Lesourd, M., Labeye, E., Versace, R.: The sensory nature of knowledge: sensory priming effects in semantic categorization. Q. J. Exp. Psychol. 63(5), 955–964 (2010)CrossRef
32.
Zurück zum Zitat Brunel, L., Goldstone, R.L., Vallet, G., Riou, B., Versace, R.: When seeing a dog activates the bark: multisensory generalization and distinctiveness effects. Exp. Psychol. 60(2), 100–112 (2013)CrossRef Brunel, L., Goldstone, R.L., Vallet, G., Riou, B., Versace, R.: When seeing a dog activates the bark: multisensory generalization and distinctiveness effects. Exp. Psychol. 60(2), 100–112 (2013)CrossRef
34.
Zurück zum Zitat Townsend, J.T., Wenger, M.J.: A theory of interactive parallel processing: new capacity measures and predictions for a response time inequality series. Psychol. Rev. 111(4), 1003–1035 (2004)CrossRef Townsend, J.T., Wenger, M.J.: A theory of interactive parallel processing: new capacity measures and predictions for a response time inequality series. Psychol. Rev. 111(4), 1003–1035 (2004)CrossRef
35.
Zurück zum Zitat Search, P.: Defining a sense of place in interactive multimedia design. In: Avgerinou, M., Chandler, S. (eds.) Visual Literacy in the 21st Century: Trends, Demands, and Capacities, pp. 143–148. International Visual Literacy Association, Chicago (2011) Search, P.: Defining a sense of place in interactive multimedia design. In: Avgerinou, M., Chandler, S. (eds.) Visual Literacy in the 21st Century: Trends, Demands, and Capacities, pp. 143–148. International Visual Literacy Association, Chicago (2011)
36.
Zurück zum Zitat Neiva, E.: Redefining the image: mimesis, convention, and semiotics. Commun. Theory 9(1), 75–91 (1999)CrossRef Neiva, E.: Redefining the image: mimesis, convention, and semiotics. Commun. Theory 9(1), 75–91 (1999)CrossRef
37.
Zurück zum Zitat Djajadiningrat, T., Matthews, B., Stienstra, M.: Easy doesn’t do it: Skill and expression in tangible aesthetics. Pers. Ubiquit. Comput. 11(8), 657–676 (2007)CrossRef Djajadiningrat, T., Matthews, B., Stienstra, M.: Easy doesn’t do it: Skill and expression in tangible aesthetics. Pers. Ubiquit. Comput. 11(8), 657–676 (2007)CrossRef
38.
Zurück zum Zitat Klemmer, S.R., Hartmann, B., Takayama, L.: How bodies matter: five themes for interaction design. In: Proceedings of Designing Interactive Systems, DIS 2006, pp. 140–148. Association for Computing Machinery (ACM), New York (2006) Klemmer, S.R., Hartmann, B., Takayama, L.: How bodies matter: five themes for interaction design. In: Proceedings of Designing Interactive Systems, DIS 2006, pp. 140–148. Association for Computing Machinery (ACM), New York (2006)
39.
Zurück zum Zitat Lakoff, G., Johnson, M.L.: Metaphors We Live By. University of Chicago Press, Chicago (1980) Lakoff, G., Johnson, M.L.: Metaphors We Live By. University of Chicago Press, Chicago (1980)
40.
Zurück zum Zitat LeBaron, C., Streeck, J.: Gestures, knowledge, and the world. In: McNeill, D. (ed.) Language and Gesture, pp. 118–138. Cambridge University Press, Cambridge (2000)CrossRef LeBaron, C., Streeck, J.: Gestures, knowledge, and the world. In: McNeill, D. (ed.) Language and Gesture, pp. 118–138. Cambridge University Press, Cambridge (2000)CrossRef
41.
Zurück zum Zitat Abrahamson, D., Lindgren, R.: Embodiment and embodied design. In: Sawyer, R.K. (ed.) The Cambridge Handbook of the Learning Sciences, 2nd edn, pp. 357–376. Cambridge University Press, Cambridge (2014) Abrahamson, D., Lindgren, R.: Embodiment and embodied design. In: Sawyer, R.K. (ed.) The Cambridge Handbook of the Learning Sciences, 2nd edn, pp. 357–376. Cambridge University Press, Cambridge (2014)
42.
Zurück zum Zitat Meister, M.L.R., Buffalo, E.A.: Memory. In: Conn, M. (ed.) Conn’s Translational Neuroscience, pp. 693–708. Academic Press, Cambridge (2016) Meister, M.L.R., Buffalo, E.A.: Memory. In: Conn, M. (ed.) Conn’s Translational Neuroscience, pp. 693–708. Academic Press, Cambridge (2016)
43.
Zurück zum Zitat Macken-Horarik, M.: Interacting with the multimodal text: reflections on image and verbiage. Vis. Commun. 3(1), 5–26 (2004)CrossRef Macken-Horarik, M.: Interacting with the multimodal text: reflections on image and verbiage. Vis. Commun. 3(1), 5–26 (2004)CrossRef
44.
Zurück zum Zitat Piaget, J.: Recherches sur L’abstraction reflechissante, vol. I and II. Presses Universitaires de France, Paris (1977) Piaget, J.: Recherches sur L’abstraction reflechissante, vol. I and II. Presses Universitaires de France, Paris (1977)
45.
Zurück zum Zitat Campbell, R.: Studies in Reflecting Abstraction. Psychology Press, Philadelphia (2001) Campbell, R.: Studies in Reflecting Abstraction. Psychology Press, Philadelphia (2001)
48.
Zurück zum Zitat Christie, M.: Aboriginal knowledge traditions in digital environments. J. Indig. Educ. 34, 61–66 (2005)CrossRef Christie, M.: Aboriginal knowledge traditions in digital environments. J. Indig. Educ. 34, 61–66 (2005)CrossRef
49.
Zurück zum Zitat Verran, H., Christie, M.: Using/designing digital technologies of representation in Aboriginal Australian knowledge practices. Hum. Technol. 3(2), 214–227 (2007)CrossRef Verran, H., Christie, M.: Using/designing digital technologies of representation in Aboriginal Australian knowledge practices. Hum. Technol. 3(2), 214–227 (2007)CrossRef
50.
Zurück zum Zitat Srinivasan, R., Huang, J.: Fluid ontologies for digital museums. Int. J. Digit. Libr. 5(3), 193–204 (2005)CrossRef Srinivasan, R., Huang, J.: Fluid ontologies for digital museums. Int. J. Digit. Libr. 5(3), 193–204 (2005)CrossRef
52.
Zurück zum Zitat Paul, C.: The database as system and cultural form: anatomies of cultural narratives. In: Vesna, V. (ed.) Database Aesthetics: Art in the Age of Information Overflow, pp. 95–109. University of Minnesota Press, Minneapolis (2007)CrossRef Paul, C.: The database as system and cultural form: anatomies of cultural narratives. In: Vesna, V. (ed.) Database Aesthetics: Art in the Age of Information Overflow, pp. 95–109. University of Minnesota Press, Minneapolis (2007)CrossRef
Metadaten
Titel
The Semiotics of Space and Time in Interaction Design
verfasst von
Patricia Search
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-91797-9_17

Neuer Inhalt