Skip to main content
Top

2010 | OriginalPaper | Chapter

Visual Iconic Patterns of Instant Messaging: Steps Towards Understanding Visual Conversations

Author : Hillary Bays

Published in: International Handbook of Internet Research

Publisher: Springer Netherlands

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

An Instant Messaging (IM) conversation is a dynamic communication register made up of text, images, animation and sound played out on a screen with potentially several parallel conversations and activities all within a physical environment. This article first examines how best to capture this unique gestalt using in situ recording techniques (video, screen capture, XML logs) which highlight the micro-phenomenal level of the exchange and the macro-social level of the interaction. Of particular interest are smileys first as cultural artifacts in CMC in general then as linguistic markers. A brief taxonomy of these markers is proposed in an attempt to clarify their frequency and patterns of their use. Then, focus is placed on their importance as perceptual cues which facilitate communication, while also serving as emotive and emphatic functional markers. We try to demonstrate that the use of smileys and animation is not arbitrary but an organized interactional and structured practice. Finally, we discuss how the study of visual markers in IM could inform the study of other visual conversation codes, such as sign languages, which also have co-produced, physical behavior, suggesting the possibility of a visual phonology.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
For more on situated and shared practice of language organisation, cf. Harold Garfinkel, Studies in Ethnomethodology, Englewood Cliffs, NJ, Prentice Hall, 1967.
 
2
Another article in this volume of particular interest to studying visual cues is by Marcoccia and Gauducheau (2007) dealing with the oral-written dimension of smileys in discussion groups and emails.
 
3
Cf: Baron, N. (2008). “Adjusting the Volume: Technology and Multitasking in Discourse Control”.
 
4
Each session consists of multiple conversations. In a typical scenario, the user had three to ten different conversations for each session and therefore multiple XML log files.
 
5
The duration was also influenced by the length of the video cassettes and the fact that the participants were in a cybercafé.
 
6
In the search for subjects, we discovered that IM is considered a very private activity, and many people were unwilling to participate. Other subjects curtailed some of their more intimate exchanges first by announcing to their conversation partners that they were in a study and being recorded and by avoiding embarrassing subjects that may have arisen.
 
7
In Japanese chat, ASCII smileys have a “frontal” point of view and are read vertically instead of horizontally.
 
8
In a recent survey of instant messaging, Yahoo! found that 66% of the 40,000 IM users surveyed have memorized at least 3 text-character shortcuts for using emoticons, while 19% have memorized 10 or more, cf. http://​blog.​messenger.​yahoo.​com/​blog/​2007/​07/​10/​emoticon-survey-results/ (accessed 28 October 2007).
 
9
We opted against using a more “morphological” approach, in which the stem symbol is the base form of a round, yellow circle because identifying prefixes, infixes or suffixes proved more problematic, in particular, for smileys that are not based on the smiley face such as the rainbow or lips.
 
10
The long breaks described by other researchers of IM did not occur in our sample study due to the fact that the participants were connecting from a cybercafé.
 
11
Cf. Bays (2001, 2003, 2005), Bays et al. (2006).
 
12
The video and screen capture data were recorded in a Parisian cybercafé (Bays et al., 2006, Avi4. 00 :23 :10).
 
13
Figures 1 and 2, above, show video stills of our subject reacting to this same exchange of animations. Likewise, she points at the screen selecting, laughs and then types her reply.
 
Literature
go back to reference Anis, J. (1988). L‘écriture, théories et descriptions. Bruxelles: De Boeck-Université. Anis, J. (1988). L‘écriture, théories et descriptions. Bruxelles: De Boeck-Université.
go back to reference Anis, J. (1998). Texte et ordinateur: l’écriture réinventée. Bruxelles: De Boeck Université. Anis, J. (1998). Texte et ordinateur: l’écriture réinventée. Bruxelles: De Boeck Université.
go back to reference Anis, J. (1999). Internet communication et langue francaise. Paris: Hermes Science Publications. Anis, J. (1999). Internet communication et langue francaise. Paris: Hermes Science Publications.
go back to reference Auer, P., Cooper-Kuhlen, E., Müller, F. (1999). Language in time, the rhythm and tempo of spoken interaction. Oxford: Oxford University Press. Auer, P., Cooper-Kuhlen, E., Müller, F. (1999). Language in time, the rhythm and tempo of spoken interaction. Oxford: Oxford University Press.
go back to reference Baron, N. (2003). Language of the internet. In A. Farghali (Ed.), The Stanford handbook for language engineers (pp. 59–127). Stanford, CA: CSLI Publications. Baron, N. (2003). Language of the internet. In A. Farghali (Ed.), The Stanford handbook for language engineers (pp. 59–127). Stanford, CA: CSLI Publications.
go back to reference Baron, N. (2005a, February 17–21). Instant messaging by American college students: A case study in computer mediated communication. American Association for the Advancement of Science annual meeting. Baron, N. (2005a, February 17–21). Instant messaging by American college students: A case study in computer mediated communication. American Association for the Advancement of Science annual meeting.
go back to reference Baron, N. (2005b). Tethered or mobile? Use of away messages in instant messaging by American college students (with Lauren Squires, Sara Tench, and Marshall Thompson). In R. Ling & P. Pederson (Eds.) Mobile communications: Re-negotiation of the social sphere (pp. 293–311). London: Springer-Verlag. Baron, N. (2005b). Tethered or mobile? Use of away messages in instant messaging by American college students (with Lauren Squires, Sara Tench, and Marshall Thompson). In R. Ling & P. Pederson (Eds.) Mobile communications: Re-negotiation of the social sphere (pp. 293–311). London: Springer-Verlag.
go back to reference Baron, N. (2005c). Instant messaging and the future of language. Communications of the ACM, 48(7), 29–31.CrossRef Baron, N. (2005c). Instant messaging and the future of language. Communications of the ACM, 48(7), 29–31.CrossRef
go back to reference Baron, N. (2007). The mechanics of text messaging and instant messaging among American college students (with Rich Ling). Journal of Language and Social Psychology, 26, 291–298.CrossRefMathSciNet Baron, N. (2007). The mechanics of text messaging and instant messaging among American college students (with Rich Ling). Journal of Language and Social Psychology, 26, 291–298.CrossRefMathSciNet
go back to reference Baron, N. (2008). Adjusting the volume: Technology and multitasking in discourse control. In J. E. Katz (Ed.), Handbook of mobile communication studies (pp. 177–193). Cambridge, MA: MIT Press. Baron, N. (2008). Adjusting the volume: Technology and multitasking in discourse control. In J. E. Katz (Ed.), Handbook of mobile communication studies (pp. 177–193). Cambridge, MA: MIT Press.
go back to reference Bays, H. (2001). Interaction conversationnelle en internet relay chat. Doctoral dissertation in Linguistics, directed by Professeur Pierre Encreve at the Ecole des Hautes Etudes en Sciences Sociales, Paris, defended 21 décembre 2001. Bays, H. (2001). Interaction conversationnelle en internet relay chat. Doctoral dissertation in Linguistics, directed by Professeur Pierre Encreve at the Ecole des Hautes Etudes en Sciences Sociales, Paris, defended 21 décembre 2001.
go back to reference Bays, H. (2003, March). Temporalité en internet relay chat: Le rythme du discours électronique. Communication électronique, conference at the Ecole des Hautes Etudes en Sciences Sociales, Paris. Bays, H. (2003, March). Temporalité en internet relay chat: Le rythme du discours électronique. Communication électronique, conference at the Ecole des Hautes Etudes en Sciences Sociales, Paris.
go back to reference Bays, H. (2005, October 6–9). Visio-verbal constructions of rhythm in IM & IRC: A cross-linguistic study. Internet research 6.0: Generations, Proceedings of the 6th Annual Conference of the Association of Internet Researchers, Chicago, IL, USA. Bays, H. (2005, October 6–9). Visio-verbal constructions of rhythm in IM & IRC: A cross-linguistic study. Internet research 6.0: Generations, Proceedings of the 6th Annual Conference of the Association of Internet Researchers, Chicago, IL, USA.
go back to reference Bays, H., de Fornel, M., & Verdier, M. (2006). Rythmes et temporalités de la conversation Electronique (RYTE). Research report for the CNRS program PI-TCAN. Bays, H., de Fornel, M., & Verdier, M. (2006). Rythmes et temporalités de la conversation Electronique (RYTE). Research report for the CNRS program PI-TCAN.
go back to reference Blum, S. (2004). Instant messaging: Functions of a new communicative tool. Anthropology 427: Doing things with words. Blum, S. (2004). Instant messaging: Functions of a new communicative tool. Anthropology 427: Doing things with words.
go back to reference Bunn, J. (2002). Wave forms: A natural syntax for rhythmic language. Palo Alto, CA: Stanford University Press. Bunn, J. (2002). Wave forms: A natural syntax for rhythmic language. Palo Alto, CA: Stanford University Press.
go back to reference Chen, L., & Gaines, B. (1998). Modeling and supporting virtual cooperative interaction through the world wide web. In F. Sudweeks, M. McLaughlin, & S. Rafaeli (Eds.), Network and netplay, virtual groups on the internet (pp. 221–242). Cambridge, MA: MIT Press. Chen, L., & Gaines, B. (1998). Modeling and supporting virtual cooperative interaction through the world wide web. In F. Sudweeks, M. McLaughlin, & S. Rafaeli (Eds.), Network and netplay, virtual groups on the internet (pp. 221–242). Cambridge, MA: MIT Press.
go back to reference Cuxac, C. (2000). La LSF, les voies de l’iconicité. Paris: Ophrys. Cuxac, C. (2000). La LSF, les voies de l’iconicité. Paris: Ophrys.
go back to reference Cuxac, C., Fusellier-Souza, I., & Sallandre, M.-A. (1999). Iconicité et catégorisations dans les langues des signes. Sémiotiques, 16, 143–166. Cuxac, C., Fusellier-Souza, I., & Sallandre, M.-A. (1999). Iconicité et catégorisations dans les langues des signes. Sémiotiques, 16, 143–166.
go back to reference Delalande, M.-A. (2007). La messagerie instantanée freine la productivité des enterprises. Le Monde Informatique, Edition du 12/10/2007. Delalande, M.-A. (2007). La messagerie instantanée freine la productivité des enterprises. Le Monde Informatique, Edition du 12/10/2007.
go back to reference Derks, D., Bos, A. E. R., & Von Grumkow, J. (2007). Emoticons and social interaction on the internet: The importance of social context. Computers in Human Behavior, 23, 842–849.CrossRef Derks, D., Bos, A. E. R., & Von Grumkow, J. (2007). Emoticons and social interaction on the internet: The importance of social context. Computers in Human Behavior, 23, 842–849.CrossRef
go back to reference Finn, A. (1999). Temporality and technology convergence. Information, Communication & Society, 2(2), 174–200.MathSciNet Finn, A. (1999). Temporality and technology convergence. Information, Communication & Society, 2(2), 174–200.MathSciNet
go back to reference Gross, E. F. (2004). Adolescent internet use: What we expect, what teens report. Applied Developmental Psychology, 25, 633–649.CrossRef Gross, E. F. (2004). Adolescent internet use: What we expect, what teens report. Applied Developmental Psychology, 25, 633–649.CrossRef
go back to reference Haiman, J. (1985). Natural syntax: Iconicity and erosion. Cambridge: Cambridge University Press. Haiman, J. (1985). Natural syntax: Iconicity and erosion. Cambridge: Cambridge University Press.
go back to reference Herring, S., (Ed.). (1996). Computer-mediated communication: Linguistic, social and cross-cultural perspectives. Pragmatics and Beyond series. Amsterdam: John Benjamins. Herring, S., (Ed.). (1996). Computer-mediated communication: Linguistic, social and cross-cultural perspectives. Pragmatics and Beyond series. Amsterdam: John Benjamins.
go back to reference Metzger, M. (2001). Discourse analysis. In C. Lucas (Ed.), The sociolinguistics of sign languages (pp. 112–144). Cambridge: Cambridge University Press. Metzger, M. (2001). Discourse analysis. In C. Lucas (Ed.), The sociolinguistics of sign languages (pp. 112–144). Cambridge: Cambridge University Press.
go back to reference Pinolosacco, G. (2007, January). La sociologie visuelle. Sociétés. Pinolosacco, G. (2007, January). La sociologie visuelle. Sociétés.
go back to reference Sacks, H., Schegloff, E. A., & Jefferson, G. (1974). A simplest systematics for the organization of turn-taking for conversation. Language, 50, 696–735.CrossRef Sacks, H., Schegloff, E. A., & Jefferson, G. (1974). A simplest systematics for the organization of turn-taking for conversation. Language, 50, 696–735.CrossRef
go back to reference Schieffelin, B., & Jones, G. (2008). Enquoting voices, accomplishing talk: Uses of be + like in instant messaging. Language & Communication, 29(1), 77–113. Schieffelin, B., & Jones, G. (2008). Enquoting voices, accomplishing talk: Uses of be + like in instant messaging. Language & Communication, 29(1), 77–113.
go back to reference Tagliamonte, S., & Denis, D. (2006, Aug 2). OMG, will txting and IM lead 2 bad grammar? Linguistics Society of Canada and the United States annual meeting. Tagliamonte, S., & Denis, D. (2006, Aug 2). OMG, will txting and IM lead 2 bad grammar? Linguistics Society of Canada and the United States annual meeting.
go back to reference Walther, J. B., & D’Addario, K. P. (2001). The impact of emoticons on message interpretation in computer-mediated communication. Social Science Computer Review, 19(3), 324–347.CrossRef Walther, J. B., & D’Addario, K. P. (2001). The impact of emoticons on message interpretation in computer-mediated communication. Social Science Computer Review, 19(3), 324–347.CrossRef
go back to reference Wellman, B. (2001). Computer networks as social networks. Science, 293, 2031–2034.CrossRef Wellman, B. (2001). Computer networks as social networks. Science, 293, 2031–2034.CrossRef
go back to reference Yates, S. J. (1996). Oral and written linguistic aspects of computer conferencing: A corpus based study. In S. C. Herring (Ed.), Computer-mediated communication. linguistic, social and cross-cultural perspectives (pp. 29–46). Amsterdam/Philadelphia: John Benjamins. Yates, S. J. (1996). Oral and written linguistic aspects of computer conferencing: A corpus based study. In S. C. Herring (Ed.), Computer-mediated communication. linguistic, social and cross-cultural perspectives (pp. 29–46). Amsterdam/Philadelphia: John Benjamins.
go back to reference Yechi, L. (1996). The geometry of visual phonology. Stanford, CA: Center for the Study of Language and Information (CSLI) Publications. Yechi, L. (1996). The geometry of visual phonology. Stanford, CA: Center for the Study of Language and Information (CSLI) Publications.
Metadata
Title
Visual Iconic Patterns of Instant Messaging: Steps Towards Understanding Visual Conversations
Author
Hillary Bays
Copyright Year
2010
Publisher
Springer Netherlands
DOI
https://doi.org/10.1007/978-1-4020-9789-8_3

Premium Partner