Skip to main content
Top
Published in: Universal Access in the Information Society 3/2014

01-08-2014 | Long paper

Mobile text-entry and visual demands: reusing and optimizing current solutions

Authors: Hugo Nicolau, Tiago Guerreiro, David Lucas, Joaquim Jorge

Published in: Universal Access in the Information Society | Issue 3/2014

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Mobile devices are increasingly used for text-entry in contexts where visual attention is fragmented and graphical information is inadequate, yet the current solutions to typing on virtual keyboards make it a visually demanding task. This work looks at assistive technologies and interface attributes as tools to ease the task. Two within-subject experiments were performed with 23 and 17 participants, respectively. The first experiment aimed to understand how walking affected text-entry performance and additionally to assess how effective assistive technologies can be in mobile contexts. In the second experiment, adaptive keyboards featuring character prediction and pre-attentive attributes to ease visual demands of text-entry interfaces were developed and evaluated. It has been found that both text-input speed and overall quality are affected in mobile situations. Contrary to the expectations, assistive technologies proved ineffective with visual feedback. The second experiment showed that pre-attentive attributes do not affect users’ performance in task-entry tasks, even though a 3.3–4.3 % decrease in error rates was measured. It was found that users reduce walking speed to compensate for challenges placed by mobile text-entry. Caution should be exercised when transferring assistive technologies to mobile contexts, since they need adaptations to address mobile users’ needs. Also, while pre-attentive attributes seemingly have no effect on experienced QWERTY typists’ performance, they showed promise for both novice users and typists in attention-demanding contexts.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Faraj, A.L., Mojahid M., Vigouroux N.: Bigkey: a virtual keyboard for mobile devices. In: Human-computer interaction. Ambient, ubiquitous and intelligent interaction, pp. 3–10 (2009) Faraj, A.L., Mojahid M., Vigouroux N.: Bigkey: a virtual keyboard for mobile devices. In: Human-computer interaction. Ambient, ubiquitous and intelligent interaction, pp. 3–10 (2009)
2.
go back to reference Barnard, L., Yi, J., Jacko, J., Sears, A.: Capturing the effects of context on human performance in mobile computing systems. Pers. Ubiquit. Comput. 11(2), 81–96 (2007)CrossRef Barnard, L., Yi, J., Jacko, J., Sears, A.: Capturing the effects of context on human performance in mobile computing systems. Pers. Ubiquit. Comput. 11(2), 81–96 (2007)CrossRef
3.
go back to reference Bergstrom-Lehtovirta, J., Oulasvirta, A., Brewster, S.: The effects of walking speed on target acquisition on a touch screen interface. In: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services, pp. 143–146, ACM (2011) Bergstrom-Lehtovirta, J., Oulasvirta, A., Brewster, S.: The effects of walking speed on target acquisition on a touch screen interface. In: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services, pp. 143–146, ACM (2011)
4.
go back to reference Bonner, M., Brudvik, J., Abowd, G., Edwards, W.: No-look notes: Accessible eyes-free multi-touch text entry. In: Pervasive Computing, pp. 409–426 (2010) Bonner, M., Brudvik, J., Abowd, G., Edwards, W.: No-look notes: Accessible eyes-free multi-touch text entry. In: Pervasive Computing, pp. 409–426 (2010)
5.
go back to reference Brewster, S., Lumsden, J., Bell, M., Hall, M., Tasker, S.: Multimodal ‘eyes-free’ interaction techniques for wearable devices. In: CHI’03: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 473–480. ACM, New York, NY, USA (2003) Brewster, S., Lumsden, J., Bell, M., Hall, M., Tasker, S.: Multimodal ‘eyes-free’ interaction techniques for wearable devices. In: CHI’03: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 473–480. ACM, New York, NY, USA (2003)
6.
go back to reference Guerreiro, T., Lagoá, P., Nicolau, H., Gonçalves, D., Jorge, J.: From tapping to touching: making touch screens accessible to blind users. IEEE Multimedia 15(4), 48–50 (2008)CrossRef Guerreiro, T., Lagoá, P., Nicolau, H., Gonçalves, D., Jorge, J.: From tapping to touching: making touch screens accessible to blind users. IEEE Multimedia 15(4), 48–50 (2008)CrossRef
7.
go back to reference Hudson, S., Harrison, C., Harrison, B., LaMarca, A.: Whack gestures: inexact and inattentive interaction with mobile devices. In: Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction, pp. 109–112, ACM (2010) Hudson, S., Harrison, C., Harrison, B., LaMarca, A.: Whack gestures: inexact and inattentive interaction with mobile devices. In: Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction, pp. 109–112, ACM (2010)
8.
go back to reference Kane, S., Bigham, J., Wobbrock, J.: Slide rule: making mobile touch screens accessible to blind people using multi-touch interaction techniques. In: Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility, pp. 73–80, ACM (2008) Kane, S., Bigham, J., Wobbrock, J.: Slide rule: making mobile touch screens accessible to blind people using multi-touch interaction techniques. In: Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility, pp. 73–80, ACM (2008)
9.
go back to reference Kristoffersen, S., Ljungberg, F.: Making place to make IT work: empirical explorations of HCI for mobile CSCW. In: Proceedings of the international ACM SIGGROUP conference on Supporting group work, pp. 276–285. ACM, New York, NY, USA (1999) Kristoffersen, S., Ljungberg, F.: Making place to make IT work: empirical explorations of HCI for mobile CSCW. In: Proceedings of the international ACM SIGGROUP conference on Supporting group work, pp. 276–285. ACM, New York, NY, USA (1999)
10.
go back to reference Li, K. A., Baudisch, P., Hinckley, K.: Blindsight: eyes-free access to mobile phones. In: CHI’08: Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, pp. 1389–1398. ACM, New York, NY, USA (2008) Li, K. A., Baudisch, P., Hinckley, K.: Blindsight: eyes-free access to mobile phones. In: CHI’08: Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, pp. 1389–1398. ACM, New York, NY, USA (2008)
11.
go back to reference Lin, M., Goldman, R., Price, K., Sears, A., Jacko, J.: How do people tap when walking? An empirical investigation of nomadic data entry. Int. J. Hum. Comput. Stud. 65(9), 759–769 (2007)CrossRef Lin, M., Goldman, R., Price, K., Sears, A., Jacko, J.: How do people tap when walking? An empirical investigation of nomadic data entry. Int. J. Hum. Comput. Stud. 65(9), 759–769 (2007)CrossRef
12.
go back to reference Liu, X., Crump, M., Logan, G.: Do you know where your fingers have been? explicit knowledge of the spatial layout of the keyboard in skilled typists. Mem. Cognit. 38(4), 474–484 (2010)CrossRef Liu, X., Crump, M., Logan, G.: Do you know where your fingers have been? explicit knowledge of the spatial layout of the keyboard in skilled typists. Mem. Cognit. 38(4), 474–484 (2010)CrossRef
13.
go back to reference Lumsden, J., Brewster, S.: A paradigm shift: alternative interaction techniques for use with mobile & wearable devices. In: Proceedings of the 2003 conference of the Centre for Advanced Studies on Collaborative research, p. 210, IBM Press (2003) Lumsden, J., Brewster, S.: A paradigm shift: alternative interaction techniques for use with mobile & wearable devices. In: Proceedings of the 2003 conference of the Centre for Advanced Studies on Collaborative research, p. 210, IBM Press (2003)
14.
go back to reference MacKenzie, I., Soukoreff, R.: Text entry for mobile computing: models and methods, theory and practice. Hum. Comput. Interact. 17(2), 147–198 (2002)CrossRef MacKenzie, I., Soukoreff, R.: Text entry for mobile computing: models and methods, theory and practice. Hum. Comput. Interact. 17(2), 147–198 (2002)CrossRef
15.
go back to reference MacKenzie, I., Soukoreff, R.: Phrase sets for evaluating text entry techniques. In: CHI’03 extended abstracts on Human factors in computing systems, pp. 754–755, ACM (2003) MacKenzie, I., Soukoreff, R.: Phrase sets for evaluating text entry techniques. In: CHI’03 extended abstracts on Human factors in computing systems, pp. 754–755, ACM (2003)
16.
go back to reference Mizobuchi, S., Chignell, M., Newton, D.: Mobile text entry: relationship between walking speed and text input task difficulty. In: Proceedings of the 7th international conference on Human computer interaction with mobile devices & services, ACM, p. 128 (2005) Mizobuchi, S., Chignell, M., Newton, D.: Mobile text entry: relationship between walking speed and text input task difficulty. In: Proceedings of the 7th international conference on Human computer interaction with mobile devices & services, ACM, p. 128 (2005)
17.
go back to reference Mustonen, T., Olkkonen, M., Hakkinen, J.: Examining mobile phone text legibility while walking. In: Conference on Human Factors in Computing Systems, pp. 1243–1246. ACM, New York, NY, USA (2004) Mustonen, T., Olkkonen, M., Hakkinen, J.: Examining mobile phone text legibility while walking. In: Conference on Human Factors in Computing Systems, pp. 1243–1246. ACM, New York, NY, USA (2004)
18.
go back to reference Nicolau, H., Jorge, J.: Touch typing using thumbs: understanding the effect of mobility and hand posture. In: Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems (CHI’12), pp. 2683–2686. ACM, New York, NY, USA (2012) Nicolau, H., Jorge, J.: Touch typing using thumbs: understanding the effect of mobility and hand posture. In: Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems (CHI’12), pp. 2683–2686. ACM, New York, NY, USA (2012)
19.
go back to reference Oulasvirta, A., Tamminen, S., Roto, V., Kuorelahti, J.: Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI. In: CHI’05: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 919–928. ACM, New York, NY, USA (2005) Oulasvirta, A., Tamminen, S., Roto, V., Kuorelahti, J.: Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI. In: CHI’05: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 919–928. ACM, New York, NY, USA (2005)
20.
go back to reference Pallant, J.: SPSS survival manual. McGraw-Hill, New York (2007) Pallant, J.: SPSS survival manual. McGraw-Hill, New York (2007)
21.
go back to reference Pascoe, J., Ryan, N., Morse, D.: Using while moving: HCI issues in fieldwork environments. ACM Trans. Comput. Hum. Interact. 7(3), 417–437 (2000)CrossRef Pascoe, J., Ryan, N., Morse, D.: Using while moving: HCI issues in fieldwork environments. ACM Trans. Comput. Hum. Interact. 7(3), 417–437 (2000)CrossRef
22.
go back to reference Sawhney, N., Schmandt, C.: Nomadic radio: speech and audio interaction for contextual messaging in nomadic environments. ACM Trans. Comput. Hum. Interact. 7(3), 383 (2000)CrossRef Sawhney, N., Schmandt, C.: Nomadic radio: speech and audio interaction for contextual messaging in nomadic environments. ACM Trans. Comput. Hum. Interact. 7(3), 383 (2000)CrossRef
23.
go back to reference Schildbach, B., Rukzio, E.: Investigating selection and reading performance on a mobile phone while walking. In: Proceedings of the 12th international conference on Human computer interaction with mobile devices and services, MobileHCI’10, pp. 93–102. ACM, New York, NY, USA (2010) Schildbach, B., Rukzio, E.: Investigating selection and reading performance on a mobile phone while walking. In: Proceedings of the 12th international conference on Human computer interaction with mobile devices and services, MobileHCI’10, pp. 93–102. ACM, New York, NY, USA (2010)
24.
go back to reference Sears, A., Lin, M., Jacko, J., Xiao, Y.: When computers fade: pervasive computing and situationally induced impairments and disabilities. Proc. HCI Int. 2, 1298–1302 (2003) Sears, A., Lin, M., Jacko, J., Xiao, Y.: When computers fade: pervasive computing and situationally induced impairments and disabilities. Proc. HCI Int. 2, 1298–1302 (2003)
25.
go back to reference Stevens, A., Bygrave, S., Brook-Carter, N., Luke, T.: Occlusion as a technique for measuring in-vehicle information system (ivis) visual distraction: a research literature review. Tech. rep. (2004) Stevens, A., Bygrave, S., Brook-Carter, N., Luke, T.: Occlusion as a technique for measuring in-vehicle information system (ivis) visual distraction: a research literature review. Tech. rep. (2004)
26.
go back to reference Treisman, A., Gormican, S.: Feature analysis in early vision: evidence from search asymmetries. Psychol. Rev. 95(1), 15 (1988)CrossRef Treisman, A., Gormican, S.: Feature analysis in early vision: evidence from search asymmetries. Psychol. Rev. 95(1), 15 (1988)CrossRef
27.
go back to reference Wickens, C.: Multiple resources and performance prediction. Ergonomics Psychol. Mech. Model Ergonomics 3, 83 (2005) Wickens, C.: Multiple resources and performance prediction. Ergonomics Psychol. Mech. Model Ergonomics 3, 83 (2005)
28.
go back to reference Wobbrock, J.: The future of mobile device research in HCI. In: CHI 2006 workshop proceedings: what is the next generation of human-computer interaction, pp. 131–134, Citeseer (2006) Wobbrock, J.: The future of mobile device research in HCI. In: CHI 2006 workshop proceedings: what is the next generation of human-computer interaction, pp. 131–134, Citeseer (2006)
29.
go back to reference Yesilada, Y., Chen, T., Harper, S.: A simple solution: solution migration from disabled to small device context. In: Proceedings of the 2010 international cross disciplinary conference on web accessibility (W4A) (W4A’10), pp. 27:1–27:2. ACM, New York, NY, USA (2010) Yesilada, Y., Chen, T., Harper, S.: A simple solution: solution migration from disabled to small device context. In: Proceedings of the 2010 international cross disciplinary conference on web accessibility (W4A) (W4A’10), pp. 27:1–27:2. ACM, New York, NY, USA (2010)
30.
go back to reference Yfantidis, G., Evreinov, G.: Adaptive blind interaction technique for touch screens. Univ. Access Inf. Soc. 4(4), 328–337 (2006)CrossRef Yfantidis, G., Evreinov, G.: Adaptive blind interaction technique for touch screens. Univ. Access Inf. Soc. 4(4), 328–337 (2006)CrossRef
31.
go back to reference Zhao, S., Dragicevic, P., Chignell, M., Balakrishnan, R., Baudisch, P: Earpod: eyes-free menu selection using touch input and reactive audio feedback. In: CHI’07: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 1395–1404. ACM, New York, NY, USA (2007) Zhao, S., Dragicevic, P., Chignell, M., Balakrishnan, R., Baudisch, P: Earpod: eyes-free menu selection using touch input and reactive audio feedback. In: CHI’07: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 1395–1404. ACM, New York, NY, USA (2007)
Metadata
Title
Mobile text-entry and visual demands: reusing and optimizing current solutions
Authors
Hugo Nicolau
Tiago Guerreiro
David Lucas
Joaquim Jorge
Publication date
01-08-2014
Publisher
Springer Berlin Heidelberg
Published in
Universal Access in the Information Society / Issue 3/2014
Print ISSN: 1615-5289
Electronic ISSN: 1615-5297
DOI
https://doi.org/10.1007/s10209-013-0319-y

Other articles of this Issue 3/2014

Universal Access in the Information Society 3/2014 Go to the issue

Premium Partner