Skip to main content
Erschienen in: Engineering with Computers 3/2013

01.07.2013 | Original Article

A virtual reality approach for usability assessment: case study on a wheelchair-mounted robot manipulator

verfasst von: G. Di Gironimo, G. Matrone, A. Tarallo, M. Trotta, A. Lanzotti

Erschienen in: Engineering with Computers | Ausgabe 3/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The aim of the paper is to address an innovative methodology for assessing the usability of a product. This methodology is particularly suitable for designing products that provide their main functions through their control interfaces. In particular, this case study relates to the usability assessment of two control devices for a wheelchair-mounted robot manipulator to assist physically disabled people. The study focuses on defining a synthetic usability index on the basis of two currently used methods: the multi criteria decision analysis and the Saaty’s analytic hierarchy process. Several virtual reality (VR)-based experiments have been conducted, set up in accordance with a cross-array experimental plan, that adequately caters for both control and noise factors. Quantitative measures and subjective user evaluations have been collected to maximize the effectiveness, the efficiency and the satisfaction perceived by users while using the product. Compared to the literature on the subject, the proposed approach provides both more flexibility in defining quantitative indexes and more adequate results, even when involving only a small sample of users in the participatory design session. The use of VR technologies for the collection of the experimental data has been essential in terms of safety, costs and repeatability of the tests, as well as of the robustness with respect to noise factors.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
It is understood that those devices actually control the computer-generated viewpoint only, without affecting the physical position of the wheelchair in the laboratory.
 
Literatur
1.
Zurück zum Zitat Abbattista F, Degemmis M, Licchelli O, Lops P, Semeraro G, Zambetta F (2002) Improving the usability of an e-commerce web site through personalization. In: Ricci F, Smith B (eds) Recommendation and personalization in Ecommerce, 2nd International conference on adaptive hypermedia and adaptive web based systems, pp 20–29 Abbattista F, Degemmis M, Licchelli O, Lops P, Semeraro G, Zambetta F (2002) Improving the usability of an e-commerce web site through personalization. In: Ricci F, Smith B (eds) Recommendation and personalization in Ecommerce, 2nd International conference on adaptive hypermedia and adaptive web based systems, pp 20–29
2.
Zurück zum Zitat Bevan N (2009) Extending quality in use to provide a framework for usability measurement. In: HCD 09: proceedings of the 1st international conference on human centered design. Springer, Berlin, pp 13–22 Bevan N (2009) Extending quality in use to provide a framework for usability measurement. In: HCD 09: proceedings of the 1st international conference on human centered design. Springer, Berlin, pp 13–22
3.
Zurück zum Zitat Caputo F, Di Gironimo G (2007) Vrtest: a virtual reality sysTEm for tranSporTation design. Centre of Competence for Transport Systems of the Campania Region, An experience of innovation and training Caputo F, Di Gironimo G (2007) Vrtest: a virtual reality sysTEm for tranSporTation design. Centre of Competence for Transport Systems of the Campania Region, An experience of innovation and training
4.
Zurück zum Zitat Caputo F, Di Gironimo G, Papa S (2006) A virtual reality system for ergonomics and usability validation of equipment controls. Anales de Ingenierìa Gràfica 18:47–64 Caputo F, Di Gironimo G, Papa S (2006) A virtual reality system for ergonomics and usability validation of equipment controls. Anales de Ingenierìa Gràfica 18:47–64
5.
Zurück zum Zitat Das H, Zak H, Johnson J, Crouch J, Frambach D (1999) Evaluation of a telerobotic system to assist surgeons in microsurgery. Comput Aided Surg 15–25 Das H, Zak H, Johnson J, Crouch J, Frambach D (1999) Evaluation of a telerobotic system to assist surgeons in microsurgery. Comput Aided Surg 15–25
7.
Zurück zum Zitat De Santis A, Di Gironimo G, Marzano A, Siciliano B, Tarallo A (2008) A virtual-reality-based evaluation environment for wheelchair-mounted manipulators. In: Proceedings of the 6th EUROGRAPHICS Italian Chapter 2008 conference. Salerno, Italy, pp 1–8 De Santis A, Di Gironimo G, Marzano A, Siciliano B, Tarallo A (2008) A virtual-reality-based evaluation environment for wheelchair-mounted manipulators. In: Proceedings of the 6th EUROGRAPHICS Italian Chapter 2008 conference. Salerno, Italy, pp 1–8
8.
Zurück zum Zitat Di Gironimo G, Lanzotti A (2009) Designing in VR. Int J Interact Design Manuf (IJIDeM) 3(2):51–53CrossRef Di Gironimo G, Lanzotti A (2009) Designing in VR. Int J Interact Design Manuf (IJIDeM) 3(2):51–53CrossRef
9.
Zurück zum Zitat Di Gironimo G, Marzano A, Tarallo A (2007) Human robot interaction in virtual reality. In: 5th EUROGRAPHICS Italian chapter conference. Trento, Italy, pp 1–8 Di Gironimo G, Marzano A, Tarallo A (2007) Human robot interaction in virtual reality. In: 5th EUROGRAPHICS Italian chapter conference. Trento, Italy, pp 1–8
10.
Zurück zum Zitat Di Gironimo G, Patalano S, Tarallo A (2009) Innovative assembly process for modular train and feasibility analysis in virtual environment. Int J Interact Design Manuf (IJIDeM) 3(2):93–101CrossRef Di Gironimo G, Patalano S, Tarallo A (2009) Innovative assembly process for modular train and feasibility analysis in virtual environment. Int J Interact Design Manuf (IJIDeM) 3(2):93–101CrossRef
11.
Zurück zum Zitat Dinh HQ, Walker N, Song C, Kobayashi A, Hodges LF (1999) Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments. Virtual Reality Conference, IEEE 0, 222. doi:10.1109/VR.1999.756955 Dinh HQ, Walker N, Song C, Kobayashi A, Hodges LF (1999) Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments. Virtual Reality Conference, IEEE 0, 222. doi:10.​1109/​VR.​1999.​756955
12.
Zurück zum Zitat Eftring H, Boschian K (1999) Technical results from manus user trials. In: Proceedings of the international conference on rehabilitation robotics (ICORR). Stanford, CA, pp 136–141 Eftring H, Boschian K (1999) Technical results from manus user trials. In: Proceedings of the international conference on rehabilitation robotics (ICORR). Stanford, CA, pp 136–141
13.
Zurück zum Zitat Eraslan E, Akay D, Kurt M (2006) Usability ranking of intercity bus passenger seats using fuzzy axiomatic design theory. In: CDVE, pp 141–148 Eraslan E, Akay D, Kurt M (2006) Usability ranking of intercity bus passenger seats using fuzzy axiomatic design theory. In: CDVE, pp 141–148
15.
Zurück zum Zitat Figueira J, Greco S, Ehrgott M (2005) Multiple criteria decision analysis: state of the art surveys. Springer, Berlin Figueira J, Greco S, Ehrgott M (2005) Multiple criteria decision analysis: state of the art surveys. Springer, Berlin
16.
Zurück zum Zitat Frøkjær E, Hertzum M, Hornbæk K (2000) Measuring usability: are effectiveness, efficiency, and satisfaction really correlated? In: CHI’00: proceedings of the SIGCHI conference on Human factors in computing systems. ACM, New York, pp 345–352. doi:10.1145/332040.332455 Frøkjær E, Hertzum M, Hornbæk K (2000) Measuring usability: are effectiveness, efficiency, and satisfaction really correlated? In: CHI’00: proceedings of the SIGCHI conference on Human factors in computing systems. ACM, New York, pp 345–352. doi:10.​1145/​332040.​332455
17.
Zurück zum Zitat Ghosh R, Dekhil M (2009) Discovering user profiles. In: Proceedings of the 18th international conference on World wide web, WWW’09. ACM, New York, pp 1233–1234. doi:10.1145/1526709.1526944 Ghosh R, Dekhil M (2009) Discovering user profiles. In: Proceedings of the 18th international conference on World wide web, WWW’09. ACM, New York, pp 1233–1234. doi:10.​1145/​1526709.​1526944
18.
Zurück zum Zitat Hassenzahl M (2003) The thing and i: understanding the relationship between user and product. In: Blythe MA, Overbeeke K, Monk AF (eds) Funology: from usability to enjoyment (human–computer interaction series). Kluwer Academic Publishers, Norwell, pp 31–42 Hassenzahl M (2003) The thing and i: understanding the relationship between user and product. In: Blythe MA, Overbeeke K, Monk AF (eds) Funology: from usability to enjoyment (human–computer interaction series). Kluwer Academic Publishers, Norwell, pp 31–42
19.
Zurück zum Zitat Hillman M, Gammie A (1994) The bath institute of medical engineering assistive robot. In: Proceedings of ICORR 94. Wilmington, pp 211–212 Hillman M, Gammie A (1994) The bath institute of medical engineering assistive robot. In: Proceedings of ICORR 94. Wilmington, pp 211–212
21.
Zurück zum Zitat ISO/IEC standard (1998) Ergonomic requirements for office work with visual display terminals—guidance on usability. ISO 9241-11:1998 ISO/IEC standard (1998) Ergonomic requirements for office work with visual display terminals—guidance on usability. ISO 9241-11:1998
22.
Zurück zum Zitat Jaspers M (2009) A comparison of usability methods for testing interactive health technologies: Methodological aspects and empirical evidence. I. J Med Inf 78(5):340–353CrossRef Jaspers M (2009) A comparison of usability methods for testing interactive health technologies: Methodological aspects and empirical evidence. I. J Med Inf 78(5):340–353CrossRef
23.
Zurück zum Zitat Jolliffe I (2002) Principal component analysis. Springer Verlag, SecaucusMATH Jolliffe I (2002) Principal component analysis. Springer Verlag, SecaucusMATH
24.
Zurück zum Zitat Kalawsky R (1998) New methodologies and techniques for evaluating user performance in advanced 3d virtual interfaces. IEE Digest. 1998(437), 5/1–5/8. doi:10.1049/ic:19980654 Kalawsky R (1998) New methodologies and techniques for evaluating user performance in advanced 3d virtual interfaces. IEE Digest. 1998(437), 5/1–5/8. doi:10.​1049/​ic:​19980654
25.
Zurück zum Zitat Kanai S, Horiuchi S, Kikuta Y, Yokoyama A, Shiroma Y (2007) An integrated environment for testing and assessing the usability of information appliances using digital and physical mock-ups. Springer, Berlin. doi:10.1007/978-3-540-73335-5 Kanai S, Horiuchi S, Kikuta Y, Yokoyama A, Shiroma Y (2007) An integrated environment for testing and assessing the usability of information appliances using digital and physical mock-ups. Springer, Berlin. doi:10.​1007/​978-3-540-73335-5
28.
Zurück zum Zitat Kuutti K, Battarbee K, Säde S, Mattelmäki T, Keinonen T, Teirikko T, Tornberg A (2001) Virtual prototypes in usability testing. In: HICSS’01: proceedings of the 34th annual Hawaii international conference on system sciences (HICSS-34), vol 5, p 5029. IEEE Computer Society, Washington Kuutti K, Battarbee K, Säde S, Mattelmäki T, Keinonen T, Teirikko T, Tornberg A (2001) Virtual prototypes in usability testing. In: HICSS’01: proceedings of the 34th annual Hawaii international conference on system sciences (HICSS-34), vol 5, p 5029. IEEE Computer Society, Washington
29.
Zurück zum Zitat Lanzotti A, Matrone G, Tarantino P, Vanacore A (2008) Statistical design for innovation in VR. In: Erto P (eds) Statistics for innovation. Springer, Milan, pp 27–41 Lanzotti A, Matrone G, Tarantino P, Vanacore A (2008) Statistical design for innovation in VR. In: Erto P (eds) Statistics for innovation. Springer, Milan, pp 27–41
32.
Zurück zum Zitat Mahdjoub M, Monticolo D, Gomes S, Sagot J (2009) A collaborative design for usability approach supported by virtual reality a multi-agent system embedded in a plm environment. Computer-Aided Design. doi:10.1016/j.cad.2009.02.009 Mahdjoub M, Monticolo D, Gomes S, Sagot J (2009) A collaborative design for usability approach supported by virtual reality a multi-agent system embedded in a plm environment. Computer-Aided Design. doi:10.​1016/​j.​cad.​2009.​02.​009
33.
Zurück zum Zitat Montero F, Lozano M, Gonzalez P (2008) Usability-oriented quality model based on ergonomic criteria. Handbook of research on web information systems quality Montero F, Lozano M, Gonzalez P (2008) Usability-oriented quality model based on ergonomic criteria. Handbook of research on web information systems quality
34.
Zurück zum Zitat Muzzupappa M, Bruno F, Mattanò RM, Pina M (2006) A new approach to participatory design: usability tests in virtual environment. In: Research in interactive design, vol 1, Cap. X. SpringerVerlag., New York, pp 80–90 Muzzupappa M, Bruno F, Mattanò RM, Pina M (2006) A new approach to participatory design: usability tests in virtual environment. In: Research in interactive design, vol 1, Cap. X. SpringerVerlag., New York, pp 80–90
35.
Zurück zum Zitat Nagarajan U, Kantor G, Hollis RL (2009) Human–robot physical interaction with dynamically stable mobile robots. In: Proceedings of the 4th ACM/IEEE international conference on human robot interaction, HRI’09. ACM, New York, pp 281–282. doi:10.1145/1514095.1514176 Nagarajan U, Kantor G, Hollis RL (2009) Human–robot physical interaction with dynamically stable mobile robots. In: Proceedings of the 4th ACM/IEEE international conference on human robot interaction, HRI’09. ACM, New York, pp 281–282. doi:10.​1145/​1514095.​1514176
36.
Zurück zum Zitat Nielsen J (1993) Usability engineering. Morgan Kaufmann Publishers Inc., San FranciscoMATH Nielsen J (1993) Usability engineering. Morgan Kaufmann Publishers Inc., San FranciscoMATH
37.
Zurück zum Zitat Norman D (2004) Emotional design. Perseus Publishing, New York Norman D (2004) Emotional design. Perseus Publishing, New York
38.
Zurück zum Zitat Park S (1996) Robust design and analysis for quality engineering. Kluwer Academic Publishers, London Park S (1996) Robust design and analysis for quality engineering. Kluwer Academic Publishers, London
39.
Zurück zum Zitat Petrie H, Hamilton F, King N, Pavan P (2006) Remote usability evaluations with disabled people. In: CHI’06: proceedings of the SIGCHI conference on human factors in computing systems, pp 1133–1141. ACM, New York. doi:10.1145/1124772.1124942 Petrie H, Hamilton F, King N, Pavan P (2006) Remote usability evaluations with disabled people. In: CHI’06: proceedings of the SIGCHI conference on human factors in computing systems, pp 1133–1141. ACM, New York. doi:10.​1145/​1124772.​1124942
40.
Zurück zum Zitat Pithon T, Weiss T, Richir S, Klinger E (2009) Wheelchair simulators: a review. Technol Disabil 21(1):1–s10 Pithon T, Weiss T, Richir S, Klinger E (2009) Wheelchair simulators: a review. Technol Disabil 21(1):1–s10
43.
Zurück zum Zitat Sauro J, Kindlund E (2005) A method to standardize usability metrics into a single score. In: CHI’05: proceedings of the SIGCHI conference on human factors in computing systems. ACM, New York, pp 401–409. doi:10.1145/1054972.1055028 Sauro J, Kindlund E (2005) A method to standardize usability metrics into a single score. In: CHI’05: proceedings of the SIGCHI conference on human factors in computing systems. ACM, New York, pp 401–409. doi:10.​1145/​1054972.​1055028
44.
Zurück zum Zitat Shackel B, Richardson S (2008) Human factors for informatics usability. Cambridge University Press, New York Shackel B, Richardson S (2008) Human factors for informatics usability. Cambridge University Press, New York
46.
Zurück zum Zitat Tullis T, Albert B (2008) Measuring the user experience. Morgan Kauffmann Publishers, San Francisco Tullis T, Albert B (2008) Measuring the user experience. Morgan Kauffmann Publishers, San Francisco
47.
Zurück zum Zitat Wallergard M, Eriksson J, Johansson G (2008) A suggested virtual reality methodology allowing people with cognitive disabilities to communicate their knowledge and experiences of public transport systems. Technol Disabil 20(1):9–24 Wallergard M, Eriksson J, Johansson G (2008) A suggested virtual reality methodology allowing people with cognitive disabilities to communicate their knowledge and experiences of public transport systems. Technol Disabil 20(1):9–24
Metadaten
Titel
A virtual reality approach for usability assessment: case study on a wheelchair-mounted robot manipulator
verfasst von
G. Di Gironimo
G. Matrone
A. Tarallo
M. Trotta
A. Lanzotti
Publikationsdatum
01.07.2013
Verlag
Springer-Verlag
Erschienen in
Engineering with Computers / Ausgabe 3/2013
Print ISSN: 0177-0667
Elektronische ISSN: 1435-5663
DOI
https://doi.org/10.1007/s00366-012-0274-x

Weitere Artikel der Ausgabe 3/2013

Engineering with Computers 3/2013 Zur Ausgabe

Neuer Inhalt