Skip to main content
Top
Published in: Engineering with Computers 3/2013

01-07-2013 | Original Article

Reliable behaviour simulation of product interface in mixed reality

Authors: Fabio Bruno, Agostino Angilica, Francesco Cosco, Maurizio Muzzupappa

Published in: Engineering with Computers | Issue 3/2013

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The validation of a product interface is often a critical issue in the design process. Virtual reality and mixed reality (MR) are able to enhance the interactive simulation of the product human–machine interface (HMI), as these technologies allow engineers to directly involve end users in the usability assessment. This paper describes a MR environment specifically addressed to the usability evaluation of a product interface, which allows the simulation of the HMI behaviour using the same models and the same software employed by engineers during the design phase. Our approach is based on the run-time connection between the visualisation software and the simulators used for product design and analysis. In particular, we use Matlab/Simulink to model and simulate the product behaviour, and Virtools to create the interactive MR environment in which the end user can test the product. Thanks to this architecture, any modification done on the behaviour models is immediately testable in MR.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Jimeno A, Puerta A (2007) State of the art of the virtual reality applied to design and manufacturing processes. Int J Adv Manuf Tech 33–9(10):866–874CrossRef Jimeno A, Puerta A (2007) State of the art of the virtual reality applied to design and manufacturing processes. Int J Adv Manuf Tech 33–9(10):866–874CrossRef
2.
go back to reference Bruno F, Muzzupappa M (2010) Product interface design: a participatory approach based on virtual reality. Int J Hum Comput Stud 68–5:254–269CrossRef Bruno F, Muzzupappa M (2010) Product interface design: a participatory approach based on virtual reality. Int J Hum Comput Stud 68–5:254–269CrossRef
3.
go back to reference Barbieri L, Bruno F, Caruso F, Muzzupappa M (2008) Innovative integration techniques between Virtual Reality systems and CAx tools. Int J Adv Manuf Tech 38–11(12):1085–1097CrossRef Barbieri L, Bruno F, Caruso F, Muzzupappa M (2008) Innovative integration techniques between Virtual Reality systems and CAx tools. Int J Adv Manuf Tech 38–11(12):1085–1097CrossRef
4.
go back to reference Aoyama H, Kimishima Y (2009) Mixed reality system for evaluating designability and operability of information appliances. Int J Interact Des Manuf 3–3:157–164CrossRef Aoyama H, Kimishima Y (2009) Mixed reality system for evaluating designability and operability of information appliances. Int J Interact Des Manuf 3–3:157–164CrossRef
5.
go back to reference Bordegoni M, Cugini U, Caruso G, Polistena S (2009) Mixed prototyping for product assessment: a reference framework. Int J Interact Des Manuf 3–3:177–187CrossRef Bordegoni M, Cugini U, Caruso G, Polistena S (2009) Mixed prototyping for product assessment: a reference framework. Int J Interact Des Manuf 3–3:177–187CrossRef
6.
go back to reference Park H, Son JS, Lee KH (2008) Design evaluation of digital consumer products using virtual reality-based functional behaviour simulation. J Eng Des 19–4:359–375CrossRef Park H, Son JS, Lee KH (2008) Design evaluation of digital consumer products using virtual reality-based functional behaviour simulation. J Eng Des 19–4:359–375CrossRef
7.
go back to reference Park H, Moon HC, Lee JY (2009) Tangible augmented prototyping of digital handheld products. Comput Ind 60–2:114–125CrossRef Park H, Moon HC, Lee JY (2009) Tangible augmented prototyping of digital handheld products. Comput Ind 60–2:114–125CrossRef
8.
go back to reference Bruno F, Caruso F, Muzzupappa M, Stork A (2007) An experimental environment for the runtime communication among different solvers and visualisation modules. Proceedings of 19th European Modeling and Simulation Symposium, Genova, Italy Bruno F, Caruso F, Muzzupappa M, Stork A (2007) An experimental environment for the runtime communication among different solvers and visualisation modules. Proceedings of 19th European Modeling and Simulation Symposium, Genova, Italy
9.
go back to reference Bruno F, Caruso F, Li K, Milite A, Muzzupappa M (2009) Dynamic simulation of virtual prototypes in immersive environment. Int J Adv Manuf Tech 43–5(6):620–630CrossRef Bruno F, Caruso F, Li K, Milite A, Muzzupappa M (2009) Dynamic simulation of virtual prototypes in immersive environment. Int J Adv Manuf Tech 43–5(6):620–630CrossRef
10.
go back to reference Fiorentino M, de Amicis R, Monno G, Stork A (2002) Spacedesign: A mixed reality workspace for aesthetic industrial design. Proceedings of the International Symposium on Mixed and Augmented Reality (ISMAR02), Darmstadt, Germany Fiorentino M, de Amicis R, Monno G, Stork A (2002) Spacedesign: A mixed reality workspace for aesthetic industrial design. Proceedings of the International Symposium on Mixed and Augmented Reality (ISMAR02), Darmstadt, Germany
11.
go back to reference Verlinden J, Horvath I (2006) Framework for testing and validating interactive augmented prototyping as a design means in industrial practice. Proceedings of Virtual Concept, Playa Del Carmen, Mexico Verlinden J, Horvath I (2006) Framework for testing and validating interactive augmented prototyping as a design means in industrial practice. Proceedings of Virtual Concept, Playa Del Carmen, Mexico
12.
go back to reference Verlinden J, Horvath I (2007) A critical systems position on augmented prototyping systems for industrial design. Proceedings of the ASME-CIE 2007, DETC2007-35642, International Design Engineering Technical Conferences, Las Vegas, USA Verlinden J, Horvath I (2007) A critical systems position on augmented prototyping systems for industrial design. Proceedings of the ASME-CIE 2007, DETC2007-35642, International Design Engineering Technical Conferences, Las Vegas, USA
13.
go back to reference Verlinden J, Horvath I (2009) Analyzing opportunities for using interactive augmented prototyping in design practice. Artif Intell Eng Des Anal Manuf 23:289–303CrossRef Verlinden J, Horvath I (2009) Analyzing opportunities for using interactive augmented prototyping in design practice. Artif Intell Eng Des Anal Manuf 23:289–303CrossRef
14.
go back to reference Kanai S, Higuchi T (2008) Applying user interface-operable 3D digital prototypes to human-centered design of information appliances. Proceedings of the ASME 2008 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference IDETC/CIE 2008, New York, USA Kanai S, Higuchi T (2008) Applying user interface-operable 3D digital prototypes to human-centered design of information appliances. Proceedings of the ASME 2008 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference IDETC/CIE 2008, New York, USA
16.
go back to reference Kanai S, Higuchi T, Kikuta Y (2009) 3D digital prototyping and usability enhancement of information appliances based on UsiXML. Int J Interact Des Manuf 3–3:201–222CrossRef Kanai S, Higuchi T, Kikuta Y (2009) 3D digital prototyping and usability enhancement of information appliances based on UsiXML. Int J Interact Des Manuf 3–3:201–222CrossRef
17.
go back to reference Bruno F, Angilica A, Cosco F, Muzzupappa M (2010) Functional behaviour simulation of industrial products in virtual reality. Proceedings of the 8th International Symposium on Tools and Methods of Competitive Engineering, TMCE 2010, 2, pp 763–774 Bruno F, Angilica A, Cosco F, Muzzupappa M (2010) Functional behaviour simulation of industrial products in virtual reality. Proceedings of the 8th International Symposium on Tools and Methods of Competitive Engineering, TMCE 2010, 2, pp 763–774
18.
go back to reference Bruno F, Angilica A, Cosco F I, Muzzupappa M (2010) Product behaviour simulation in mixed reality. Proceedings of ASME World Conference on Innovative Virtual Reality (WINVR2010), Ames, Iowa, USA Bruno F, Angilica A, Cosco F I, Muzzupappa M (2010) Product behaviour simulation in mixed reality. Proceedings of ASME World Conference on Innovative Virtual Reality (WINVR2010), Ames, Iowa, USA
19.
go back to reference Bruno F, Cosco F, Angilica A, Muzzupappa M (2010) Mixed prototyping for products usability evaluation. Proceedings of the ASME 2010 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference (IDETC/CIE 2010), Montreal, Quebec, Canada Bruno F, Cosco F, Angilica A, Muzzupappa M (2010) Mixed prototyping for products usability evaluation. Proceedings of the ASME 2010 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference (IDETC/CIE 2010), Montreal, Quebec, Canada
20.
go back to reference Vezhnevets V, Sazonov V, Andreeva A (2003) A survey on pixel-based skin color detection techniques. Proceedings of Graphicon 2003, Moscow, Russia Vezhnevets V, Sazonov V, Andreeva A (2003) A survey on pixel-based skin color detection techniques. Proceedings of Graphicon 2003, Moscow, Russia
21.
go back to reference Kakumanu P, Makrogiannis S, Bourbakis N (2007) A survey of skin-color modeling and detection methods. Pattern Recogn 40–3:1106–1122CrossRef Kakumanu P, Makrogiannis S, Bourbakis N (2007) A survey of skin-color modeling and detection methods. Pattern Recogn 40–3:1106–1122CrossRef
22.
go back to reference Phung SL, Bouzerdoum A, Chai D (2005) Skin segmentation using color pixel classification: analysis and comparison. IEEE Trans Pattern Anal Mach Intell 27–1:148–154CrossRef Phung SL, Bouzerdoum A, Chai D (2005) Skin segmentation using color pixel classification: analysis and comparison. IEEE Trans Pattern Anal Mach Intell 27–1:148–154CrossRef
23.
go back to reference Bordegoni M, Caruso G, Ferrise F (2008) Mixed-Reality Environment based on Haptic Control System for a tractor cabin design review. Proceedings of CIRP Design Conference, Enschede, April 7–9 Bordegoni M, Caruso G, Ferrise F (2008) Mixed-Reality Environment based on Haptic Control System for a tractor cabin design review. Proceedings of CIRP Design Conference, Enschede, April 7–9
24.
go back to reference Hartmann B, Klemmer SR, Bernstein M, Abdulla L, Burr B, Robinson-Mosher A, Gee J (2006) Reflective physical prototyping through integrated design, test, and analysis. Proceedings of the Annual ACM Symposium on User Interface Software and Technology-UIST’06, Montreux, Switzerland Hartmann B, Klemmer SR, Bernstein M, Abdulla L, Burr B, Robinson-Mosher A, Gee J (2006) Reflective physical prototyping through integrated design, test, and analysis. Proceedings of the Annual ACM Symposium on User Interface Software and Technology-UIST’06, Montreux, Switzerland
25.
go back to reference Landauer TK, Nielsen J (1993) A mathematical model of the finding of usability problems. In: Proceedings of ACM INTERCHI’93 Conference, Amsterdam, 24–29 April, 206–213 Landauer TK, Nielsen J (1993) A mathematical model of the finding of usability problems. In: Proceedings of ACM INTERCHI’93 Conference, Amsterdam, 24–29 April, 206–213
26.
go back to reference Virzi RA (1992) Refining the test phase of usability evaluation: how many subjects is enough? Hum Factors 34:457–468 Virzi RA (1992) Refining the test phase of usability evaluation: how many subjects is enough? Hum Factors 34:457–468
28.
go back to reference ANSI (2001) Common industry format for usability test reports (ANSI-NCITS 354-2001). American National Standards Institute, Washington, DC ANSI (2001) Common industry format for usability test reports (ANSI-NCITS 354-2001). American National Standards Institute, Washington, DC
29.
go back to reference ISO 9241 (1998) Ergonomic requirements for office work with visual display terminals (VDTs)–Part 11: guidance on usability (ISO 9241-11:1998(E)). Geneva, Switzerland ISO 9241 (1998) Ergonomic requirements for office work with visual display terminals (VDTs)–Part 11: guidance on usability (ISO 9241-11:1998(E)). Geneva, Switzerland
30.
go back to reference Lewis JR (2006) Usability testing. In: Salvendy G (ed) Handbook of human factors and ergonomics. John Wiley, New York, NY, pp 1275–1316CrossRef Lewis JR (2006) Usability testing. In: Salvendy G (ed) Handbook of human factors and ergonomics. John Wiley, New York, NY, pp 1275–1316CrossRef
Metadata
Title
Reliable behaviour simulation of product interface in mixed reality
Authors
Fabio Bruno
Agostino Angilica
Francesco Cosco
Maurizio Muzzupappa
Publication date
01-07-2013
Publisher
Springer-Verlag
Published in
Engineering with Computers / Issue 3/2013
Print ISSN: 0177-0667
Electronic ISSN: 1435-5663
DOI
https://doi.org/10.1007/s00366-012-0293-7

Other articles of this Issue 3/2013

Engineering with Computers 3/2013 Go to the issue