Skip to main content

2012 | OriginalPaper | Buchkapitel

6. Performance Evaluation Based on Psychophysical Tests

verfasst von : Evren Samur

Erschienen in: Performance Metrics for Haptic Interfaces

Verlag: Springer London

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A haptic interface is meant to be used by a human user. Its performance is highly affected by the user behavior and constraints. Application based or task specific evaluation methods have been proposed to test haptic interfaces during their proper use. This approach requires a human user to perform the task, thus it involves human dynamic and intention uncertainties. Although there is a variety of task specific evaluation approaches for haptic interfaces, it has not yet been possible to define a norm for meaningful device comparison and assessment. A proper evaluation procedure for haptic interfaces should link device performance measures to the limits of human perception in order to obtain device-specific limits. This chapter deals with psychophysical evaluation methodology. Testbed evaluation approach is applied to haptic interactions and a set of benchmark metrics are provided for haptic interfaces. We describe the methodology of seven testbeds and experimentally demonstrate usefulness of the testbeds on three commercial force-feedback devices. Finally, the general discussion at the end of this chapter summarizes the outcomes of the proposed psychophysical evaluation methodology.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Avizzano, C.A., Solis, J., Frisoli, A., Bergamasco, M.: Motor learning skill experiments using haptic interface capabilities. In: Proc. of 11th IEEE International Workshop on Robot and Human Interactive Communication, pp. 198–203 (2002) Avizzano, C.A., Solis, J., Frisoli, A., Bergamasco, M.: Motor learning skill experiments using haptic interface capabilities. In: Proc. of 11th IEEE International Workshop on Robot and Human Interactive Communication, pp. 198–203 (2002)
2.
Zurück zum Zitat Basdogan, C., Ho, C., Srinivasan, M.A., Slater, M.: An experimental study on the role of touch in shared virtual environments. ACM Trans. Comput.-Hum. Interact. 7(4), 443–460 (2000) CrossRef Basdogan, C., Ho, C., Srinivasan, M.A., Slater, M.: An experimental study on the role of touch in shared virtual environments. ACM Trans. Comput.-Hum. Interact. 7(4), 443–460 (2000) CrossRef
3.
Zurück zum Zitat Bowman, D.A., Hodges, L.F.: Formalizing the design, evaluation, and application of interaction techniques for immersive virtual environments. J. Vis. Lang. Comput. 10(1), 37–53 (1999) CrossRef Bowman, D.A., Hodges, L.F.: Formalizing the design, evaluation, and application of interaction techniques for immersive virtual environments. J. Vis. Lang. Comput. 10(1), 37–53 (1999) CrossRef
4.
Zurück zum Zitat Campion, G., Hayward, V.: Fundamental limits in the rendering of virtual haptic textures. In: World Haptics Conference, pp. 263–270 (2005) Campion, G., Hayward, V.: Fundamental limits in the rendering of virtual haptic textures. In: World Haptics Conference, pp. 263–270 (2005)
5.
Zurück zum Zitat Chun, K., Verplank, B., Barbagli, F., Salisbury, K.: Evaluating haptics and 3d stereo displays using Fitts’ law. In: Proc. of the 3rd IEEE Workshop on HAVE, pp. 53–58 (2004) Chun, K., Verplank, B., Barbagli, F., Salisbury, K.: Evaluating haptics and 3d stereo displays using Fitts’ law. In: Proc. of the 3rd IEEE Workshop on HAVE, pp. 53–58 (2004)
6.
Zurück zum Zitat Durlach, N.I., Delhorne, L.A., Wong, A., Ko, W.Y., Rabinowitz, W.M., Hollerbach, J.: Manual discrimination and identification of length by the finger-span method. Percept. Psychophys. 46(1), 29–38 (1989) CrossRef Durlach, N.I., Delhorne, L.A., Wong, A., Ko, W.Y., Rabinowitz, W.M., Hollerbach, J.: Manual discrimination and identification of length by the finger-span method. Percept. Psychophys. 46(1), 29–38 (1989) CrossRef
7.
Zurück zum Zitat Fitts, P.M.: The information capacity of the human motor system in controlling the amplitude of movement. J. Exp. Psychol. 47, 381–391 (1954) CrossRef Fitts, P.M.: The information capacity of the human motor system in controlling the amplitude of movement. J. Exp. Psychol. 47, 381–391 (1954) CrossRef
9.
Zurück zum Zitat Hannaford, B., Wood, L., McAffee, D., Zak, H.: Performance evaluation of a six axis generalized force reflecting teleoperator. IEEE Trans. Syst. Man Cybern. 21, 620–633 (1991) CrossRef Hannaford, B., Wood, L., McAffee, D., Zak, H.: Performance evaluation of a six axis generalized force reflecting teleoperator. IEEE Trans. Syst. Man Cybern. 21, 620–633 (1991) CrossRef
10.
Zurück zum Zitat Harders, M., Barlit, A., Akahane, K., Sato, M., Szkely, G.: Comparing 6dof haptic interfaces for application in 3d assembly tasks. In: Proc. of Eurohaptics’06 (2006) Harders, M., Barlit, A., Akahane, K., Sato, M., Szkely, G.: Comparing 6dof haptic interfaces for application in 3d assembly tasks. In: Proc. of Eurohaptics’06 (2006)
11.
Zurück zum Zitat Jandura, L., Srinivasan, M.A.: Experiments on human performance in torque discrimination and control. Dyn. Control Syst., ASME 55-1, 369–375 (1994) Jandura, L., Srinivasan, M.A.: Experiments on human performance in torque discrimination and control. Dyn. Control Syst., ASME 55-1, 369–375 (1994)
12.
Zurück zum Zitat Jones, L.A., Lederman, S.J.: Human Hand Function. Oxford University Press, London (2006) CrossRef Jones, L.A., Lederman, S.J.: Human Hand Function. Oxford University Press, London (2006) CrossRef
13.
Zurück zum Zitat Kappers, A.M., Koenderink, J.J., Lichtenegger, I.: Haptic identification of curved surfaces. Percept. Psychophys. 56(1), 53–61 (1994) CrossRef Kappers, A.M., Koenderink, J.J., Lichtenegger, I.: Haptic identification of curved surfaces. Percept. Psychophys. 56(1), 53–61 (1994) CrossRef
14.
Zurück zum Zitat Kirkpatrick, A.E., Douglas, S.A.: Application-based evaluation of haptic interfaces. In: Proc. of the 10th Haptic Symposium, p. 32 (2002) Kirkpatrick, A.E., Douglas, S.A.: Application-based evaluation of haptic interfaces. In: Proc. of the 10th Haptic Symposium, p. 32 (2002)
15.
Zurück zum Zitat Klatzky, R.L., Loomis, J.M., Lederman, S.J., Wake, H., Fujita, N.: Haptic identification of objects and their depictions. Percept. Psychophys. 54(2), 170–178 (1993) CrossRef Klatzky, R.L., Loomis, J.M., Lederman, S.J., Wake, H., Fujita, N.: Haptic identification of objects and their depictions. Percept. Psychophys. 54(2), 170–178 (1993) CrossRef
16.
Zurück zum Zitat Lamb, G.D.: Tactile discrimination of textured surfaces: psychophysical performance measurements in humans. J. Physiol. 338(1), 551–565 (1983) Lamb, G.D.: Tactile discrimination of textured surfaces: psychophysical performance measurements in humans. J. Physiol. 338(1), 551–565 (1983)
17.
Zurück zum Zitat Lawrence, D.A., Pao, L.Y., Dougherty, A.M., Salada, M.A., Pavlou, Y.: Rate-hardness: a new performance metric for haptic interfaces. IEEE Trans. Robot. Autom. 16(4), 357–371 (2000) CrossRef Lawrence, D.A., Pao, L.Y., Dougherty, A.M., Salada, M.A., Pavlou, Y.: Rate-hardness: a new performance metric for haptic interfaces. IEEE Trans. Robot. Autom. 16(4), 357–371 (2000) CrossRef
18.
Zurück zum Zitat MacKenzie, I.S.: Fitts’ law as a research and design tool in human-computer interaction. Hum.-Comput. Interact. 7, 91–139 (1992) CrossRef MacKenzie, I.S.: Fitts’ law as a research and design tool in human-computer interaction. Hum.-Comput. Interact. 7, 91–139 (1992) CrossRef
19.
Zurück zum Zitat MacKenzie, I.S., Sellen, A., Buxton, W.: A comparison of input devices in elemental pointing and dragging tasks. In: Proc. of the CHI’91 Conference on Human Factors in Computing Systems, pp. 161–166 (1991) MacKenzie, I.S., Sellen, A., Buxton, W.: A comparison of input devices in elemental pointing and dragging tasks. In: Proc. of the CHI’91 Conference on Human Factors in Computing Systems, pp. 161–166 (1991)
20.
Zurück zum Zitat MacLean, K.E., Snibbe, S.S.: An architecture for haptic control of media. In: Proc. of the 8th Ann. Symp. on Haptic Interfaces for Virtual Environment and Teleoperator Systems, ASME/IMECE, pp. 3–5 (1999) MacLean, K.E., Snibbe, S.S.: An architecture for haptic control of media. In: Proc. of the 8th Ann. Symp. on Haptic Interfaces for Virtual Environment and Teleoperator Systems, ASME/IMECE, pp. 3–5 (1999)
22.
Zurück zum Zitat Murray, A.M., Klatzky, R.L., Khosla, P.K.: Psychophysical characterization and testbed validation of a wearable vibrotactile glove for telemanipulation. Presence: Teleoperators Virtual Environ. 12(2), 156–182 (2003) CrossRef Murray, A.M., Klatzky, R.L., Khosla, P.K.: Psychophysical characterization and testbed validation of a wearable vibrotactile glove for telemanipulation. Presence: Teleoperators Virtual Environ. 12(2), 156–182 (2003) CrossRef
23.
Zurück zum Zitat Oakley, I., McGee, M.R., Brewster, S.A., Gray, P.D.: Putting the feel in ‘look and feel’. CHI, pp. 415–422 (2000) Oakley, I., McGee, M.R., Brewster, S.A., Gray, P.D.: Putting the feel in ‘look and feel’. CHI, pp. 415–422 (2000)
24.
Zurück zum Zitat O’Malley, M., Goldfarb, M.: The effect of force saturation on the haptic perception of detail. IEEE/ASME Trans. Mechatron. 7, 280–288 (2002) CrossRef O’Malley, M., Goldfarb, M.: The effect of force saturation on the haptic perception of detail. IEEE/ASME Trans. Mechatron. 7, 280–288 (2002) CrossRef
25.
Zurück zum Zitat Samur, E., Wang, F., Spaelter, U., Bleuler, H.: Generic and systematic evaluation of haptic interfaces based on testbeds. In: Proc. of IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, IROS’07 (2007) Samur, E., Wang, F., Spaelter, U., Bleuler, H.: Generic and systematic evaluation of haptic interfaces based on testbeds. In: Proc. of IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, IROS’07 (2007)
27.
Zurück zum Zitat Tan, H.: Identification of sphere size using the phantom: towards a set of building blocks for rendering haptic environment. In: ASME Annual Meeting, pp. 197–203 (1997) Tan, H.: Identification of sphere size using the phantom: towards a set of building blocks for rendering haptic environment. In: ASME Annual Meeting, pp. 197–203 (1997)
28.
Zurück zum Zitat Turk, M., Robertson, G.: Perceptual user interfaces. Commun. ACM 43(3), 32–34 (2000) CrossRef Turk, M., Robertson, G.: Perceptual user interfaces. Commun. ACM 43(3), 32–34 (2000) CrossRef
29.
Zurück zum Zitat Unger, B.J., Nicolaidis, A., Berkelman, P.J., Thompson, A., Klatzky, R.L., Hollis, R.L.: Comparison of 3-d haptic peg-in-hole tasks in real and virtual environments. In: IEEE/RSJ, IROS, pp. 1751–1756 (2001) Unger, B.J., Nicolaidis, A., Berkelman, P.J., Thompson, A., Klatzky, R.L., Hollis, R.L.: Comparison of 3-d haptic peg-in-hole tasks in real and virtual environments. In: IEEE/RSJ, IROS, pp. 1751–1756 (2001)
30.
Zurück zum Zitat Wall, S.A., Harwin, W.: A high bandwidth interface for haptic human computer interaction. Mechatronics 11, 371–387 (2001) CrossRef Wall, S.A., Harwin, W.: A high bandwidth interface for haptic human computer interaction. Mechatronics 11, 371–387 (2001) CrossRef
31.
Zurück zum Zitat Wall, S.A., Harwin, W.S.: Quantification of the effects of haptic feedback during a motor skills task in a simulated environment. In: Proc. of the 2nd PHANToM Users Research Symposium, pp. 61–69 (2000) Wall, S.A., Harwin, W.S.: Quantification of the effects of haptic feedback during a motor skills task in a simulated environment. In: Proc. of the 2nd PHANToM Users Research Symposium, pp. 61–69 (2000)
32.
Zurück zum Zitat Weisenberger, J., Kreier, M., Rinker, M.: Judging the orientation of sinusoidal and square-wave virtual gratings presented via 2-dof and 3-dof haptic interfaces. Haptics-e 1(4) (2000) Weisenberger, J., Kreier, M., Rinker, M.: Judging the orientation of sinusoidal and square-wave virtual gratings presented via 2-dof and 3-dof haptic interfaces. Haptics-e 1(4) (2000)
33.
Zurück zum Zitat Wichmann, F.A., Hill, N.J.: The psychometric function: I. Fitting, sampling, and goodness of fit. Percept. Psychophys. 63(8), 1293–1313 (2001) CrossRef Wichmann, F.A., Hill, N.J.: The psychometric function: I. Fitting, sampling, and goodness of fit. Percept. Psychophys. 63(8), 1293–1313 (2001) CrossRef
Metadaten
Titel
Performance Evaluation Based on Psychophysical Tests
verfasst von
Evren Samur
Copyright-Jahr
2012
Verlag
Springer London
DOI
https://doi.org/10.1007/978-1-4471-4225-6_6

Neuer Inhalt