Skip to main content Accessibility help
×
Hostname: page-component-8448b6f56d-cfpbc Total loading time: 0 Render date: 2024-04-18T22:59:20.014Z Has data issue: false hasContentIssue false
This chapter is part of a book that is no longer available to purchase from Cambridge Core

14 - Simulation for Performance and Training

from PART III - METHODS FOR STUDYING THE STRUCTURE OF EXPERTISE

Paul Ward
Affiliation:
Human Performance Laboratory, Learning Systems Institute, Florida State University
A. Mark Williams
Affiliation:
Research Institute for Sport and Exercise Science, Liverpool John Moores University
Peter A. Hancock
Affiliation:
Department of Psychology and Institute for Simulation and Training, University of Central Florida
K. Anders Ericsson
Affiliation:
Florida State University
Neil Charness
Affiliation:
Florida State University
Paul J. Feltovich
Affiliation:
University of West Florida
Robert R. Hoffman
Affiliation:
University of West Florida
Get access

Summary

Keywords: Simulation, Expert Performance, Training, Skill Acquisition, Aviation, Sport, Surgery.

Introduction

Many methods have been used to study experts. Traditionally, researchers have dissected performance into its constituent parts to isolate basic underlying mechanisms. Although this provides experimental control, task simplification and the use of novel and artificial tasks are antithetical to reproducing the “real-world” demands faced by actual domain experts. Changing the nature of the phenomenon under investigation may lead to a reduction, if not eradication, of the expert advantage. Cognitive anthropologists (see Clancey, Chapter 8) and Naturalistic Decision Making researchers (see Ross et al., Chapter 23), on the other hand, have argued that the most useful method of examining expertise is to capture performance as it occurs in the “natural” environment. However, critics have claimed that although this type of approach allows “real-world” performance to be described, only minimal explanation is possible with regard to the underlying cognitive processes (e.g., Yates, 2001). Brehmer and Dörner (1993) concluded that field examination may not permit any definite conclusions to be drawn, whereas laboratory tasks are often too simplistic to reach any conclusions of interest. This leaves us in the invidious position that what is interesting is not explained and what is explained is not interesting. Simulation in its many guises may offer an excellent compromise.

The range and type of possible simulation environments is vast. Some are referred to as Computer-Aided Virtual Environment (CAVE) systems. Others include high fidelity simulations of complex systems (e.g.

Type
Chapter
Information
Publisher: Cambridge University Press
Print publication year: 2006

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Abernethy, B., Thomas, K. T., & Thomas, J. R. (1993). Strategies for improving understanding of motor expertise (or mistakes we have made and things we have learned!). In Starkes, J. L. & Allard, F. (Eds.), Cognitive issues in motor expertise (pp. 317–356). Amsterdam: Elsevier Publishing. Google Scholar
Abernethy, B., Wann, J., & Parks, S. (1998). Training perceptual motor skills for sport. In Elliott, B. (Ed.), Training in sport: Applying sport science (pp. 1–55). London: Wiley Publications.Google Scholar
Allard, F., Graham, S., & Paarsalu, M. L. (1980). Perception in sport: Basketball. Journal of Sport Psychology, 2, 14–21.CrossRefGoogle Scholar
Allard, F., & Starkes, J. L. (1980). Perception in sport: Volleyball. Journal of Sport Psychology, 2, 22–53.CrossRefGoogle Scholar
Allerton, D. J. (2000). Flight simulation: Past, present and future. Aeronautical Journal, 104, 651–663.Google Scholar
Bellenkes, A. H., Wickens, C. D., & Kramer, A. F. (1997). Visual scanning and pilot expertise: The role of attentional flexibility and mental model development. Aviation, Space, and Environmental Medicine, 68, 569–579.Google ScholarPubMed
Brehmer, B., & Dörner, D. (1993). Experiments with computer-simulated microworlds: Escaping both the narrow straits of the laboratory and the deep blue sea of the field study. Computers in Human Behavior, 9, 171–184.CrossRefGoogle Scholar
Borgeaud, P., & Abernethy, B. (1987). Skilled perception in volleyball defense. Journal of Sport Psychology, 9, 400–406.CrossRefGoogle Scholar
Charness, N. (1976). Memory for chess positions: Resistance to interference. Journal of Experimental Psychology: Human Learning and Memory, 2, 641–653.Google Scholar
Chase, W., & Ericsson, K. A. (1982). Skill and working memory. In Bower, G. H. (Ed.), The psychology of learning and motivation (pp. 1–58). New York: Academic Press.Google Scholar
Chase, W. G., & Simon, H. A. (1973). Perception in chess. Cognitive Psychology, 4, 55–81.CrossRefGoogle Scholar
Chi, M. T. H., Glaser, R., & Farr, M. (1980). The nature of expertise. Hillsdale, NJ: Erlbaum.Google Scholar
Colt, H. G., Crawford, S. W., & Galbraith, O. (2001). Virtual reality bronchoscopy simulation. Chest, 120, 1333–1339.CrossRefGoogle ScholarPubMed
Day, L. J. (1980). Anticipation in junior tennis players. In Groppel, J. & Sears, R. (Eds.), Proceedings of the International Symposium on the Effective Teaching of Racquet Sports (pp. 107–116). Champaign, IL: University of Illinois.Google Scholar
Doane, S. M., Sohn, Y. W., & Jodlowski, M. T. (2004). Pilot ability to anticipate the consequences of flight actions as a function of expertise. Human Factors, 46, 92–103.CrossRefGoogle Scholar
Endsley, M. (1995). Towards a theory of situation awareness. Human Factors, 37, 32–64.CrossRefGoogle Scholar
Entin, E. B., Serfaty, D., Elliott, L. R., & Schiflett, S. G. (2001). DMT-RNet: An internet-based infrastructure for distributed multidisciplinary investigations of C2 performance. In Proceedings of the 6th International Command and Control Research and Technology Symposium, June 2001. Annapolis, MD.
Ericsson, K. A. (1996). The road to excellence: The acquisition of expert performance in the arts and science, sports, and games. Mahwah, NJ: Erlbaum.Google Scholar
Ericsson, K. A. (2003). How the expert-performance approach differs from traditional approaches to expertise in sports: In search of a shared theoretical framework for studying expert performance. In Starkes, J. & Ericsson, K. A. (Eds.), Expert performance in sport: Recent advances in research on sport expertise (pp. 371–401). Champaign, IL: Human Kinetics.Google Scholar
Ericsson, K. A., & Kintsch, W. (1995). Long term working memory. Psychological Review, 102, 211–245.CrossRefGoogle ScholarPubMed
Ericsson, K. A., Krampe, R. Th., & Tesch-Römer, C. (1993). The role of deliberate practice in the acquisition of expert performance. Psychological Review, 100, 363–406.CrossRefGoogle Scholar
Ericsson, K. A., & Smith, J. (1991). Prospects and limits of the empirical study of expertise: An introduction. In Ericsson, K. A. & Smith, J. (Eds.), Toward a general theory of expertise: Prospects and limits (pp. 1–38). New York: Cambridge University Press.Google Scholar
Farrow, D., Chivers, P., Hardingham, C., & Sacuse, S. (1998). The effect of video-based perceptual training on the tennis return of serve. International Journal of Sport Psychology, 29, 231–242.Google Scholar
Feltovich, P., Spiro, R., & Coulson, R. (1997). Issues of expert flexibility in contexts characterized by complexity and change. In Feltovich, P. J., Ford, K. M., & Hoffman, R. R. (Eds.), Expertise in context. Menlo Park, CA: AAAI/MIT Press.Google Scholar
Fischhoff, B. (1989). Eliciting knowledge for analytical representation. IEEE Transactions on Systems, Man, and Cybernetics, 19, 448–461.CrossRefGoogle Scholar
Gallagher, A. G., & Satava, R. M. (2002). Virtual reality as a metric for the assessment of laparoscopic psychomotor skills. Surgical Endoscopy, 16, 1746–1752.CrossRefGoogle ScholarPubMed
Goldiez, B., Ahmad, A. M., & Hancock, P. A. (2005). Wayfinding and navigation in augmented reality. Manuscript submitted for publication.
Gray, W. (2002). Simulated task environments: The role of high-fidelity simulations, scaled worlds, synthetic environments, and laboratory tasks in basic and applied cognitive research. Cognitive Science Quarterly, 2, 205–227.Google Scholar
Groot, A. (1978/1946). Thought and choice in chess. The Hague: Mouton. Google Scholar
Haskins, M. J. (1965). Development of a response-recognition training film in tennis. Perceptual and Motor Skills, 21, 207–211.CrossRefGoogle ScholarPubMed
Hatano, G, & Ignaki, K. (1986). Two courses of expertise. In Stevenson, H., Azuma, H., & Hakuta, K. (Eds.), Child development and education in Japan. New York: W. H. Freeman.Google Scholar
Hays, R. T., Jacobs, J. W., Prince, C., & Salas, E. (1992). Flight simulator training effectiveness: A meta-analysis. Military Psychology, 4, 63–74.CrossRefGoogle Scholar
Haluck, R. S., Webster, R. W., Snyder, A. J., Melkonian, M. G., Mohler, B. J., Dise, M. L., & Lefever, A. (2001). A virtual reality surgical simulator trainer for navigation in laparoscopic Surgery. In Westwood, J. D. et al. (Eds.), Medicine meets virtual reality 2001: Outer space, inner space, virtual space (pp. 171–177). Amsterdam: IOS Press.Google Scholar
Helsen, W. F., & Starkes, J. L. (1999). A multidimensional approach to skilled perception and performance in sport. Applied Cognitive Psychology, 13, 1–27.3.0.CO;2-T>CrossRefGoogle Scholar
Higgins, T. J., Chignell, M. H., & Hancock, P. A. (1989). Knowledge-based supervisory control for aerospace applications. In Hancock, P. A. & Chignell, M. H. (Eds.), Intelligent interfaces: Theory, research, and design. North Holland: Elsevier.Google Scholar
Hoffman, R. R. (1992). The psychology of expertise: Cognitive research and empirical AI. New York: Springer-Verlag.CrossRefGoogle Scholar
Hoffman, R. R., & Deffenbacher, K. A. (1993). An analysis of the relations of basic and applied science. Ecological Psychology, 5, 315–352.CrossRefGoogle Scholar
Hubbard, J. P., Levitt, E. J., Schumacher, C. F., & Schnabel, T. G. (1965). An objective evaluation of clinical competence: New techniques used by the National Board of Medical Examiners. New England Journal of Medicine, 272, 1321–1328.CrossRefGoogle Scholar
Jodlowski, M. T., & Doane, S. M. (2003). Event reasoning as a function of working memory capacity and long term working memory skill. In Proceedings of the 25th Annual Meeting of the Cognitive Science Society, July 31–August 2. Boston, MA: Cognitive Science Society.Google Scholar
Jodlowski, M. T., Doane, S. M., & Brou, R. J. (2003). Adaptive expertise during simulated flight. In Proceedings of the Human Factors and Ergonomics Society 47th Annual Meeting, October 10–17. Denver, Colorado: HFES.Google Scholar
Jones, C. M., & Miles, T. R. (1978). Use of advance cues in predicting the flight of a lawn tennis ball. Journal of Human Movement Studies, 4, 231–5.Google Scholar
Kasarskis, P., Stehwien, J., Hickox, J., Aretz, A., & Wickens, C. (2001). Comparison of expert and novice scan behaviors during VFR flight. Paper presented at the 11th International Symposium on Aviation Psychology. Columbus OH: The Ohio State University.Google Scholar
Khatwa, R., & Helmreich, R. (1999). Analysis of critical factors during approach and landing in accidents and normal flight. Flight Safety Digest. Alexandria, VA: Flight Safety Foundation.Google Scholar
Kintsch, W. (1988). The use of knowledge in discourse processing: A construction-integration model. Psychological Review, 95, 163–182.CrossRefGoogle Scholar
Kneebone, R. (2003). Simulation in surgical training: Educational issues and practical applications. Medical Education, 37, 267–77.CrossRefGoogle Scholar
Kohn, L. T., Corrigan, J. M., & Donaldson, M. (1999). To err is human: Building a safer health system. Washington, DC: Institute of Medicine.Google Scholar
Law, B., Atkins, M. S., Kirkpatrick, A. E., Lomax, A. J., & Mackenzie, C. L. (2004). Eye gaze patterns differentiate novice and experts in a virtual laparoscopic surgery training environment. Proceedings of the eye tracking research & applications symposium on eye tracking research & applications (pp. 41–48). New York: ACM Press.Google Scholar
Lintern, G., Roscoe, S. N., Koonce, J. M., & Segal, L. (1990). Transfer of landing skills in beginning flight training. Human Factors, 32, 319–327.CrossRefGoogle Scholar
Londerlee, B. R. (1967). Effect of training with motion pictures versus flash cards upon football play recognition. Research Quarterly, 38, 202–207.Google Scholar
McCloy, R., & Stone, R. (2001). Science, medicine, and the future: Virtual reality in surgery. British Medical Journal, 323, 912–915.CrossRefGoogle ScholarPubMed
McMorris, T., & Hauxwell, B. (1997). Improving anticipation of soccer goalkeepers using video observation. In Reilly, T., Bangsbo, J., & Hughes, M. (Eds.), Science and football III (pp. 290–294). London: E. & F. N. Spon.Google Scholar
Patel, V. L., & Groen, G. (1986). Knowledge-based solution strategies in medical reasoning. Cognitive Science, 10, 91–116.CrossRefGoogle Scholar
Povenmire, H. K., & Roscoe, S. N. (1973). Incremental transfer effectiveness of a ground-based general aviation trainer. Human Factors, 15, 534–542.CrossRefGoogle Scholar
Roscoe, S. N. (1971). Incremental transfer effectiveness. Human Factors, 13, 561–567.CrossRefGoogle Scholar
Rosser, J. C., Rosser, L. E., & Savalgi, R. S. (1997). Skill acquisition and assessment of laparoscopic surgery. Archives of Surgery, 132, 200–204.CrossRefGoogle ScholarPubMed
Salas, E., Bowers, C. A., & Rhodenizer, L. (1998). It is not how much you have but how you use it: Toward a rational use of simulation to support aviation training. The International Journal of Aviation Psychology, 8, 197–208.CrossRefGoogle ScholarPubMed
Salas, E., & Klein, G. (2001). Linking expertise and naturalistic decision making (Expertise: Research and applications). Mahwah, NJ: Erlbaum.Google Scholar
Schijven, M., & Jakimowicz, J. (2003). Construct validity: Experts and novices performing on the Xitact LS500 laparoscopy simulator. Surgical Endoscopy, 17, 803–810.CrossRefGoogle ScholarPubMed
Senate of Surgery (1998). Response to the general medical council determination on the Bristol Case. London: Senate Paper 5, The Senate of Surgery of Great Britain and Northern Ireland.
Seymour, N. E., Gallagher, A. G., Roman, S. A., Brien, M. K., Bansal, V. K., Anderson, D. K., & Satava, R. M. (2002). Virtual reality training improves operating room performance: Results of a randomized, double blinded study. Annals of Surgery, 236, 458–463.CrossRefGoogle ScholarPubMed
Singer, R. N., Cauraugh, J. H., Chen, D., Steinberg, G. M., Frehlich, S. G., & Wang, L. (1994). Training mental quickness in beginning/intermediate tennis players. The Sport Psychologist, 8, 305–318.CrossRefGoogle Scholar
Smeeton, N. J., Williams, A. M., Hodges, N. J., & Ward, P. (2005). The relative effectiveness of various instructional approaches in developing anticipation skill. Journal of Experimental Psychology: Applied, 11, 98–110.Google ScholarPubMed
Smode, A. F., Hall, E. R., & Meyer, D. E. (1966). An assessment of research relevant to pilot training (Vol. 11) (Technical Report No. AMRL-TR-66-196). Wright Patterson Air Force Base, OH: Aerospace Medical Research Laboratory.CrossRefGoogle ScholarPubMed
Sohn, Y. W., & Doane, S. M. (2003). Roles of working memory capacity and long-term working memory skill in complex task performance. Memory & Cognition, 31, 458–466.CrossRefGoogle ScholarPubMed
Starkes, J. L., & Ericsson, K. A. (2003). Expert performance in sports: Advances in research on sports expertise. Champaign, IL: Human Kinetics.Google Scholar
Starkes, J. L., & Lindley, S. (1994). Can we hasten expertise by video simulations? Quest, 46, 211–222.CrossRefGoogle Scholar
Staszewski, J. (1999). Information processing analysis of human land mine detection skill. In T. Broach, A. C. Dubey, R. E. Dugan, & J. Harvey, (Eds.), Detection and remediation technologies for mines and mine-like targets IV. Proceedings of the Society for Photo-Optical Instrumentation Engineers 13th Annual Meeting, SPIE. Vol. 3710, 766–777.
Staszewski, J., & Davison, A. (2000). Mine detection training based on expert skill. In Dubey, A. C., Harvey, J. F., Broach, J. T., & Dugan, R. E. (Eds.), Detection and remediation technologies for mines and mine-like targets V. Proceedings of Society of Photo-Optical Instrumentation Engineers 14th Annual Meeting, SPIE Vol. 4038, 90–101.Google Scholar
Strom, P., Kjellin, A., Hedman, L., Wredmark, T., & Fellander-Tsai, L. (2004). Training in tasks with different visual-spatial components does not improve virtual arthroscopy performance. Surgical Endoscopy, 18, 115–120.Google Scholar
Taffinder, N., Sutton, C., Fishwick, R. J., McManus, I. C., & Darzi, A. (1998). Validation of virtual reality to teach and assess psycho-motor skills in laparoscopic surgery: Results form randomized controlled studies using the MIST VR laparoscopic simulator. Studies in Health Technology and Informatics, 50, 124–130.Google Scholar
Tayler, M. A., Burwitz, L., & Davids, K. (1994). Coaching perceptual strategy in badminton. Journal of Sports Sciences, 12, 213.Google Scholar
Taylor, H. L., Talleur, D. A., Emanuel, T. W., Rantanen, E. M., Bradshaw, G. L., & Phillips, S. I. (2001). Incremental training effectiveness of personal computers used for instrument training. Paper presented at the 11th International Symposium on Aviation Psychology. Columbus, OH: The Ohio State University.Google Scholar
Taylor, H. L., Talleur, D. A., Emanuel, T. W., Rantanen, E. M., Bradshaw, G. L., & Phillips, S. I. (2002). Incremental training effectiveness of personal computers used for instrument training: Basic instruments. Interim Technical Report ARL-02-4/NASA-02-2. Moffett Field, CA: NASA Ames Research Center (Contract NASA NAG 2–1282). Google Scholar
Thomas, J. R. (2003). Meta analysis of motor expertise. Invited Motor Development Scholar Address presented at the North American Society for the Psychology of Sport and Physical Activity Conference. NASPSPA: Savannah, GA.Google Scholar
Torkington, J., Smith, S. G. T., Rees, B. I., & Darzi, A. (2001). Skill transfer from virtual reality to a real laparoscopic task. Surgical Endoscopy, 15, 1076–1079.CrossRefGoogle ScholarPubMed
Dijk, T. A., & Kintsch, W. (1983). Strategies of discourse comprehension. New York: Academic Press.Google Scholar
Verner, L., Oleynikov, D., Holtmann, S., Haider, H., & Zhukov, L. (2003). Measurements of the level of surgical expertise using flight path analysis from da Vinci Robotic Surgical System. Medicine Meets Virtual Reality, 11, 373–378.Google Scholar
Walls, J., Bertrand, L., Gale, T., & Saunders, N. (1998). Assessment of upwind dinghy sailing performance using a virtual reality dinghy sailing simulator. Journal of Science and Medicine in Sport, 1, 61–71.CrossRefGoogle ScholarPubMed
Ward, P., & Williams, A. M. (2003). Perceptual and cognitive skill development in soccer: The multidimensional nature of expert performance. Journal of Sport and Exercise Psychology, 25, 93–111.CrossRefGoogle Scholar
Ward, P., Williams, A. M., & Bennett, S. J. (2002). Visual search and biological motion perception in tennis. Research Quarterly for Exercise and Sport, 73, 107–112.CrossRefGoogle ScholarPubMed
Williams, A. M., & Burwitz, L. (1993). Advance cue utilisation in soccer. In Reilly, T., Clarys, J., & Stibbe, A. (Eds.), Science and football II (pp. 239–244). London: E. & F. N. Spon.CrossRefGoogle Scholar
Williams, A. M., & Davids, K. (1998). Visual search strategy, selective attention, and expertise in soccer. Research Quarterly for Exercise and Sport, 69, 111–128.CrossRefGoogle ScholarPubMed
Williams, A. M., Davids, K., Burwitz, L., & Williams, J. G. (1993). Cognitive knowledge and soccer performance. Perceptual and Motor Skills, 76, 579–593.CrossRefGoogle Scholar
Williams, A. M., Davids, K., Burwitz, L., & Williams, J. G. (1994). Visual search strategies of experienced and inexperienced soccer players. Research Quarterly for Exercise and Sport, 65, 127–135.CrossRefGoogle ScholarPubMed
Williams, A. M., & Hodges, N. J. (2004) (Eds.). Skill acquisition in sport: Research, theory and practice. London: Routledge.Google Scholar
Williams, A. M., & Ward, P. (2001). Developing perceptual skill in sport: The need for evidence-based practice. In Papaioannou, A., Goudas, M., & Theodorakis, Y. (Eds.), Proceedings of the 10th World Congress of Sport Psychology: Vol. 3. In the dawn of the new millennium (pp. 159–161). Skiathos, Hellas: International Society of Sport Psychology.Google Scholar
Williams, A. M., & Ward, P. (2003). Perceptual expertise: Development in sport. In Starkes, J. L. & Ericsson, K. A. (Eds.), Expert performance in sport: Advances in research on sport expertise, (pp. 220–249). Champaign, IL: Human Kinetics.Google Scholar
Williams, A. M., Ward, P., Allen, D., & Smeeton, N. J. (2004). Developing perceptual skill in tennis using on-court instruction: Perception versus perception and action. Journal of Applied Sport Psychology, 16, 350–360.CrossRefGoogle Scholar
Williams, A. M., Ward, P., & Chapman, C. (2003). Training perceptual skill in field hockey: Is there transfer from the laboratory to the field? Research Quarterly for Exercise and Sport, 74, 98–103.CrossRefGoogle Scholar
Williams, A. M., Ward, P., Knowles, J., & Smeeton, N. (2002). Anticipation skill in a real-world task: Measurement, training, and transfer in tennis. Journal of Experimental Psychology: Applied, 8, 259–270.Google Scholar
Yates, J. F. (2001). “Outsider”: Impressions of naturalistic decision making. In Salas, E. & Klein, G. (Eds.), Linking expertise and naturalistic decision making (pp. 9–33). Mahwah, NJ: Erlbaum.Google Scholar

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×