Troubleshooting is a common form of problem solving. Technicians (e.g., automotive mechanics, electricians) and professionals (physician, therapists, ombudspersons) diagnose faulty systems and take direct, corrective action to eliminate any faults in order to return the systems to their normal states. Traditional approaches to troubleshooting instruction have emphasized either theoretical or domain knowledge about the system or specific troubleshooting procedures. These methods have failed to develop transferable troubleshooting skills in learners. In this article, we propose an architecture for designing learning environments for troubleshooting. The architecture integrates experiential, domain, and device knowledge in a learning system that enables learners to generate and test hypotheses for every action they take, relate every action to a conceptual model of the system, and query experienced troubleshooters about what they would do. The architecture includes three essential components: A multi-layered conceptual model of the system that includes topographic, function, strategic, and procedural representations; a simulator that requires the learner to generate hypotheses, reconcile the hypotheses to the system mode, test the hypotheses, and interpret the results from the test; and a case library that uses a case-based reasoning engine to access relevant stories of troubleshooting experiences as advice for the learner. This novel architecture can be used to develop learning environments for different kinds of troubleshooting.
Similar content being viewed by others
References
Aamodt, A., and Plaza, E. (1994). Case-based reasoning: Foundational issues, methodological variations, and system approaches. Artificial Intelligence Communications 7(1), 39–59.
Allen, J. A., Hayes, R. Y. T., and Buffardi, L. C. (2001). Maintenance training simulator fidelity and individual differences in transfer of training. In Sweezey, R. W., and Andrews, D. H. (eds.), Readings in Training and Simulation: A 30-Year Perspective, Human Factors Society, Santa Monica, CA, pp. 272–284.
Allen, J. A., Terague, R. C., and Carter, R. E. (1996). The effects of network size and fault intermittency on troubleshooting performance. IEEE Trans. Syst. Man Cybern. 26(1): 125–132.
Axton, T. R., Doverspike, D., Park, S. R., and Barrett, G. V. (1997). A model of the information-processing and cognitive ability requirements for mechanical troubleshooting. Int. J. Cogn. Ergon. 1(3): 245–266.
Bereiter, S. R., and Miller, S. M. (1989). A field study of computer-controlled manufacturing systems. IEEE Trans. Syst. Man Cybern. 19: 205–219.
Besnard, D., and Bastien-Toniazzo, M. (1999). Expert error in troubleshooting: An exploratory study in electronics. Int. J. Hum.-Comput. Stud. 50: 391–405.
Boshuizen, H. P. A., and Schmidt, H. G. (1992). The role of biomedical knowledge in clinical reasoning by experts, intermediates, and novices. Cogn. Sci. 5: 121–152.
Brown, J. S., Burton, R. R., Bell, A. G. (1975). SOPHIE: A step toward creating a reactive learning environment. International Journal of Man-Machine Studies 7(5): 675–696.
Brown, J. S., Collins, A., and Duguid, P. (1989). Situated cognition and the culture of learning. Educ. Res. 18: 32–42.
Catrambone, R. C., and Holyoak, K. J. (1990). Learning subgoals and methods for solving probability problems. Memory Cogn. 18(6): 593–603.
Chi, M. T. H., Bassock, M., Lewis, M. W., Reiman, P., and Glaser, R. (1989). Self-explanations: How students study and use examples in learning to solve problems. Cogn. Sci. 13: 145–182.
Chi, M. T. H., Feltovich, P. J., and Glaser, R. (1981). Categorization and representation of physics problems by experts and novices. Cogn. Sci. 5: 121–152.
Chi, M. T. H., and Van Lehn, K. A. (1991). The content of physics self-explanations. J. Learn. Sci. 1(1): 69–105.
Cooper, G., and Sweller, J. (1987). Effects of schema acquisition and rule automation on mathematical problem solving. J. Educ. Psychol. 79: 347–362.
David, R. (1983). Reasoning from first principles in electronic troubleshooting. Int. J. Man-Mach. Stud. 19: 403–423.
Davis, J. K., and Haueisen, W. C. (1976). Field independence and hypothesis testing. Percept. Motor Skills 43: 763–769.
De Croock, M. B. M., van Merrienboer, J. J. G., and Paas, F. G. W. C. (1998). High versus low contextual interference in simulation-based training of troubleshooting skill: Effects of transfer performance and invested mental effort. Comput. Hum. Behav. 14(2): 249–267.
deKleer, J. (1985). How circuits work. In Bobrow, D. G. (ed.), Qualitative Reasoning About Physical Systems, MIT Press, Cambridge, MA, pp. 205–280.
Dreyfus, H. L., and Dreyfus, S. E. (1986). Mind Over Machine, The Free Press, New York.
Elstein, A. S., Shulman, L. S., and Sprafka, S. A. (1978). Medical Problem Solving: An Analysis of Clinical Reasoning, Harvard University Press, Cambridge, MA.
Ericsson, K. A., and Smith, J. (1991). Prospects of the limits of the empirical study of expertise: An introduction. In Ericson, K. A., and Smith, J. (eds.), Toward A General Theory of Expertise: Prospects and Limits, Cambridge University Press, New York, pp. 1–38.
Feurzig, W., and Ritter, F. (1988). Understanding reflective problem solving. In Pstoka, J., Massey, L. D., and Mutter, S. A. (eds.), Intelligent Tutoring Systems: Lessons Learned, Lawrence Erlbaum Associates, Hillsdale, NJ, pp. 435–450.
Flesher, J. W. (1993). An exploration of technical troubleshooting expertise in design, manufacturing, and repair contexts. J. Ind. Teach. Educ. 31(1): 34–56.
Frederiksen, N. (1984). Implications of cognitive theory for instruction in problem solving. Rev. Educ. Res. 54(3): 363–407.
Frederiksen, J. R., and White, B. Y. (1988). Implicit testing within an intelligent tutoring system. Mach.-Mediat. Learn. 2: 351–372.
Frederiksen, J. R., and White, B. Y. (1993). The avionics job-family tutor: An approach to developing generic cognitive skills within a job-situated context. In Artificial Intelligence in Education: Proceedings of AI-ED 93, World Conference on Artificial Intelligence in Education (pp. 513–520), Edinburgh, Scotland.
Gaba, D. (1991). Dynamic decision making in anesthesiology: Cognitive models and training approaches. In Evans, D. A., and Patel, V. (eds.), Advance Models of Cognition for Medical Training and Practice, Springer-Verlag, Heidelburg FRG, pp. 123–147.
Gitomer, D. H. (1988). Individual differences in troubleshooting. Hum. Perform. 1(2): 111–131.
Gitomer, D. H., Steinberg, L. S., and Mislevy, R. J. (1995). Diagnostic assessment of a troubleshooting skill in an intelligent tutoring system. In Nichols, P. D., Chipman, S. F., and Brennan, R. L. (eds.), Cognitively Diagnostic Assessment, Lawrence Erlbaum Associates, Hillsdale, NJ.
Gott, S. P., Hall, E. P., Pokorny, R. A., Dibble, E., and Glaser, R. (1993). A naturalistic study of transfer: Adaptive expertise in technical domains. In Detterman, D., and Sternberg, R. (eds.), Transfer on Trial: Intelligence, Cognition, and Instruction, Ablex Publishing, Westport, CT, pp. 258–288.
Hall, E. P., Gott, S. P., and Pokorny, R. A. (1995). A procedural guide to cognitive task analysis: The PARI methodology (Tech. Report AL/HR-TR-1995–0108). Brooks Air Force Base, TX: Human Resources Directorate.
Hegarty, M. (1991). Knowledge and processes in mechanical problem solving. In Sternberg, R. J., and Frensch, P. A. (eds.), Complex Problem Solving: Principles and Mechanisms, Lawrence Erlbaum Associates, Hillsdale, NJ, pp. 253–185.
Heller, L. C. (1982). An exploration of the effect of structure variables on mathematical word problem-solving achievement (Doctoral dissertation, Rutgers University, 1982). Dissert. Abstr. Int. 44: 416.
Henning, P. H. (1996). A Qualitative Study of Situated Learning by Refrigeration Service Technicians Working for a Supermarket Chain in Northeastern Pennsylvania. Unpublished Ph.D. dissertation, The Pennsylvania State University, Pennsylvania.
Hernandez-Serrano, J., and Jonassen, D. H. (2003). The effects of case libraries on problem solving. J. Comput.-Assist. Learn. 19.
Hoc, J. M., and Carlier, X. (2000). A method to describe human diagnostic strategies in relation to the design of human-machine cooperation. Int. J. Cogn. Ergon. 4(4): 297–309.
Hung, W., and Jonassen, D. H. (2006). Conceptual understanding of causal reasoning in physics. International Journal of Science Education 28(5): 1–21.
Johnson, S. D. (1988). Cognitive analysis of expert and novice troubleshooting performance. Perform. Improv. Q. 1(3): 38–54.
Johnson, S. D. (1989). A description of experts and novice performance differences on technical troubleshooting tasks. J. Ind. Teach. Educ. 26: 19–37.
Johnson, S. D. (1991). Training technical troubleshooters. Tech. Skills Train. 27(7): 9–16.
Johnson, S. D., Flesher, J. W., and Chung, S.-P. (1995, December). Understanding troubleshooting styles to improve training methods. Paper presented at the Annual Meeting of the American Vocational Association, Denver, CO. (ERIC Document Reproduction Service No. ED 389 948).
Johnson, S. D., Flesher, J. W., Jehng, J. C., and Ferej, A. (1993). Enhancing electrical troubleshooting skills in a computer-coached practice environment. Interact. Learn. Environ. 3(3): 199–214.
Johnson, S. D., and Satchwell, R. E. (1993). The effect of functional flow diagrams on apprentice aircraft mechanics’ technical system understanding. Perform. Improv. Q. 6(4): 73–91.
Johnson, W. B., and Norton, J. E. (1992). Modeling student performance in diagnostic tasks: A decade of evolution. In Regian, J. W., and Shute, V. J. (eds.), Cognitive Approaches to Automated Instruction, Lawrence Erlbaum Associates, Hillsdale, NJ, pp. 195–216.
Johnson, W. B., and Rouse, W. B. (2001). Training maintenance technicians for troubleshooting: Two experiments with computer simulations. In Sweezy, R. W., and Andrews, D. H. (eds.), Readings in Training and Simulation: A 30-Year Perspective, Human Factors Society, Santa Monica, CA.
Jonassen, D. H. (2000). Toward a design theory of problem solving. Educ. Technol. Res. Dev. 48(4): 63–85.
Jonassen, D. H., and Henning, P. (1999). Mental models: Knowledge in the head and knowledge in the world. Educ. Technol. 39(3): 37–42.
Jonassen, D. H., and Hernandez-Serrano, J. (2002). Case-based reasoning and instructional design: Using stories to support problem solving. Educ. Technol. Res. Dev. 50(2): 65–77.
Jonassen, D. H., Mann, E., and Ambruso, D. J. (1996). Causal modeling for structuring case-based learning environments. Intell. Tutor. Media 6(3/4): 103–112.
Kelley, H. H. (1973). The process of causal attribution. Am. Psychol. 28: 107–128.
Kieras, D. E., and Bovair, S. (1984). The role of a mental model in learning to operate a device. Cogn. Sci. 8: 255–273.
Kolodner, J. (1993). Case-Based Reasoning, Morgan Kaufman, New York.
Konradt, U. (1995). Strategies of failure diagnosis in computer-controlled manufacturing systems. Int. J. Hum.-Comput. Stud. 43: 503–521.
Kurland, L. C., Granville, R. A., and MacLaughlin, D. B. (1992). Design, development, and implementation of an intelligent tutoring system for training radar mechanics to troubleshoot. In Intelligent Instruction by Computer: Theory and Practice, Taylor & Francis, Washington, DC.
Kyllonen, P. C., and Shute, V. J. (1989). A taxonomy of learning skills. In Ackerman, P. L., Sternberg, R. J., and Glaser, R. (eds.), Learning and Individual Differences, Lawrence Erlbaum Associates, Hillsdale, NJ.
Lajoie, S. P., and Lesgold, A. M. (1992a). Dynamic assessment of proficiency for solving procedural knowledge tasks. Educ. Psychol. 27(3): 365–384.
Lajoie, S. P., and Lesgold, A. (1992b). Apprenticeship training in the workplace: Computer-coached practice environment as a new form of apprenticeship. In Farr, M. J., and Psotka, J. (eds.), Intelligent Instruction in Computer: Theory and Practice, Taylor & Francis, Washington, DC.
Larkin, J., McDermott, J., Simon, D. P., and Simon, H. A. (1980). Expert and novice performance in solving physics problems. Science 208: 1335–1342.
Lesgold, A., and Lajoie, S. (1991). Complex problem solving in electronics. In Sternberg, R. J., and Frensch, P. A. (eds.), Complex Problem Solving: Principles and Mechanisms, Lawrence Erlbaum Associates, Hillsdale, NJ.
McGuinness, C. (1986). Problem representation: The effects of spatial arrays. Memory Cogn. 14(3): 270–280.
MacPherson, R. T. (1998). Factors affecting technological trouble shooting skills. J. Ind. Teach. Educ. 35(4): 5–28.
Mayer, R. E., and Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. Educ. Psychol. 38(1): 43–52.
Means, B., and Gott, S. P. (1988). Cognitive task analysis as a basis for tutor development: Articulating abstract knowledge representation. In Psotka, J., Massey, L. D., and Mutter, S. A. (eds.), Intelligent Tutoring Systems: Lessons Learned, Lawrence Erlbaum Associates, Hillsdale, NJ, pp. 35–57.
Moran, A. P. (1986). Field independence and proficiency in electrical fault diagnosis. IEEE Trans. Syst. Man Cybern. SMC-16(1): 162–165.
Morris, N. M., and Rouse, W. B. (1985). Review and evaluation of empirical research in troubleshooting. Hum. Factors 27(5): 503–530.
Mwangi, W., and Sweller, J. (1998). Learning to solve compare word problems: The effect of example format and generating self-explanations. Cognit. Instr. 16: 173–199.
Newell, A., and Simon, H. A. (1972). Human Problem Solving, Printice-Hall, Englewood Cliffs, NJ.
Paas, F., Renkl, A., and Sweller, J. (2003). Cognitive load theory and instructional design: Recent developments. Educ. Psychol. 38(1): 1–4.
Park, O. K., and Gittelman, S. S. (1992). Selective use of animation and feedback in computer-based instruction. Educ. Technol. Res. Dev. 40(4): 27–38.
Patrick, J. (1993). Cognitive aspects of fault-finding training and transfer. Le Travail Humain 56(2/3): 187–209.
Patrick, J., and Haines, B. (1988). Training and transfer of fault-finding skill. Ergonomics 31(2): 193–210.
Perez, R. S. (1991). A view from troubleshooting. In Smith, M. U. (ed.), Toward a Unified Theory of Problem Solving, Lawrence Erlbaum Associates, Hillsdale, NJ.
Perkins, D. N., and Grotzer, T. A. (2000, April). Models and Moves: Focusing on Dimensions of Causal Complexity to Achieve Deeper Scientific Understanding. Paper presented at the American Educational Research Association Annual Conference, New Orleans, LA.
Pokorny, R. A., Hall, E. P., Gallaway, M. A., and Dibble, E. (1996). Analyzing components of work samples to evaluate performance. Mil. Psychol. 8(3): 161–177.
Prochaska, J. O., DiClemente, C. C., and Norcross, J. C. (1992). In search of how people change: Applications to addictive behaviors. Am. Psychol. 47(9): 1102–1114.
Rasmussen, J. (1984a). Strategies for state identification and diagnosis in supervisory control tasks, and design of computer-based support systems. In Rouse, W. B. (ed.), Adv. Man-Mach. Syst. Res., 1: 139–193.
Rasmussen, J. (1984b). Information Processing and Human-Machine Interaction: An Approach to Cognitive Engineering, North-Holland, Amsterdam.
Reimann, P., and Chi, M. T. H. (1989). Human expertise. In Gilhooly, K. J. (ed.), Human and Machine Problem Solving, Plenum, New York, pp. 161–191.
Renkl, A., and Atkinson, R. K. (2003). Structuring the transition from example study to problem solving in cognitive skill acquisition: A cognitive load perspective. Educ. Psychol. 38(1): 15–22.
Ronning, McCurdy, and Ballinger (1984, January). Individual differences: A third component in problem-solving instruction. J. Res. Sci. Teach. 21(1): 71–82.
Rouse, W. B., Pellegrino, S. J., and Rouse, S. H. (1980). A rule-based model of human problem solving performance in fault diagnosis tasks. IEEE Transactions on Systems Man, and Cybernetics, SMC-10, 366–376.
Rowe, A. L., and Cooke, N. J. (1995). Measuring mental models: Choosing the right tool for the job. Hum. Resour. Dev. Q. 6(3): 243–262.
Rowe, A. L., Cooke, N. J., Hall, E. P., and Halgren, T. L. (1996). Toward an on-line knowledge assessment methodology: Building on the relationship between knowing and doing. J. Exp. Psychol. Appl. 2(1): 31–47.
Schaafstal, A., and Schraagen, J. M. (1993). The acquisition of troubleshooting skill implication for tools for learning. In Brouwer-Janse, M. D., and Harrington, T. L. (eds.), Human-Machine Communication for Educational Systems Design, Springer-Verlag, New York, pp. 107–118.
Schaafstal, A., and Schraagen, J. M. (2000). Training of troubleshooting: A structured, task analytical approach. In Schraagen, J. M., Chipman, S. F., and Shalin, V. L. (eds.), Cognitive Task Analysis, Lawrence Erlbaum Associates, Mahwah, NJ, pp. 57–70.
Schaafstal, A., Schraagen, J. M., and van Berlo, M. (2000). Cognitive task analysis and innovation of training: The case of structured troubleshooting. Hum. Factors 42(1): 75–86.
Schank, R. C. (1990). Tell Me a Story: Narrative and Intelligence, Northwestern University Press, Evanston, IL.
Schmidt, H. G., and Boshuizen, H. G. A. (1993). On acquiring expertise in medicine. Educ. Psychol. Rev. 5(3): 205–221.
Schön, D. A. (1993). The Reflective Practitioner—How Professionals Think in Action, Basic Books, New York.
Sembugmorthy, V., and Chandrasekeran, B. (1986). Functional representations of devices and compilation of diagnostic problem-solving systems. In Kolodner, J., and Riesbeck, C. K. (eds.), Experience, Memory, and Reasoning, Lawrence Erlbaum Associates, Hillsdale, NJ, pp. 47–53.
Sweller, J., and Cooper, G. A. (1985). The use of worked examples as a substitute for problem solving in learning algebra. Cognit. Instr. 2: 59–89.
Swezey, R. W., Perez, R., and Allen, J. (1988). Effects of instructional delivery system and training parameter manipulations on electromechanical performance. Hum. Factors 30(6): 751–762.
Thagard, P. (2000). Coherence in Thought and Action, MIT Press, Cambridge, MA.
Tarmizi, R. A., and Sweller, J. (1988). Guidance during mathematical problem solving. J. Educ. Psychol. 80: 424–436.
Tenney, Y. J., and Kurland, L. C. (1988). The development of troubleshooting expertise in radar mechanics. In Psotka, J., Massey, L. D., and Mutter, S. A. (eds.), Intelligent Tutoring Systems: Lessons Learned, Lawrence Erlbaum Associates, Hillsdale, NJ, pp. 59–83.
Tversky, B., Franklin, N., Taylor, H. A., and Bryant, D. J. (1994). Spatial mental models from descriptions. J. Am. Soc. Inf. Sci. 45(9): 656–669.
Van Merrienboer, J. J. G., Kirschner, P. A., and Kester, L. (2003). Taking the load off a learner's mental mind: Instructional design for complex learning. Educ. Psychol. 38(1): 5–13.
Ward, M., and Sweller, J. (1990). Structuring effective worked examples. Cognition and Instruction, 7(1): 1–39.
Zeitz, C. M., and Spoehr, K. T. (1989). Knowledge organization and the acquisition of procedural expertise. Appl. Cogn. Psychol. 3: 313–336.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Jonassen, D.H., Hung, W. Learning to Troubleshoot: A New Theory-Based Design Architecture. Educ Psychol Rev 18, 77–114 (2006). https://doi.org/10.1007/s10648-006-9001-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10648-006-9001-8