Abstract
The study of how individuals organize knowledge has been a popular endeavor for several decades. As a result, techniques have been developed to assess how individuals represent and organize knowledge internally. Although several conceptual knowledge elicitation methods have been developed and used to assess the organization of knowledge, their use is often labor intensive and time consuming. Presented here is a software tool that was developed to reduce the problems associated with manually administering the conceptual knowledge elicitation technique, or card sorting. The TPL—KATS-card sort software not only simplifies the administration of the task, but also adds features to the card-sorting task such as media insertion, time stamping, and instructorless administration. In the present article, an introduction to the card-sorting technique is provided, the new software tool is described, and the advantages of the software are detailed.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Beissner, K. L. (1992). Use of concept mapping to improve problem solving.Journal of Physical Therapy Education,6, 22–27.
Cheatham, D. B., &Lane, S. (2002). Differential access hypothesis: The effects of task and information type on the validity of knowledge acquisition methods. InProceedings of the Forty-Sixth Meeting of the Human Factors & Ergonomic Society (pp. 487–491). Baltimore, MD: Human Factors and Ergonomics Society.
Chi, M. T., Hutchinson, J. E., &Robin, A. F. (1989). How inferences about novel domain-related concepts can be constrained by structural knowledge.Merrill—Palmer Quarterly,35, 27–62.
Chi, M.T., &Koeske, R. D. (1983). Network representation of a child’s dinosaur knowledge.Developmental Psychology,19, 29–39.
Cooke, N. J. (1999). Knowledge elicitation. In F. T. Durso (Ed.),Applied cognition (pp. 479–509). Chichester, U.K.: Wiley.
Cuevas, H. M., Fiore, S. M., &Oser, R. L. (2002). Scaffolding cognitive and metacognitive processes: Use of diagrams in computer-based training environments.Instructional Science,30, 433–464.
Diekhoff, G. M., &Diekhoff, K. B. (1982). Cognitive maps as a tool in communicating structural knowledge.Educational Technology,22, 28–30.
Evans, A. W., III, Hitt, J. M., II, & Jentsch, F. (2001, March).Mental model reliability. Poster presented at the APA Division 21 and 19 Mid-year Meeting, Crystal City, VA.
Evans, A. W., III,Hoeft, R., Jentsch, F., &Bowers, C. (2001). Can a picture say a thousand words? Comparisons of structural organization vs. pictorial information. InProceedings of the Forty-Sixth Annual Meeting of the Human Factors and Ergonomic Society (pp. 240–244). Baltimore, MD: Human Factors and Ergonomics Society.
Fiore, S. M., Cuevas, H. M., &Oser, R. L. (2003). A picture is worth a thousand connections: The facilitative effects of diagrams on task performance and mental model development.Computers in Human Behavior,19, 185–199.
Fiore, S. M., Cuevas, H. M., Scielzo, S., &Salas, E. (2002). Training individuals for distributed teams: Problem solving assessment for distributed mission research.Computers in Human Behavior,18, 125–140.
Fiore, S. M., Fowlkes, J., Martin-Milham, L., &Oser, R. L. (2000). Convergence or divergence of expert models: On the utility of knowledge structure assessment in training research. InProceedings of the Forty-Fourth Annual Meeting of the Human Factors and Ergonomics Society (pp. 427–430). Santa Monica, CA: Human Factors and Ergonomics Society.
Geeslin, W. E., &Shavelson, R. J. (1975). Comparison of content structure and cognitive structure in high school students’ learning of probability.Journal of Research in Mathematics Education,6, 109–120.
Goldstein, I. L. (1993).Training in organization (3rd ed.). Pacific Grove, CA: Brooks/Cole.
Harper, M. E., Jentsch, F., Rhodenizer-VanDuyne, L. G., &Sanchez, K. A. (2002). Computerized card sort training tool: Is it comparable to manual card sorting? InProceedings of the Forty-Seventh Annual Meeting of the Human Factors and Ergonomic Society (pp. 2049–2053). Baltimore, MD: Human Factors and Ergonomics Society.
Job, R., Rumiati, R., &Lotto, L. (1992). The picture superiority effect in categorization: Visual or semantic?Journal of Experimental Psychology: Learning, Memory, & Cognition,18, 1019–1028.
Jonassen, D. H., Beissner, K., &Yacci, M. (1993).Structural knowledge: Techniques for representing, conveying, and acquiring structural knowledge. Hillsdale, NJ: Erlbaum.
Maiden, N. A. M., &Hare, M. (1998). Problem domain categories in requirements engineering.International Journal of Human—Computer Studies,49, 281–304.
Miller, G. A. (1969). A psychological method to investigate verbal concepts.Journal of Mathematical Psychology,6, 169–191.
Niessen, C., Eyferth, K., &Bierwagen, T. (1999). Modeling cognitive processes of experienced air traffic controllers.Ergonomics,42, 1507–1520.
Preece, P. F. W. (1976). Mapping cognitive structure: A comparison of methods.Journal of Educational Psychology,68, 1–8.
Quilici, J. H., &Mayer, R. E. (2002). Teaching students to recognize structural similarities between statistics word problems.Applied Cognitive Psychology,16, 325–342.
Quillian, M. R. (1968). Semantic memory. In M. Minsky (Ed.),Semantic information processing (pp. 216–260). Cambridge, MA: MIT Press.
Rao, V. R., &Katz, R. (1971). Alternative multidimensional scaling methods for large stimulus sets.Journal of Marketing Research,8, 488–494.
Rumelhart, D. E. (1978). Schemata: The building blocks of cognition. In R. J. Spiro, B. C. Bruce, & W. F. Brewer (Eds.),Theoretical issues in reading comprehension: Perspectives from cognitive psychology, linguistics, artificial intelligence, and education (pp. 45–95). Hills-dale, NJ: Erlbaum.
Rumelhart, D. E., &Ortony, A. (1982). The representation of knowledge in memory.Infanciay Aprendizaje,19-20, 115–158.
Satchwell, R. E. (1997). Using functional flow diagrams to enhance technical systems understanding.Journal of Industrial Teacher Education,34, 50–81.
Schvaneveldt, R. W. (1990).Pathfinder associative networks: Studies in knowledge organization. Norwood, NJ: Ablex.
Smith-Jentsch, K. A., Campbell, G. E., Milanovich, D. M., &Reynolds, A. M. (2001). Measuring teamwork mental models to support training needs assessment, development, and evaluation: Two empirical studies.Journal of Organizational Behavior,22, 179–194.
Stephenson, W. (1953).The study of behavior. Chicago: University of Chicago Press.
Tessmer, M., Perrin, B., &Bennett, W. (1998). Assessing the stability of structural learning measures.Training Research Journal,4, 57–77.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was funded by Grant 99-G-047 from the Federal Aviation Administration (FAA), Office of the Chief Scientific and Technical Advisor for Human Factors, AAR-100, to the University of Central Florida, Partnership for Aviation Team Training Research. The opinions expressed in this article are those of the authors and do not necessarily represent the position of the University of Central Florida or the FAA.
Rights and permissions
About this article
Cite this article
Harper, M.E., Jentsch, F.G., Berry, D. et al. TPL—KATS-card sort: A tool for assessing structural knowledge. Behavior Research Methods, Instruments, & Computers 35, 577–584 (2003). https://doi.org/10.3758/BF03195536
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03195536