Skip to main content
Top
Published in: Technology, Knowledge and Learning 2/2019

30-09-2017 | Original research

Overcoming the PBL Assessment Challenge: Design and Development of the Incremental Thesaurus for Assessing Causal Maps (ITACM)

Authors: Philippe J. Giabbanelli, Andrew A. Tawfik

Published in: Technology, Knowledge and Learning | Issue 2/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Because of the lack of tools available to assess problem-solving skills, teachers often revert to more traditional instructional approaches (e.g. lecture-based, memorization) that fail to prepare learners for the complexity of dynamic work environments. To overcome this challenge, technology solutions are needed that accurately and efficiently assess complex problem-solving skills such as causal reasoning. Moreover, these tools must be valid and reliable so instructors can accurately assess student learning. This emergent report details the design and development of Incremental Thesaurus for Assessing Causal Maps. As will be described, the software offers three unique features: (a) analysis of causal map with little or no manipulation of the original file; (b) a growing repository of terms that supports efficient assessment and (c) ability to codify the level of concept complexity using the structure–behavior–function framework.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Bastien, M., Heymann, S., & Jacomy, M. (2009) Gephi: An open source software for exploring and manipulating networks. In Proceedings of the international AAAI conference on weblogs and social media. Bastien, M., Heymann, S., & Jacomy, M. (2009) Gephi: An open source software for exploring and manipulating networks. In Proceedings of the international AAAI conference on weblogs and social media.
go back to reference Baur, M., & Benkert, M. (2005). Network comparison. In U. Brandes & T. Erlebach (Eds.), Network analysis (pp. 318–340). Berlin: Springer.CrossRef Baur, M., & Benkert, M. (2005). Network comparison. In U. Brandes & T. Erlebach (Eds.), Network analysis (pp. 318–340). Berlin: Springer.CrossRef
go back to reference Brown, J. S., Collins, A., & Duguid, P. (1989). Situated cognition and the culture of learning. Educational Researcher, 18(1), 32–42.CrossRef Brown, J. S., Collins, A., & Duguid, P. (1989). Situated cognition and the culture of learning. Educational Researcher, 18(1), 32–42.CrossRef
go back to reference Chi, M., Feltovich, P., & Glaser, R. (1981). Categorization and representation of physics problems by experts and novices. Cognitive Science, 5(2), 121–152.CrossRef Chi, M., Feltovich, P., & Glaser, R. (1981). Categorization and representation of physics problems by experts and novices. Cognitive Science, 5(2), 121–152.CrossRef
go back to reference Dickinson, P. J., Bunke, H., Dadej, A., & Kraetzl, M. (2003). On graphs with unique node labels. In E. Hancock & M. Vento (Eds.), Graph based representations in pattern recognition (pp. 13–23). Berlin: Springer.CrossRef Dickinson, P. J., Bunke, H., Dadej, A., & Kraetzl, M. (2003). On graphs with unique node labels. In E. Hancock & M. Vento (Eds.), Graph based representations in pattern recognition (pp. 13–23). Berlin: Springer.CrossRef
go back to reference Ertmer, P. (1999). Addressing first- and second-order barriers to change: Strategies for technology integration. Educational Technology Research and Development, 47(4), 47–61.CrossRef Ertmer, P. (1999). Addressing first- and second-order barriers to change: Strategies for technology integration. Educational Technology Research and Development, 47(4), 47–61.CrossRef
go back to reference Ertmer, P., & Ottenbreit-Leftwich, A. (2013). Removing obstacles to the pedagogical changes required by Jonassen’s vision of authentic technology-enabled learning. Computers & Education, 64, 175–182.CrossRef Ertmer, P., & Ottenbreit-Leftwich, A. (2013). Removing obstacles to the pedagogical changes required by Jonassen’s vision of authentic technology-enabled learning. Computers & Education, 64, 175–182.CrossRef
go back to reference Eseryel, D., Ifenthaler, D., & Ge, X. (2013). Validation study of a method for assessing complex ill-structured problem solving by using causal representations. Educational Technology Research and Development, 61(3), 443–463.CrossRef Eseryel, D., Ifenthaler, D., & Ge, X. (2013). Validation study of a method for assessing complex ill-structured problem solving by using causal representations. Educational Technology Research and Development, 61(3), 443–463.CrossRef
go back to reference Feltovich, P. J., Spiro, R. J., & Coulson, R. L. (1997). Issues of expert flexibility in contexts characterized by complexity and change. In P. Feltovich, K. Fork, & R. Hoffman (Eds.), Expertise in context: Human and machine (pp. 125–146). Cambridge, MA: MIT Press. Feltovich, P. J., Spiro, R. J., & Coulson, R. L. (1997). Issues of expert flexibility in contexts characterized by complexity and change. In P. Feltovich, K. Fork, & R. Hoffman (Eds.), Expertise in context: Human and machine (pp. 125–146). Cambridge, MA: MIT Press.
go back to reference Giabbanelli, P. J., & Baniukiewicz, M. (2018). Navigating complex systems for policymaking using simple software tools. In V. Mago, P. J. Giabbanelli, & E. Papageorgiou (Eds.), Advanced data analytics in health. New York, NY: Springer.CrossRef Giabbanelli, P. J., & Baniukiewicz, M. (2018). Navigating complex systems for policymaking using simple software tools. In V. Mago, P. J. Giabbanelli, & E. Papageorgiou (Eds.), Advanced data analytics in health. New York, NY: Springer.CrossRef
go back to reference Hmelo-Silver, C. E., Marathe, S., & Liu, L. (2007). Fish swim, rocks sit, and lungs breathe: Expert-novice understanding of complex systems. Journal of the Learning Sciences, 16(3), 307–331.CrossRef Hmelo-Silver, C. E., Marathe, S., & Liu, L. (2007). Fish swim, rocks sit, and lungs breathe: Expert-novice understanding of complex systems. Journal of the Learning Sciences, 16(3), 307–331.CrossRef
go back to reference Hmelo-Silver, C. E., Nagarajan, A., & Day, R. S. (2002). “It’s harder than we thought it would be”: A comparative case study of expert–novice experimentation strategies. Science Education, 86(2), 219–243.CrossRef Hmelo-Silver, C. E., Nagarajan, A., & Day, R. S. (2002). “It’s harder than we thought it would be”: A comparative case study of expert–novice experimentation strategies. Science Education, 86(2), 219–243.CrossRef
go back to reference Hmelo-Silver, C. E., & Pfeffer, M. G. (2004). Comparing expert and novice understanding of a complex system from the perspective of structures, behaviors, and functions. Cognitive Science, 28(1), 127–138.CrossRef Hmelo-Silver, C. E., & Pfeffer, M. G. (2004). Comparing expert and novice understanding of a complex system from the perspective of structures, behaviors, and functions. Cognitive Science, 28(1), 127–138.CrossRef
go back to reference Hung, W. (2011). Theory to reality: A few issues in implementing problem-based learning. Educational Technology Research and Development, 59(4), 529–552.CrossRef Hung, W. (2011). Theory to reality: A few issues in implementing problem-based learning. Educational Technology Research and Development, 59(4), 529–552.CrossRef
go back to reference Hung, W. (2016). All PBL starts here: The problem. Interdisciplinary Journal of Problem-Based Learning, 10(2), 2.CrossRef Hung, W. (2016). All PBL starts here: The problem. Interdisciplinary Journal of Problem-Based Learning, 10(2), 2.CrossRef
go back to reference Ifenthaler, D., & Eseryel, D. (2013). Facilitating complex learning by mobile augmented reality learning environments. In R. Huang, Kinshuk, & J. M. Spector (Eds.), Reshaping learning (pp. 415–438). Berlin: Springer.CrossRef Ifenthaler, D., & Eseryel, D. (2013). Facilitating complex learning by mobile augmented reality learning environments. In R. Huang, Kinshuk, & J. M. Spector (Eds.), Reshaping learning (pp. 415–438). Berlin: Springer.CrossRef
go back to reference Ifenthaler, D., & Pirnay-Dummer, P. (2014). Model-based tools for knowledge assessment. In J. M. Spector, M. D. Merrill, J. Elen, & M. J. Bishop (Eds.), Handbook of research on educational communications and technology (4th ed., pp. 289–301). New York, NY: Springer.CrossRef Ifenthaler, D., & Pirnay-Dummer, P. (2014). Model-based tools for knowledge assessment. In J. M. Spector, M. D. Merrill, J. Elen, & M. J. Bishop (Eds.), Handbook of research on educational communications and technology (4th ed., pp. 289–301). New York, NY: Springer.CrossRef
go back to reference Jacobson, M. J. (2001). Problem solving, cognition, and complex systems: Differences between experts and novices. Complexity, 6(3), 41–49.CrossRef Jacobson, M. J. (2001). Problem solving, cognition, and complex systems: Differences between experts and novices. Complexity, 6(3), 41–49.CrossRef
go back to reference Jeong, A., & Lee, W. J. (2012). Developing causal understanding with causal maps: The impact of total links, temporal flow, and lateral position of outcome nodes. Educational Technology Research and Development, 60(2), 325–340.CrossRef Jeong, A., & Lee, W. J. (2012). Developing causal understanding with causal maps: The impact of total links, temporal flow, and lateral position of outcome nodes. Educational Technology Research and Development, 60(2), 325–340.CrossRef
go back to reference Jonassen, D. H. (2000). Toward a design theory of problem solving. Educational Technology, Research and Development, 48(4), 63–85.CrossRef Jonassen, D. H. (2000). Toward a design theory of problem solving. Educational Technology, Research and Development, 48(4), 63–85.CrossRef
go back to reference Jonassen, D. H. (2011). Learning to solve problems: A handbook for designing problem-solving learning environments (1st ed.). London: Routledge. Jonassen, D. H. (2011). Learning to solve problems: A handbook for designing problem-solving learning environments (1st ed.). London: Routledge.
go back to reference Jonassen, D. H., & Hung, W. (2006). Learning to troubleshoot: A new theory-based design architecture. Educational Psychology Review, 18(1), 77–114.CrossRef Jonassen, D. H., & Hung, W. (2006). Learning to troubleshoot: A new theory-based design architecture. Educational Psychology Review, 18(1), 77–114.CrossRef
go back to reference Kolodner, J. (1991). Improving human decision making through case-based decision aiding. AI Magazine, 12(2), 52–68. Kolodner, J. (1991). Improving human decision making through case-based decision aiding. AI Magazine, 12(2), 52–68.
go back to reference Kolodner, J., Hmelo-Silver, C., & Narayanan, N. H. (1996). Problem-based learning meets case-based reasoning. In Proceedings of the 1996 international conference on learning sciences (pp. 188–195). Evanston, Illinois: International Society of the Learning Sciences. Kolodner, J., Hmelo-Silver, C., & Narayanan, N. H. (1996). Problem-based learning meets case-based reasoning. In Proceedings of the 1996 international conference on learning sciences (pp. 188–195). Evanston, Illinois: International Society of the Learning Sciences.
go back to reference Moon, B., Hoffman, R. R., Novak, J., & Canas, A. (2011). Applied concept mapping. Boca Raton: CRC Press. Moon, B., Hoffman, R. R., Novak, J., & Canas, A. (2011). Applied concept mapping. Boca Raton: CRC Press.
go back to reference Savin-Baden, M. (2004). Understanding the impact of assessment on students in problem-based learning. Innovations in Education and Teaching International, 41(2), 221–233.CrossRef Savin-Baden, M. (2004). Understanding the impact of assessment on students in problem-based learning. Innovations in Education and Teaching International, 41(2), 221–233.CrossRef
go back to reference Senocak, E. (2009). Development of an instrument for assessing undergraduate science students’ perceptions: The problem-based learning environment inventory. Journal of Science Education and Technology, 18(6), 560–569.CrossRef Senocak, E. (2009). Development of an instrument for assessing undergraduate science students’ perceptions: The problem-based learning environment inventory. Journal of Science Education and Technology, 18(6), 560–569.CrossRef
Metadata
Title
Overcoming the PBL Assessment Challenge: Design and Development of the Incremental Thesaurus for Assessing Causal Maps (ITACM)
Authors
Philippe J. Giabbanelli
Andrew A. Tawfik
Publication date
30-09-2017
Publisher
Springer Netherlands
Published in
Technology, Knowledge and Learning / Issue 2/2019
Print ISSN: 2211-1662
Electronic ISSN: 2211-1670
DOI
https://doi.org/10.1007/s10758-017-9338-8

Other articles of this Issue 2/2019

Technology, Knowledge and Learning 2/2019 Go to the issue

Premium Partners