Skip to main content
Erschienen in: International Journal of Technology and Design Education 4/2015

01.11.2015

Concurrent think-aloud protocols to assess elementary design students

verfasst von: Todd R. Kelley, Brenda M. Capobianco, Kevin J. Kaluf

Erschienen in: International Journal of Technology and Design Education | Ausgabe 4/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Initiatives to integrate engineering design in the elementary science classroom have become increasingly evident in both national reform documents and classroom practice. Missing from these efforts is a purposeful attempt to capture students’ designerly thinking and dialogues as they engage in the process. The purpose of this study was to investigate how elementary school students approach and engage in engineering design using concurrent think-aloud protocols. Data from seven concurrent think-aloud protocols among triads of elementary students across seven classrooms were analyzed to identify how students conceptualize design. Researchers employed a transfer problem and think-aloud protocol analysis to assess students’ transfer of learning from classroom science based engineering design-based experiences. Results indicate that elementary student triad design teams were able to define a design problem, identify constraints and criteria, and generate multiple design ideas to solve the problem. Protocol timelines were generated using NVivo software to capture sequence of the triads’ coded cognitive strategies crucial in understanding which triads used a systematic approach to solving the problem from triads that randomly brainstormed ideas. If design is to become a pedagogical approach to teaching science or other STEM-related subjects, attention must be given to how students learn design and function within design. Concurrent think-aloud protocol provides a promising means of assessment of such efforts.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
Zurück zum Zitat Adams, R. S., Turns, J., & Atman, C. J. (2003). Educating effective engineering designers: The role of the reflective practice. Design Studies, 24(3), 275–294.CrossRef Adams, R. S., Turns, J., & Atman, C. J. (2003). Educating effective engineering designers: The role of the reflective practice. Design Studies, 24(3), 275–294.CrossRef
Zurück zum Zitat Atman, C. J., & Bursic, K. M. (1998). Verbal protocol analysis as a method to document engineering student design processes. Journal of Engineering Education, 87(2), 121–132.CrossRef Atman, C. J., & Bursic, K. M. (1998). Verbal protocol analysis as a method to document engineering student design processes. Journal of Engineering Education, 87(2), 121–132.CrossRef
Zurück zum Zitat Ball, L. J., Ormerod, T. C., & Morley, N. J. (2004). Spontaneous analogising in engineering design: A comparative analysis of experts and novices. Design Studies, 25(5), 495–508.CrossRef Ball, L. J., Ormerod, T. C., & Morley, N. J. (2004). Spontaneous analogising in engineering design: A comparative analysis of experts and novices. Design Studies, 25(5), 495–508.CrossRef
Zurück zum Zitat Bransford, J. D., Brown, A. L., & Cocking, R. R. (Eds.). (1999). How people learn: Brain, mind, experience and school. Washington, DC: National Academy Press. Bransford, J. D., Brown, A. L., & Cocking, R. R. (Eds.). (1999). How people learn: Brain, mind, experience and school. Washington, DC: National Academy Press.
Zurück zum Zitat Bransford, J. D., & Schwartz, D. L. (1999). Rethinking transfer: A simple proposal with multiple implications. In A. Iran-Nejad & P. D. Pearson (Eds.), Review of research in education (Vol. 24, pp. 61–100). Washington, DC: American Educational Research Association. Bransford, J. D., & Schwartz, D. L. (1999). Rethinking transfer: A simple proposal with multiple implications. In A. Iran-Nejad & P. D. Pearson (Eds.), Review of research in education (Vol. 24, pp. 61–100). Washington, DC: American Educational Research Association.
Zurück zum Zitat Brown, A. L. (1978). Knowing when, where, and how to remember: A problem of metacognition. In R. Glaser (Ed.), Advances in instructional psychology (Vol. 1, pp. 77–165). Hillsdale: Erlbaum. Brown, A. L. (1978). Knowing when, where, and how to remember: A problem of metacognition. In R. Glaser (Ed.), Advances in instructional psychology (Vol. 1, pp. 77–165). Hillsdale: Erlbaum.
Zurück zum Zitat Cooke, L. (2010). Assessing concurrent think-aloud protocol as a usable test method: a technical communication approach. IEEE Transactions on Professional Communication, 53(3), 202–215.CrossRef Cooke, L. (2010). Assessing concurrent think-aloud protocol as a usable test method: a technical communication approach. IEEE Transactions on Professional Communication, 53(3), 202–215.CrossRef
Zurück zum Zitat Cross, N. (1994). Engineering design methods, strategies for product design (2nd ed.). Chichester: Wiley. Cross, N. (1994). Engineering design methods, strategies for product design (2nd ed.). Chichester: Wiley.
Zurück zum Zitat Cross, N., & Cross, C. A. (1996). Winning by design: The methods of Gordon Murray, race car designer. Design Studies, 17(1), 91–107. Cross, N., & Cross, C. A. (1996). Winning by design: The methods of Gordon Murray, race car designer. Design Studies, 17(1), 91–107.
Zurück zum Zitat Cross, N., & Cross, A. C. (1998). Expertise in engineering design. Research in Engineering Design, 10(3), 141–149.CrossRef Cross, N., & Cross, A. C. (1998). Expertise in engineering design. Research in Engineering Design, 10(3), 141–149.CrossRef
Zurück zum Zitat Cross, N., & Dorst, K. (1999). Co-evolution of problem and solution spaces in creative design. In J. S. Gero & M. L. Maher (Eds.), Computational models of creative design IV (pp. 243–262). Sydney: Key Centre of Design Computing and Cognition, University of Sydney. Cross, N., & Dorst, K. (1999). Co-evolution of problem and solution spaces in creative design. In J. S. Gero & M. L. Maher (Eds.), Computational models of creative design IV (pp. 243–262). Sydney: Key Centre of Design Computing and Cognition, University of Sydney.
Zurück zum Zitat Department for education and skills. (1999). Design and technology the national curriculum for England. London: Department For Education and Skills. Department for education and skills. (1999). Design and technology the national curriculum for England. London: Department For Education and Skills.
Zurück zum Zitat Dixon, R., & Brown, R. (2012). Transfer of learning: connecting concepts during problem solving. Journal of Technology Education, 24(1), 2–17. Dixon, R., & Brown, R. (2012). Transfer of learning: connecting concepts during problem solving. Journal of Technology Education, 24(1), 2–17.
Zurück zum Zitat Donovan, M., Bransford, J., & Pellegrino, J. (Eds.). (1999). How people learn: Bridging research and practice. Washington, DC: National Academy Press. Donovan, M., Bransford, J., & Pellegrino, J. (Eds.). (1999). How people learn: Bridging research and practice. Washington, DC: National Academy Press.
Zurück zum Zitat Dorst, K., & Cross, N. (2001). Creativity in the design process: Co-evolution of problem–solution. Design Studies, 22(1), 425–437.CrossRef Dorst, K., & Cross, N. (2001). Creativity in the design process: Co-evolution of problem–solution. Design Studies, 22(1), 425–437.CrossRef
Zurück zum Zitat Dunker, K. (1926). A qualitative (experimental and theoretical) study of productive thinking (solving of comprehensible problems). Pedagogical Seminary, 33, 642–708.CrossRef Dunker, K. (1926). A qualitative (experimental and theoretical) study of productive thinking (solving of comprehensible problems). Pedagogical Seminary, 33, 642–708.CrossRef
Zurück zum Zitat Dym, C., Agogino, A., Eris, O., Frey, D., & Leifer, L. (2005). Engineering design thinking, teaching, and learning. Journal of Engineering Education, 95(1), 103–120.CrossRef Dym, C., Agogino, A., Eris, O., Frey, D., & Leifer, L. (2005). Engineering design thinking, teaching, and learning. Journal of Engineering Education, 95(1), 103–120.CrossRef
Zurück zum Zitat Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis: Verbal reports as data. Cambridge, MA: MIT Press. Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis: Verbal reports as data. Cambridge, MA: MIT Press.
Zurück zum Zitat Flavell, J. H. (1976). Metacognitive aspects of problem solving. In L. B. Resnick (Ed.), The nature of intelligence. NJ: Erlbaum. Flavell, J. H. (1976). Metacognitive aspects of problem solving. In L. B. Resnick (Ed.), The nature of intelligence. NJ: Erlbaum.
Zurück zum Zitat Fortus, D., Dershimer, C., Krajcik, J., Marx, R., & Mamlok-Naaman, R. (2004). Design-based science and student learning. Journal of Research in Science Teaching, 41(10), 1081–1110.CrossRef Fortus, D., Dershimer, C., Krajcik, J., Marx, R., & Mamlok-Naaman, R. (2004). Design-based science and student learning. Journal of Research in Science Teaching, 41(10), 1081–1110.CrossRef
Zurück zum Zitat Gall, M. D., Gall, J. P., & Borg, W. R. (2007). Educational research: An introduction (8th ed.). Boston: Pearson Education Inc. Gall, M. D., Gall, J. P., & Borg, W. R. (2007). Educational research: An introduction (8th ed.). Boston: Pearson Education Inc.
Zurück zum Zitat Halfin, H. H. (1973). Technology: A process approach. (Doctoral dissertation, West Virginia University, 1973) dissertation Abstracts International, 11(1), 1111A. Halfin, H. H. (1973). Technology: A process approach. (Doctoral dissertation, West Virginia University, 1973) dissertation Abstracts International, 11(1), 1111A.
Zurück zum Zitat Hennessy, S., & Murphy, P. (1999). The potential for collaborative problem solving in D&T. International Journal of Technology and Design Education, 9, 1–36.CrossRef Hennessy, S., & Murphy, P. (1999). The potential for collaborative problem solving in D&T. International Journal of Technology and Design Education, 9, 1–36.CrossRef
Zurück zum Zitat Hill, R. B. (1997). The design of an instrument to assess problem solving activities in technology education. Journal of Technology Education, 9(1), 31–46. Hill, R. B. (1997). The design of an instrument to assess problem solving activities in technology education. Journal of Technology Education, 9(1), 31–46.
Zurück zum Zitat Hill, R. B. (2006). New perspectives: Technology teacher education and engineering design. Journal of Industrial Teacher Education, 43(3), 45–63. Hill, R. B. (2006). New perspectives: Technology teacher education and engineering design. Journal of Industrial Teacher Education, 43(3), 45–63.
Zurück zum Zitat Jain, V. K., & Sobek, D. K., I. I. (2006). Linking design process to customer satisfaction through virtual design of experiments. Research in Engineering Design, 17(2), 59–71.CrossRef Jain, V. K., & Sobek, D. K., I. I. (2006). Linking design process to customer satisfaction through virtual design of experiments. Research in Engineering Design, 17(2), 59–71.CrossRef
Zurück zum Zitat Jonassen, D. H. (2000). Toward a design theory of problem solving. Educational Technology Research and Development, 48(4), 63–85.CrossRef Jonassen, D. H. (2000). Toward a design theory of problem solving. Educational Technology Research and Development, 48(4), 63–85.CrossRef
Zurück zum Zitat Kangas, K., Seitamaa-Hakkarainen, P., & Hakkarainen, K. (2011). Figuring the world of designing: Expert participation in elementary classroom. International Journal of Technology and Design Education, 23(2), 425–442. Kangas, K., Seitamaa-Hakkarainen, P., & Hakkarainen, K. (2011). Figuring the world of designing: Expert participation in elementary classroom. International Journal of Technology and Design Education, 23(2), 425–442.
Zurück zum Zitat Kangas, K., Seitamaa-Hakkarainen, P., & Hakkarainen, K. (2013). Design expert’s participation in elementary students’ collaborative design process. International Journal of Technology Design Education, 23(1), 161–178.CrossRef Kangas, K., Seitamaa-Hakkarainen, P., & Hakkarainen, K. (2013). Design expert’s participation in elementary students’ collaborative design process. International Journal of Technology Design Education, 23(1), 161–178.CrossRef
Zurück zum Zitat Kilgore, D., Atman, C. J., Yasuhara, K., Barker, T. J., & Morozov, A. (2007). Considering context: A study of first year engineering students. Journal of Engineering Education, 96(4), 321–334.CrossRef Kilgore, D., Atman, C. J., Yasuhara, K., Barker, T. J., & Morozov, A. (2007). Considering context: A study of first year engineering students. Journal of Engineering Education, 96(4), 321–334.CrossRef
Zurück zum Zitat Kolodner, J. L., Camp, P. J., Crismond, D., Fasse, B., Gray, J., Holbrook, J., Puntembakar, S., & Ryan, M. (2003). Problem-based learning meets case based reasoning in middle school science classroom: Putting learning by designTM into practice. Journal of the Learning Sciences, 12(4), 495–547. Kolodner, J. L., Camp, P. J., Crismond, D., Fasse, B., Gray, J., Holbrook, J., Puntembakar, S., & Ryan, M. (2003). Problem-based learning meets case based reasoning in middle school science classroom: Putting learning by designTM into practice. Journal of the Learning Sciences, 12(4), 495–547.
Zurück zum Zitat Kruger, C., & Cross, N. (2001). Modeling cognitive strategies in creative design. In J. Gero & M. Maher (Eds.), Computational and cognitive models of creative design V. Australia: University of Sidney. Kruger, C., & Cross, N. (2001). Modeling cognitive strategies in creative design. In J. Gero & M. Maher (Eds.), Computational and cognitive models of creative design V. Australia: University of Sidney.
Zurück zum Zitat Kruger, C., & Cross, N. (2006). Solution driven versus problem driven design: strategies and outcomes. Design Studies, 27(5), 527–548.CrossRef Kruger, C., & Cross, N. (2006). Solution driven versus problem driven design: strategies and outcomes. Design Studies, 27(5), 527–548.CrossRef
Zurück zum Zitat Lave, J., & Wenger, E. (1991). Situated learning. Legitimate peripheral participation. Cambridge: Cambridge University Press.CrossRef Lave, J., & Wenger, E. (1991). Situated learning. Legitimate peripheral participation. Cambridge: Cambridge University Press.CrossRef
Zurück zum Zitat Merriam, S. B. (2001, 1998). Qualitative research and case study applications in education. San Francisco: Jossey-Bass. Merriam, S. B. (2001, 1998). Qualitative research and case study applications in education. San Francisco: Jossey-Bass.
Zurück zum Zitat Ministry of Education. (2007). The New Zealand curriculum. Wellington: Learning Media. Ministry of Education. (2007). The New Zealand curriculum. Wellington: Learning Media.
Zurück zum Zitat National Research Council. (2012). A framework for K12 science education: Practices, cross cutting concepts, and core ideas. Washington, DC: National Academies Press. National Research Council. (2012). A framework for K12 science education: Practices, cross cutting concepts, and core ideas. Washington, DC: National Academies Press.
Zurück zum Zitat Nicholl, B., Hosking, I., Elton, E., Lee, Y., Bell, J., & Clarkson, P. (2013). Inclusive design in the Key Stage 3 classroom: An investigation of teachers’ understanding and implementation of user-centered design principles in design and technology. International Journal of Technology Design Education, 23(4), 921–938.CrossRef Nicholl, B., Hosking, I., Elton, E., Lee, Y., Bell, J., & Clarkson, P. (2013). Inclusive design in the Key Stage 3 classroom: An investigation of teachers’ understanding and implementation of user-centered design principles in design and technology. International Journal of Technology Design Education, 23(4), 921–938.CrossRef
Zurück zum Zitat Patrick, C. (1935). Creative thought in poets. Achieves of Psychology, 178, p. 74. Patrick, C. (1935). Creative thought in poets. Achieves of Psychology, 178, p. 74.
Zurück zum Zitat Penner, D. E., Giles, N. D., Lehrer, R., & Schauble, L. (1997). Building functional models: Design an Elbow. Journal of Research in Science Teaching, 34(2), 125–143.CrossRef Penner, D. E., Giles, N. D., Lehrer, R., & Schauble, L. (1997). Building functional models: Design an Elbow. Journal of Research in Science Teaching, 34(2), 125–143.CrossRef
Zurück zum Zitat Perez, R. S., Fleming Johnson, J., & Emery, C. D. (1995). Instructional design experts: A cognitive model of design. Instructional Science, 23(5–6), 321–349.CrossRef Perez, R. S., Fleming Johnson, J., & Emery, C. D. (1995). Instructional design experts: A cognitive model of design. Instructional Science, 23(5–6), 321–349.CrossRef
Zurück zum Zitat Prevost, A., Nathan, M., Stein, B., Tran, N., & Phelps, A. (2009). Integration of mathematics in pre-college engineering: The search for explicit connections. In Proceedings of the American Society of Engineering Education (ASEE) Annual Conference and Exposition. Austin, TX: ASEE. Prevost, A., Nathan, M., Stein, B., Tran, N., & Phelps, A. (2009). Integration of mathematics in pre-college engineering: The search for explicit connections. In Proceedings of the American Society of Engineering Education (ASEE) Annual Conference and Exposition. Austin, TX: ASEE.
Zurück zum Zitat Rennie, L., Venville, G., & Wallace, J. (2012). Integrating science, technology, engineering, and mathematics: Issues, reflections, and ways forward. New York: Rutledge. Rennie, L., Venville, G., & Wallace, J. (2012). Integrating science, technology, engineering, and mathematics: Issues, reflections, and ways forward. New York: Rutledge.
Zurück zum Zitat Robertson, W. C. (1990). Detection of cognitive structure with protocol data: Predicting performance on physics transfer problems. Cognitive Science, 14(1), 253–280.CrossRef Robertson, W. C. (1990). Detection of cognitive structure with protocol data: Predicting performance on physics transfer problems. Cognitive Science, 14(1), 253–280.CrossRef
Zurück zum Zitat Ross, B. H. (1984). Reminding and their effects in learning a cognitive skill. Cognitive Psychology, 16(1), 371–416.CrossRef Ross, B. H. (1984). Reminding and their effects in learning a cognitive skill. Cognitive Psychology, 16(1), 371–416.CrossRef
Zurück zum Zitat Royer, J. M. (1986). Designing instruction to produce understanding: An approach based on cognitive theory. In G. D. Phye & T. Andre (Eds.), Cognitive classroom learning: understanding, thinking and problem solving (pp. 83–113). Orlando, FL: Academic Press Inc. Royer, J. M. (1986). Designing instruction to produce understanding: An approach based on cognitive theory. In G. D. Phye & T. Andre (Eds.), Cognitive classroom learning: understanding, thinking and problem solving (pp. 83–113). Orlando, FL: Academic Press Inc.
Zurück zum Zitat SchÖn, D. (1983). The reflective practitioner. New York: Basic Books. SchÖn, D. (1983). The reflective practitioner. New York: Basic Books.
Zurück zum Zitat Smith, C.O. (1971). The structure of intellect processes analyses system. A technique for the investigation and qualification of problem solving processes. Doctoral Dissertation, University of Huston. Smith, C.O. (1971). The structure of intellect processes analyses system. A technique for the investigation and qualification of problem solving processes. Doctoral Dissertation, University of Huston.
Zurück zum Zitat van Someren, M. W., Barnard, Y. F., & Sandberg, J. A. C. (1994). The think-aloud method: A practical guide to modeling cognitive processes. London: Academic Press. van Someren, M. W., Barnard, Y. F., & Sandberg, J. A. C. (1994). The think-aloud method: A practical guide to modeling cognitive processes. London: Academic Press.
Zurück zum Zitat Welch, M. (1999). Analyzing the tacit strategies of novice designers. Research in Science & Technical Education, 17(1), 19–34.CrossRef Welch, M. (1999). Analyzing the tacit strategies of novice designers. Research in Science & Technical Education, 17(1), 19–34.CrossRef
Metadaten
Titel
Concurrent think-aloud protocols to assess elementary design students
verfasst von
Todd R. Kelley
Brenda M. Capobianco
Kevin J. Kaluf
Publikationsdatum
01.11.2015
Verlag
Springer Netherlands
Erschienen in
International Journal of Technology and Design Education / Ausgabe 4/2015
Print ISSN: 0957-7572
Elektronische ISSN: 1573-1804
DOI
https://doi.org/10.1007/s10798-014-9291-y

Weitere Artikel der Ausgabe 4/2015

International Journal of Technology and Design Education 4/2015 Zur Ausgabe

    Premium Partner