Skip to main content
SpringerLink
Log in

High Element Interactivity Information During Problem Solving may Lead to Failure to Obtain the Testing Effect

  • Research into Practice
  • Published:
Educational Psychology Review Aims and scope Submit manuscript

Abstract

The testing effect occurs when learners who are tested rather than relearning material perform better on a final test than those who relearn. Based on cognitive load theory, it was predicted that the testing effect may not be obtained when the material being learned is high in element interactivity. Three experiments investigated conditions of the phenomenon using school students aged 8 to 9 years learning to interpret and use a bus table. Results from Experiments 1 and 2 indicated a reverse testing effect on an immediate test. Experiment 3 was similar to Experiments 1 and 2 but had a 1-week delayed test which showed no significant effect. It was suggested that the failure to obtain a testing effect was determined by the high levels of element interactivity of the material that had to be learned.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  • Bartlett, F. C. (1932). Remembering: a study in experimental and social psychology. Oxford: Macmillan.

    Google Scholar 

  • Brainerd, C. J., & Reyna, V. F. (1995). Learning rate, learning opportunities, and the development of forgetting. Developmental Psychology, 31, 251–262. doi:10.1037/0012-1649.31.2.251.

    Article  Google Scholar 

  • Butler, A. C., & Roediger, H. L., III. (2007). Feedback enhances the positive effects and reduces the negative effects of multiple-choice testing. Memory and Cognition, 36, 604–616. doi:10.1080/09541440701326097.

    Article  Google Scholar 

  • Carpenter, S. K., & Pashler, H. (2007). Testing beyond words: using tests to enhance visuospatial map learning. Psychonomic Bulletin & Review, 14, 474–478. doi:10.3758/BF03194092.

    Article  Google Scholar 

  • Carpenter, S. K., Pashler, H., Wixted, J. T., & Vul, E. (2008). The effects of tests on learning and forgetting. Memory & Cognition, 36, 438–448. doi:10.3758/MC.36.2.438.

    Article  Google Scholar 

  • Carroll, W. M. (1994). Using worked examples as an instructional support in the algebra classroom. Journal of Educational Psychology, 86, 360–397. doi:10.1037/0022-0663.86.3.360.

    Article  Google Scholar 

  • Chi, M., Glaser, R., & Rees, E. (1982). Expertise in problem solving. In R. Sternberg (Ed.), Advances in the psychology of human intelligence (pp. 7–75). Hillsdale: Erlbaum.

    Google Scholar 

  • Cooper, G., & Sweller, J. (1987). The effects of schema acquisition and rule automation on mathematical problem-solving transfer. Journal of Educational Psychology, 79, 347–362. doi:10.1037/0022-0663.79.4.347.

    Article  Google Scholar 

  • Coppens, L. C., Verkoeijen, P. P. J. L., & Rikers, R. M. J. P. (2011). Learning Adinkra symbols: the effect of testing. Journal of Cognitive Psychology, 23, 351–357. doi:10.1080/20445911.2011.507188.

    Article  Google Scholar 

  • Cowan, N. (2001). The magical number 4 in short-term memory: a reconsideration of mental storage capacity. Behavioral and Brain Sciences, 24, 87–114. doi:10.1017/S0140525X01003922.

    Article  Google Scholar 

  • De Groot, A. (1965). Thought and choice in chess. The Hague: Mouton. (Original work published 1946).

    Google Scholar 

  • Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013). Improving students’ learning with effective learning techniques: promising directions from cognitive and educational psychology. Psychology Science in the Public Interest, 14, 4–58.

    Article  Google Scholar 

  • Ericsson, K. A., & Kintsch, W. (1995). Long-term working memory. Psychological Review, 102, 211–245. doi:10.1037/0033-295X.102.2.211.

    Article  Google Scholar 

  • Gates, A. I. (1917). Recitation as a factor in memorizing. Archives of Psychology, 40, 104.

    Google Scholar 

  • Geary, D. C. (2008). An evolutionarily informed education science. Educational Psychologist, 43, 179–195. doi:10.1080/00461520802392133.

    Article  Google Scholar 

  • Geary, D. C. (2012). Evolutionary educational psychology. In K. Harris, S. Graham, & T. Urdan (Eds.), APA educational psychology handbook (Vol. 1, pp. 597–621). Washington: American Psychological Association.

    Google Scholar 

  • Hogan, R. M., & Kintsch, W. (1971). Differential effects of study and test trials on long-term recognition and recall. Journal of Verbal Learning and Verbal Behavior, 10, 562–567. doi:10.1016/S0022-5371(71)80029-4.

    Article  Google Scholar 

  • Huber, D. E., Tomlinson, T. D., Jang, Y., & Hopper, W. J. (2015). The search of associative memory with recovery interference (SAM-RI) memory model and its application to retrieval practice paradigms. In Cognitive Modeling in Perception and Memory: A Festschrift for Richard M. Shiffrin. Psychology Press, ch. 5.

  • Johnson, C. I., & Mayer, R. E. (2009). A testing effect with multimedia learning. Journal of Educational Psychology, 101, 621–629. doi:10.1037/a0015183.

    Article  Google Scholar 

  • Kalyuga, S., Chandler, P., Tuovinen, J., & Sweller, J. (2001). When problem solving is superior to studying worked examples. Journal of Educational Psychology, 93, 579–588. doi:10.1037/0022-0663.93.3.579.

    Article  Google Scholar 

  • Leahy, W., & Sweller, J. (2008). The imagination effect increases with an increased intrinsic cognitive load. Applied Cognitive Psychology, 22, 273–283. doi:10.1002/acp.1373.

    Article  Google Scholar 

  • Lipowski, S. L., Pyc, M. A., Dunlosky, J., & Rawson, K. A. (2014). Establishing and explaining the testing effect in free recall for young children. Developmental Psychology, 50, 994–1000. doi:10.1037/a0035202.

    Article  Google Scholar 

  • Marsh, E. J., Roediger, H. L., Bjork, R. A., & Bjork, E. L. (2007). The memorial consequences of multiple-choice testing. Psychonomic Bulletin & Review, 14, 194–199. doi:10.3758/Bf03194051.

    Article  Google Scholar 

  • Miller, G. A. (1956). The magical number of seven, plus or minus two: some limits on our capacity for processing information. Psychological Review, 63, 81–97. doi:10.1037/0033-295X.101.2.343.

    Article  Google Scholar 

  • Newell, A., & Simon, H. A. (1972). Human problem solving. Englewood Cliffs: Prentice Hall.

    Google Scholar 

  • Nievelstein, F., van Gog, T., van Dijck, G., & Boshuizen, H. P. A. (2013). The worked example and expertise reversal effect in less structured tasks: learning to reason about legal cases. Contemporary Educational Psychology, 38, 118–125. doi:10.1037/0022-0663.86.1.122.

    Article  Google Scholar 

  • Paas, F. (1992). Training strategies for attaining transfer of problem-solving skill in statistics: a cognitive-load approach. Journal of Educational Psychology, 84, 429–434. doi:10.1037/0022-0663.84.4.429.

    Article  Google Scholar 

  • Paas, F., & van Merriënboer, J. (1994). Variability of worked examples and transfer of geometrical problem-solving skills: a cognitive-load approach. Journal of Educational Psychology, 86, 122–133. doi:10.1037/0022-0663.86.1.122.

    Article  Google Scholar 

  • Peterson, L. R., & Peterson, M. J. (1959). Short-term retention of individual verbal items. Journal of Experimental Psychology, 58, 193–198. doi:10.1037/h0049234193–198.

    Article  Google Scholar 

  • Pyc, M. A., & Rawson, K. A. (2010). Why testing improves memory: mediator effectiveness hypothesis. Science, 330(6002), 335. doi:10.1126/science.1191465.

    Article  Google Scholar 

  • Roediger, H. L., & Karpicke, J. D. (2006a). The power of testing memory: basic research and implications for educational practice. Perspectives on Psychological Science, 1, 181–210. doi:10.1111/j.1745-6916.2006.00012.x.

    Article  Google Scholar 

  • Roediger, H. L., & Karpicke, J. D. (2006b). Test-enhanced learning: taking memory tests improves long-term retention. Psychological Science, 17, 249–255. doi:10.1111/j.1467-9280.2006.01693.x.

    Article  Google Scholar 

  • Roediger, H. L., Putnam, A.L., & Smith, M. (2011). Ten benefits of testing and their applications to educational practice. In J. Mestre & B. Ross (Eds.), The psychology of learning and motivation: Cognition in education. Vol. 55, pp. 1–36.

  • Spitzer, H. F. (1939). Studies in retention. Journal of Educational Psychology, 30, 641–656. doi:10.1037/h0063404.

    Article  Google Scholar 

  • Sweller, J. (1988). Cognitive load during problem solving: effects on learning. Cognitive Science, 12, 257–285. doi:10.1207/s15516709cog1202_4.

    Article  Google Scholar 

  • Sweller, J. (1994). Cognitive load theory, learning difficulty, and instructional design. Learning and Instruction, 4, 295–312. doi:10.1016/0959-4752(94)90003-5.

    Article  Google Scholar 

  • Sweller, J. (2004). Instructional design consequences of an analogy between evolution by natural selection and human cognitive architecture. Instructional Science, 32, 9–31. doi:10.1023/B:TRUC.0000021808.72598.4d.

    Article  Google Scholar 

  • Sweller, J. (2010). Element interactivity and intrinsic, extraneous and germane cognitive load. Educational Psychology Review, 22, 123–138. doi:10.1007/s10648-010-9128-5.

    Article  Google Scholar 

  • Sweller, J. (2011). Cognitive load theory. In J. Mestre & B. Ross (Eds.), The psychology of learning and motivation: cognition in education (Vol. 55, pp. 37–76). Oxford: Academic.

    Google Scholar 

  • Sweller, J. (2012). Human cognitive architecture: Why some instructional procedures work and others do not. In K. Harris, S. Graham, & T. Urdan (Eds.), APA educational psychology handbook (Vol. 1, pp. 295–325). Washington: American Psychological Association.

    Google Scholar 

  • Sweller, J., & Chandler, P. (1994). Why some material is difficult to learn. Cognition and Instruction, 12(3), 185–233. doi:10.1207/s1532690xci1203_1.

    Article  Google Scholar 

  • Sweller, J., & Cooper, G. A. (1985). The use of worked examples as a substitute for problem solving in learning algebra. Cognition and Instruction, 2(1), 59–89. doi:10.1207/s1532690xci0201_3.

    Article  Google Scholar 

  • Sweller, J., & Sweller, S. (2006). Natural information processing systems. Evolutionary Psychology, 4, 434–458.

    Google Scholar 

  • Sweller, J., Ayres, P., & Kalyuga, S. (2011). Cognitive load theory. New York: Springer.

    Book  Google Scholar 

  • Thompson, C. P., Wenger, S. K., & Bartling, C. A. (1978). How recall facilitates subsequent recall: a reappraisal. Journal of Experimental Psychology: Human Learning and Memory, 4, 210–221.

    Google Scholar 

  • Toppino, T. C., & Cohen, M. S. (2009). The testing effect and the retention interval. Experimental Psychology, 56, 252–257.

    Article  Google Scholar 

  • Van Gerven, P. W. M., Paas, F. G. W. C., Van Merriënboer, J. J. G., & Schmidt, H. G. (2002). Cognitive load theory and aging: effects of worked examples on training efficiency. Learning and Instruction, 12, 87–105. doi:10.1016/S0959-4752(01)00017-2.

    Article  Google Scholar 

  • Van Gog, T., & Kester, L. (2012). A test of the testing effect: acquiring problem-solving skills from worked examples. Cognitive Science, 36, 1532–1541. doi:10.1111/cogs.12002.

    Article  Google Scholar 

  • Van Gog, T., Paas, F., & Van Merriënboer, J. J. G. (2006). Effects of process-oriented worked examples on troubleshooting transfer performance. Learning and Instruction, 16(2 SPEC. ISS), 154–164. doi:10.1016/j.learninstruc.2006.02.003.

    Google Scholar 

  • Van Gog, T., Kester, L., & Paas, F. (2011). Effects of worked examples, example-problem, and problem-example pairs on novices’ learning. Contemporary Educational Psychology, 36, 212–218. doi:10.1016/j.cedpsych.2010.10.004.

    Article  Google Scholar 

  • Van Merriënboer, J., Kester, L., & Pass, F. (2006). Teaching complex rather than simple tasks: balancing intrinsic and germane load to enhance transfer of learning. Applied Cognitive Psychology, 20, 343–352. doi:10.1002/acp.1250.

    Article  Google Scholar 

  • Verkoeijen, P. P. J. L., Bouwmeester, S., & Camp, G. (2012). A short term testing effect in cross-language recognition. Psychological Science, 23, 567–571. doi:10.1177/0956797611435132.

    Article  Google Scholar 

  • Wheeler, M. A., Ewers, M., & Buonanno, J. F. (2003). Different rates of forgetting following study versus test trials. Memory, 11, 571–580. doi:10.1080/09658210244000414.

    Article  Google Scholar 

  • Wiklund-Hörnqvist, C., Jonsson, B., & Nyberg, L. (2014). Strengthening concept learning by repeated testing. Scandinavian Journal of Psychology, 55, 10–16. doi:10.1111/sjop.12093.

    Article  Google Scholar 

  • Wilkins, N. J., & Rawson, K. A. (2013). Why does lag affect the durability of memory-based automaticity: loss of memory strength or interference? Acta Psychologica, 144, 390–396. doi:10.1016/j.actpsy.2013.07.021.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Education, Macquarie University, Sydney, NSW, 2052, Australia

    Wayne Leahy

  2. School of Education, University of Western Sydney, Penrith, Australia

    José Hanham

  3. School of Education, University of New South Wales, Sydney, Australia

    John Sweller

Authors
  1. Wayne Leahy
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. José Hanham
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. John Sweller
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wayne Leahy.

Appendix

Appendix

The 12 questions used in Experiments 1 and 2 and 3

  1. 1.

    What route number does not stop at some bus stops in the morning?

  2. 2.

    You look in what column to find White St.?

  3. 3.

    What do the blank spaces mean on the timetable?

  4. 4.

    How many buses leave Casey St. all day?

  5. 5.

    How many buses leave Beach St. in the afternoon?

  6. 6.

    What is the earliest time of the day the 103 bus leaves a bus stop?

  7. 7.

    The 105 bus does its final stop at what street?

  8. 8.

    What route number does not stop at Main St. in the afternoon?

  9. 9.

    What is the route number of the bus that stops at Beach St. at 3 pm?

  10. 10.

    There are four buses during the morning. One of them stops at Beach St. at 9.45 am. What time does it go from Kent St.?

  11. 11.

    What route number will I take from Alt St. to get to Smith St. at 1.15 pm?

  12. 12.

    I need to travel from Kent St. to arrive at Smith St. at 10.15 pm. What time do I take the bus from Kent St.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Leahy, W., Hanham, J. & Sweller, J. High Element Interactivity Information During Problem Solving may Lead to Failure to Obtain the Testing Effect. Educ Psychol Rev 27, 291–304 (2015). https://doi.org/10.1007/s10648-015-9296-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10648-015-9296-4

Keywords

Search

Navigation