Skip to main content
Log in

A Relational Reasoning Approach to Text-Graphic Processing

  • Review Article
  • Published:
Educational Psychology Review Aims and scope Submit manuscript

Abstract

We propose that research on text-graphic processing could be strengthened by the inclusion of relational reasoning perspectives. We briefly outline four aspects of relational reasoning: analogies, anomalies, antinomies, and antitheses. Next, we illustrate how text-graphic researchers have been conducting research aligned with aspects of relational reasoning, although not deliberately. We call for future research on intentionally designed text-graphic pairings that should be empirically tested for their ability to support relational reasoning. Finally, we argue that relational reasoning may help explain some of the mixed results and unintended outcomes that often appear in the text-graphic research literature.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  • Ainsworth, S. (2006). DeFT: a conceptual framework for considering learning with multiple representations. Learning and Instruction, 16(3), 183–198.

    Article  Google Scholar 

  • Ainsworth, S. E., & Burcham, S. (2007). The impact of text coherence on learning by self-explanation. Learning and Instruction, 17, 286–303.

    Article  Google Scholar 

  • Alexander, P. A., & The Disciplined Reading and Learning Research Laboratory. (2012). Reading into the future: competence for the 21st century. Educational Psychologist, 47(4), 259–280. doi:10.1080/00461520.2012.722511.

    Article  Google Scholar 

  • Alexander, P. A., Dumas, D., Grossnickle, E. M., List, A., & Firetto, C. M. (2016a). Measuring relational reasoning. The Journal of Experimental Education, 84(1), 119–151.

    Article  Google Scholar 

  • Alexander, P. A., Jablansky, S., Singer, L. M., & Dumas, D. (2016b). Relational reasoning what we know and why it matters. Policy Insights from the Behavioral and Brain Sciences, 3(1), 36–44.

    Article  Google Scholar 

  • Ariasi, N., & Mason, L. (2011). Uncovering the effect of text structure in learning from a science text: an eye-tracking study. Instructional Science, 39, 581–601.

    Article  Google Scholar 

  • Broughton, S., Sinatra, G. M., & Reynolds, R. E. (2010). The nature of the refutation text effect: implications of attention allocation. Journal of Educational Research, 103(6), 407–423.

    Article  Google Scholar 

  • Carney, R. N., & Levin, J. R. (2002). Pictorial illustrations still improve students’ learning from text. Educational Psychology Review, 14(1), 5–26.

  • ChanLin, L. J. (1996). Enhancing computer graphics through metaphorical elaboration. Journal of Instructional Psychology, 23(3), 196–203.

    Google Scholar 

  • Chinn, C. A., & Brewer, W. F. (1993). The role of anomalous data in knowledge acquisition: a theoretical framework and implications for science instruction. Review of Educational Research, 63(1), 1–49.

    Article  Google Scholar 

  • Cordova, J., Sinatra, G. M., Broughton, S. H., Taasoobshirazi, G., & Lombardi, D. (2014). Self-efficacy, confidence in prior knowledge, and conceptual change. Contemporary Educational Psychology, 39, 164–174. doi:10.1016/j.cedpsych.2014.03.006.

    Article  Google Scholar 

  • Danielson, R. W., Schwartz, N. H., & Lippmann, M. (2015). Metaphorical graphics aid learning and memory. Learning and Instruction, 39, 194–205.

    Article  Google Scholar 

  • Danielson, R. W., Sinatra, G. M., & Kendeou, P. (2016). Augmenting the refutation text effect with analogies and graphics. Discourse Processes. doi:10.1080/0163853X.2016.1166334.

    Google Scholar 

  • Dole, J. A., & Sinatra, G. M. (1998). Reconceptualizing change in the cognitive construction of knowledge. Educational Psychologist, 33(2–3), 109–128.

    Article  Google Scholar 

  • Duit, R. (1991). On the role of analogies and metaphors in learning science. Science Education, 75(6), 649–673.

    Article  Google Scholar 

  • Dumas, D., Alexander, P. A., & Grossnickle, E. M. (2013). Relational reasoning and its manifestations in the educational context: a systematic review of the literature. Educational Psychology Review, 25(3), 391–427.

    Article  Google Scholar 

  • Franco, G. M., Muis, K. R., Kendeou, P., Ranellucci, J., Sampasivam, L., & Wang, X. (2012). Examining the influences of epistemic beliefs and knowledge representations on cognitive processing and conceptual change when learning physics. Learning and Instruction, 22(1), 62–77.

    Article  Google Scholar 

  • Garcia de Osuna, J., Ranney, M., & Nelson, J. (2004). Qualitative and quantitative effects of surprise:(Mis) estimates, rationales, and feedback-induced preference changes while considering abortion. In Proceedings of the Twenty-sixth Annual Conference of the Cognitive Science Society (pp. 422–427).

  • Gee, B. (1978). Models as a pedagogical tool: can we learn from Maxwell? Physics Education, 13(5), 287.

    Article  Google Scholar 

  • Glynn, S. M. (2007). Methods and strategies: the teaching-with-analogies model. Science and Children, 44(8), 52–55.

    Google Scholar 

  • Gribbin, J. (2011). In Search of Schrodinger's cat: quantum physics and reality. Bantam.

  • Guzzetti, B., Snyder, T., & Glass, G. (1992). Promoting conceptual change in science: can texts be used effectively? Journal of Reading, 35, 642–649.

    Google Scholar 

  • Hagan, S. M. (2007). Visual/verbal collaboration in print: complementary differences, necessary ties, and an untapped rhetorical opportunity. Written Communication, 24(1), 49–83.

    Article  Google Scholar 

  • Hegarty, M. (2011). The cognitive science of visual-spatial displays: implications for design. Topics in Cognitive Science, 3(3), 446–474.

    Article  Google Scholar 

  • Houts, P. S., Doak, C. C., Doak, L. G., & Loscalzo, M. J. (2006). The role of pictures in improving health communication: a review of research on attention, comprehension, recall, and adherence. Patient Education and Counseling, 61(2), 173–190. doi:10.1016/j.pec.2005.05.004.

    Article  Google Scholar 

  • Johnson-Laird, P. N. (1983). Mental models: towards a cognitive science of language, inference, and consciousness. Cambridge: Cambridge University Press.

    Google Scholar 

  • Kendeou, P., Walsh, E. K., Smith, E. R., & O'Brien, E. J. (2014). Knowledge revision processes in refutation texts. Discourse Processes, 51, 374–397. doi:10.1080/0163853x.2014.913961.

    Article  Google Scholar 

  • Kintsch, W. (1992). A cognitive architecture for comprehension. In H. H. Pick, P. can den Broek, & D. C. Knill (Eds.), The study of cognition: conceptual and methodological issues (pp. 143–164). Washington, DC: American Psychological Association.

    Chapter  Google Scholar 

  • Knecht, P., & Najvarová, V. (2010). How do students rate textbooks? A review of research and ongoing challenges for textbook research and textbook production. Journal of Educational Media, Memory, and Society., 2(1), 1–16.

    Article  Google Scholar 

  • Kreezer, G., & Dallenbach, K. M. (1929). Learning the relation of opposition. The American Journal of Psychology, 41(3), 432–441.

    Article  Google Scholar 

  • Lakoff, G. (1993). Metaphor and thought (2nd ed.). Cambridge: Cambridge University Press.

    Google Scholar 

  • Liben, L. S. (2001). Thinking through maps. In M. Gattis (Ed.), Spatial schemas and abstract thought (pp. 45–77). Cambridge: MIT Press.

    Google Scholar 

  • Mann, M. E. (2013). The hockey stick and the climate wars: dispatches from the front lines. Ney York: Columbia University Press.

    Book  Google Scholar 

  • Marsh, E. E., & White, M. D. (2003). A taxonomy of relationships between images and texts. Journal of Documentation, 59(6), 647e672. doi:10.1108/00220410310506303.

  • Mason, L., Gava, M., & Boldrin, A. (2008). On warm conceptual change: the interplay of text, epistemological beliefs, and topic interest. Journal of Educational Psychology, 100(2), 291–309.

    Article  Google Scholar 

  • Mason, L., Baldi, R., Danielson, R. W., & Sinatra, G. M. (2016). Refutation text and graphics: effects on conceptual change learning. Washington, DC: Paper presented at the annual meeting of the American Educational Research Association.

    Google Scholar 

  • Mayer, R. E. (2001). Multi-media learning. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Mayer, R. E., & Moreno, R. (2002). Aids to computer-based multimedia learning. Learning and Instruction, 12, 107–119.

    Article  Google Scholar 

  • McCabe, D. P., & Castel, A. D. (2008). Seeing is believing: the effect of brain images on judgments of scientific reasoning. Cognition, 107, 343–352.

    Article  Google Scholar 

  • McKay, E. (1999). Exploring the effect of graphical metaphors on the performance of learning computer programming concepts in adult learners: a pilot study. Educational Psychology, 19(4), 471–487.

    Article  Google Scholar 

  • McNamara, D. S., Kintsch, E., Songer, N. B., & Kintsch, W. (1996). Are good texts always better? Interactions of text coherence, background knowledge, and levels of understanding in learning from text. Cognition and Instruction, 14(1), 1–43.

    Article  Google Scholar 

  • Moreno, R., & Mayer, R. E. (1999a). Cognitive principles of multimedia learning: the role of modality and contiguity. Journal of Educational Psychology, 91, 358–368.

    Article  Google Scholar 

  • Moreno, R., & Mayer, R. E. (1999b). Multimedia supported metaphors for meaning making in mathematics. Cognition and Instruction, 17, 215–248.

    Article  Google Scholar 

  • Moreno, R., & Mayer, R. E. (2000). A coherence effect in multimedia learning: the case for minimizing irrelevant sounds in the design of multimedia instructional messages. Journal of Educational Psychology, 92(1), 117–125.

    Article  Google Scholar 

  • Murphy, G. L. (1996). On metaphoric representation. Cognition, 60(2), 173–204.

    Article  Google Scholar 

  • Murphy, P. K. (2001). Teaching as persuasion: a new metaphor for a new decade. Theory Into Practice, 40(4), 224–227.

    Article  Google Scholar 

  • Nussbaum, E. M. (2011). Argumentation, dialogue theory, and probability modeling: alternative frameworks for argumentation research in education. Educational Psychologist, 46(2), 84–106.

    Article  Google Scholar 

  • Orgill, M. K., & Thomas, M. (2007). Analogies and the 5E model. Science Teacher, 74(1), 40–45.

    Google Scholar 

  • Park, S., & Lim, J. (2007). Promoting positive emotion in multimedia learning using visual illustrations. Journal of Educational Multimedia and Hypermedia, 16(2), 141–162.

    Google Scholar 

  • Podolefsky, N. S. & Finkelstein, N. D. (2006). Use of analogy in learning physics: the role of representations. physical review special topics. Physics Education Research, 2(020101), 1-10.

  • Ranney, M. A., & Clark, D. (2016). Climate change conceptual change: scientific information can transform attitudes. Topics in Cognitive Science, 8, 49–75.

    Article  Google Scholar 

  • Rapp, D. N., & Braasch, J. L. (2014). Processing inaccurate information: theoretical and applied perspectives from cognitive science and the educational sciences. Cambridge, MA: MIT Press.

  • Sab, S., Wittwer, J., Senkbeil, M., & Koller, O. (2011). Pictures in test items: effects on response time and response correctness. Applied Cognitive Psychology, 26(1), 70–81. doi:10.1002/acp.1798.

    Google Scholar 

  • Sagan, C. (2011). Demon-haunted world: science as a candle in the dark. Ballantine Books.

  • Savinainen, A., & Viiri, J. (2008). The force concept inventory as a measure of students conceptual coherence. International Journal of Science and Mathematics Education, 6(4), 719–740.

    Article  Google Scholar 

  • Schnotz, W. (2002). Towards an integrated view of learning from text and visual displays. Educational Psychology Review, 14(1), 101–120.

    Article  Google Scholar 

  • Schnotz, W. (2014). Integrated model of text and picture comprehension. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (2nd ed.). Cambridge, England: Cambridge University Press. doi:10.1017/CBO9781139547369.006.

    Google Scholar 

  • Schnotz, W., & Bannert, M. (2003). Construction and interference in learning from multiple representation. Learning and Instruction, 13, 141–156.

    Article  Google Scholar 

  • Schnotz, W., Bannert, M., & Seufert, T. (2002). Toward an integrative view of text and picture comprehension: visualization effects on the construction of mental models. In J. Otero & J. A. Leon (Eds.), Psychology of science text comprehension (pp. 385–416). Mahwah, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Schwartz, N. H., Stroud, M., Hong, N. S., Lee, T., Scott, B., & McGee, S. M. (2006). Summoning prior knowledge: the influence of metaphorical priming on learning in a hypermedia environment. Journal of Educational and Computing Research, 35(1), 1–30.

    Article  Google Scholar 

  • Segers, E., Verhoeven, L., & Hulstijn-Hendrikse, N. (2008). Cognitive processes in children’s multimedia text learning. Applied Cognitive Psychology, 22, 375–387.

    Article  Google Scholar 

  • Shah, P., & Carpenter, P. (1995). Conceptual limitations in comprehending line graphs. Journal of Experimental Psychology: General, 124, 337–370.

    Google Scholar 

  • Sinatra, G. M., & Broughton, S. H. (2011). Bridging reading comprehension and conceptual change in science education: the promise of refutation text. Reading Research Quarterly, 46(4), 374–393.

    Google Scholar 

  • Sinatra, G. M., & Danielson, R. W. (2016). Overcoming stumbling blocks to public understanding of science through refutation texts and graphics. In R. W. Danielson (Ed.), Promoting public understanding of science: a cornerstone of diverse democracies. Washington, DC: Symposium presented at the annual meeting of the American Educational Research Association.

    Google Scholar 

  • Smallman, H. S., & St. John, M. (2005). Naive realism: misplaced faith in realistic displays. Ergonomics in Design, 13, 14–19.

    Article  Google Scholar 

  • Stroud, M. J., & Schwartz, N. H. (2010). Summoning prior knowledge through metaphorical graphics: an example in chemistry instruction. Journal of Educational Research, 103, 351e366. doi:10.1080/00220670903383077.

    Article  Google Scholar 

  • Sweller, J., Van Merrienboer, J. J., & Paas, F. G. (1998). Cognitive architecture and instructional design. Educational Psychology Review, 10(3), 251–296.

    Article  Google Scholar 

  • Thomas, G. P., & McRobbie, C. J. (2001). Using a metaphor for learning to improve student’s metacognition in the chemistry classroom. Journal of Research in Science Teaching, 38(2), 222–259.

    Article  Google Scholar 

  • Tippett, C. D. (2010). Refutation text in science education: a review of two decades of research. International Journal of Science and Mathematics Education, 8(6), 951–970.

    Article  Google Scholar 

  • Treagust, D. F., Harrison, A. G., & Venville, G. J. (1996). Using an analogical teaching approach to engender conceptual change. International Journal of Science Education, 18(2), 213–229.

    Article  Google Scholar 

  • Tufte, E. R. (2006). Beautiful evidence. New York: Graphics Press.

    Google Scholar 

  • Tufte, E. R., & Weise Moeller, E. (1997). Visual explanations: images and quantities, evidence and narrative (Vol. 36). Cheshire, CT: Graphics Press.

  • Tversky, B. (2001). Spatial schemas in depictions. In M. Gattis (Ed.), Spatial schemas and abstract thought (pp. 79–112). Cambridge: MIT Press.

    Google Scholar 

  • Tversky, B., Morrison, J. B., & Betrancourt, M. (2002). Animation: can it facilitate? International Journal of Human-Computer Studies, 57, 247–262.

    Article  Google Scholar 

  • Webb, M. J. (1985). Analogies and their limitations. School Science and Mathematics, 85, 645–650.

    Article  Google Scholar 

  • Weller, C. M. (1970). The role of analogy in teaching science. Journal of Research in Science Teaching, 7, 113–119.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Robert W. Danielson.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Danielson, R.W., Sinatra, G.M. A Relational Reasoning Approach to Text-Graphic Processing. Educ Psychol Rev 29, 55–72 (2017). https://doi.org/10.1007/s10648-016-9374-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10648-016-9374-2

Keywords

Navigation