skip to main content
article

Exploring the role of visualization and engagement in computer science education

Published:24 June 2002Publication History
Skip Abstract Section

Abstract

Visualization technology can be used to graphically illustrate various concepts in computer science. We argue that such technology, no matter how well it is designed, is of little educational value unless it engages learners in an active learning activity. Drawing on a review of experimental studies of visualization effectiveness, we motivate this position against the backdrop of current attitudes and best practices with respect to visualization use. We suggest a new taxonomy of learner engagement with visualization technology. Grounded in Bloom's well-recognized taxonomy of understanding, we suggest metrics for assessing the learning outcomes to which such engagement may lead. Based on these taxonomies of engagement and effectiveness metrics, we present a framework for experimental studies of visualization effectiveness. Interested computer science educators are invited to collaborate with us by carrying out studies within this framework.

References

  1. Anderson, J. M., and Naps, T. L. A Context for the Assessment of Algorithm Visualization System as Pedagogical Tools. First International Program Visualization Workshop, Porvoo, Finland. University of Joensuu Press (July 2001), 121--130.Google ScholarGoogle Scholar
  2. Baecker, R. Sorting Out Sorting: A Case Study of Software Visualization for Teaching Computer Science. In Software Visualization, J. Stasko, J. Domingue, M. H. Brown, and B. A. Price, Eds. MIT Press, 1998, ch. 24, pp. 369--381.Google ScholarGoogle Scholar
  3. Bazik, J., Tamassia, R., Reiss, S. P., and van Dam, A. Software Visualization in Teaching at Brown University. In Software Visualization, J. Stasko, J. Domingue, M. H. Brown, and B. A. Price, Eds. MIT Press, 1998, ch. 25, pp. 382--398.Google ScholarGoogle Scholar
  4. Biermann, H., and Cole, R. Comic Strips for Algorithm Visualization. Tech. rep., NYU 1999--778, New York University, Feb. 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Bloom, B. S., and Krathwohl, D. R. Taxonomy of Educational Objectives; the Classification of Educational Goals, Handbook I: Cognitive Domain. AddisonWesley, 1956.Google ScholarGoogle Scholar
  6. Boroni, C. M., Eneboe, T. J., Goosey, F. W., Ross, J. A., and Ross, R. J. Dancing with Dynalab, Endearing the Science of Computing to Students. Twenty-seventh SIGCSE Technical Symposium on Computer Science Education (1996), 135--139. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Bridgeman, S., Goodrich, M. T., Kobourov, S. G., and Tamassia, R. PILOT: An Interactive Tool for Learning and Grading. 31st ACM SIGCSE Technical Symposium on Computer Science Education (SIGCSE 2000), Austin, Texas (Mar. 2000), 139--143. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Brown, M. H. Algorithm Animation. MIT Press, Cambridge, Massachussets, 1988.Google ScholarGoogle Scholar
  9. Brown, M. H., and Raisamo, R. JCAT: Collaborative Active Textbooks Using Java. Computer Networks and ISDN Systems 29 (1997), 1577--1586. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Brown, M. H., and Sedgewick, R. A System for Algorithm Animation Structures. ACM SIGGRAPH '84 Proceedings, Minneapolis, Minnesota (July 1984), 177--186. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Byrne, M. D., Catrambone, R., and Stasko, J. Evaluating Animations as Student Aids in Learning Computer Algorithms. Computers & Education 33 (1996), 253--278. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Citrin, W., and Gurka, J. A Low-Overhead Technique for Dynamic Blackboarding Using Morphing Technology. Computers & Education 26, 4 (1996), 189--196. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Crosby, M. E., and Stelovsky, J. From Multimedia Instruction to Multimedia Evaluation. Journal of Educational Multimedia and Hypermedia 4 (1995), 147--162. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Dann, W., Cooper, S., and Pausch, R. Using Visualization To Teach Novices Recursion. 6th Annual ACM SIGCSE/SIGCUE Conference on Innovation and Technology in Computer Science Education (ITiCSE 2001), Canterbury, England (June 2001), 109--112. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Faltin, N. Structure and Constraints in Interactive Exploratory Algorithm Learning. In Software Visualization (2002), S. Diehl, Ed., no. 2269 in Lecture Notes in Computer Science, Springer, pp. 213--226. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Felder, R. M. Reaching the second tier. Journal of College Science Teaching 23, 5 (1993), 286--290.Google ScholarGoogle Scholar
  17. Felder, R. M. Matters of style. ASEE Prism 6, 4 (1996), 18--23.Google ScholarGoogle Scholar
  18. Gloor, P. A. User Interface Issues for Algorithm Animation. In Software Visualization, J. Stasko, J. Domingue, M. H. Brown, and B. A. Price, Eds. MIT Press, 1998, ch. 11, pp. 145--152.Google ScholarGoogle Scholar
  19. Grissom, S. Personal communication, 2002.Google ScholarGoogle Scholar
  20. Gurka, J. S. Pedagogic Aspects of Algorithm Animation. PhD thesis, Department of Computer Science, University of Colorado, 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Haajanen, J., Pesonius, M., Sutinen, E., Tarhio, J., Teräsvirta, T., and Vanninen, P. Animation of User Algorithms on the Web. IEEE Symposium on Visual Languages (1997), 360--367. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Hansen, S., Schrimpsher, D., and Narayanan, N. H., From Algorithm Animations to Animation-Embedded Hypermedia Visualizations. Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications (ED-MEDIA 1999), Seattle, Washington (1999), 1032--1037.Google ScholarGoogle Scholar
  23. Hansen, S. R., Narayanan, N. H., and Schrimpsher, D. Helping Learners Visualize and Comprehend Algorithms. Interactive Multimedia Electronic Journal of Computer-Enhanced Learning 2, 1 (2000).Google ScholarGoogle Scholar
  24. Hundhausen, C. D. Toward Effective Algorithm Visualization Artifacts: Designing for Participation and Communication in an Undergraduate Algorithms Course. PhD thesis, University of Oregon, 1999. Unpublished Doctoral Dissertation, available as technical report CIS-TR-99-07 (June 1999) in Department of Computer and Information Science, University of Oregon, Eugene. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Hundhausen, C. D. Integrating Algorithm Visualization Technology into an Undergraduate Algorithms Course: Ethnographic Studies of a Social Constructivist Approach. Computers & Education (2002), (in print). Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Hundhausen, C. D., and Douglas, S. Using Visualizations to Learn Algorithms: Should Students Construct Their Own, or View an Expert's? IEEE Symposium on Visual Languages, Los Alamitos, California (2000), 21--28. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Hundhausen, C. D., and Douglas, S. A. Low-Fidelity Algorithm Visualization. Journal of Visual Languages and Computing (2002), (in print).Google ScholarGoogle Scholar
  28. Hundhausen, C. D., Douglas, S. A., and Stasko, J. T. A Meta-Study of Algorithm Visualization Effectiveness. Journal of Visual Languages and Computing (2002), (in print).Google ScholarGoogle Scholar
  29. Hung, T., and Rodger, S. H. Increasing Visualization and Interaction in the Automata Theory Course. 31st ACM SIGCSE Technical Symposium on Computer Science Education (SIGCSE 2000), Austin, Texas (Mar. 2000), 6--10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Jarc, D., Feldman, M. B., and Heller, R. S. Assessing the Benefits of Interactive Prediction Using Web-based Algorithm Animation Courseware. 31st ACM SIGCSE Technical Symposium on Computer Science Education (SIGCSE 2000), Austin, Texas (Mar. 2000), 377--381. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Kann, C., Lindeman, R. W., and Heller, R. Integrating Algorithm Animation into a Learning Environment. Computers & Education 28 (1997), 223--228. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Katz, B., and Almstrum, V. Collaborative Project Plans, version 1.3. WWW: http://www.cs.utexas.edu/users/csed/CPP/, Nov. 3, 1998.Google ScholarGoogle Scholar
  33. Keirsey, D. M. Keirsey Temperament and Character Web Site. WWW: http://www.keirsey.com, 2002.Google ScholarGoogle Scholar
  34. Khuri, S. Designing Effective Algorithm Visualizations. First International Program Visualization Workshop, Porvoo, Finland. University of Joensuu Press (Feb. 2001), 1--12.Google ScholarGoogle Scholar
  35. Khuri, S. A User-Centered Approach for Designing Algorithm Visualizations. Informatik / Informatique, Special Issue on Visualization of Software (Apr. 2001), 12--16.Google ScholarGoogle Scholar
  36. Kolb, D. Experiential Learning. Prentice-Hall, New Jersey, 1984.Google ScholarGoogle Scholar
  37. Korhonen, A., and Malmi, L. Algorithm Simulation with Automatic Assessment. 5th Annual ACM SIGCSE/SIGCUE Conference on Innovation and Technology in Computer Science Education (ITiCSE 2000), Helsinki, Finland (July 2000), 160--163. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Korhonen, A., and Malmi, L. Matrix - Concept Animation and Algorithm Simulation System. Proceedings of the Working Conference on Advanced Visual Interface (AVI 2002), Trento, Italy (May 2002), 256--262. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Korhonen, A., Sutinen, E., and Tarhio, J. Understanding Algorithms by Means of Visualized Path Testing. In Software Visualization (2002), S. Diehl, Ed., no. 2269 in Lecture Notes in Computer Science, Springer, pp. 256--268. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Lawrence, A. W. Empirical Studies of the Value of Algorithm Animation in Algorithm Understanding. PhD thesis, Department of Computer Science, Georgia Institute of Technology, 1993. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Mayer, E., and Anderson, R. B. Animations need narrations: An experimental test of a dual-coding hypothesis. Journal of Educational Psychology 83 (1991), 484--490.Google ScholarGoogle ScholarCross RefCross Ref
  42. Naharro-Berrocal, F., Pareja-Flores, C., Urquiza-Fuentes, J., Velázquez-Iturbide, J. A., and Gortázar-Bellas, F. Redesigning the Animation Capabilities of a Functional Programming Environment under an Educational Framework. Second International Program Visualization Workshop, Ärhus, Denmark (June 2002), (in print).Google ScholarGoogle Scholar
  43. Naharro-Berrocal, F., Pareja-Flores, C., and Velázquez-Iturbide, J. A. Automatic Generation of Algorithm Animations in a Programming Environment. 30th ASEE/IEEE Frontiers in Education Conference, Kansas City, Missouri (Oct. 2000), S2C 6--12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Naps, T., Eagan, J., and Norton, L. JHAVÉ: An Environment to Actively Engage Students in Web-based Algorithm Visualizations. 31st ACM SIGCSE Technical Symposium on Computer Science Education (SIGCSE 2000), Austin, Texas (Mar. 2000), 109--113. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Naps, T. L. Incorporating Algorithm Visualization into Educational Theory: A Challenge for the Future. Informatik / Informatique, Special Issue on Visualization of Software (Apr. 2001), 17--21.Google ScholarGoogle Scholar
  46. Niemivirta, M. Motivation and performance in context - the influence of goal orientation and instructional setting on situational appraisals and task performance. International Journal of Psychology in the Orient (2002), (in print).Google ScholarGoogle Scholar
  47. Papert, S. Mindstorms: Children, Computers, and Powerful Ideas. Basic Books, New York, 1980. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Pierson, W., and Rodger, S. H. Web-based Animation of Data Structures Using JAWAA. 29th ACM SIGCSE Technical Symposium on Computer Science Education (SIGCSE '98), Atlanta, Georgia (1998), 267--271. Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Price, B., Baecker, R., and Small, I. An Introduction to Software Visualization. In Software Visualization, J. Stasko, J. Domingue, M. H. Brown, and B. A. Price, Eds. MIT Press, 1998, ch. 1, pp. 3--27.Google ScholarGoogle Scholar
  50. Price, B. A., Baecker, R. M., and Small, I. S. A Principled Taxonomy of Software Visualization. Journal of Visual Languages and Computing 4, 3 (1993), 211--264.Google ScholarGoogle ScholarCross RefCross Ref
  51. Rodger, S. Integrating Animations into Courses. 1st Annual ACM SIGCSE/SIGCUE Conference on Integrating Technology into Computer Science Education (ITiCSE '96), Barcelona, Spain (June 1996), 72--74. Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Ross, R. J. Personal communication, 2002.Google ScholarGoogle Scholar
  53. Rößling, G., and Freisleben, B. ANIMAL: A System for Supporting Multiple Roles in Algorithm Animation. Journal of Visual Languages and Computing 13, 2 (2002), (in print).Google ScholarGoogle ScholarCross RefCross Ref
  54. Stasko, J. TANGO: A Framework and System for Algorithm Animation. IEEE Computer 23 (1990), 27--39. Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Stasko, J. Using Student-built Algorithm Animations as Learning Aids. 28th ACM SIGCSE Technical Symposium on Computer Science Education (SIGCSE '97), San Jose, California (Feb. 1997), 25--29. Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Stasko, J., Badre, A., and Lewis, C. Do Algorithm Animations Assist Learning? An Empirical Study and Analysis. Proceedings of ACM INTERCHI 1993 Conference on Human Factors in Computing Systems (1993), 61--66. Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Stern, L., Søndergaard, H., and Naish, L. A Strategy for Managing Content Complexity in Algorithm Animation. 4th Annual ACM SIGCSE/SIGCUE Conference on Innovation and Technology in Computer Science Education (ITiCSE'99), Cracow, Poland (Sept. 1999), 127--130. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Exploring the role of visualization and engagement in computer science education
      Index terms have been assigned to the content through auto-classification.

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM SIGCSE Bulletin
        ACM SIGCSE Bulletin  Volume 35, Issue 2
        June 2003
        202 pages
        ISSN:0097-8418
        DOI:10.1145/782941
        Issue’s Table of Contents
        • cover image ACM Conferences
          ITiCSE-WGR '02: Working group reports from ITiCSE on Innovation and technology in computer science education
          June 2002
          201 pages
          ISBN:9781450374491
          DOI:10.1145/960568

        Copyright © 2002 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 24 June 2002

        Check for updates

        Qualifiers

        • article

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader