Abstract
Visualization technology can be used to graphically illustrate various concepts in computer science. We argue that such technology, no matter how well it is designed, is of little educational value unless it engages learners in an active learning activity. Drawing on a review of experimental studies of visualization effectiveness, we motivate this position against the backdrop of current attitudes and best practices with respect to visualization use. We suggest a new taxonomy of learner engagement with visualization technology. Grounded in Bloom's well-recognized taxonomy of understanding, we suggest metrics for assessing the learning outcomes to which such engagement may lead. Based on these taxonomies of engagement and effectiveness metrics, we present a framework for experimental studies of visualization effectiveness. Interested computer science educators are invited to collaborate with us by carrying out studies within this framework.
- Anderson, J. M., and Naps, T. L. A Context for the Assessment of Algorithm Visualization System as Pedagogical Tools. First International Program Visualization Workshop, Porvoo, Finland. University of Joensuu Press (July 2001), 121--130.Google Scholar
- Baecker, R. Sorting Out Sorting: A Case Study of Software Visualization for Teaching Computer Science. In Software Visualization, J. Stasko, J. Domingue, M. H. Brown, and B. A. Price, Eds. MIT Press, 1998, ch. 24, pp. 369--381.Google Scholar
- Bazik, J., Tamassia, R., Reiss, S. P., and van Dam, A. Software Visualization in Teaching at Brown University. In Software Visualization, J. Stasko, J. Domingue, M. H. Brown, and B. A. Price, Eds. MIT Press, 1998, ch. 25, pp. 382--398.Google Scholar
- Biermann, H., and Cole, R. Comic Strips for Algorithm Visualization. Tech. rep., NYU 1999--778, New York University, Feb. 1999. Google ScholarDigital Library
- Bloom, B. S., and Krathwohl, D. R. Taxonomy of Educational Objectives; the Classification of Educational Goals, Handbook I: Cognitive Domain. AddisonWesley, 1956.Google Scholar
- Boroni, C. M., Eneboe, T. J., Goosey, F. W., Ross, J. A., and Ross, R. J. Dancing with Dynalab, Endearing the Science of Computing to Students. Twenty-seventh SIGCSE Technical Symposium on Computer Science Education (1996), 135--139. Google ScholarDigital Library
- Bridgeman, S., Goodrich, M. T., Kobourov, S. G., and Tamassia, R. PILOT: An Interactive Tool for Learning and Grading. 31st ACM SIGCSE Technical Symposium on Computer Science Education (SIGCSE 2000), Austin, Texas (Mar. 2000), 139--143. Google ScholarDigital Library
- Brown, M. H. Algorithm Animation. MIT Press, Cambridge, Massachussets, 1988.Google Scholar
- Brown, M. H., and Raisamo, R. JCAT: Collaborative Active Textbooks Using Java. Computer Networks and ISDN Systems 29 (1997), 1577--1586. Google ScholarDigital Library
- Brown, M. H., and Sedgewick, R. A System for Algorithm Animation Structures. ACM SIGGRAPH '84 Proceedings, Minneapolis, Minnesota (July 1984), 177--186. Google ScholarDigital Library
- Byrne, M. D., Catrambone, R., and Stasko, J. Evaluating Animations as Student Aids in Learning Computer Algorithms. Computers & Education 33 (1996), 253--278. Google ScholarDigital Library
- Citrin, W., and Gurka, J. A Low-Overhead Technique for Dynamic Blackboarding Using Morphing Technology. Computers & Education 26, 4 (1996), 189--196. Google ScholarDigital Library
- Crosby, M. E., and Stelovsky, J. From Multimedia Instruction to Multimedia Evaluation. Journal of Educational Multimedia and Hypermedia 4 (1995), 147--162. Google ScholarDigital Library
- Dann, W., Cooper, S., and Pausch, R. Using Visualization To Teach Novices Recursion. 6th Annual ACM SIGCSE/SIGCUE Conference on Innovation and Technology in Computer Science Education (ITiCSE 2001), Canterbury, England (June 2001), 109--112. Google ScholarDigital Library
- Faltin, N. Structure and Constraints in Interactive Exploratory Algorithm Learning. In Software Visualization (2002), S. Diehl, Ed., no. 2269 in Lecture Notes in Computer Science, Springer, pp. 213--226. Google ScholarDigital Library
- Felder, R. M. Reaching the second tier. Journal of College Science Teaching 23, 5 (1993), 286--290.Google Scholar
- Felder, R. M. Matters of style. ASEE Prism 6, 4 (1996), 18--23.Google Scholar
- Gloor, P. A. User Interface Issues for Algorithm Animation. In Software Visualization, J. Stasko, J. Domingue, M. H. Brown, and B. A. Price, Eds. MIT Press, 1998, ch. 11, pp. 145--152.Google Scholar
- Grissom, S. Personal communication, 2002.Google Scholar
- Gurka, J. S. Pedagogic Aspects of Algorithm Animation. PhD thesis, Department of Computer Science, University of Colorado, 1996. Google ScholarDigital Library
- Haajanen, J., Pesonius, M., Sutinen, E., Tarhio, J., Teräsvirta, T., and Vanninen, P. Animation of User Algorithms on the Web. IEEE Symposium on Visual Languages (1997), 360--367. Google ScholarDigital Library
- Hansen, S., Schrimpsher, D., and Narayanan, N. H., From Algorithm Animations to Animation-Embedded Hypermedia Visualizations. Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications (ED-MEDIA 1999), Seattle, Washington (1999), 1032--1037.Google Scholar
- Hansen, S. R., Narayanan, N. H., and Schrimpsher, D. Helping Learners Visualize and Comprehend Algorithms. Interactive Multimedia Electronic Journal of Computer-Enhanced Learning 2, 1 (2000).Google Scholar
- Hundhausen, C. D. Toward Effective Algorithm Visualization Artifacts: Designing for Participation and Communication in an Undergraduate Algorithms Course. PhD thesis, University of Oregon, 1999. Unpublished Doctoral Dissertation, available as technical report CIS-TR-99-07 (June 1999) in Department of Computer and Information Science, University of Oregon, Eugene. Google ScholarDigital Library
- Hundhausen, C. D. Integrating Algorithm Visualization Technology into an Undergraduate Algorithms Course: Ethnographic Studies of a Social Constructivist Approach. Computers & Education (2002), (in print). Google ScholarDigital Library
- Hundhausen, C. D., and Douglas, S. Using Visualizations to Learn Algorithms: Should Students Construct Their Own, or View an Expert's? IEEE Symposium on Visual Languages, Los Alamitos, California (2000), 21--28. Google ScholarDigital Library
- Hundhausen, C. D., and Douglas, S. A. Low-Fidelity Algorithm Visualization. Journal of Visual Languages and Computing (2002), (in print).Google Scholar
- Hundhausen, C. D., Douglas, S. A., and Stasko, J. T. A Meta-Study of Algorithm Visualization Effectiveness. Journal of Visual Languages and Computing (2002), (in print).Google Scholar
- Hung, T., and Rodger, S. H. Increasing Visualization and Interaction in the Automata Theory Course. 31st ACM SIGCSE Technical Symposium on Computer Science Education (SIGCSE 2000), Austin, Texas (Mar. 2000), 6--10. Google ScholarDigital Library
- Jarc, D., Feldman, M. B., and Heller, R. S. Assessing the Benefits of Interactive Prediction Using Web-based Algorithm Animation Courseware. 31st ACM SIGCSE Technical Symposium on Computer Science Education (SIGCSE 2000), Austin, Texas (Mar. 2000), 377--381. Google ScholarDigital Library
- Kann, C., Lindeman, R. W., and Heller, R. Integrating Algorithm Animation into a Learning Environment. Computers & Education 28 (1997), 223--228. Google ScholarDigital Library
- Katz, B., and Almstrum, V. Collaborative Project Plans, version 1.3. WWW: http://www.cs.utexas.edu/users/csed/CPP/, Nov. 3, 1998.Google Scholar
- Keirsey, D. M. Keirsey Temperament and Character Web Site. WWW: http://www.keirsey.com, 2002.Google Scholar
- Khuri, S. Designing Effective Algorithm Visualizations. First International Program Visualization Workshop, Porvoo, Finland. University of Joensuu Press (Feb. 2001), 1--12.Google Scholar
- Khuri, S. A User-Centered Approach for Designing Algorithm Visualizations. Informatik / Informatique, Special Issue on Visualization of Software (Apr. 2001), 12--16.Google Scholar
- Kolb, D. Experiential Learning. Prentice-Hall, New Jersey, 1984.Google Scholar
- Korhonen, A., and Malmi, L. Algorithm Simulation with Automatic Assessment. 5th Annual ACM SIGCSE/SIGCUE Conference on Innovation and Technology in Computer Science Education (ITiCSE 2000), Helsinki, Finland (July 2000), 160--163. Google ScholarDigital Library
- Korhonen, A., and Malmi, L. Matrix - Concept Animation and Algorithm Simulation System. Proceedings of the Working Conference on Advanced Visual Interface (AVI 2002), Trento, Italy (May 2002), 256--262. Google ScholarDigital Library
- Korhonen, A., Sutinen, E., and Tarhio, J. Understanding Algorithms by Means of Visualized Path Testing. In Software Visualization (2002), S. Diehl, Ed., no. 2269 in Lecture Notes in Computer Science, Springer, pp. 256--268. Google ScholarDigital Library
- Lawrence, A. W. Empirical Studies of the Value of Algorithm Animation in Algorithm Understanding. PhD thesis, Department of Computer Science, Georgia Institute of Technology, 1993. Google ScholarDigital Library
- Mayer, E., and Anderson, R. B. Animations need narrations: An experimental test of a dual-coding hypothesis. Journal of Educational Psychology 83 (1991), 484--490.Google ScholarCross Ref
- Naharro-Berrocal, F., Pareja-Flores, C., Urquiza-Fuentes, J., Velázquez-Iturbide, J. A., and Gortázar-Bellas, F. Redesigning the Animation Capabilities of a Functional Programming Environment under an Educational Framework. Second International Program Visualization Workshop, Ärhus, Denmark (June 2002), (in print).Google Scholar
- Naharro-Berrocal, F., Pareja-Flores, C., and Velázquez-Iturbide, J. A. Automatic Generation of Algorithm Animations in a Programming Environment. 30th ASEE/IEEE Frontiers in Education Conference, Kansas City, Missouri (Oct. 2000), S2C 6--12. Google ScholarDigital Library
- Naps, T., Eagan, J., and Norton, L. JHAVÉ: An Environment to Actively Engage Students in Web-based Algorithm Visualizations. 31st ACM SIGCSE Technical Symposium on Computer Science Education (SIGCSE 2000), Austin, Texas (Mar. 2000), 109--113. Google ScholarDigital Library
- Naps, T. L. Incorporating Algorithm Visualization into Educational Theory: A Challenge for the Future. Informatik / Informatique, Special Issue on Visualization of Software (Apr. 2001), 17--21.Google Scholar
- Niemivirta, M. Motivation and performance in context - the influence of goal orientation and instructional setting on situational appraisals and task performance. International Journal of Psychology in the Orient (2002), (in print).Google Scholar
- Papert, S. Mindstorms: Children, Computers, and Powerful Ideas. Basic Books, New York, 1980. Google ScholarDigital Library
- Pierson, W., and Rodger, S. H. Web-based Animation of Data Structures Using JAWAA. 29th ACM SIGCSE Technical Symposium on Computer Science Education (SIGCSE '98), Atlanta, Georgia (1998), 267--271. Google ScholarDigital Library
- Price, B., Baecker, R., and Small, I. An Introduction to Software Visualization. In Software Visualization, J. Stasko, J. Domingue, M. H. Brown, and B. A. Price, Eds. MIT Press, 1998, ch. 1, pp. 3--27.Google Scholar
- Price, B. A., Baecker, R. M., and Small, I. S. A Principled Taxonomy of Software Visualization. Journal of Visual Languages and Computing 4, 3 (1993), 211--264.Google ScholarCross Ref
- Rodger, S. Integrating Animations into Courses. 1st Annual ACM SIGCSE/SIGCUE Conference on Integrating Technology into Computer Science Education (ITiCSE '96), Barcelona, Spain (June 1996), 72--74. Google ScholarDigital Library
- Ross, R. J. Personal communication, 2002.Google Scholar
- Rößling, G., and Freisleben, B. ANIMAL: A System for Supporting Multiple Roles in Algorithm Animation. Journal of Visual Languages and Computing 13, 2 (2002), (in print).Google ScholarCross Ref
- Stasko, J. TANGO: A Framework and System for Algorithm Animation. IEEE Computer 23 (1990), 27--39. Google ScholarDigital Library
- Stasko, J. Using Student-built Algorithm Animations as Learning Aids. 28th ACM SIGCSE Technical Symposium on Computer Science Education (SIGCSE '97), San Jose, California (Feb. 1997), 25--29. Google ScholarDigital Library
- Stasko, J., Badre, A., and Lewis, C. Do Algorithm Animations Assist Learning? An Empirical Study and Analysis. Proceedings of ACM INTERCHI 1993 Conference on Human Factors in Computing Systems (1993), 61--66. Google ScholarDigital Library
- Stern, L., Søndergaard, H., and Naish, L. A Strategy for Managing Content Complexity in Algorithm Animation. 4th Annual ACM SIGCSE/SIGCUE Conference on Innovation and Technology in Computer Science Education (ITiCSE'99), Cracow, Poland (Sept. 1999), 127--130. Google ScholarDigital Library
Index Terms
- Exploring the role of visualization and engagement in computer science education
Recommendations
Exploring the role of visualization and engagement in computer science education
ITiCSE-WGR '02: Working group reports from ITiCSE on Innovation and technology in computer science educationVisualization technology can be used to graphically illustrate various concepts in computer science. We argue that such technology, no matter how well it is designed, is of little educational value unless it engages learners in an active learning ...
Motivational active learning for computer science education (abstract only)
SIGCSE '14: Proceedings of the 45th ACM technical symposium on Computer science educationMotivational Active Learning (MAL) is an innovative pedagogical approach based on MIT's teaching format TEAL (Technology-Enabled Active Learning) combined with advanced motivational strategies based on gamification design aspects. The main idea of MAL ...
Visualization in education of theoretical computer science
CompSysTech '07: Proceedings of the 2007 international conference on Computer systems and technologiesThe paper describe the possibility of using visualization in education of theoretical computer science. Abstract computational models are used frequently in theoretical computer science. We have developed an animations that visualize a concrete examples ...
Comments