ABSTRACT
Researchers have been developing online tutors for various disciplines, including Computer Science. Educators are increasingly using online tutors to supplement their courses. Are online tutors effective? Can they help students learn? If so, what features contribute to their effectiveness? We will examine these questions in the context of an online tutor that we developed for introductory Computer Science. The tutor is designed to help students learn expression evaluation in C++/Java.We evaluated the tutor over several years, in multiple sections of Computer Science I each year. We used controlled tests with differential treatments, and used pre and post-tests to evaluate the effectiveness of the tutor. Our results show that online tutors indeed help students learn. Students who use the tutor for practice learn better than those who use a printed workbook. Students who receive both graphic visualization and text explanation learn better than those who receive only graphic visualization. Students who use graphic visualization learn better than those who receive no explanation. These results will be of interest to both developers and users of online tutors.
- Anderson J.R., Corbett A.T., Koedinger K.R. and Pelletier R., "Cognitive Tutors: Lessons Learned", The Journal of the Learning Sciences, Vol No 4(2), 1995, Lawrence Erlbaum Associates, Inc., pp 167--207.Google Scholar
- Arnow D. and Barshay, O., WebToTeach: An Interactive Focused Programming Exercise System, In proceedings of FIE 1999, San Juan, Puerto Rico (November 1999), Session 12a9.Google ScholarCross Ref
- Baldwin, D. Three years experience with Gateway Labs. In Proceedings of ITiCSE '96 (Barcelona, Spain, June 1996), ACM Press, 6--7. Google ScholarDigital Library
- M. Ben-Ari, Constructivism in Computer Science, Proceedings of 29th SIGCSE Technical Symposium, March 1998, 257--261. Google ScholarDigital Library
- Bloom, B.S.: The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring. Educational Researcher, Vol 13 (1984) 3--16.Google Scholar
- Bridgeman, S., Goodrich, M.T., Kobourov, S.G., and Tamassia, R. PILOT: An Interactive Tool for Learning and Grading. in Proceedings of SIGCSE '00 (Austin, TX, March 2000), ACM Press, 139--143. Google ScholarDigital Library
- Brusilovsky, P. and Su, H.: Adaptive Visualization Component of a Distributed Web-Based Adaptive Educational System, Proceedings of the 6th international conference on Intelligent Tutoring Systems, June 2002, LNCS 2363, Springer Verlag, 229--238. Google ScholarDigital Library
- Brusilovsky, P., Explanatory Visualization in an educational programming environment: connecting examples with general knowledge. In: B. Blumenthal, J. Gornostaev and C. Unger (eds.) Human Computer Interaction. LNCS 876. Berlin: Springer-Verlag, 202--212. Google ScholarDigital Library
- Dancik, G. and Kumar, A.N., A Tutor for Counter-Controlled Loop Concepts and Its Evaluation, Proceedings of Frontiers in Education Conference (FIE 2003), Boulder, CO, 11/5-8/2003, Session T3C.Google ScholarCross Ref
- Etheredge, J. CMeRun: Program Logic Debugging Courseware for CSi/2 Students. Proceedings of 35th SIGCSE Technical Symposium on Computer Science Education, March 2004, 22--25. Google ScholarDigital Library
- Fernandes, E. and Kumar, A.: A Tutor on Scope for the Programming Languages Course, Proceedings of 35th SIGCSE Technical Symposium, Norfolk, VA, (March 2004), 90--95. Google ScholarDigital Library
- Hristova, M., Misra, A., Rutter, M, and Mercuri, R. Identifying and Correcting Java Programming Errors for Introductory Computer Science Students. Proceedings of 34th SIGCSE Technical Symposium on Computer Science Education, February 2003, 153--156. Google ScholarDigital Library
- Kostadinov, R. and Kumar, A.N. A Tutor for Learning Encapsulation in C++ Classes, Proceedings of ED-MEDIA 2003 World Conference on Educational Multimedia, Hypermedia and Telecommunications, Honolulu, HI, 6/23-28/2003, 1311--1314.Google Scholar
- Kumar, A.N., Learning Programming by Solving Problems, in Informatics Curricula and Teaching Methods, L. Cassel and R.A. Reis ed., Kluwer Academic Publishers, Norwell, MA, 2003, 29--39.Google ScholarCross Ref
- Krishna, A., and Kumar A.: A Problem Generator to Learn Expression Evaluation in CS I and Its Effectiveness, The Journal of Computing in Small Colleges, Vol 16, No. 4, (May 2001), 34--43. Google ScholarDigital Library
- Kumar, A.N., A Tutor for Using Dynamic Memory in C++, Proceedings of 2002 Frontiers in Education Conference (FIE 2002), Boston, MA, 11/6-9/2002, Session T4G.Google Scholar
- Kumar A. Learning the Interaction between Pointers and Scope in C++, Proceedings of The Sixth Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE 2001), Canterbury, UK, (June 2001), 45--48. Google ScholarDigital Library
- Kumar A.N.: Dynamically Generating Problems on Static Scope, Proceedings of The Fifth Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE 2000), Helsinki, Finland, (July 2000), 9--12. Google ScholarDigital Library
- Naps, T.L., Eagan, J.R. and Norton L.L. (2000) JHAVE -- an environment to actively engage students in Web-based algorithm visualizations. Proceedings of 31st SIGCSE Technical Symposium on Computer Science Education, March 2000, 32(1), 109--113. Google ScholarDigital Library
- Odekirk-Hash, E. and Zachary, J.L. Automated Feedback on Programs Means Students Need Less Help from Teachers. Proceedings of 32nd SIGCSE Technical Symposium on Computer Science Education, February 2001, 55--59. Google ScholarDigital Library
- Rodger, S., and Gramond, E., JFLAP: An Aid to Study Theorems in Automata Theory, Proceedings of ITiCSE 98, Dublin, Ireland, August 1998, 302. Google ScholarDigital Library
- Shah, H. and Kumar, A.N., A Tutoring System for Parameter Passing in Programming Languages, Proceedings of The Seventh Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE 2002), Aarhus, Denmark, June 2002, 170--174. Google ScholarDigital Library
- Wood, David and Wood, Heather, Vygotsky, Tutoring and Learning, Oxford review of Education 22(1): 5--16, 1996.Google Scholar
- Yoo, J.P., Seo, S.J. and Yoo, S.K. Designing an Adaptive Tutor for CS-I Laboratory. Proceedings of the 5th International Conference on Internet Computing, Las Vegas, NV, 2004.Google Scholar
Index Terms
- Results from the evaluation of the effectiveness of an online tutor on expression evaluation
Recommendations
Results from the evaluation of the effectiveness of an online tutor on expression evaluation
Researchers have been developing online tutors for various disciplines, including Computer Science. Educators are increasingly using online tutors to supplement their courses. Are online tutors effective? Can they help students learn? If so, what ...
The Effectiveness of Visualization for Learning Expression Evaluation: A Reproducibility Study
ITiCSE '16: Proceedings of the 2016 ACM Conference on Innovation and Technology in Computer Science EducationA study was conducted to reproduce the results of an earlier study on the effectiveness of visualization for learning expression evaluation in a problem-solving software tutor on arithmetic expressions. In the current reproducibility study, data was ...
Comments