skip to main content
10.1145/1047344.1047422acmconferencesArticle/Chapter ViewAbstractPublication PagessigcseConference Proceedingsconference-collections
Article

Results from the evaluation of the effectiveness of an online tutor on expression evaluation

Published:23 February 2005Publication History

ABSTRACT

Researchers have been developing online tutors for various disciplines, including Computer Science. Educators are increasingly using online tutors to supplement their courses. Are online tutors effective? Can they help students learn? If so, what features contribute to their effectiveness? We will examine these questions in the context of an online tutor that we developed for introductory Computer Science. The tutor is designed to help students learn expression evaluation in C++/Java.We evaluated the tutor over several years, in multiple sections of Computer Science I each year. We used controlled tests with differential treatments, and used pre and post-tests to evaluate the effectiveness of the tutor. Our results show that online tutors indeed help students learn. Students who use the tutor for practice learn better than those who use a printed workbook. Students who receive both graphic visualization and text explanation learn better than those who receive only graphic visualization. Students who use graphic visualization learn better than those who receive no explanation. These results will be of interest to both developers and users of online tutors.

References

  1. Anderson J.R., Corbett A.T., Koedinger K.R. and Pelletier R., "Cognitive Tutors: Lessons Learned", The Journal of the Learning Sciences, Vol No 4(2), 1995, Lawrence Erlbaum Associates, Inc., pp 167--207.Google ScholarGoogle Scholar
  2. Arnow D. and Barshay, O., WebToTeach: An Interactive Focused Programming Exercise System, In proceedings of FIE 1999, San Juan, Puerto Rico (November 1999), Session 12a9.Google ScholarGoogle ScholarCross RefCross Ref
  3. Baldwin, D. Three years experience with Gateway Labs. In Proceedings of ITiCSE '96 (Barcelona, Spain, June 1996), ACM Press, 6--7. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. M. Ben-Ari, Constructivism in Computer Science, Proceedings of 29th SIGCSE Technical Symposium, March 1998, 257--261. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Bloom, B.S.: The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring. Educational Researcher, Vol 13 (1984) 3--16.Google ScholarGoogle Scholar
  6. Bridgeman, S., Goodrich, M.T., Kobourov, S.G., and Tamassia, R. PILOT: An Interactive Tool for Learning and Grading. in Proceedings of SIGCSE '00 (Austin, TX, March 2000), ACM Press, 139--143. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Brusilovsky, P. and Su, H.: Adaptive Visualization Component of a Distributed Web-Based Adaptive Educational System, Proceedings of the 6th international conference on Intelligent Tutoring Systems, June 2002, LNCS 2363, Springer Verlag, 229--238. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Brusilovsky, P., Explanatory Visualization in an educational programming environment: connecting examples with general knowledge. In: B. Blumenthal, J. Gornostaev and C. Unger (eds.) Human Computer Interaction. LNCS 876. Berlin: Springer-Verlag, 202--212. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Dancik, G. and Kumar, A.N., A Tutor for Counter-Controlled Loop Concepts and Its Evaluation, Proceedings of Frontiers in Education Conference (FIE 2003), Boulder, CO, 11/5-8/2003, Session T3C.Google ScholarGoogle ScholarCross RefCross Ref
  10. Etheredge, J. CMeRun: Program Logic Debugging Courseware for CSi/2 Students. Proceedings of 35th SIGCSE Technical Symposium on Computer Science Education, March 2004, 22--25. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Fernandes, E. and Kumar, A.: A Tutor on Scope for the Programming Languages Course, Proceedings of 35th SIGCSE Technical Symposium, Norfolk, VA, (March 2004), 90--95. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Hristova, M., Misra, A., Rutter, M, and Mercuri, R. Identifying and Correcting Java Programming Errors for Introductory Computer Science Students. Proceedings of 34th SIGCSE Technical Symposium on Computer Science Education, February 2003, 153--156. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Kostadinov, R. and Kumar, A.N. A Tutor for Learning Encapsulation in C++ Classes, Proceedings of ED-MEDIA 2003 World Conference on Educational Multimedia, Hypermedia and Telecommunications, Honolulu, HI, 6/23-28/2003, 1311--1314.Google ScholarGoogle Scholar
  14. Kumar, A.N., Learning Programming by Solving Problems, in Informatics Curricula and Teaching Methods, L. Cassel and R.A. Reis ed., Kluwer Academic Publishers, Norwell, MA, 2003, 29--39.Google ScholarGoogle ScholarCross RefCross Ref
  15. Krishna, A., and Kumar A.: A Problem Generator to Learn Expression Evaluation in CS I and Its Effectiveness, The Journal of Computing in Small Colleges, Vol 16, No. 4, (May 2001), 34--43. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Kumar, A.N., A Tutor for Using Dynamic Memory in C++, Proceedings of 2002 Frontiers in Education Conference (FIE 2002), Boston, MA, 11/6-9/2002, Session T4G.Google ScholarGoogle Scholar
  17. Kumar A. Learning the Interaction between Pointers and Scope in C++, Proceedings of The Sixth Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE 2001), Canterbury, UK, (June 2001), 45--48. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Kumar A.N.: Dynamically Generating Problems on Static Scope, Proceedings of The Fifth Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE 2000), Helsinki, Finland, (July 2000), 9--12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Naps, T.L., Eagan, J.R. and Norton L.L. (2000) JHAVE -- an environment to actively engage students in Web-based algorithm visualizations. Proceedings of 31st SIGCSE Technical Symposium on Computer Science Education, March 2000, 32(1), 109--113. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Odekirk-Hash, E. and Zachary, J.L. Automated Feedback on Programs Means Students Need Less Help from Teachers. Proceedings of 32nd SIGCSE Technical Symposium on Computer Science Education, February 2001, 55--59. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Rodger, S., and Gramond, E., JFLAP: An Aid to Study Theorems in Automata Theory, Proceedings of ITiCSE 98, Dublin, Ireland, August 1998, 302. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Shah, H. and Kumar, A.N., A Tutoring System for Parameter Passing in Programming Languages, Proceedings of The Seventh Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE 2002), Aarhus, Denmark, June 2002, 170--174. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Wood, David and Wood, Heather, Vygotsky, Tutoring and Learning, Oxford review of Education 22(1): 5--16, 1996.Google ScholarGoogle Scholar
  24. Yoo, J.P., Seo, S.J. and Yoo, S.K. Designing an Adaptive Tutor for CS-I Laboratory. Proceedings of the 5th International Conference on Internet Computing, Las Vegas, NV, 2004.Google ScholarGoogle Scholar

Index Terms

  1. Results from the evaluation of the effectiveness of an online tutor on expression evaluation

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      SIGCSE '05: Proceedings of the 36th SIGCSE technical symposium on Computer science education
      February 2005
      610 pages
      ISBN:1581139977
      DOI:10.1145/1047344

      Copyright © 2005 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 23 February 2005

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • Article

      Acceptance Rates

      Overall Acceptance Rate1,595of4,542submissions,35%

      Upcoming Conference

      SIGCSE Virtual 2024

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader