Skip to main content
Top
Published in: Technology, Knowledge and Learning 3/2022

04-04-2021 | Original research

Investigation of The Web-based Self-Assessment System Based on Assessment Analytics in Terms of Perceived Self-intervention

Author: Fatma Bayrak

Published in: Technology, Knowledge and Learning | Issue 3/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The self-assessment system was developed based on the assessment as learning (AaL) approach, in which learners take responsibility for their own learning and use feedback for self-intervention. The feedback as the system’s principal component was produced using assessment data in the system. It is essential for the assessment as learning that students construct their interventions to their learning processes by using assessment feedback. From this point, this study aimed to evaluate the web-based self-assessment system through the lens of student perceived self-intervention. The one-shot case study design (one-group post-test) model, one of weak experimental design, was used as a research design. The web-based self-assessment system was employed over a 10-week period to support face-to-face lessons. At the beginning of the implementation process, students taking the “Measurement and Evaluation in Education” lesson in the education faculty were informed about the system. After the implementation process, the perceived self-intervention scale was used to determine the students' perception. A total of 214 students (71%) took at least one test in the system and gained access to the feedback module. The high level of participation in a non-mandatory system may be considered a success. Learners appeared to have utilized feedback gained from the system in planning self-intervention and monitoring and evaluating the planned intervention's effectiveness.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Footnotes
1
Reviewer comment: “The word “perceived" normally follows subjective comments (e.g. perceived effectiveness, perceived usefulness, perceived ease of use and perceived importance), status (e.g. perceived happiness and perceived stress) or others (e.g. perceived risks and perceived threats). “Self-intervention” is an activity, which does not suit the word “perceived”.” Although the reviewer has a meaningful suggestion, since the name of the scale was used as it is in the manuscript in former articles, it is decided to keep the name.
 
Literature
go back to reference Andrade, H., & Valtcheva, A. (2009). Promoting learning and achievement through self-assessment. Theory into practice, 48(1), 12–19.CrossRef Andrade, H., & Valtcheva, A. (2009). Promoting learning and achievement through self-assessment. Theory into practice, 48(1), 12–19.CrossRef
go back to reference Bajzek, D., Brown, W., Lovett, M. & Rule, G. (2007). Inventing the Digital Dashboard for Learning. In C. Montgomerie & J. Seale (Eds.), Proceedings of ED-MEDIA 2007--World Conference on Educational Multimedia, Hypermedia & Telecommunications (pp. 1084–1092). Vancouver, Canada: Association for the Advancement of Computing in Education (AACE). https://www.learntechlib.org/primary/p/25512/. Accessed 1 June 2019. Bajzek, D., Brown, W., Lovett, M. & Rule, G. (2007). Inventing the Digital Dashboard for Learning. In C. Montgomerie & J. Seale (Eds.), Proceedings of ED-MEDIA 2007--World Conference on Educational Multimedia, Hypermedia & Telecommunications (pp. 1084–1092). Vancouver, Canada: Association for the Advancement of Computing in Education (AACE). https://​www.​learntechlib.​org/​primary/​p/​25512/​. Accessed 1 June 2019.
go back to reference Bayrak, F. (2014). The effectiveness of perceived self intervention in web based self-assessment system (Unpublished doctoral dissertation). University of Hacettepe, Ankara, Turkey. Bayrak, F. (2014). The effectiveness of perceived self intervention in web based self-assessment system (Unpublished doctoral dissertation). University of Hacettepe, Ankara, Turkey.
go back to reference Bayrak, F., & Yurdugül, H. (2016a). Web-tabanlı öz-değerlendirme sisteminde öğrenci uyarı indeksini temel alan öğrenme analitiği modülünün tasarlanması [Designing learning analytics module based on student caution index for web-based self-assessment system]. Eğitim Teknolojisi Kuram ve Uygulama, 6(2), 85–99.CrossRef Bayrak, F., & Yurdugül, H. (2016a). Web-tabanlı öz-değerlendirme sisteminde öğrenci uyarı indeksini temel alan öğrenme analitiği modülünün tasarlanması [Designing learning analytics module based on student caution index for web-based self-assessment system]. Eğitim Teknolojisi Kuram ve Uygulama, 6(2), 85–99.CrossRef
go back to reference Bayrak, F., & Yurdugül, H. (2016b). Web-tabanlı öz-değerlendirme sisteminde öğrenenlerin öz-müdahale algisi ve test alma davranişlarinin başarı üzerine etkisi [The effect of self-intervention perception and test taking behaviour on success in web-based self-assessment system]. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, 7(1), 221–236.CrossRef Bayrak, F., & Yurdugül, H. (2016b). Web-tabanlı öz-değerlendirme sisteminde öğrenenlerin öz-müdahale algisi ve test alma davranişlarinin başarı üzerine etkisi [The effect of self-intervention perception and test taking behaviour on success in web-based self-assessment system]. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, 7(1), 221–236.CrossRef
go back to reference Brew, A. (1999). Towards autonomous assessment: using self-assessment and peer assessment. In S. Brown & A. Glasner (Eds.), Assessment matters in higher education: Choosing and using diverse assessment. (pp. 159–171). Buckingham. Brew, A. (1999). Towards autonomous assessment: using self-assessment and peer assessment. In S. Brown & A. Glasner (Eds.), Assessment matters in higher education: Choosing and using diverse assessment. (pp. 159–171). Buckingham.
go back to reference Brookhart, S. M. (2008). How to give effective feedback to your students. . ASCD. Brookhart, S. M. (2008). How to give effective feedback to your students. . ASCD.
go back to reference Brown, G., & Harris, L. (2013). Student Self-Assessment. In J. H. McMillan (Ed.), SAGE handbook of research on classroom assessment. (pp. 367–393). SAGE.CrossRef Brown, G., & Harris, L. (2013). Student Self-Assessment. In J. H. McMillan (Ed.), SAGE handbook of research on classroom assessment. (pp. 367–393). SAGE.CrossRef
go back to reference Clow , D. (2012). The learning analytics cycle: Closing the loop effectively. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (LAK12) (pp. 134–138), Vancouver, BC, Canada, April 29–May 02, 2012. https://doi.org/10.1145/2330601.2330636 Clow , D. (2012). The learning analytics cycle: Closing the loop effectively. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (LAK12) (pp. 134–138), Vancouver, BC, Canada, April 29–May 02, 2012. https://​doi.​org/​10.​1145/​2330601.​2330636
go back to reference Corrin, L., & de Barba, P. (2015). How do students interpret feedback delivered via dashboards?. In Proceedings of the fifth international conference on learning analytics and knowledge. ACM. pp. 430–431 Corrin, L., & de Barba, P. (2015). How do students interpret feedback delivered via dashboards?. In Proceedings of the fifth international conference on learning analytics and knowledge. ACM. pp. 430–431
go back to reference Dann, R. (2002). Promoting assessment as learning. . Routledge Falmer. Dann, R. (2002). Promoting assessment as learning. . Routledge Falmer.
go back to reference Deno, S. L. (1985). Curriculum-based measurement: The emerging alternative. Exceptional children, 52(3), 219–232.CrossRef Deno, S. L. (1985). Curriculum-based measurement: The emerging alternative. Exceptional children, 52(3), 219–232.CrossRef
go back to reference Deno, S. L. (1998). Curriculum-based measurement and special education services: A fundamental and direct relationship. In M. R. Shinn (Ed.) Curriculum-based measurement: Assessing special children (pp.1-17). Guilford Press. Deno, S. L. (1998). Curriculum-based measurement and special education services: A fundamental and direct relationship. In M. R. Shinn (Ed.) Curriculum-based measurement: Assessing special children (pp.1-17). Guilford Press.
go back to reference Djamasbi, S., & Loiacono, E. (2006). Gender feedback and decision making: How men and women differ on the use of computerized feedback?. In Proceedings of the Twelfth Americas Conference on Information Systems (AMCIS), Acapulco, Mexico, August 2006, pp. 2993–3000. Djamasbi, S., & Loiacono, E. (2006). Gender feedback and decision making: How men and women differ on the use of computerized feedback?. In Proceedings of the Twelfth Americas Conference on Information Systems (AMCIS), Acapulco, Mexico, August 2006, pp. 2993–3000.
go back to reference Dutton, P. J., Bickerstaff, H. E., Rymer, J. M., Webb, M. E., Ballinger-Mills, D., Greenough, A., & Reynolds, P. A. (2017). Investigation of formative assessment of learning (INFORMAL): The performance indicator tool (PIT). Technology, Knowledge and Learning, 22(2), 161–171. https://doi.org/10.1007/s10758-017-9307-2.CrossRef Dutton, P. J., Bickerstaff, H. E., Rymer, J. M., Webb, M. E., Ballinger-Mills, D., Greenough, A., & Reynolds, P. A. (2017). Investigation of formative assessment of learning (INFORMAL): The performance indicator tool (PIT). Technology, Knowledge and Learning, 22(2), 161–171. https://​doi.​org/​10.​1007/​s10758-017-9307-2.CrossRef
go back to reference Earl. (2006). Assessment as learning. In W. D. Hawley (Ed.), The keys to effective schools educational reform as continuous improvement. (pp. 85–98). Corwin Press. Earl. (2006). Assessment as learning. In W. D. Hawley (Ed.), The keys to effective schools educational reform as continuous improvement. (pp. 85–98). Corwin Press.
go back to reference Earl, L., & Katz, S. (2008). Getting to the core of learning: Using assessment for self-monitoring and self-regulation. In S. Swaffield (Ed.), Unlocking Assessment. (pp. 104–118). David Fulton Publishers. Earl, L., & Katz, S. (2008). Getting to the core of learning: Using assessment for self-monitoring and self-regulation. In S. Swaffield (Ed.), Unlocking Assessment. (pp. 104–118). David Fulton Publishers.
go back to reference Ellis, C. (2017). The Importance of E-Portfolios for Effective Student-Facing Learning Analytics. In T. Chaudhuri & B. Cabau (Eds.), E-Portfolios in Higher Education, A Multidisciplinary Approach. (pp. 35–49). Springer.CrossRef Ellis, C. (2017). The Importance of E-Portfolios for Effective Student-Facing Learning Analytics. In T. Chaudhuri & B. Cabau (Eds.), E-Portfolios in Higher Education, A Multidisciplinary Approach. (pp. 35–49). Springer.CrossRef
go back to reference Few, S. (2006). Information dashboard design: The effective visual communication of data. . O’Reilly Media. Few, S. (2006). Information dashboard design: The effective visual communication of data. . O’Reilly Media.
go back to reference Hattie, J., & Gan, M. (2011). Instruction based on feedback. In R. E. Mayer & P. A. Alexander (Eds.), Handbook of research on learning and instruction. (pp. 263–285). London: Routledge. Hattie, J., & Gan, M. (2011). Instruction based on feedback. In R. E. Mayer & P. A. Alexander (Eds.), Handbook of research on learning and instruction. (pp. 263–285). London: Routledge.
go back to reference Ifenthaler, D. (2015). Learning analytics. In J. M. Spector (Ed.), The Sage encyclopedia of educational technology. (Vol. 2, pp. 447–451). Sage Publications. Ifenthaler, D. (2015). Learning analytics. In J. M. Spector (Ed.), The Sage encyclopedia of educational technology. (Vol. 2, pp. 447–451). Sage Publications.
go back to reference Jacobs, J., & Rudis, B. (2014). Data-driven security: analysis, visualization and dashboards. . Wiley. Jacobs, J., & Rudis, B. (2014). Data-driven security: analysis, visualization and dashboards. . Wiley.
go back to reference Kalaycı, Ş. (2010). SPSS Applied multivariate statistical techniques [SPSS Uygulamalı çok değişkenli istatistik teknikleri]. . Asil Yayın Dağıtım. Kalaycı, Ş. (2010). SPSS Applied multivariate statistical techniques [SPSS Uygulamalı çok değişkenli istatistik teknikleri]. . Asil Yayın Dağıtım.
go back to reference Kibble, J. D. (2007). Use of unsupervised online quizzes as formative assessment in a medical physiology course: effects of incentives on student participation and performance. Advances in Physiology Education, 31(3), 253–260.CrossRef Kibble, J. D. (2007). Use of unsupervised online quizzes as formative assessment in a medical physiology course: effects of incentives on student participation and performance. Advances in Physiology Education, 31(3), 253–260.CrossRef
go back to reference Kibble, J. D. (2011). Voluntary participation in online formative quizzes is a sensitive predictor of student success. Advances in Physiology Education, 35(1), 95–96.CrossRef Kibble, J. D. (2011). Voluntary participation in online formative quizzes is a sensitive predictor of student success. Advances in Physiology Education, 35(1), 95–96.CrossRef
go back to reference Korkut Altuna, O. K., & Arslan, F. M. (2016). Impact of the number of scale points on data characteristics and respondents’ evaluations: An experimental design approach using 5-point and 7-point likert-type scales. Siyasal Journal Of Political Sciences., 55, 1–20. Korkut Altuna, O. K., & Arslan, F. M. (2016). Impact of the number of scale points on data characteristics and respondents’ evaluations: An experimental design approach using 5-point and 7-point likert-type scales. Siyasal Journal Of Political Sciences., 55, 1–20.
go back to reference Kovanović, V., Joksimović, S., Gašević, D., Hatala, M., & Siemens, G. (2015). Content analytics: The definition, scope, and an overview of published research. In C. Lang, G. Siemens, A. Wise, & D. Gašević (Eds.) Handbook of Learning Analytics (pp 77–92). Society for Learning Analytics Research. Kovanović, V., Joksimović, S., Gašević, D., Hatala, M., & Siemens, G. (2015). Content analytics: The definition, scope, and an overview of published research. In C. Lang, G. Siemens, A. Wise, & D. Gašević (Eds.) Handbook of Learning Analytics (pp 77–92). Society for Learning Analytics Research.
go back to reference Lal, P. (2014). Designing online learning strategies through analytics. In: F. J. García-Peñalvo & A. M. Seoane Pardo (Eds.), Online Tutor 2.0: Methodologies and Case Studies for Successful Learning: Methodologies and case studies for successful learning. Hershey, PA: IGI Global. pp. 1–15. Lal, P. (2014). Designing online learning strategies through analytics. In: F. J. García-Peñalvo & A. M. Seoane Pardo (Eds.), Online Tutor 2.0: Methodologies and Case Studies for Successful Learning: Methodologies and case studies for successful learning. Hershey, PA: IGI Global. pp. 1–15.
go back to reference McMillan, J. H. (Ed.). (2007). Formative classroom assessment: Research, theory and practice. . Teacher’s College Press. McMillan, J. H. (Ed.). (2007). Formative classroom assessment: Research, theory and practice. . Teacher’s College Press.
go back to reference Mory, E. H. (2004). Feedback research revisited. In D. H. Jonassen (Ed.), Handbook of research on educational communications and technology. (pp. 745–783). Lawrence Erlbaum Associates Publishers. Mory, E. H. (2004). Feedback research revisited. In D. H. Jonassen (Ed.), Handbook of research on educational communications and technology. (pp. 745–783). Lawrence Erlbaum Associates Publishers.
go back to reference Mottus, A., Kinshuk, G. S., & Chen, N.-S. (2015). Use of dashboards and visualization techniques to support teacher decision making. Lecture notes in educational technologyIn Huang R. Kinshuk (Ed.), Ubiquitous learning environments and technologies. (pp. 181–199). Heidelberg: Springer.CrossRef Mottus, A., Kinshuk, G. S., & Chen, N.-S. (2015). Use of dashboards and visualization techniques to support teacher decision making. Lecture notes in educational technologyIn Huang R. Kinshuk (Ed.), Ubiquitous learning environments and technologies. (pp. 181–199). Heidelberg: Springer.CrossRef
go back to reference Narciss, S. (2017). Conditions and effects of feedback viewed through the lens of the interactive tutoring feedback model. Scaling up assessment for learning in higher education. (pp. 173–189). Singapore: Springer.CrossRef Narciss, S. (2017). Conditions and effects of feedback viewed through the lens of the interactive tutoring feedback model. Scaling up assessment for learning in higher education. (pp. 173–189). Singapore: Springer.CrossRef
go back to reference Nicol, D., & Milligan, C. (2006). Rethinking technology-supported assessment practices in relation to the seven principles of good feedback practice. In C. Bryan, C. Bryan, & K. Clegg (Eds.), Innovative Assessment in Higher Education. (pp. 64–77). London: Routledge. Nicol, D., & Milligan, C. (2006). Rethinking technology-supported assessment practices in relation to the seven principles of good feedback practice. In C. Bryan, C. Bryan, & K. Clegg (Eds.), Innovative Assessment in Higher Education. (pp. 64–77). London: Routledge.
go back to reference Nouira, A., Cheniti-Belcadhi, L., & Braham, R. (2017). An Ontological Model for Assessment Analytics. In Proceedings of the 13th International Conference on Web Information Systems and Technologies (WEBIST 2017) pp 243–251. Nouira, A., Cheniti-Belcadhi, L., & Braham, R. (2017). An Ontological Model for Assessment Analytics. In Proceedings of the 13th International Conference on Web Information Systems and Technologies (WEBIST 2017) pp 243–251.
go back to reference Nouira, A., Cheniti-Belcadhi, L., & Braham, R. (2018). An enhanced xAPI data model supporting assessment analytics. Procedia Computer Science, 126, 566–575.CrossRef Nouira, A., Cheniti-Belcadhi, L., & Braham, R. (2018). An enhanced xAPI data model supporting assessment analytics. Procedia Computer Science, 126, 566–575.CrossRef
go back to reference O’Rourke, N., & Hatcher, L. (2013). A step-by-step approach to using SAS for factor analysis and structural equation modeling. . Sas Institute. O’Rourke, N., & Hatcher, L. (2013). A step-by-step approach to using SAS for factor analysis and structural equation modeling. . Sas Institute.
go back to reference Papamitsiou, Z., & Economides, A. A. (2016). An assessment analytics framework (AAF) for enhancing students’ progress. In S. Caballé & R. Clarisó (Eds.), Formative assessment, learning data analytics and Gamification. (pp. 117–133). Academic Press.CrossRef Papamitsiou, Z., & Economides, A. A. (2016). An assessment analytics framework (AAF) for enhancing students’ progress. In S. Caballé & R. Clarisó (Eds.), Formative assessment, learning data analytics and Gamification. (pp. 117–133). Academic Press.CrossRef
go back to reference Pellegrino, J. W., Chudowsky, N., & Glaser, R. (2001). Knowing what students know: The science and design of educational assessment. . National Academy Press. Pellegrino, J. W., Chudowsky, N., & Glaser, R. (2001). Knowing what students know: The science and design of educational assessment. . National Academy Press.
go back to reference Rodríguez-Gómez, G., & Ibarra-Sáiz, M. S (2015). Assessment as learning and empowerment: Towards sustainable learning in higher education. In: M. Peris-Ortiz & J. M. Merigó Lindahl (Eds.), Sustainable Learning in Higher Education Developing Competencies for the Global Marketplace. Springer. pp. 1–20. Rodríguez-Gómez, G., & Ibarra-Sáiz, M. S (2015). Assessment as learning and empowerment: Towards sustainable learning in higher education. In: M. Peris-Ortiz & J. M. Merigó Lindahl (Eds.), Sustainable Learning in Higher Education Developing Competencies for the Global Marketplace. Springer. pp. 1–20.
go back to reference Webb, M., & Ifenthaler, D. (2018). Assessment as, for, and of twenty-first-century learning using information technology: An overview. In J. Voogt, G. Knezek, R. Christensen, & K.-W. Lai (Eds.), Second handbook of information technology in primary and secondary education. (pp. 1–20). New York: Springer. Webb, M., & Ifenthaler, D. (2018). Assessment as, for, and of twenty-first-century learning using information technology: An overview. In J. Voogt, G. Knezek, R. Christensen, & K.-W. Lai (Eds.), Second handbook of information technology in primary and secondary education. (pp. 1–20). New York: Springer.
Metadata
Title
Investigation of The Web-based Self-Assessment System Based on Assessment Analytics in Terms of Perceived Self-intervention
Author
Fatma Bayrak
Publication date
04-04-2021
Publisher
Springer Netherlands
Published in
Technology, Knowledge and Learning / Issue 3/2022
Print ISSN: 2211-1662
Electronic ISSN: 2211-1670
DOI
https://doi.org/10.1007/s10758-021-09511-8

Other articles of this Issue 3/2022

Technology, Knowledge and Learning 3/2022 Go to the issue

Premium Partners