Skip to main content
Erschienen in: Software Quality Journal 1/2011

01.03.2011

Metrics-based evaluation of learning object reusability

verfasst von: Javier Sanz-Rodriguez, Juan Manuel Dodero, Salvador Sanchez-Alonso

Erschienen in: Software Quality Journal | Ausgabe 1/2011

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper aims to help in the selection of reusable educational materials from repositories on the web, developing an indicator of the reusability of learning objects. For this purpose, our research will be carried out in three stages. The first, based on previous studies in this area, will determine those aspects that influence reusability. The second will define a set of metrics that measure those aspects using metadata. The third will propose different methods of aggregation in order to obtain a single resulting value and evaluate the efficiency of the model by analyzing a significant set of learning objects obtained from the eLera and Merlot repositories. The results obtained suggest that the proposed indicator could provide useful information when searching for learning objects in repositories. This reusability measurement could constitute an indicator of quality, which would allow search results to be ordered, with those with the greatest possibility of being reused taking priority. Furthermore, the proposed reusability indicator could be calculated automatically or in an assisted way if metadata elements satisfy the minimum quality requisites identified.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Barnard, J. (1998). A new reusability metric for object-oriented software. Software Quality Journal, 7, 35–50.CrossRef Barnard, J. (1998). A new reusability metric for object-oriented software. Software Quality Journal, 7, 35–50.CrossRef
Zurück zum Zitat Barzilai, J. (1997). Deriving weights from pairwise comparison matrices. The Journal of the Operational Research Society, 48(12), 1226–1232.MATH Barzilai, J. (1997). Deriving weights from pairwise comparison matrices. The Journal of the Operational Research Society, 48(12), 1226–1232.MATH
Zurück zum Zitat Boyle, T. (2003). Design principles for authoring dynamic, reusable learning objects. Australian Journal of Educational Technology, 19(1), 46–58. Boyle, T. (2003). Design principles for authoring dynamic, reusable learning objects. Australian Journal of Educational Technology, 19(1), 46–58.
Zurück zum Zitat Cafolla, R. (2006). Project Merlot: Bringing Peer Review to Web-based Educational Resources. Journal of Technology and Teacher Education, 14(2), 313–323. Cafolla, R. (2006). Project Merlot: Bringing Peer Review to Web-based Educational Resources. Journal of Technology and Teacher Education, 14(2), 313–323.
Zurück zum Zitat Campbell, L. (2003). Engaging with the learning object economy. In A. Littlejohn (Ed.), Reusing online resources: A sustainable approach to e-learning (pp. 35–45). London: Kogan Page. Campbell, L. (2003). Engaging with the learning object economy. In A. Littlejohn (Ed.), Reusing online resources: A sustainable approach to e-learning (pp. 35–45). London: Kogan Page.
Zurück zum Zitat Cervera, J. F., Lopez, M. G., Fernandez, C., & Sanchez-Alonso, S. (2009). Quality metrics in learning objects. In F. Sartori, M. A. Sicilia, & N. Manouselis (Eds.), Metadata and semantics research (pp. 135–141). Berlin, Heidelberg: Springer.CrossRef Cervera, J. F., Lopez, M. G., Fernandez, C., & Sanchez-Alonso, S. (2009). Quality metrics in learning objects. In F. Sartori, M. A. Sicilia, & N. Manouselis (Eds.), Metadata and semantics research (pp. 135–141). Berlin, Heidelberg: Springer.CrossRef
Zurück zum Zitat Conte, S. D., Dunsmore, H. E., & Shen, V. Y. (1989). Software engineering metrics and models. San Francisco: Benjamin Cummings. Conte, S. D., Dunsmore, H. E., & Shen, V. Y. (1989). Software engineering metrics and models. San Francisco: Benjamin Cummings.
Zurück zum Zitat Cuadrado-Gallego, J. J., & Sicilia, M. A. (2005). Learning objects reusability metrics: Some ideas from software engineering, In Proceedings of the international conference on internet technologies and applications. Wreham, UK: North East Wales Institute. Cuadrado-Gallego, J. J., & Sicilia, M. A. (2005). Learning objects reusability metrics: Some ideas from software engineering, In Proceedings of the international conference on internet technologies and applications. Wreham, UK: North East Wales Institute.
Zurück zum Zitat Currier, S., & Campbell, L. (2002). Evaluating learning resources for reusability: The dner and learning objects study. In Proceeding of the Australasian society for computers in learning in tertiary education, Auckland, New Zeland. Currier, S., & Campbell, L. (2002). Evaluating learning resources for reusability: The dner and learning objects study. In Proceeding of the Australasian society for computers in learning in tertiary education, Auckland, New Zeland.
Zurück zum Zitat Daniel, B., & Mohan, P. (2004). A model for evaluating learning objects. In Proceedings of the IEEE international conference on advanced learning technologies (pp. 50–60). Daniel, B., & Mohan, P. (2004). A model for evaluating learning objects. In Proceedings of the IEEE international conference on advanced learning technologies (pp. 50–60).
Zurück zum Zitat Downes, S. (2001). Learning objects: Resources for distance education worldwide. International Review of Research in Open and Distance Learning, 2(1). Downes, S. (2001). Learning objects: Resources for distance education worldwide. International Review of Research in Open and Distance Learning, 2(1).
Zurück zum Zitat Duval, E. (2004). Learning technology standardization: Making sense of it all. International Journal on Computer Science and Information Systems, 1(1), 33–43.CrossRef Duval, E. (2004). Learning technology standardization: Making sense of it all. International Journal on Computer Science and Information Systems, 1(1), 33–43.CrossRef
Zurück zum Zitat Duval, E., Warkentyne, K., Haenni, F., Forte, E., Cardinaels, K., Verhoeven, B., et al. (2001). The ariadne knowledge pool system. Communications of the ACM, 44(5), 72–78.CrossRef Duval, E., Warkentyne, K., Haenni, F., Forte, E., Cardinaels, K., Verhoeven, B., et al. (2001). The ariadne knowledge pool system. Communications of the ACM, 44(5), 72–78.CrossRef
Zurück zum Zitat Etzkorn, L. H., Hughes, W. E., & Davis, C. G. (2001). Automated reusability quality analysis. Information and Software Technology, 43(5), 295–308.CrossRef Etzkorn, L. H., Hughes, W. E., & Davis, C. G. (2001). Automated reusability quality analysis. Information and Software Technology, 43(5), 295–308.CrossRef
Zurück zum Zitat Fenton, N. E., & Pfleeger, S. L. (1997). Software metrics (3rd ed.). Boston, Massachusetts: International Thompson Publishing. Fenton, N. E., & Pfleeger, S. L. (1997). Software metrics (3rd ed.). Boston, Massachusetts: International Thompson Publishing.
Zurück zum Zitat Friesen, N. (2009). Open educational resources: New possibilities for change and sustainability. International Review of Research in Open and Distance Learning, 10(5). Friesen, N. (2009). Open educational resources: New possibilities for change and sustainability. International Review of Research in Open and Distance Learning, 10(5).
Zurück zum Zitat Garcia, E., & Sicilia, M. A. (2009). Preliminary explorations on the statistical profiles of highly-rated learning objects. In F. Sartori, M. A. Sicilia, & N. Manouselis (Eds.), Metadata and semantics research (pp. 108–117). Berlin, Heidelberg: Springer.CrossRef Garcia, E., & Sicilia, M. A. (2009). Preliminary explorations on the statistical profiles of highly-rated learning objects. In F. Sartori, M. A. Sicilia, & N. Manouselis (Eds.), Metadata and semantics research (pp. 108–117). Berlin, Heidelberg: Springer.CrossRef
Zurück zum Zitat Glass, R. L. (1995). A structure-based critique of contemporary computing research. Journal of Systems and Software, 28(1), 3–7.CrossRef Glass, R. L. (1995). A structure-based critique of contemporary computing research. Journal of Systems and Software, 28(1), 3–7.CrossRef
Zurück zum Zitat Huddlestone, J., & Pike, J. (2005). Learning object reuse—A four tier model. In the IEE and MOD HFI DTC symposium on people and systems—who are we designing for, London. Huddlestone, J., & Pike, J. (2005). Learning object reuse—A four tier model. In the IEE and MOD HFI DTC symposium on people and systemswho are we designing for, London.
Zurück zum Zitat IEEE. (1993). Std. 610.12–1990. Standard glossary of software engineering terminology. Los Alamitos,CA, USA: IEEE Computer Society Press. IEEE. (1993). Std. 610.12–1990. Standard glossary of software engineering terminology. Los Alamitos,CA, USA: IEEE Computer Society Press.
Zurück zum Zitat Kay, R., & Knaack, L. (2007). Evaluating the learning in learning objects, open learning. The Journal of Open and Distance Learning, 22(1), 5–28.CrossRef Kay, R., & Knaack, L. (2007). Evaluating the learning in learning objects, open learning. The Journal of Open and Distance Learning, 22(1), 5–28.CrossRef
Zurück zum Zitat Kelty, C. M., Burrus, C. S., & Baraniuk, R. G. (2008). Peer review anew: Three principles and a case study in postpublication quality assurance. Proceedings of the IEEE Special Issue on Educational Technology, 96(6), 1000–1011. Kelty, C. M., Burrus, C. S., & Baraniuk, R. G. (2008). Peer review anew: Three principles and a case study in postpublication quality assurance. Proceedings of the IEEE Special Issue on Educational Technology, 96(6), 1000–1011.
Zurück zum Zitat Koper, R. (2003). Combining reusable learning resources and services to pedagogical purposeful units of learning. In A. Littlejohn (Ed.), Reusing online resources: A sustainable approach to elearning (pp. 46–59). London: Kogan Page. Koper, R. (2003). Combining reusable learning resources and services to pedagogical purposeful units of learning. In A. Littlejohn (Ed.), Reusing online resources: A sustainable approach to elearning (pp. 46–59). London: Kogan Page.
Zurück zum Zitat Kumar, V., Nesbit, J. C., & Han, K. (2005). Rating learning object quality with distributed bayesian belief networks: The why and the how. In Fifth IEEE international conference on advanced learning technologies (pp. 685–687). Kumar, V., Nesbit, J. C., & Han, K. (2005). Rating learning object quality with distributed bayesian belief networks: The why and the how. In Fifth IEEE international conference on advanced learning technologies (pp. 685–687).
Zurück zum Zitat Margaritopoulos, T., Margaritopoulos, M., Mavridis, I., & Manitsaris, A. (2009). A fine grained metric system for the completeness of metadata. In Proceedings of third international conference metadata and semantic research, MTSR (pp. 83–94). Milan, Italy. Margaritopoulos, T., Margaritopoulos, M., Mavridis, I., & Manitsaris, A. (2009). A fine grained metric system for the completeness of metadata. In Proceedings of third international conference metadata and semantic research, MTSR (pp. 83–94). Milan, Italy.
Zurück zum Zitat Marichal, J. L. (2000). An axiomatic approach of the discrete choquet integral as a tool to aggregate interacting criteria. IEEE Transactions on Fuzzy Systems, 8(6), 800–807.CrossRefMathSciNet Marichal, J. L. (2000). An axiomatic approach of the discrete choquet integral as a tool to aggregate interacting criteria. IEEE Transactions on Fuzzy Systems, 8(6), 800–807.CrossRefMathSciNet
Zurück zum Zitat Nesbit, J. C., & Belfer, K. (2004). Collaborative evaluation of learning objects. In R. McGreal (Ed.), Online education using learning objects. London: Routledge/Falmer. Nesbit, J. C., & Belfer, K. (2004). Collaborative evaluation of learning objects. In R. McGreal (Ed.), Online education using learning objects. London: Routledge/Falmer.
Zurück zum Zitat Nesbit, J. C., Li, J., & Leacock, T. (2006). Web-based tools for collaborative evaluation of learning resources. Journal on Systemics, Cybernetics and Informatics, 3(5), 102–112. Nesbit, J. C., Li, J., & Leacock, T. (2006). Web-based tools for collaborative evaluation of learning resources. Journal on Systemics, Cybernetics and Informatics, 3(5), 102–112.
Zurück zum Zitat Ochoa, X., & Duval, E. (2007). Relevance ranking metrics for learning objects. In Proceedings of the second European conference on technology enhanced learning (Vol. 4753, pp. 262–276). Springer. Ochoa, X., & Duval, E. (2007). Relevance ranking metrics for learning objects. In Proceedings of the second European conference on technology enhanced learning (Vol. 4753, pp. 262–276). Springer.
Zurück zum Zitat Ochoa, X., & Duval, E. (2008). Measuring learning object reuse, In Proceedings of the 3rd European conference on technology enhanced learning: Times of convergence, Springer-Verlag, Vol. 5192, Lecture Notes in Computer Science, pp. 322–325. Ochoa, X., & Duval, E. (2008). Measuring learning object reuse, In Proceedings of the 3rd European conference on technology enhanced learning: Times of convergence, Springer-Verlag, Vol. 5192, Lecture Notes in Computer Science, pp. 322–325.
Zurück zum Zitat Ochoa, X., & Duval, E. (2009). Quantitative analysis of learning object repositories. IEEE Transactions on Learning Technologies, 2(3), 226–238.CrossRef Ochoa, X., & Duval, E. (2009). Quantitative analysis of learning object repositories. IEEE Transactions on Learning Technologies, 2(3), 226–238.CrossRef
Zurück zum Zitat Omosule, S., Shoniregun, C., & Preston, D. (2008).A framework for culture influence virtual learning environments trust. Third international conference on digital information management, ICDIM (pp. 411–416). London, UK. Omosule, S., Shoniregun, C., & Preston, D. (2008).A framework for culture influence virtual learning environments trust. Third international conference on digital information management, ICDIM (pp. 411–416). London, UK.
Zurück zum Zitat Palmer, K., & Richardson, P. (2004). Learning object reusability—motivation, production and use. In 11th international conference of the association for learning technology. Devon, England:University of Exeter. Palmer, K., & Richardson, P. (2004). Learning object reusability—motivation, production and use. In 11th international conference of the association for learning technology. Devon, England:University of Exeter.
Zurück zum Zitat Pitkanen, S. H., & Silander, P. (2004). Criteria for pedagogical reusability of learning objects enabling adaptation and individualised learning processes. In Proceedings of the IEEE international conference on advanced learning technologies (pp. 246–250). Joensuu, Finland. Pitkanen, S. H., & Silander, P. (2004). Criteria for pedagogical reusability of learning objects enabling adaptation and individualised learning processes. In Proceedings of the IEEE international conference on advanced learning technologies (pp. 246–250). Joensuu, Finland.
Zurück zum Zitat Polsani, P. R. (2003). Use and abuse of reusable learning objects. Journal of Digital Information, 3(4). Polsani, P. R. (2003). Use and abuse of reusable learning objects. Journal of Digital Information, 3(4).
Zurück zum Zitat Poulin, J. (1996). Measuring software reuse: Principles, practices, and economic models. Boston, Massachusetts: Addison-Wesley Longman Publishing. Poulin, J. (1996). Measuring software reuse: Principles, practices, and economic models. Boston, Massachusetts: Addison-Wesley Longman Publishing.
Zurück zum Zitat Riaz, M., Mendes, E., & Tempero, E. D. (2009). A systematic review of software maintainability prediction and metrics. In Proceedings of the third international symposium on empirical software engineering and measurement, ESEM (pp. 367–377). Florida, USA. Riaz, M., Mendes, E., & Tempero, E. D. (2009). A systematic review of software maintainability prediction and metrics. In Proceedings of the third international symposium on empirical software engineering and measurement, ESEM (pp. 367–377). Florida, USA.
Zurück zum Zitat Rodríguez-Ardura, I., Jiménez-Zarco, A. I., Ammetller-Montes, G., & Pacheco-Berna, M. C. (2009). Improving hypermedia teaching resources–new designs for e-learning environments. International Journal of Technology Enhanced Learning, 1(4), 286–296.CrossRef Rodríguez-Ardura, I., Jiménez-Zarco, A. I., Ammetller-Montes, G., & Pacheco-Berna, M. C. (2009). Improving hypermedia teaching resources–new designs for e-learning environments. International Journal of Technology Enhanced Learning, 1(4), 286–296.CrossRef
Zurück zum Zitat Sicilia, M. A. (2004). Reusability and reuse of learning objects, myths, realities and possibilities. In Proceedings of the first pluri-disciplinary symposium on design, evaluation and description of reusable learning contents. Sicilia, M. A. (2004). Reusability and reuse of learning objects, myths, realities and possibilities. In Proceedings of the first pluri-disciplinary symposium on design, evaluation and description of reusable learning contents.
Zurück zum Zitat Sicilia, M.A., & Garcia, E. (2003). On the concepts of usability and reusability of learning objects. International Review of Research in Open and Distance Learning, 4(2). Sicilia, M.A., & Garcia, E. (2003). On the concepts of usability and reusability of learning objects. International Review of Research in Open and Distance Learning, 4(2).
Zurück zum Zitat Sosteric, M., & Hesemeier, S. (2002). When is a learning object not an object. The International Review of Research in Open and Distance Learning, 3(2). Sosteric, M., & Hesemeier, S. (2002). When is a learning object not an object. The International Review of Research in Open and Distance Learning, 3(2).
Zurück zum Zitat Tabachnick, B. G., & Fidell, L. S. (1996). Using multivariate statistics (3rd ed.). New York: HarperCollins. Tabachnick, B. G., & Fidell, L. S. (1996). Using multivariate statistics (3rd ed.). New York: HarperCollins.
Zurück zum Zitat Tzikopoulos, A., Manouselis, N., & Vuorikari, R. (2007). An overview of learning object repositories, in idea group publishing. Learning Objects for Instruction: Design and Evaluation, pp. 44–64. Tzikopoulos, A., Manouselis, N., & Vuorikari, R. (2007). An overview of learning object repositories, in idea group publishing. Learning Objects for Instruction: Design and Evaluation, pp. 44–64.
Zurück zum Zitat Vargo, J., Nesbit J. C., Belfer, K., & Archambault, A. (2003). Learning object evaluation: Computer-mediated collaboration and inter-rater reliability. International Journal of Computers and Applications, 25(3). Vargo, J., Nesbit J. C., Belfer, K., & Archambault, A. (2003). Learning object evaluation: Computer-mediated collaboration and inter-rater reliability. International Journal of Computers and Applications, 25(3).
Zurück zum Zitat Vinoski, S. (2005). Old measures for new services. IEEE Internet Computing, 9(6), 72–74.CrossRef Vinoski, S. (2005). Old measures for new services. IEEE Internet Computing, 9(6), 72–74.CrossRef
Zurück zum Zitat Wiley, D. A. (2002). Connecting learning objects to instructional design theory: A definition, a metaphor and a taxonomy. In D. A. Wiley (Ed.), The instructional use of learning objects (pp. 3–24). Bloomington, Indiana: Agency for Instructional Technology and Association for Educational Communications and Technology. Wiley, D. A. (2002). Connecting learning objects to instructional design theory: A definition, a metaphor and a taxonomy. In D. A. Wiley (Ed.), The instructional use of learning objects (pp. 3–24). Bloomington, Indiana: Agency for Instructional Technology and Association for Educational Communications and Technology.
Zurück zum Zitat Yang, D., & Yang, Q. (2005). Customizable distance learning: Criteria for developing learning objects and learning model templates. In Proceedings of the 7th international conference on electronic commerce, Xi’an (China) (pp. 765–770). ACM. Yang, D., & Yang, Q. (2005). Customizable distance learning: Criteria for developing learning objects and learning model templates. In Proceedings of the 7th international conference on electronic commerce, Xi’an (China) (pp. 765–770). ACM.
Zurück zum Zitat Zimmermann, B., Meyer, M., Rensing, C., & Steinmetz, R. (2007). Improving retrieval of reusable learning resources by estimating adaptation effort. In Proceedings of the first international workshop on learning object discovery and exchange, Vol. 311, pp. 46–53. Zimmermann, B., Meyer, M., Rensing, C., & Steinmetz, R. (2007). Improving retrieval of reusable learning resources by estimating adaptation effort. In Proceedings of the first international workshop on learning object discovery and exchange, Vol. 311, pp. 46–53.
Metadaten
Titel
Metrics-based evaluation of learning object reusability
verfasst von
Javier Sanz-Rodriguez
Juan Manuel Dodero
Salvador Sanchez-Alonso
Publikationsdatum
01.03.2011
Verlag
Springer US
Erschienen in
Software Quality Journal / Ausgabe 1/2011
Print ISSN: 0963-9314
Elektronische ISSN: 1573-1367
DOI
https://doi.org/10.1007/s11219-010-9108-5

Weitere Artikel der Ausgabe 1/2011

Software Quality Journal 1/2011 Zur Ausgabe

Premium Partner