Skip to main content
Top

2019 | OriginalPaper | Chapter

Towards the Design and Deployment of an Item Bank: An Analysis of the Requirements Elicited

Authors : Claudia-Melania Chituc, Marisa Herrmann, Daniel Schiffner, Marc Rittberger

Published in: Advances in Web-Based Learning – ICWL 2019

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Assessments are an important phase in the learning process. Information and communication technologies advancements determined the development of e-learning software tools which support e-learning activities, including e-assessment. The increasing usage of summative and formative e-assessments led to the challenge of managing items. The concept of an item bank is meant to support teachers and students alike, to provide an overview when taking assessments or creating exams. This article presents an on-going R&D project towards the design and deployment of an item bank for computer-based tests, and discusses its role within a service-oriented system architecture which enables the execution of activities related to e-assessment, ranging from item design and test creation, to the analysis of event logs generated by test-takers. The research methodology followed for the requirements elicitation and main findings are presented, and directions for future work are discussed.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Molnar, A.: Computers in education: a brief history. Technol. Horiz. Educ. 24, 63–69 (1997) Molnar, A.: Computers in education: a brief history. Technol. Horiz. Educ. 24, 63–69 (1997)
3.
go back to reference Alruwais, A.N., Wills, G., Wald, M.: Advantages and challenges of using e-assessment. Int. J. Inf. Educ. Technol. 8(1), 34–37 (2018) Alruwais, A.N., Wills, G., Wald, M.: Advantages and challenges of using e-assessment. Int. J. Inf. Educ. Technol. 8(1), 34–37 (2018)
4.
go back to reference Vale, D.C.: Computerized Item Banking (Chap. 11). In: Downing, S.M., Haladyna, T.M. (eds.) Handbook of Test Development, pp. 261–285. Lawrence Erlbaum Associates, Publishers London, Mahwah (2006) Vale, D.C.: Computerized Item Banking (Chap. 11). In: Downing, S.M., Haladyna, T.M. (eds.) Handbook of Test Development, pp. 261–285. Lawrence Erlbaum Associates, Publishers London, Mahwah (2006)
5.
go back to reference Umar, J.: Item banking. In: Masters, G.N., Keeves, J.P. (eds.) Advances in Measurement in Educational Research and Assessment. Pergamon, New York (1999) Umar, J.: Item banking. In: Masters, G.N., Keeves, J.P. (eds.) Advances in Measurement in Educational Research and Assessment. Pergamon, New York (1999)
6.
go back to reference Chapelle, C.A., Voss, E.: 20 years of technology and language assessment in language learning & technology. Lang. Learn. Technol. 20(2), 116–128 (2016) Chapelle, C.A., Voss, E.: 20 years of technology and language assessment in language learning & technology. Lang. Learn. Technol. 20(2), 116–128 (2016)
7.
go back to reference Ward, A.W., Murray-Ward, M.: Guidelines for the development of item banks. Educ. Meas.: Issues Pract. 13(1), 34–39 (1994)CrossRef Ward, A.W., Murray-Ward, M.: Guidelines for the development of item banks. Educ. Meas.: Issues Pract. 13(1), 34–39 (1994)CrossRef
8.
go back to reference Biggs, J.: Aligning teaching and assessment to curriculum objectives, Imaginative Curriculum project, LTSN Generic Center (2003) Biggs, J.: Aligning teaching and assessment to curriculum objectives, Imaginative Curriculum project, LTSN Generic Center (2003)
9.
go back to reference Hettiarachchi, E., Huertas, M.A., Mor, E.: E-assessment system for skill and knowledge assessment in computer engineering education. Int. J. Eng. Educ. 31(2), 529–540 (2015) Hettiarachchi, E., Huertas, M.A., Mor, E.: E-assessment system for skill and knowledge assessment in computer engineering education. Int. J. Eng. Educ. 31(2), 529–540 (2015)
10.
go back to reference Bull, J., Mckenna, C.: Blueprint for Computer-Assisted Assessment. Routledge, London (2003)CrossRef Bull, J., Mckenna, C.: Blueprint for Computer-Assisted Assessment. Routledge, London (2003)CrossRef
11.
go back to reference Tselonis, C., Sargeant, J.: Domain-specific formative feedback through domain-independent diagram matching. In: Khabdia F. (ed.) 11th International Computer Assisted Assessment Conference (CAA), 10–11 July 2007, pp. 403–420. Loughborough University, UK (2007) Tselonis, C., Sargeant, J.: Domain-specific formative feedback through domain-independent diagram matching. In: Khabdia F. (ed.) 11th International Computer Assisted Assessment Conference (CAA), 10–11 July 2007, pp. 403–420. Loughborough University, UK (2007)
12.
go back to reference Sitthiworachart, J., Joy, M., Sutinen, E.: Success factors for e-assessment in computer science education. In: Bonk C., et al. (eds.) Proceedings of E-Learn 2008 – World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education, Las Vegas, USA, pp. 2287–2293 (2008) Sitthiworachart, J., Joy, M., Sutinen, E.: Success factors for e-assessment in computer science education. In: Bonk C., et al. (eds.) Proceedings of E-Learn 2008 – World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education, Las Vegas, USA, pp. 2287–2293 (2008)
13.
go back to reference Marriott, P.: Students’ evaluation of the use of online summative assessment on an undergraduate financial accounting module. Br. J. Educ. Technol. 40(2), 237–254 (2009)CrossRef Marriott, P.: Students’ evaluation of the use of online summative assessment on an undergraduate financial accounting module. Br. J. Educ. Technol. 40(2), 237–254 (2009)CrossRef
14.
go back to reference Daly, C., Pachler, N., Mor, Y., Meller, H.: Exploring formative e-assessment: using case stories and design patterns. Assess. Eval. High. Educ. 35(5), 619–636 (2010)CrossRef Daly, C., Pachler, N., Mor, Y., Meller, H.: Exploring formative e-assessment: using case stories and design patterns. Assess. Eval. High. Educ. 35(5), 619–636 (2010)CrossRef
15.
go back to reference Beevers, C., et al.: What can e-assessment do for learning and teaching? Part 1 of a draft of current and emerging practice review by the e-Assessment Association expert panel. Int. J. E-Assess. 1(2) (2011) Beevers, C., et al.: What can e-assessment do for learning and teaching? Part 1 of a draft of current and emerging practice review by the e-Assessment Association expert panel. Int. J. E-Assess. 1(2) (2011)
16.
go back to reference Wellington, P., Thomas, I., Powell, I., Clarke, B.: Authentic assessment applied to engineering and business undergraduate consulting teams. Int. J. Eng. Educ. 18(2), 168–179 (2002) Wellington, P., Thomas, I., Powell, I., Clarke, B.: Authentic assessment applied to engineering and business undergraduate consulting teams. Int. J. Eng. Educ. 18(2), 168–179 (2002)
17.
go back to reference Millard, D., et al.: Mapping the e-learning assessment domain: concept maps for orientation and navigation, In: Richards, G. (ed.) Proceedings of e-Learn 2005 – World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education, pp. 2770–2775. AACE, Vancouver (2005) Millard, D., et al.: Mapping the e-learning assessment domain: concept maps for orientation and navigation, In: Richards, G. (ed.) Proceedings of e-Learn 2005 – World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education, pp. 2770–2775. AACE, Vancouver (2005)
18.
go back to reference IMS: IMS Question & Test Interoperability Assessment Test, Section and Item Information Model, v2.1, 31 August 2012 (2012) IMS: IMS Question & Test Interoperability Assessment Test, Section and Item Information Model, v2.1, 31 August 2012 (2012)
19.
go back to reference Petersen, M.A., et al.: Development of an item bank for computerized adaptive test (CAT) measurement of pain. Qual. Life Res. 25(1), 1–11 (2016)CrossRef Petersen, M.A., et al.: Development of an item bank for computerized adaptive test (CAT) measurement of pain. Qual. Life Res. 25(1), 1–11 (2016)CrossRef
20.
go back to reference Burrghof, K.L.: Assembling an item-bank for computerized linear and adaptive testing in geography. Int. Educ. J. 2(4), 74–83 (2001) Burrghof, K.L.: Assembling an item-bank for computerized linear and adaptive testing in geography. Int. Educ. J. 2(4), 74–83 (2001)
21.
go back to reference Smith, B., Shane Gallagher, P., Schatz, S., Vogel-Walcutt, J.: Total learning architecture: moving into the future, I/ITSEC, paper no. 18224 (2018) Smith, B., Shane Gallagher, P., Schatz, S., Vogel-Walcutt, J.: Total learning architecture: moving into the future, I/ITSEC, paper no. 18224 (2018)
22.
go back to reference Nuntiyagul, A., Naruedomkul, K., Cercone, N., Wongsawang, D.: Adaptable learning assistant for item bank management. Comput. Educ. 50(1), 357–370 (2008)CrossRef Nuntiyagul, A., Naruedomkul, K., Cercone, N., Wongsawang, D.: Adaptable learning assistant for item bank management. Comput. Educ. 50(1), 357–370 (2008)CrossRef
23.
go back to reference Jackson, M.: Software Requirements & Specifications: A Lexicon of Practice, Principles and Prejudices. Addison-Wesley Publishing Co., ACM Press, Boston, New York (1995) Jackson, M.: Software Requirements & Specifications: A Lexicon of Practice, Principles and Prejudices. Addison-Wesley Publishing Co., ACM Press, Boston, New York (1995)
25.
go back to reference Wiegers, K.E.: Software Requirements, 2nd edn. Microsoft Press, Redmond (2003) Wiegers, K.E.: Software Requirements, 2nd edn. Microsoft Press, Redmond (2003)
26.
go back to reference Lilly, S., Use case pitfalls: top 10 problems from real projects using use cases. In: Proceedings of Technology of Object-Oriented Languages and Systems - TOOLS 30, pp. 174–183, IEEE, Santa Barbara (1999) Lilly, S., Use case pitfalls: top 10 problems from real projects using use cases. In: Proceedings of Technology of Object-Oriented Languages and Systems - TOOLS 30, pp. 174–183, IEEE, Santa Barbara (1999)
27.
go back to reference Kotonya, G., Sommerville, I.: Requirements Engineering: Processes and Techniques, 1st edn. Wiley, Hoboken (1998) Kotonya, G., Sommerville, I.: Requirements Engineering: Processes and Techniques, 1st edn. Wiley, Hoboken (1998)
28.
go back to reference Pohl, K.: Requirements Engineering: Fundamentals, Principles, and Techniques, 1st edn. Springer, Heidelberg (2010)CrossRef Pohl, K.: Requirements Engineering: Fundamentals, Principles, and Techniques, 1st edn. Springer, Heidelberg (2010)CrossRef
29.
go back to reference Chituc, C.-M., Herrmann, M.: Item bank: requirements elicitation and specification, DIPF Technical Report, DIPF (2019) Chituc, C.-M., Herrmann, M.: Item bank: requirements elicitation and specification, DIPF Technical Report, DIPF (2019)
Metadata
Title
Towards the Design and Deployment of an Item Bank: An Analysis of the Requirements Elicited
Authors
Claudia-Melania Chituc
Marisa Herrmann
Daniel Schiffner
Marc Rittberger
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-35758-0_15

Premium Partner