Skip to main content
Top
Published in: Universal Access in the Information Society 4/2018

05-01-2017 | Long Paper

Digital assessment in higher education

Promoting universal usability through requirements specification and universal design quality (UD-Q) reviews

Authors: Miriam Eileen Nes Begnum, Rikke Julie Foss-Pedersen

Published in: Universal Access in the Information Society | Issue 4/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Statistics show there is a clear relationship between higher education and employment in Norway, especially for people with disabilities. The use of digital assessment solutions is increasing in Norwegian higher education. The overall goal of this study is therefore to highlight the potential for improvement of current practices related to universal design, both for providers of digital assessment solutions and for higher education institutions. Based on a case study of practices in Norwegian higher education sector, this article reviews existing requirements for ensuring universal design in digital assessment solutions, prototypes an approach to evaluating universal design quality (UD-Q) of two major Norwegian digital assessment solutions and investigates the compliance between providers’ self-assessments from interviews and UD-Q evaluation scores. The article presents two contributions: (1) an improved set of requirements for universal usability when procuring digital assessments solutions and (2) UD-Q, a stepwise feature analysis-based expert inspection method for evaluating the UD-Q of digital assessment solutions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Lid, I.M.: Universell utforming - Verdigrunnlag, kunnskap og praksis. Cappelen Damm Akademisk, Oslo (2013) Lid, I.M.: Universell utforming - Verdigrunnlag, kunnskap og praksis. Cappelen Damm Akademisk, Oslo (2013)
16.
go back to reference Zhuhadar, L., Carson, B., Daday, J., Nasraoui, O.: A universal design infrastructure for multimodal presentation of materials in STEM programs: universal design. In: Proceedings of the 24th International Conference on World Wide Web, Florence, Italy, pp. 569–574 (2015) Zhuhadar, L., Carson, B., Daday, J., Nasraoui, O.: A universal design infrastructure for multimodal presentation of materials in STEM programs: universal design. In: Proceedings of the 24th International Conference on World Wide Web, Florence, Italy, pp. 569–574 (2015)
17.
go back to reference Klironomos, I., Antona, M., Basdekis, I., Stephanidis, C.: White paper: promoting design for all and e-accessibility in Europe. Univ. Access Inf. Soc. 5(1), 105–119 (2006)CrossRef Klironomos, I., Antona, M., Basdekis, I., Stephanidis, C.: White paper: promoting design for all and e-accessibility in Europe. Univ. Access Inf. Soc. 5(1), 105–119 (2006)CrossRef
18.
go back to reference Bocconi, S., Dini, S., Ferlino, L., Martinoli, C., Ott, M.: ICT educational tools and visually impaired students: different answers to different accessibility needs. In: Universal Access in Human-Computer Interaction, Applications and Services, Lecture Notes in Computer Science vol. 4556, pp. 491–500 (2007) Bocconi, S., Dini, S., Ferlino, L., Martinoli, C., Ott, M.: ICT educational tools and visually impaired students: different answers to different accessibility needs. In: Universal Access in Human-Computer Interaction, Applications and Services, Lecture Notes in Computer Science vol. 4556, pp. 491–500 (2007)
19.
go back to reference Rose, D.H., Strangman, N.: Universal design for learning: meeting the challenge of individual learning differences through a neurocognitive perspective. Univ. Access Inf. Soc. 5(4), 381–391 (2007)CrossRef Rose, D.H., Strangman, N.: Universal design for learning: meeting the challenge of individual learning differences through a neurocognitive perspective. Univ. Access Inf. Soc. 5(4), 381–391 (2007)CrossRef
20.
go back to reference Buzzi, M., Buzzi, M., Leporini, B.: Accessing e-learning systems via screen reader: an example, Lecture Notes in Computer Science, 5613 Human-Computer Interaction. Interacting in Various Application Domains, pp. 21–30 (2009)CrossRef Buzzi, M., Buzzi, M., Leporini, B.: Accessing e-learning systems via screen reader: an example, Lecture Notes in Computer Science, 5613 Human-Computer Interaction. Interacting in Various Application Domains, pp. 21–30 (2009)CrossRef
21.
go back to reference Bocconi, S., Ott, M.: ICT and universal access to education: towards a culture of accessibility. Inf. Syst. E-learn. Knowl. Manag. Res. Commun. Comput. Inf. Sci. 278, 330–337 (2013)CrossRef Bocconi, S., Ott, M.: ICT and universal access to education: towards a culture of accessibility. Inf. Syst. E-learn. Knowl. Manag. Res. Commun. Comput. Inf. Sci. 278, 330–337 (2013)CrossRef
22.
go back to reference Squires, D., Preece, J.: Predicting quality in educational software: evaluating for learning, usability and the synergy between them. Interact. Comput. 11(5), 467–483 (1999)CrossRef Squires, D., Preece, J.: Predicting quality in educational software: evaluating for learning, usability and the synergy between them. Interact. Comput. 11(5), 467–483 (1999)CrossRef
23.
go back to reference Petrie, H., Bevan, N.: The Evaluation of Accessibility, Usability and User Experience, The Universal Access Handbook. CRC Press, Boca Raton (2009) Petrie, H., Bevan, N.: The Evaluation of Accessibility, Usability and User Experience, The Universal Access Handbook. CRC Press, Boca Raton (2009)
24.
go back to reference Benyon, D.: Designing Interactive Systems—A Comprehensive Guide to HCI, UX and Interaction Design, vol. 219, 3rd edn. Pearson, London (2014) Benyon, D.: Designing Interactive Systems—A Comprehensive Guide to HCI, UX and Interaction Design, vol. 219, 3rd edn. Pearson, London (2014)
25.
go back to reference Nielsen, J.: Usability Engineering, pp. 155–156. Academic Press, London (1993)MATH Nielsen, J.: Usability Engineering, pp. 155–156. Academic Press, London (1993)MATH
27.
go back to reference Lazar, J., Feng, J.H., Hochheiser, H.: Research Methods in Human-Computer Interaction, vol. 150. Wiley, Chichester (2010) Lazar, J., Feng, J.H., Hochheiser, H.: Research Methods in Human-Computer Interaction, vol. 150. Wiley, Chichester (2010)
28.
go back to reference Granić, A., Ćukušić, M.: Universal design within the context of e-learning, universal access in human-computer interaction. In: Applications and Services, Lecture Notes in Computer Science vol. 4556, pp. 617–626 (2007) Granić, A., Ćukušić, M.: Universal design within the context of e-learning, universal access in human-computer interaction. In: Applications and Services, Lecture Notes in Computer Science vol. 4556, pp. 617–626 (2007)
29.
go back to reference Granić, A., Adams, R.: User sensitive research in e-learning: exploring the role of individual user characteristics. Univ. Access Inf. Soc. 10(3), 307–318 (2010)CrossRef Granić, A., Adams, R.: User sensitive research in e-learning: exploring the role of individual user characteristics. Univ. Access Inf. Soc. 10(3), 307–318 (2010)CrossRef
30.
go back to reference Pullin, G., Newell, A.: Focussing on extra-ordinary users. In: Universal Access in Human Computer Interaction, Coping with Diversity, Lecture Notes in Computer Science, vol. 4554, pp. 253–262 (2007) Pullin, G., Newell, A.: Focussing on extra-ordinary users. In: Universal Access in Human Computer Interaction, Coping with Diversity, Lecture Notes in Computer Science, vol. 4554, pp. 253–262 (2007)
31.
go back to reference Ardito, C., Costabile, M.F., De Marsico, M., Lanzilotti, R., Levialdi, S., Plantamura, P., Roselli, T., Rossano, V., Tersigni, M.: Towards guidelines for usability of e-learning applications. In: Lecture Notes in Computer Science, 3196 User-Centered Interaction Paradigms for Universal Access in the Information Society, pp. 185–202 (2004)CrossRef Ardito, C., Costabile, M.F., De Marsico, M., Lanzilotti, R., Levialdi, S., Plantamura, P., Roselli, T., Rossano, V., Tersigni, M.: Towards guidelines for usability of e-learning applications. In: Lecture Notes in Computer Science, 3196 User-Centered Interaction Paradigms for Universal Access in the Information Society, pp. 185–202 (2004)CrossRef
32.
go back to reference Ardito, C., Costabile, M.F., De Marsico, M., Lanzilotti, R., Levialdi, S., Roselli, T., Rossano, V.: An approach to usability evaluation of e-learning applications. Univ. Access Inf. Soc. 4(3), 270–283 (2006)CrossRef Ardito, C., Costabile, M.F., De Marsico, M., Lanzilotti, R., Levialdi, S., Roselli, T., Rossano, V.: An approach to usability evaluation of e-learning applications. Univ. Access Inf. Soc. 4(3), 270–283 (2006)CrossRef
33.
go back to reference Yesilada, Y., Brajnik, G., Harper, S.: How much does expertise matter? A barrier walkthrough study with experts and non-experts. In: Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility, Pittsburgh, Pennsylvania, USA (2009) Yesilada, Y., Brajnik, G., Harper, S.: How much does expertise matter? A barrier walkthrough study with experts and non-experts. In: Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility, Pittsburgh, Pennsylvania, USA (2009)
34.
go back to reference Tanaka, E.H., Da Rocha, H.V.: Evaluation of web accessibility tools. In: Proceedings of the 10th Brazilian Symposium on Human Factors in Computing Systems and the 5th Latin American Conference on Human-Computer Interaction, Porto de Galinhas, Pernambuco, Brazil, pp. 272–279 (2011) Tanaka, E.H., Da Rocha, H.V.: Evaluation of web accessibility tools. In: Proceedings of the 10th Brazilian Symposium on Human Factors in Computing Systems and the 5th Latin American Conference on Human-Computer Interaction, Porto de Galinhas, Pernambuco, Brazil, pp. 272–279 (2011)
35.
go back to reference Kitchenham, B.A.: DESMET: A method for evaluating Software Engineering methods and tools. Technical Report, University of Keele (1996) Kitchenham, B.A.: DESMET: A method for evaluating Software Engineering methods and tools. Technical Report, University of Keele (1996)
36.
go back to reference Kitchenham, B.A.: Evaluating software engineering methods and tool part 1: the evaluation context and evaluation methods. SIGSOFT Softw. Eng. Notes 21(1), 11–14 (1996)CrossRef Kitchenham, B.A.: Evaluating software engineering methods and tool part 1: the evaluation context and evaluation methods. SIGSOFT Softw. Eng. Notes 21(1), 11–14 (1996)CrossRef
37.
go back to reference Tollefsen, M.: Web og Universell Utforming, 63. Universitetsforlaget, Oslo (2013) Tollefsen, M.: Web og Universell Utforming, 63. Universitetsforlaget, Oslo (2013)
40.
go back to reference Leedy, P.D., Ormrod, J.E.: Practical Research Planning and Design, 10th edn. Pearson Education Limited, Essex (2014) Leedy, P.D., Ormrod, J.E.: Practical Research Planning and Design, 10th edn. Pearson Education Limited, Essex (2014)
41.
go back to reference Thagaard, T.: Systematikk og innlevelse: en innføring i kvalitativ metode, 4th edn. Fagbokforlaget, Bergen (2013) Thagaard, T.: Systematikk og innlevelse: en innføring i kvalitativ metode, 4th edn. Fagbokforlaget, Bergen (2013)
42.
go back to reference Creswell, J.W., Miller, D.L.: Determining validity in qualitative inquiry. Theory Pract. 39(3), 124–130 (2000)CrossRef Creswell, J.W., Miller, D.L.: Determining validity in qualitative inquiry. Theory Pract. 39(3), 124–130 (2000)CrossRef
43.
go back to reference Nes, M.E.S.: Appraising and Evaluating the Use of DAISY: For Print Disabled Students in Norwegian Primary- and Secondary Education. University of Oslo, Oslo (2007) Nes, M.E.S.: Appraising and Evaluating the Use of DAISY: For Print Disabled Students in Norwegian Primary- and Secondary Education. University of Oslo, Oslo (2007)
44.
go back to reference Nes, M.E.S., Ribu, K., Tollefsen, M.: DAISY—Universally designed? Prototyping an approach to measuring universal design. In: Proceedings ICCHP, Linz, Austria, Lecture Notes in Computer Science, Computers Helping People with Special Needs, vol. 5105, pp. 268–275 (2008) Nes, M.E.S., Ribu, K., Tollefsen, M.: DAISY—Universally designed? Prototyping an approach to measuring universal design. In: Proceedings ICCHP, Linz, Austria, Lecture Notes in Computer Science, Computers Helping People with Special Needs, vol. 5105, pp. 268–275 (2008)
50.
go back to reference Guenaga, M.L., Burger, D., Olivier, J.: Accessibility for e-Learning Environments. In: Proceedings ICCHP, Paris, Lecture Notes in Computer Science, Computers Helping People with Special Needs, vol. 3118, pp. 157–163 (2004) Guenaga, M.L., Burger, D., Olivier, J.: Accessibility for e-Learning Environments. In: Proceedings ICCHP, Paris, Lecture Notes in Computer Science, Computers Helping People with Special Needs, vol. 3118, pp. 157–163 (2004)
51.
go back to reference Hansen, E.G., Mislevyb, R.J., Steinbergc, L.S., Leed, M.J., Forere, D.C.: Accessibility of tests for individuals with disabilities within a validity framework. System 33(1), 107–133 (2005)CrossRef Hansen, E.G., Mislevyb, R.J., Steinbergc, L.S., Leed, M.J., Forere, D.C.: Accessibility of tests for individuals with disabilities within a validity framework. System 33(1), 107–133 (2005)CrossRef
Metadata
Title
Digital assessment in higher education
Promoting universal usability through requirements specification and universal design quality (UD-Q) reviews
Authors
Miriam Eileen Nes Begnum
Rikke Julie Foss-Pedersen
Publication date
05-01-2017
Publisher
Springer Berlin Heidelberg
Published in
Universal Access in the Information Society / Issue 4/2018
Print ISSN: 1615-5289
Electronic ISSN: 1615-5297
DOI
https://doi.org/10.1007/s10209-016-0513-9

Other articles of this Issue 4/2018

Universal Access in the Information Society 4/2018 Go to the issue

Premium Partner