André P. Freire
Renata P. M. Fortes
ABSTRACT
Accessibility is a concept related to providing access to Web content to people with different abilities and people using different devices. A number of metrics have been proposed in the last years to help to obtain quantitative Web accessibility levels. Each Web development project has different aspects, and the choice of a given Web accessibility metric should be carefully considered according to the needs of the project. In this paper, we present a review on the main existing Web accessibility metrics, emphasizing the main features and comparing their correlations from experimental data obtained from large scale evaluations. Project managers and evaluators should consider specific features for each given project to effectively choose a proper metric. Needs to adjust customized coefficients or to adhere to automatic evaluation tools are important issues to be observed.
- C. Benavídez, J. Fuertes, E. Gutiérrez, and L. Martínez. Semi-Automatic Evaluation of Web Accessibility with HERA 2.0. In Proceedings of the 10th International Conference on Computers Helping People with Special Needs (ICCHP 2006), pages 199--206. Springer, 2006 Google Scholar
Digital Library
- L. C. Briand, C. M. Differding, and H. D. Rombach. Practical Guidelines for Measurement-Based Process Improvement. Software Process Improvement and Practice Journal, 2(4), 1997.Google Scholar
- C. Buhler, H. Heck, O. Perlick, A. Nietzio, and N. Ulltveit-Moe. Interpreting results from large-scale automatic evaluation of web accessibility. In Computers Helping People with Special Needs, volume 4061/2006, pages 184--191. Springer Berlin / Heidelberg, 2006. Google ScholarDigital Library
- W. W. A. B. Cluster. Unified Web Evaluation Methodology (UWEM 1.0), 2006. Available at http://www.wabcluster.org/uwem/. Last access on January/2008.Google Scholar
- M. K. Daskalantonakis. A Practical View of Software Measurement and Implementation Experiences within Motorola. IEEE Transactions on Software Engineering, 18(11):998 -- 1010, 1992. Google ScholarDigital Library
- Dix, J. E. Finlay, G. D. Abowd, and R. Beale. Human-Computer Interaction. Prentice Hall, 3a. edition, 2003. Google ScholarDigital Library
- N. E. Fenton and S. L. Pfleeger. Software Metrics: A Rigorous and Practical Approach. PWS Publishing Co., Boston, MA, USA, 1998. Google ScholarDigital Library
- P. Freire, T. J. Bittar, and R. P. M. Fortes. An approach based on metrics for monitoring web accessibility in brazilian municipalities web sites. In Proceedings of the 23rd Annual ACM Symposium on Applied Computing, pages 2420--2424. ACM Press, 2008. Google ScholarDigital Library
- P. Freire, R. Goularte, and R. P. de Mattos Fortes. Techniques for developing more accessible web applications: a survey towards a process classification. In SIGDOC '07: Proceedings of the 25th annual ACM international conference on Design of communication, pages 162--169, New York, NY, USA, 2007. ACM Press. Google ScholarDigital Library
- P. Freire, E. H. Tanaka, S. M. A. de Lara, H. V. Rocha, and R. P. M. Fortes. Comparing accessibility in web based e-learning environments: a metric based approach. In Proceedings of the XIII Brazilian Symposium on Multimedia and the Web (Webmedia), pages 49--56. ACM Press, 2007.Google Scholar
- Fuggetta, L. Lavazza, S. Morasca, S. Cinti, G. Oldano, and E. Orazi. Applying GQM in an Industrial Software Factory. ACM Transactions on Software Engineering and Methodology, 7(4):411--448, 1998. Google ScholarDigital Library
- J. Gonzalez, M. Macias, R. Rodriguez, and F. Sanchez. Accessibility metrics of web pages for blind end-users. In Proceedings of the 2003 International Conference on Web Engineering (ICWE), pages 374--383, Oviedo, Spain, 2003. Springer Berlin / Heidelberg. Google ScholarDigital Library
- ISO - International Standard Organization, New York, NY. (ISO/IEC 12207) Standard for Information Technology - Software Lifecycle Processes, 1998. 85 S.Google Scholar
- ISO - International Standard Organization. (ISO 9126-1) Software Engineering - Product Quality-Part 1: Quality Model. Geneva, 2001.Google Scholar
- M. Y. Ivory, R. R. Sinha, and M. A. Hearst. Empirically validated web page design metrics. In CHI '01: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 53--60, New York, NY, USA, 2001. ACM. Google ScholarDigital Library
- S. Kan. Metrics and Models in Software Quality Engineering. Addison Wesley, 1995. Google ScholarDigital Library
- L. Lavazza and G. Barresi. Automated support for process-aware definition and execution of measurement plans. In ICSE '05: Proceedings of the 27th international conference on Software engineering, pages 234--243, New York, NY, USA, 2005. ACM. Google ScholarDigital Library
- E. M. Mendes, N. Mosley, and S. Counsell. Web Metrics - Estimating Design and Authoring Effort. IEEE Multimedia, 8(1):50--57, 2001. Google ScholarDigital Library
- L. Olsina and G. Rossi. Measuring Web Application Quality with WebQEM. IEEE MultiMedia, 9(4):20--29, 2002. Google ScholarDigital Library
- Parmanto and X. Zeng. Metric for Web accessibility evaluation. Journal of the American Society for Information Science and Technology, 56(33):1394--1404, 2005. Google ScholarDigital Library
- H. Petrie, F. Hamilton, N. King, and P. Pavan. Remote usability evaluations with disabled people. In CHI '06: Proceedings of the SIGCHI conference on Human Factors in computing systems, pages 1133--1141, New York, NY, USA, 2006. ACM Press. Google ScholarDigital Library
- S. L. Pfleeger. Software Engineering: Theory and Practice. Prentice-Hall, Upper Saddle River New Jersey, 2a edition, 2001. Google ScholarDigital Library
- I. Spinuzzi. Learning our abcs: accessibility, bottlenecks, and control in an organized research unit's website. In SIGDOC '07: Proceedings of the 25th annual ACM international conference on Design of communication, pages 201--206, New York, NY, USA, 2007. ACM. Google ScholarDigital Library
- T. Sullivan and R. Matson. Barriers to use: usability and content accessibility on the Web's most popular sites. In CUU '00: Proceedings on the 2000 conference on Universal Usability, pages 139--144, New York, NY, USA, 2000. ACM Press. Google ScholarDigital Library
- M. Vigo, M. Arrue, G. Brajnik, R. Lomuscio, and J. Abascal. Quantitative metrics for measuring web accessibility. In W4A '07: Proceedings of the 2007 international cross-disciplinary conference on Web accessibility (W4A), pages 99--107, New York, NY, USA, 2007. ACM Press. Google ScholarDigital Library
- W3C. Web Content Accessibility Guidelines 1.0, 1999. Available at http://www.w3c.org/TR/WCAG10. Last access at February/2008.Google Scholar
- W3C. Web Content Accessibility Guidelines 2.0 - Working Draft, 2007. Available at http://www.w3c.org/TR/WCAG20. Last access at February/2008.Google Scholar
- X. Zeng. Evaluation and Enhancement of Web Content Accessibility for Persons with Disabilities. PhD thesis, University of Pittsburgh, 2004.Google Scholar
Index Terms
- An evaluation of web accessibility metrics based on their attributes
Recommendations
A comparative test of web accessibility evaluation methods
Assets '08: Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibilityAccessibility auditors have to choose a method when evaluating accessibility: expert review (a.k.a. conformance testing), user testing, subjective evaluations, barrier walkthrough are some possibilities. However, little is known to date about their ...
Benchmarking web accessibility evaluation tools: measuring the harm of sole reliance on automated tests
W4A '13: Proceedings of the 10th International Cross-Disciplinary Conference on Web AccessibilityThe use of web accessibility evaluation tools is a widespread practice. Evaluation tools are heavily employed as they help in reducing the burden of identifying accessibility barriers. However, an over-reliance on automated tests often leads to setting ...
A challenge to web accessibility metrics and guidelines: putting people and processes first
W4A '12: Proceedings of the International Cross-Disciplinary Conference on Web AccessibilityThis paper argues that web accessibility is not an intrinsic characteristic of a digital resource but is determined by complex political, social and other contextual factors, as well as technical aspects which are the focus of WAI standardisation ...
Comments