Markel Vigo
Giorgio Brajnik
Julio Abascal
ABSTRACT
This paper raises the need for quantitative accessibility measurement and proposes three different application scenarios where quantitative accessibility metrics are useful: Quality Assurance within Web Engineering, Information Retrieval and accessibility monitoring. We propose a quantitative metric which is automatically calculated from reports of automatic evaluation tools. In order to prove the reliability of the metric, 15 websites (1363 web pages) are measured based on results yielded by 2 evaluation tools: EvalAccess and LIFT. Statistical analysis of results shows that the metric is dependent on the evaluation tool. However, Spearman's test produces high correlation between results of different tools. Therefore, we conclude that the metric is reliable for ranking purposes in Information Retrieval and accessibility monitoring scenarios and can also be partially applied in a Web Engineering scenario.
- Abascal, J., Arrue, M., Fajardo, I., Garay, N., and Tomás, J. Use of Guidelines to automatically verify web accessibility. International Journal on Universal Access in the Information Society (UAIS) 3(1), 71--79, 2004, Springer. Google Scholar
Digital Library
- Arrue, M., Vigo, M., and Abascal, J. Quantitative Metrics for Web Accessibility Evaluation. In Proceedings of ICWE 2005 Workshop on Web Metrics and Measurement. University of Wollongong School of IT and Computer Science.Google Scholar
- Brajnik, G. Comparing accessibility evaluation tools: a method for tool effectiveness. Universal Access in the Information Society (UAIS) 3(3-4), 252-263, 2004, Springer. Google ScholarDigital Library
- Bühler, C., Heck, H., Perlick, O., Nietzio, A., and Ullveit-Moe, N. Interpreting Results from Large Scale Automatic Evaluation of Web Accessibility. In K. Miesenberger et. al (Eds.). Computers Helping People with Special Needs 2006. Lecture Notes in Computer Science 4061. Springer, 184--191. Google ScholarDigital Library
- Google Accessible Search. Available at http://labs.google.com/accessible/Google Scholar
- Hackett, S., Parmanto, B., and Zeng, X. Accessibility of Internet websites through time. In Proceedings of 6th International ACM SIGACCESS Conference on Computers and Accessibility 2004, pp. 32--39. Google ScholarDigital Library
- Ivory, M., Yu, S., and Gronemyer, K. Search result exploration: a preliminary study of blind and sighted users' decision making and performance. CHI Extended Abstracts 2004, pp. 1453--1456. Google ScholarDigital Library
- Mich, L., Franch, and M. Gaio, L. Evaluating and Designing the Quality of Web Sites. IEEE MultiMedia 10(1), 34--43, 2003. Google ScholarDigital Library
- Olsina, L. and Rossi, G. Measuring Web Application Quality with WebQEM. IEEE Multimedia 9(4), 20--29, 2002. Google ScholarDigital Library
- Snaprud, M. H., Ulltveit-Moe, N., Pillai, A. B., and Olsen M. G. A Proposed Architecture for Large Scale Web Accessibility Assessment. In K. Miesenberger et al. (Eds.). Computers Helping People with Special Needs 2006. Lecture Notes in Computer Science 4061, pp. 234--241, Springer. Google Scholar
- Sullivan, T. and Matson, R. Barriers to use: usability and content accessibility on the Web's most popular sites. Proceedings of ACM Conference on Universal Usability 2000, pp. 139--144. Google ScholarDigital Library
Index Terms
- Quantitative metrics for measuring web accessibility
Recommendations
An evaluation of web accessibility metrics based on their attributes
SIGDOC '08: Proceedings of the 26th annual ACM international conference on Design of communicationAccessibility is a concept related to providing access to Web content to people with different abilities and people using different devices. A number of metrics have been proposed in the last years to help to obtain quantitative Web accessibility ...
Automatic web accessibility metrics: Where we are and where we can go
The fact that several web accessibility metrics exist may be evidence of a lack of a comparison framework that highlights how well they work and for what purposes they are appropriate. In this paper we aim at formulating such a framework, demonstrating ...
Analysis and integration of web accessibility metrics
W4A '10: Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A)"Analysis and Integration of Web Accessibility Metrics" was presented as a grade thesis. It included the development of "OceanAcc", an evaluation and analysis tool that performs a semi-automatic evaluation process. With little user intervention, can ...
Comments