Evaluation of a Metadata Application Profile for Learning Resources on Organic Agriculture

Metadata specifications and standards serve as the basis for creating metadata application profiles that are particularly adapted to the needs of specific applications. The process of developing such application profiles is usually an iterative one, involving several stakeholders such as technical experts and domain experts. In this process, evaluation should have a pivotal role, by engaging methods and instruments that can ensure that the interests and needs of all stakeholders are reflected in the produced application profile. This paper presents how evaluation is dealt with, in a particular case study of developing a metadata application profile for learning resources. It particularly puts emphasis on the way the domain experts have evaluated the elements of the application profile, on dimensions related to their envisaged usefulness, comprehensibility, and ease to use during content annotation. The methodology followed, the pilot evaluation experiment with the domain experts, and the way the results have been incorporated in the application profile elaboration process, are discussed.