Playability Assessment for Educational Computer Games: Pilot Study for Model Development

This study used the partial least squares (PLS) and structural equation modeling (SEM) tool to examine evaluation constructs that are appropriate to evaluate educational computer games (ECG) by real users. The focus of the evaluation constructs are for evaluating ECG that still in the development process. There are five constructs that being derived from heuristic evaluation for ECG known as Playability Heuristic Evaluation for Educational Computer Games (PHEG) that being developed to evaluate ECG by expert evaluators. The constructs are interface (10), educational element (6), content (6), playability (7) and multimedia (8). Total numbers of items for the five constructs are 37. Statistical results confirm that all of the five constructs and 29 items are important to be included in evaluating ECG. The results, besides indicating the suitability of the PLS in statistical analysis, has also contributed to a better understanding of constructs needed in evaluating ECG that still in the development process that has not been tested. Findings are useful for game developers and educational technologist to have a validated model and questionnaire that can be used to evaluate ECG. The result of the evaluation using the proposed model can be used to enhance the ECG before it can be released. Limitations and suggestions for future research are also included.