Introduction
Usability and usability testing
Key points to consider when planning a usability test
Complexity of the user pathway and the ePRO system
Stage of system development
Usability metrics to measure
The use of usability questionnaires
Sample size
Iterative nature of usability testing
Homogeneity of target end users
Design of ePRO systems
Type of usability testing
Task scenarios
Moderator’s duties and choice of moderating technique(s)
Moderating techniques | Pros | Cons |
---|---|---|
Concurrent think aloud (CTA) | Understand participants’ thoughts as they occur and as they attempt to work through issues they encounter Elicit real-time feedback and emotional responses | Can interfere with usability metrics, such as accuracy and time on task |
Retrospective think aloud (RTA) | Does not interfere with usability metrics | Overall session length increases Difficulty in remembering thoughts from up to an hour before = poor data |
Concurrent probing (CP) | Understand participants’ thoughts as they attempt to work through a task | Interferes with natural thought process and progression that participants would make on their own, if uninterrupted |
Retrospective probing (RP) | Does not interfere with usability metrics | Difficulty in remembering = poor data |