1 Introduction
2 Theoretical background
3 Method
3.1 Participant recruitment
3.2 Procedure
3.3 Technology
3.4 Data collection
3.5 Data analysis
-
Critical problems prevented participants from completing tasks and/or recurred across all participants;
-
Serious problems severely increased the task completion time and/or recurred frequently across participants. However, a serious problem did not prevent a participant from completing the task eventually;
-
Minor problems increased task completion time slightly and/or recurred infrequently across the evaluation participants. Finally, a minor problem did not prevent the evaluation participants from completing a test task easily.
3.6 Ethics
4 Results
4.1 Participants
4.2 Quantitative measures
Tablet | NAO | p value | |
---|---|---|---|
Usability
| |||
System Usability Scale | 62.50 ± 16.50 | 60.50 ± 18.18 |
0.566
|
Perceived usefulness
| |||
I think that using [the tablet/the robot] makes it easier to do exercises correctly | 4.80 ± 0.70 | 4.35 ± 1.27 | |
I think that [the tablet/the robot] is useful for remaining healthy | 3.70 ± 1.78 | 3.95 ± 1.50 | |
I think that using [the tablet/the robot] provides me with good insights in my health status | 4.15 ± 1.27 | 3.75 ± 1.41 | |
Average score
|
4.21 ± 0.97
|
4.02 ± 1.16
|
0.528
|
Control
| |||
I have a lot control over what I can do with [the tablet/the robot] | 3.40 ± 1.57 | 3.00 ± 1.45 | |
The [tablet/robot] always listens to what I what I want it to do. | 3.75 ± 1.48 | 3.55 ± 1.47 | |
I can determine for myself what happens on [the tablet/the robot] | 3.90 ± 1.59 | 3.35 ± 1.66 | |
Average score |
3.68 ± 1.44
|
3.30 ± 1.33
|
0.326
|
Enjoyment
| |||
Using [the tablet/the robot] was enjoyable/disgusting | 4.20 ± 1.01 | 4.05 ± 0.89 | |
Using [the tablet/the robot] was exciting/dull | 3.95 ± 1.00 | 4.00 ± 1.21 | |
Using [the tablet/the robot] was pleasant/unpleasant | 4.40 ± 1.00 | 4.45 ± 0.95 | |
Using [the tablet/the robot] was interesting/boring | 4.65 ± 0.75 | 4.90 ± 0.31 | |
Average score |
4.30 ± 0.80
|
4.35 ± 0.68
|
0.794
|
4.3 Usability issues
4.3.1 General issues
Problem |
NAO
|
Tablet PC
| ||||
---|---|---|---|---|---|---|
Occurrence | n | Severity | Occurrence | n | Severity | |
The older adult…
| ||||||
…answered too soon | 25 | 12 | Critical | |||
…answering too softly | 47 | 15 | Critical | |||
…was unable to hear NAO | 34 | 10 | Critical | |||
…did not answer at all | 6 | 4 | Serious | |||
…answered too late | 5 | 4 | Serious | |||
…was unable to touch touchscreen correctly | 28 | 18 | Critical | |||
…was unsure how to use the tablet | 3 | 3 | Serious | |||
…was unable to read the text on the screen | 1 | 1 | Serious |
4.3.2 Issues hindering proper monitoring
Problem |
NAO
|
Tablet PC
| ||||
---|---|---|---|---|---|---|
Occurrence | n | Severity | Occurrence | n | Severity | |
The older adult…
| ||||||
…was unable to understand NAO | 16 | 11 | Critical | |||
…did not know what to answer | 12 | 8 | Critical | |||
…did not provide an answer NAO could understand | 60 | 16 | Critical | |||
…did not understand how to answer questions | 8 | 5 | Critical | |||
…did not understand instructions | 1 | 1 | Minor |
4.3.3 Issues hindering proper exercising
Problem |
NAO
|
Tablet PC
| ||||
---|---|---|---|---|---|---|
Occurrence | n | Severity | Occurrence | n | Severity | |
The older adult…
| ||||||
…does not understand that NAO demonstrates an exercise first | 49 | 18 | Critical | |||
…does not understand that s/he should repeat the exercise | 18 | 14 | Critical | 19 | 10 | Critical |
…does not understand that s/he has to touch NAOs head when finished | 10 | 6 | Critical | |||
…has difficulty with exercising and watching NAO simultaneously | 3 | 2 | Serious | |||
…does not understand instructions | 2 | 1 | Serious | 10 | 5 | Serious |
…touches NAOs head at the wrong place | 1 | 1 | Minor | |||
…doubts whether to watch NAO or exercise | 1 | 1 | Minor | |||
…starts exercising too soon | 1 | 1 | Minor | |||
…is unwilling willing to watch the video and starts exercising | 13 | 9 | Minor | |||
…is unwilling to read the instructions | 1 | 1 | Minor |