9. Validation and Intermediate Discussion

After development of the Reactance Scale for Human–Computer Interaction (RSHCI) was finished, its validity in terms of whether it really measures state reactance and perceived freedom threat was investigated. To this end, a number of criteria to assess criterion validity and inner criterion validity was formulated. Validation was performed on the basis of data collected in the online study that was also used to select the items which were suitable for the questionnaire. Also, a small laboratory experiment was conducted, in which participants interacted with intelligent personal assistants. The gathered data was used to correlate the state reactance dimensions of the RSHCI with another, established state reactance metric and a trait reactance metric. The results show that the state reactance part of the RSHCI correlates highly with the state reactance measurement of the established method. Therefore, inner criterion validity can be assumed. Also, the results regarding freedom threat indicate that the freedom threat dimension of the RSHCI really measures the level of perceived freedom threat.