The Hospital Anxiety and Depression Scale: A meta confirmatory factor analysis

https://doi.org/10.1016/j.jpsychores.2012.10.010Get rights and content

Abstract

Objective

To systematically evaluate the latent structure of the Hospital Anxiety and Depression Scale (HADS) through reanalysis of previous studies and meta confirmatory factor analysis (CFA).

Method

Data from 28 samples were obtained from published studies concerning the latent structure of the HADS. Ten models were considered, including eight previously identified models and two bifactor models. The fit of each model was assessed separately in each sample and by meta CFA. Meta CFA was conducted using all samples and using subgroups consisting of community samples, cardiovascular disease samples and samples from studies administering the English language version of the HADS.

Results

A bifactor model including all items loading onto a general distress factor and two orthogonal anxiety and depression group factors provided the best fit for the majority of samples. Meta CFA provided further support for the bifactor model with two group factors. This was the case using all samples, as well as all subgroup analyses. The general distress factor explained 73% of the covariance between items, with the (autonomic) anxiety and (anhedonic) depression factors explaining 11% and 16%, respectively.

Conclusion

A bifactor structure provides the most acceptable empirical explanation for the HADS correlation structure. Due to the presence of a strong general factor, the HADS does not provide good separation between symptoms of anxiety and depression. We recommend it is best used as a measure of general distress.

Introduction

The Hospital Anxiety and Depression Scale (HADS) is a widely used measure of psychological distress designed for use in non-psychiatric patient populations [1]. Numerous studies examining its construct validity using exploratory (EFA) and confirmatory (CFA) factor analysis and item response theory (IRT) methods in clinical and non-clinical populations have been published. The findings of these studies have been summarized in several reviews [2], [3], [4], [5]. However, disagreement about the underlying dimensionality of the HADS remains and concerns regarding the apparent lack of consistency between studies have led to calls for the abandonment of the HADS [6]. Inconsistency is likely to be partially due to the application of different methodologies between studies.

As we have previously suggested, the reason for the apparent inconsistency between methods may also be due to the presence of a general distress factor [7]. Two alternative hierarchical models — higher-order and bifactor — have been proposed to represent the structure of scales with a general factor. The most widely supported three factor structure in the Cosco et al. [5] review of the HADS is a higher-order model, proposed by Dunbar and colleagues [8], based on the Tripartite theory of anxiety and depression [9]. The Tripartite theory posits that a higher-order general somatopsychic distress trait, negative affectivity (NA), accounts for the observed association between anxiety and depression. The Tripartite theory stipulates that the specific component of anxiety is autonomic arousal marked by somatic symptoms, and that the main component of depression is anhedonia characterized by low positive affect — a loss of pleasure and interest in life and inability to feel please even when engaging in pleasurable activities [10]. As was noted by Dunbar and colleagues [8], several of the HADS items fit these constructs well.

The crucial difference between higher-order and bifactor models lies in the ability to separate the variance accounted for by the general factor from the other factors. Higher-order models are composed of first-order factors (e.g. autonomic arousal, anhedonia) onto which the observed items load and higher-order factors (e.g. distress/NA) onto which the first-order factors load. This superordinate higher-order factor is assumed to cause the correlation between the observed items loading on different scales. Where the higher-order factor explains a large proportion of the variance in the lower-order factors (i.e. the first-order factors are highly correlated) the use of the total score, calculated by summing across the subscales, is a valid measure of the higher-order factor. In this situation it is difficult to disentangle the separate effects of the first-order factors from any higher-order factor. For example, it is unclear whether the association between depression, anxiety and anger with cardiovascular disease is due to specific components of these overlapping affective constructs or by some general negative affective disposition [11].

Bifactor models consist of a broad general factor, such as distress or depression, onto which all observed items load and conceptually narrower group factors onto which observed items with related content load [12]. The essential difference is that the general factor is at the same level conceptually as the group factors, thus allowing for the parsing of the variance explained by the general and group factors. This enables the evaluation of the specific components independent contribution to prediction, of say incident cardiovascular disease, controlling for the general factor. As with the higher-order model, where there is a strong general factor a combined overall score is a valid measure of the general factor. A bifactor version of the tripartite model would consist of a general factor and group factors relating to autonomic arousal and anhedonia, and would allow for the separation of item variance into the variance explained by the general factor and each of the group factors. Also known as group-factor models, bifactor models were initially developed in intelligence research [13] but have since been applied to the study of psychological distress [14], [15], [16], [17], [18]. A bifactor structure has not yet been considered in relation to the HADS.

The present study involves a re-analysis and meta-analysis of previously published studies considering the latent structure of the HADS. The goal is to examine whether uncertainty regarding the latent structure of the HADS is due to differences between the methods and samples of earlier studies. Some of the ambiguity in previous studies may have arisen from the methods used, both in terms of the overarching method (EFA, CFA and IRT) and also differences in the structures compared within CFA studies. A re-analysis will enable the comparison of all previously identified ‘best fitting’ latent structures using CFA, thus minimizing any ambiguity that might have arisen from the application of different methods. As well as the ‘best fitting’ structures, the bifactor structure will also be considered since this has shown optimal fit for similar instruments. The meta-analysis involves pooling inter-item correlation matrices from samples used in previous studies, which are then subjected to CFA. Subgroup analysis considering samples drawn from specific populations (community samples, cardiovascular disease samples) and also only studies using English translations of the HADS will further allow for the consideration of whether ambiguity may be due to different latent structures across populations.

Section snippets

Sample

Data were drawn from studies selected for inclusion in a recent systematic review of the HADS [5], which included studies published between 2002 and 2010. Where the inter-item correlation matrices were not included in the original publication, the corresponding author was contacted by email. Where no response was received from the corresponding author within 4 weeks, a follow-up email was sent. If the corresponding author's email address was no longer active, attempts were made to identify a

Within sample analysis

Confirmatory factor analysis was applied to the inter-item correlations matrices for each of the 28 samples. The eight models derived from the literature and the two bifactor models were considered, all with and without item wording methods factors. The frequency with which each of the models was selected as superior by various goodness-of-fit criteria are presented in Table 2, for models without the inclusion of an item wording method factor. Appendix A.1 provides model fit statistics for each

Discussion

Meta CFA of the latent structure of the HADS provided evidence for a bifactor structure consisting of a general distress factor and anxiety and depression group factors. This structure was also supported by reanalysis of the majority of previous studies considering the latent structure of the HADS. This finding indicates that, although tapping into autonomic arousal and anhedonia as originally intended, the HADS is saturated by the presence of a strong general factor, accounting for over 70% of

Conflict of interest statement

There are no known conflicts of interest associated with this publication and there has been no significant financial support for this work that could have influenced its outcome.

Acknowledgments

We thank all the authors of the original papers that were able to provide information that enabled this analysis.

S. Norton was supported by an Economic and Social Research Council and Medical Research council interdisciplinary studentship and, in part, by the NIHR CLAHRC for Cambridgeshire and Peterborough. A. Sacker was supported by Grant RES-596-28-0001 from the Economic and Social Research Council.

References (62)

  • C Brennan et al.

    The Hospital Anxiety and Depression Scale: a diagnostic meta-analysis of case-finding ability

    J Psychosom Res

    (2010)
  • S Friedman et al.

    Three-dimensional structure of the Hospital Anxiety and Depression Scale in a large French primary care population suffering from major depression

    Psychiatry Res

    (2001)
  • H Caci et al.

    How does the Hospital and Anxiety and Depression Scale measure anxiety and depression in healthy subjects?

    Psychiatry Res

    (2003)
  • AJ Mitchell et al.

    Diagnostic validity of the Hospital Anxiety and Depression Scale (HADS) in cancer and palliative settings: a meta-analysis

    J Affect Disord

    (2010)
  • K Gough et al.

    Psychometric properties of the Hospital Anxiety and Depression Scale in family caregivers of palliative care patients

    J Pain Symptom Manage

    (2009)
  • AS Zigmond et al.

    The Hospital Anxiety and Depression Scale

    Acta Psychiatr Scand

    (1983)
  • CR Martin

    What does the Hospital Anxiety and Depression Scale (HADS) really measure in liaison psychiatry settings?

    Curr Psychiatry Rev

    (2005)
  • M Dunbar et al.

    A confirmatory factor analysis of the Hospital Anxiety and Depression scale: comparing empirically and theoretically derived structures

    Br J Clin Psychol

    (2000)
  • D Watson et al.

    Health complaints, stress, and distress: exploring the central role of negative affectivity

    Psychol Rev

    (1989)
  • LA Clark et al.

    Tripartite model of anxiety and depression: psychometric evidence and taxonomic implications

    J Abnorm Psychol

    (1991)
  • J Suls et al.

    Anger, anxiety, and depression as risk factors for cardiovascular disease: the problems and implications of overlapping affective dispositions

    Psychol Bull

    (2005)
  • S Reise et al.

    The role of the bifactor model in resolving dimensionality issues in health outcomes measures

    Qual Life Res

    (2007)
  • J Schmid et al.

    The development of hierarchical factor solutions

    Psychometrika

    (1957)
  • LC Ward

    Comparison of factor structure models for the Beck Depression Inventory–II

    Psychol Assess

    (2006)
  • J Chilcot et al.

    A confirmatory factor analysis of the beck depression inventory-II in end-stage renal disease patients

    J Psychosom Res

    (March 2011)
  • LJ Simms et al.

    Parsing the general and specific components of depression and anxiety with bifactor modeling

    Depress Anxiety

    (2008)
  • WHM Emons et al.

    Dimensionality of the Hospital Anxiety and Depression Scale (HADS) in Cardiac Patients: comparison of Mokken Scale Analysis and Factor Analysis

    Assessment

    (October 14 2010)
  • CJ Gibbons et al.

    Rasch analysis of the Hospital Anxiety and Depression Scale (HADS) for use in motor neurone disease

    Health Qual Life Outcomes

    (2011)
  • A-S Helvik et al.

    A psychometric evaluation of the Hospital Anxiety and Depression Scale for the medically hospitalized elderly

    Nord J Psychiatry

    (2011)
  • Lambert et al.

    Rasch analysis of the Hospital Anxiety and Depression Scale among caregivers of cancer survivors: implications for its use in psycho-oncology

    Psychooncology

    (2011)
  • E Wouters et al.

    Wording Effects and the Factor Structure of the Hospital Anxiety & Depression Scale in HIV/AIDS Patients on Antiretroviral Treatment in South Africa

    PLoS One

    (2012)
  • Cited by (325)

    View all citing articles on Scopus
    View full text