Skip to main content
Top
Published in: Quality of Life Research 8/2014

01-10-2014

Results from several population studies show that recommended scoring methods of the SF-36 and the SF-12 may lead to incorrect conclusions and subsequent health decisions

Authors: Graeme Tucker, Robert Adams, David Wilson

Published in: Quality of Life Research | Issue 8/2014

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Purpose

To compare the measurement properties of the physical component summary (PCS) and mental component summary (MCS) scores of the SF-36 and SF-12 based on the traditional orthogonal scoring algorithms with the performance of the PCS and MCS scored based on structural equation model coefficients from a correlated model.

Methods

This study used three large-scale representative population studies to compare the measurement properties of the PCS and MCS scores of the SF-36 and SF-12 with the performance of the PCS and MCS scores based on structural equation models producing coefficients from a correlated model. We assessed the relationships of these scores with selected important mental health measures and chronic conditions from three representative Australian population studies that address clinical conditions of high prevalence and health service importance.

Results

Structural equation model scoring methods produced summary scores with higher correlations than the recommended orthogonal methods across a range of disease and health conditions. The problem experienced in using the orthogonal methods is that negative scoring coefficients are applied to negative z-scores for sub-scales, inflating the resulting summary scores. Effect sizes over a half of a standard deviation were common.

Conclusions

If health policy or investment decisions are made based on the results of studies employing the recommended orthogonal scoring methods then the expected outcome of such decisions or investments may not be achieved.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Hawthorne, G., Osborne, R. H., Taylor, A., & Sansoni, J. (2007). The SF-36 Version 2: Critical analysis of population weighting, scoring algorithms and population norms. Quality of Life Research, 16, 661–673.PubMedCrossRef Hawthorne, G., Osborne, R. H., Taylor, A., & Sansoni, J. (2007). The SF-36 Version 2: Critical analysis of population weighting, scoring algorithms and population norms. Quality of Life Research, 16, 661–673.PubMedCrossRef
2.
go back to reference Ware, J. E., Snow, K. K., Kosinski, M., & Gandek, B. (1993). The SF-36 health survey manual and interpretation guide. Boston, MA: The Health Institute, New England Medical Centre. Ware, J. E., Snow, K. K., Kosinski, M., & Gandek, B. (1993). The SF-36 health survey manual and interpretation guide. Boston, MA: The Health Institute, New England Medical Centre.
3.
go back to reference Sorensen, L., Stokes, J. A., Purdie, D. M., et al. (2004). Medication reviews in the community: Results of a randomized, controlled effectiveness trial. British Journal of Clinical Pharmacology, 58, 648–664.PubMedCentralPubMedCrossRef Sorensen, L., Stokes, J. A., Purdie, D. M., et al. (2004). Medication reviews in the community: Results of a randomized, controlled effectiveness trial. British Journal of Clinical Pharmacology, 58, 648–664.PubMedCentralPubMedCrossRef
4.
go back to reference Commonwealth Department of Health and Aged Care. (1999). The Australian coordinated care trials: Background and trial descriptions. Canberra: Department of Health and Aged Care. Commonwealth Department of Health and Aged Care. (1999). The Australian coordinated care trials: Background and trial descriptions. Canberra: Department of Health and Aged Care.
5.
go back to reference McCallum, J. (1995). The new SF-36 health status measure: Australian validity tests. Canberra: National Centre for Epidemiology and Population Health. Paper presented to the Health Outcomes and Quality of Life Measurement Conference. McCallum, J. (1995). The new SF-36 health status measure: Australian validity tests. Canberra: National Centre for Epidemiology and Population Health. Paper presented to the Health Outcomes and Quality of Life Measurement Conference.
6.
go back to reference McCallum, J. (1995). The SF-36 in an Australian sample: Validating a new, generic health status measure. Australian Journal of Public Health, 19, 160–166.PubMedCrossRef McCallum, J. (1995). The SF-36 in an Australian sample: Validating a new, generic health status measure. Australian Journal of Public Health, 19, 160–166.PubMedCrossRef
7.
go back to reference Sanson-Fisher, R. W., & Perkins, J. J. (1998). Adaptation and validation of the SF-36 health survey for use in Australia. Journal of Clinical Epidemiology, 51(11), 961–967.PubMedCrossRef Sanson-Fisher, R. W., & Perkins, J. J. (1998). Adaptation and validation of the SF-36 health survey for use in Australia. Journal of Clinical Epidemiology, 51(11), 961–967.PubMedCrossRef
8.
go back to reference Ware, J. E., Kosinski, M., & Keller, S. D. (1994). SF-36 physical and mental health summary scales: A users manual. Boston, MA: The Health Institute, New England Medical Centre. Ware, J. E., Kosinski, M., & Keller, S. D. (1994). SF-36 physical and mental health summary scales: A users manual. Boston, MA: The Health Institute, New England Medical Centre.
9.
go back to reference Hays, R. D., Sherbourne, C. D., & Mazel, R. M. (1993). The RAND 36-item health survey 1.0. Health Economics, 2, 217–227.PubMedCrossRef Hays, R. D., Sherbourne, C. D., & Mazel, R. M. (1993). The RAND 36-item health survey 1.0. Health Economics, 2, 217–227.PubMedCrossRef
10.
go back to reference Hays, R. D., Prince-Embury, S., & Chen, H. (1998). RAND-36 health status inventory. San Antonio, TX: The Psychological Corporation. Hays, R. D., Prince-Embury, S., & Chen, H. (1998). RAND-36 health status inventory. San Antonio, TX: The Psychological Corporation.
11.
go back to reference Hays, R. D., & Morales, L. S. (2001). The RAND-36 measure of health-related quality of life. Annals of Medicine, 33, 350–357.PubMedCrossRef Hays, R. D., & Morales, L. S. (2001). The RAND-36 measure of health-related quality of life. Annals of Medicine, 33, 350–357.PubMedCrossRef
12.
go back to reference Simon, G. E., Revicki, D. A., Grothaus, L., & Vonkorf, M. (1998). SF-36 summary scores: Are physical and mental health truly distinct? Medical Care, 36, 567–572.PubMedCrossRef Simon, G. E., Revicki, D. A., Grothaus, L., & Vonkorf, M. (1998). SF-36 summary scores: Are physical and mental health truly distinct? Medical Care, 36, 567–572.PubMedCrossRef
13.
go back to reference Wilson, D., Parsons, J., & Tucker, G. (2000). The SF-36 summary scales: Problems and solutions. Sozial-und Präventivmedizin, 45, 239–246.PubMedCrossRef Wilson, D., Parsons, J., & Tucker, G. (2000). The SF-36 summary scales: Problems and solutions. Sozial-und Präventivmedizin, 45, 239–246.PubMedCrossRef
14.
go back to reference Taft, C., Karlson, J., & Sullivan, M. (2001). Do SF-36 summary component scores accurately summarise subscale scores? Quality of Life Research, 10, 395–404.PubMedCrossRef Taft, C., Karlson, J., & Sullivan, M. (2001). Do SF-36 summary component scores accurately summarise subscale scores? Quality of Life Research, 10, 395–404.PubMedCrossRef
15.
go back to reference Farivar, S. S., Cunningham, W. E., & Hays, R. D. (2007). Correlated physical and mental health summary scores for the SF-36 and SF-12 health survey, V. 1. Health and Quality of Life Outcomes, 5, 54.PubMedCentralPubMedCrossRef Farivar, S. S., Cunningham, W. E., & Hays, R. D. (2007). Correlated physical and mental health summary scores for the SF-36 and SF-12 health survey, V. 1. Health and Quality of Life Outcomes, 5, 54.PubMedCentralPubMedCrossRef
16.
go back to reference Hann, M., & Reeves, D. (2008). The SF-36 scales are not accurately summarised by independent physical and mental component scores. Quality of Life Research, 17, 413–423.PubMedCrossRef Hann, M., & Reeves, D. (2008). The SF-36 scales are not accurately summarised by independent physical and mental component scores. Quality of Life Research, 17, 413–423.PubMedCrossRef
17.
go back to reference Anagnostopoulos, F., Niakas, D., & Tountas, Y. (2009). Comparison between exploratory factor-analytic and SEM-based approaches to constructing SF-36 summary scores. Quality of Life Research, 18, 53–63.PubMedCrossRef Anagnostopoulos, F., Niakas, D., & Tountas, Y. (2009). Comparison between exploratory factor-analytic and SEM-based approaches to constructing SF-36 summary scores. Quality of Life Research, 18, 53–63.PubMedCrossRef
18.
go back to reference Fleishman, J. A., Selim, A. J., & Kazis, L. E. (2010). Deriving SF-12v2 physical and mental health summary scores: A comparison of different scoring algorithms. Quality of Life Research, 19(2), 231–241.PubMedCrossRef Fleishman, J. A., Selim, A. J., & Kazis, L. E. (2010). Deriving SF-12v2 physical and mental health summary scores: A comparison of different scoring algorithms. Quality of Life Research, 19(2), 231–241.PubMedCrossRef
19.
go back to reference Tucker, G., Adams, R., & Wilson, D. (2010). New Australian population scoring coefficients for the old version of the SF-36 and SF-12 health status questionnaires. Quality of Life Research, 19(7), 1069–1076.PubMedCrossRef Tucker, G., Adams, R., & Wilson, D. (2010). New Australian population scoring coefficients for the old version of the SF-36 and SF-12 health status questionnaires. Quality of Life Research, 19(7), 1069–1076.PubMedCrossRef
23.
go back to reference Cheok, F., Schrader, G., Banham, D., Marker, J., & Hordacre, A. L. (2003). Identification, course, and treatment of depression after admission for a cardiac condition: Rationale and patient characteristics for the Identifying Depression As a Comorbid Condition (IDACC) project. American Heart Journal, 146(6), 978–984.PubMedCrossRef Cheok, F., Schrader, G., Banham, D., Marker, J., & Hordacre, A. L. (2003). Identification, course, and treatment of depression after admission for a cardiac condition: Rationale and patient characteristics for the Identifying Depression As a Comorbid Condition (IDACC) project. American Heart Journal, 146(6), 978–984.PubMedCrossRef
24.
go back to reference Schrader, G., Cheok, F., Hordacre, A. L., & Guiver, N. (2004). Predictors of depression three months after cardiac hospitalization. Psychosomatic Medicine, 66(4), 514–520.PubMedCrossRef Schrader, G., Cheok, F., Hordacre, A. L., & Guiver, N. (2004). Predictors of depression three months after cardiac hospitalization. Psychosomatic Medicine, 66(4), 514–520.PubMedCrossRef
25.
go back to reference Wilson, D. H., Appleton, S. L., Taylor, A. W., Tucker, G., Ruffin, R. E., Wittert, G., et al. (2010). Depression and obesity in adults with asthma: Multiple comorbidities and management issues. Medical Journal of Australia, 192(7), 381–383.PubMed Wilson, D. H., Appleton, S. L., Taylor, A. W., Tucker, G., Ruffin, R. E., Wittert, G., et al. (2010). Depression and obesity in adults with asthma: Multiple comorbidities and management issues. Medical Journal of Australia, 192(7), 381–383.PubMed
26.
go back to reference Sullivan, M. D., O’Connor, P., Feeney, P., Hire, D., Simmons, D. L., Raisch, D. W., et al. (2012). Depression predicts all-cause mortality: Epidemiological evaluation from the ACCORD HRQL substudy. Diabetes Care, 35(8), 1708–1715. doi:10.2337/dc11-1791.PubMedCentralPubMedCrossRef Sullivan, M. D., O’Connor, P., Feeney, P., Hire, D., Simmons, D. L., Raisch, D. W., et al. (2012). Depression predicts all-cause mortality: Epidemiological evaluation from the ACCORD HRQL substudy. Diabetes Care, 35(8), 1708–1715. doi:10.​2337/​dc11-1791.PubMedCentralPubMedCrossRef
27.
go back to reference Lin, E. H., Von Korff, M., Ciechanowski, P., Peterson, D., Ludman, E. J., Rutter, C. M., et al. (2012). Treatment adjustment and medication adherence for complex patients with diabetes, heart disease, and depression: A randomized controlled trial. The Annals of Family Medicine, 10(1), 6–14. doi:10.1370/afm.1343.CrossRef Lin, E. H., Von Korff, M., Ciechanowski, P., Peterson, D., Ludman, E. J., Rutter, C. M., et al. (2012). Treatment adjustment and medication adherence for complex patients with diabetes, heart disease, and depression: A randomized controlled trial. The Annals of Family Medicine, 10(1), 6–14. doi:10.​1370/​afm.​1343.CrossRef
28.
go back to reference Katon, W. J. (2011). Epidemiology and treatment of depression in patients with chronic medical illness. Dialogues in Clinical Neuroscienc, 13(1), 7–23. Katon, W. J. (2011). Epidemiology and treatment of depression in patients with chronic medical illness. Dialogues in Clinical Neuroscienc, 13(1), 7–23.
29.
go back to reference Davydow, D. S., Katon, W. J., & Zatzick, D. F. (2009). Psychiatric morbidity and functional impairments in survivors of burns, traumatic injuries, and ICU stays for other critical illnesses: A review of the literature. International Review of Psychiatry, 21(6), 531–538. doi:10.3109/09540260903343877.PubMedCentralPubMedCrossRef Davydow, D. S., Katon, W. J., & Zatzick, D. F. (2009). Psychiatric morbidity and functional impairments in survivors of burns, traumatic injuries, and ICU stays for other critical illnesses: A review of the literature. International Review of Psychiatry, 21(6), 531–538. doi:10.​3109/​0954026090334387​7.PubMedCentralPubMedCrossRef
31.
go back to reference Australian Bureau of Statistics (1995). National Health Survey. SF-36 Population Norms Australia. Canberra: Australian Bureau of Statistics, Catalogue Number 4399.0. Australian Bureau of Statistics (1995). National Health Survey. SF-36 Population Norms Australia. Canberra: Australian Bureau of Statistics, Catalogue Number 4399.0.
32.
go back to reference Ware, J., Kosinski, M., & Keller, S. (1995). SF-12: How to score the SF-12 physical and mental health summary scales (2nd ed.). Boston: The Health Institute, New England Medical Center. Ware, J., Kosinski, M., & Keller, S. (1995). SF-12: How to score the SF-12 physical and mental health summary scales (2nd ed.). Boston: The Health Institute, New England Medical Center.
33.
go back to reference Ware J. E. Jr., Kosinski M., Turner-Bowker, D., Sundaram M., Gandeck, B., & Maruish M. E. (2002). User’s manual for the SF-12 V2 health survey, Second Edition. Quality Metric, 24 Albion Rd, Building 400, Lincoln, RI 02865, USA. Ware J. E. Jr., Kosinski M., Turner-Bowker, D., Sundaram M., Gandeck, B., & Maruish M. E. (2002). User’s manual for the SF-12 V2 health survey, Second Edition. Quality Metric, 24 Albion Rd, Building 400, Lincoln, RI 02865, USA.
36.
go back to reference Hawthorne, G. & Richardson, J. (1997). The assessment of quality of life (AQoL) instrument construction, initial validation and utility scaling. Centre for Health Program Evaluation, Melbourne (15 pages) (ISBN 1 875677 85 2). Hawthorne, G. & Richardson, J. (1997). The assessment of quality of life (AQoL) instrument construction, initial validation and utility scaling. Centre for Health Program Evaluation, Melbourne (15 pages) (ISBN 1 875677 85 2).
37.
go back to reference Hawthorne, G., Korn, S., & Richardson, J. (2013). Population norms for the AQoL derived from the 2007 Australian National Survey of Mental Health and Wellbeing. Australian and New Zealand Journal of Public Health, 37(1), 7–16.PubMedCrossRef Hawthorne, G., Korn, S., & Richardson, J. (2013). Population norms for the AQoL derived from the 2007 Australian National Survey of Mental Health and Wellbeing. Australian and New Zealand Journal of Public Health, 37(1), 7–16.PubMedCrossRef
38.
go back to reference Selim, A., Ren, X., Fincke, G., Rogers, W., Lee, A., & Kazis, L. (1997). A symptom-based measure of the severity of chronic lung disease: results from the Veterans Health Study. Chest, 111, 1607–1614.PubMedCrossRef Selim, A., Ren, X., Fincke, G., Rogers, W., Lee, A., & Kazis, L. (1997). A symptom-based measure of the severity of chronic lung disease: results from the Veterans Health Study. Chest, 111, 1607–1614.PubMedCrossRef
39.
go back to reference Ruffin, R. E., Wilson, D. H., Chittleborough, C. R., Southcott, A. M., Smith, B., & Christopher, D. J. (2000). Multiple respiratory symptoms predict quality of life in chronic lung disease: A population-based study of Australian adults. Quality of Life Research, 9, 1031–1039.PubMedCrossRef Ruffin, R. E., Wilson, D. H., Chittleborough, C. R., Southcott, A. M., Smith, B., & Christopher, D. J. (2000). Multiple respiratory symptoms predict quality of life in chronic lung disease: A population-based study of Australian adults. Quality of Life Research, 9, 1031–1039.PubMedCrossRef
40.
go back to reference Goldberg, D. P., & Hillier, V. F. (1979). A scaled version of the General Health Questionnaire. Psychological Medicine, 9, 139–145.PubMedCrossRef Goldberg, D. P., & Hillier, V. F. (1979). A scaled version of the General Health Questionnaire. Psychological Medicine, 9, 139–145.PubMedCrossRef
41.
go back to reference Radloff, L. S. (1977). The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1, 385–401.CrossRef Radloff, L. S. (1977). The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1, 385–401.CrossRef
42.
go back to reference Kessler, R. C., Andrews, G., Colpe, L. J., Hripi, E., Mrocsek, D. K., Normand, S.-L. T., et al. (2002). Short screening scales to monitor population prevalences and trends in nonspecific psychological distress. Psychological Medicine, 32(6), 959–976.PubMedCrossRef Kessler, R. C., Andrews, G., Colpe, L. J., Hripi, E., Mrocsek, D. K., Normand, S.-L. T., et al. (2002). Short screening scales to monitor population prevalences and trends in nonspecific psychological distress. Psychological Medicine, 32(6), 959–976.PubMedCrossRef
43.
go back to reference Wilson, D., Wakefield, M., & Taylor, A. (1992). The South Australian health omnibus survey. Health Promotion Journal of Australia, 2, 47–49. Wilson, D., Wakefield, M., & Taylor, A. (1992). The South Australian health omnibus survey. Health Promotion Journal of Australia, 2, 47–49.
44.
go back to reference Grant, J. F., Taylor, A. W., Ruffin, R. E., Wilson, D. H., Phillips, P. J., Adams, R. J. T., et al. (2009). Cohort profile: The North West Adelaide Health Study (NWAHS). International Journal of Epidemiology, 38, 1479–1486. doi:10.1093/ije/dyn262.PubMedCrossRef Grant, J. F., Taylor, A. W., Ruffin, R. E., Wilson, D. H., Phillips, P. J., Adams, R. J. T., et al. (2009). Cohort profile: The North West Adelaide Health Study (NWAHS). International Journal of Epidemiology, 38, 1479–1486. doi:10.​1093/​ije/​dyn262.PubMedCrossRef
45.
go back to reference WANTS Health West. (2001). Collaborative health and wellbeing survey design and methodology. Perth, WA: Western Australian Government. WANTS Health West. (2001). Collaborative health and wellbeing survey design and methodology. Perth, WA: Western Australian Government.
46.
go back to reference Cohen, J. (1988). Statistical power analysis for the behavioural sciences (2nd ed.). Hillsdale, NJ: Eribaum. Cohen, J. (1988). Statistical power analysis for the behavioural sciences (2nd ed.). Hillsdale, NJ: Eribaum.
47.
go back to reference Kolappe, K., Henderson, D. C., & Kishare, S. P. (2013). No physical health without mental health: Lessons unlearned? Bulletin of the World Health Organization, 91, 3.CrossRef Kolappe, K., Henderson, D. C., & Kishare, S. P. (2013). No physical health without mental health: Lessons unlearned? Bulletin of the World Health Organization, 91, 3.CrossRef
49.
go back to reference Academy of Medical Royal Colleges. (2009). No health without mental health: The alert summary report. London: Millbank Medical Ltd. Academy of Medical Royal Colleges. (2009). No health without mental health: The alert summary report. London: Millbank Medical Ltd.
51.
go back to reference Adams, R. J., Wilson, D. H., Taylor, A. W., Daly, A., Tursan d’Espaignet, E., Dal Grande, E., et al. (2004). Psychological factors and asthma quality of life: A population based study. Thorax, 59, 930–935.PubMedCentralPubMedCrossRef Adams, R. J., Wilson, D. H., Taylor, A. W., Daly, A., Tursan d’Espaignet, E., Dal Grande, E., et al. (2004). Psychological factors and asthma quality of life: A population based study. Thorax, 59, 930–935.PubMedCentralPubMedCrossRef
52.
go back to reference Jain, A., & Lolak, S. (2009). Psychiatric aspects of chronic lung disease. Current Psychiatry Reports, 11, 219–225.PubMedCrossRef Jain, A., & Lolak, S. (2009). Psychiatric aspects of chronic lung disease. Current Psychiatry Reports, 11, 219–225.PubMedCrossRef
Metadata
Title
Results from several population studies show that recommended scoring methods of the SF-36 and the SF-12 may lead to incorrect conclusions and subsequent health decisions
Authors
Graeme Tucker
Robert Adams
David Wilson
Publication date
01-10-2014
Publisher
Springer International Publishing
Published in
Quality of Life Research / Issue 8/2014
Print ISSN: 0962-9343
Electronic ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-014-0669-9

Other articles of this Issue 8/2014

Quality of Life Research 8/2014 Go to the issue

Premium Partner