Skip to main content
Top
Published in: Social Indicators Research 3/2023

24-08-2023 | Original Research

Feasibility and Validity of Using Item Response Theory to Assess Cumulative Social Risk

Authors: Salene M.W. Jones, Katherine J. Briant, Cecy Corona, Jason A. Mendoza

Published in: Social Indicators Research | Issue 3/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Social risks are patient-level effects of social determinants of health. Cumulative social risk, the total of multiple risks, predicts health outcomes such as cancer mortality. Current measures of cumulative social risk count the number of domains in which a patient has risks. We tested whether an item response theory (IRT) model could be an alternative method for measuring cumulative social risk. A population-based sample (n = 1118) was recruited from 13 counties of western Washington State. Participants completed a one-time survey online. Questions on social risk included two on housing instability, two on food insecurity, one on affording medical care and one on general financial health. Additional measures to test the construct validity of the cumulative social risk score included perceived discrimination, perceived stress, smoking status and having a usual place for healthcare. The IRT model fit the six social risk items. Social risk items ranged in severity from just above the mean (0.18 standard deviations) to substantially above the mean (4.18 standard deviations). IRT scores were positively and significantly associated with perceived discrimination (p < 0.001), perceived stress (p < 0.001), being a current smoker vs. a never (p < 0.001) or former smoker (p = 0.006) and not having a usual place for healthcare vs. having a usual place of care (p = 0.033). Cumulative social risk can be measured and assessed using IRT models. Weighted IRT cumulative social risk scores were associated with multiple health markers, indicating promise for this type of measure. Future research is needed to compare IRT-based and count-based cumulative social risk scores.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
go back to reference Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In F. M. Lord, & M. R. Novick (Eds.), Statistical theories of Mental Test Scores (pp. 395–479). Addison-Wesley. Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In F. M. Lord, & M. R. Novick (Eds.), Statistical theories of Mental Test Scores (pp. 395–479). Addison-Wesley.
go back to reference Bock, R. D., & Mislevy, R. J. J. A. (1982). p. m. Adaptive EAP estimation of ability in a microcomputer environment. 6(4), 431–444. Bock, R. D., & Mislevy, R. J. J. A. (1982). p. m. Adaptive EAP estimation of ability in a microcomputer environment. 6(4), 431–444.
go back to reference Browne, M., & Ceduk, R. (1993). Alternate ways of assessing model fit. In K. Bollen, & J. Long (Eds.), Testing structural equation models (pp. 136–162). Sage. Browne, M., & Ceduk, R. (1993). Alternate ways of assessing model fit. In K. Bollen, & J. Long (Eds.), Testing structural equation models (pp. 136–162). Sage.
go back to reference Cohen, S., Kamarck, T., & Mermelstein, R. (1994). Perceived stress scale. Measuring stress: A guide for health and social scientists, 10(2), 1–2. Cohen, S., Kamarck, T., & Mermelstein, R. (1994). Perceived stress scale. Measuring stress: A guide for health and social scientists, 10(2), 1–2.
go back to reference Finney Rutten, L. J., Blake, K. D., Skolnick, V. G., Davis, T., Moser, R. P., & Hesse, B. W. (2020). Data Resource Profile: The National Cancer Institute’s Health Information National Trends Survey (HINTS). International Journal Of Epidemiology, 49(1), 17–17j. https://doi.org/10.1093/ije/dyz083.CrossRef Finney Rutten, L. J., Blake, K. D., Skolnick, V. G., Davis, T., Moser, R. P., & Hesse, B. W. (2020). Data Resource Profile: The National Cancer Institute’s Health Information National Trends Survey (HINTS). International Journal Of Epidemiology, 49(1), 17–17j. https://​doi.​org/​10.​1093/​ije/​dyz083.CrossRef
go back to reference Fries, J. F., Krishnan, E., Rose, M., Lingala, B., & Bruce, B. (2011). Improved responsiveness and reduced sample size requirements of PROMIS physical function scales with item response theory. Arthritis Res Ther, 13(5), R147. https://doi.org/10.1186/ar3461.CrossRef Fries, J. F., Krishnan, E., Rose, M., Lingala, B., & Bruce, B. (2011). Improved responsiveness and reduced sample size requirements of PROMIS physical function scales with item response theory. Arthritis Res Ther, 13(5), R147. https://​doi.​org/​10.​1186/​ar3461.CrossRef
go back to reference Gamble, S., Mawokomatanda, T., Xu, F., Chowdhury, P. P., Pierannunzi, C., Flegel, D., Garvin, W., & Town, M. (2017). Surveillance for certain Health Behaviors and Conditions among States and selected local areas - behavioral risk factor Surveillance System, United States, 2013 and 2014. MMWR Surveill Summ, 66(16), 1–144. https://doi.org/10.15585/mmwr.ss6616a1.CrossRef Gamble, S., Mawokomatanda, T., Xu, F., Chowdhury, P. P., Pierannunzi, C., Flegel, D., Garvin, W., & Town, M. (2017). Surveillance for certain Health Behaviors and Conditions among States and selected local areas - behavioral risk factor Surveillance System, United States, 2013 and 2014. MMWR Surveill Summ, 66(16), 1–144. https://​doi.​org/​10.​15585/​mmwr.​ss6616a1.CrossRef
go back to reference Groves, R. M. (2006). Nonresponse rates and nonresponse bias in household surveys. Public Opinion Quarterly, 70(5), 646–675.CrossRef Groves, R. M. (2006). Nonresponse rates and nonresponse bias in household surveys. Public Opinion Quarterly, 70(5), 646–675.CrossRef
go back to reference Handbook of item response theory modeling: Applications to typical performance assessment. (2015). Routledge/Taylor & Francis Group. Handbook of item response theory modeling: Applications to typical performance assessment. (2015). Routledge/Taylor & Francis Group.
go back to reference Harris, P. A., Taylor, R., Thielke, R., Payne, J., Gonzalez, N., & Conde, J. G. (2009). Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support. Journal Of Biomedical Informatics, 42(2), 377–381. https://doi.org/10.1016/j.jbi.2008.08.010.CrossRef Harris, P. A., Taylor, R., Thielke, R., Payne, J., Gonzalez, N., & Conde, J. G. (2009). Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support. Journal Of Biomedical Informatics, 42(2), 377–381. https://​doi.​org/​10.​1016/​j.​jbi.​2008.​08.​010.CrossRef
go back to reference Harris, P. A., Taylor, R., Minor, B. L., Elliott, V., Fernandez, M., O’Neal, L., McLeod, L., Delacqua, G., Delacqua, F., Kirby, J., Duda, S. N., & Consortium, R. E. (2019). The REDCap consortium: Building an international community of software platform partners. Journal Of Biomedical Informatics, 95, 103208. https://doi.org/10.1016/j.jbi.2019.103208.CrossRef Harris, P. A., Taylor, R., Minor, B. L., Elliott, V., Fernandez, M., O’Neal, L., McLeod, L., Delacqua, G., Delacqua, F., Kirby, J., Duda, S. N., & Consortium, R. E. (2019). The REDCap consortium: Building an international community of software platform partners. Journal Of Biomedical Informatics, 95, 103208. https://​doi.​org/​10.​1016/​j.​jbi.​2019.​103208.CrossRef
go back to reference Hays, R. D., Spritzer, K. L., Fries, J. F., & Krishnan, E. (2015). Responsiveness and minimally important difference for the patient-reported outcomes measurement information system (PROMIS) 20-item physical functioning short form in a prospective observational study of rheumatoid arthritis. Annals Of The Rheumatic Diseases, 74(1), 104–107. https://doi.org/10.1136/annrheumdis-2013-204053.CrossRef Hays, R. D., Spritzer, K. L., Fries, J. F., & Krishnan, E. (2015). Responsiveness and minimally important difference for the patient-reported outcomes measurement information system (PROMIS) 20-item physical functioning short form in a prospective observational study of rheumatoid arthritis. Annals Of The Rheumatic Diseases, 74(1), 104–107. https://​doi.​org/​10.​1136/​annrheumdis-2013-204053.CrossRef
go back to reference Jensen, J. D., Shannon, J., Iachan, R., Deng, Y., Kim, S. J., Demark-Wahnefried, W., Faseru, B., Paskett, E. D., Hu, J., Vanderpool, R. C., Lazovich, D., Mendoza, J. A., Shete, S., Robertson, L. B., Balkrishnan, R., Briant, K. J., Haaland, B., Haggstrom, D. A., & Fuemmeler, B. F. (2022). Examining rural-urban differences in Fatalism and Information overload: Data from 12 NCI-Designated Cancer Centers. Cancer Epidemiology, Biomarkers & Prevention. https://doi.org/10.1158/1055-9965.EPI-21-0355. & Rural Workgroup of the Population Health Assessment in Cancer Center Catchment AreasCrossRef Jensen, J. D., Shannon, J., Iachan, R., Deng, Y., Kim, S. J., Demark-Wahnefried, W., Faseru, B., Paskett, E. D., Hu, J., Vanderpool, R. C., Lazovich, D., Mendoza, J. A., Shete, S., Robertson, L. B., Balkrishnan, R., Briant, K. J., Haaland, B., Haggstrom, D. A., & Fuemmeler, B. F. (2022). Examining rural-urban differences in Fatalism and Information overload: Data from 12 NCI-Designated Cancer Centers. Cancer Epidemiology, Biomarkers & Prevention. https://​doi.​org/​10.​1158/​1055-9965.​EPI-21-0355. & Rural Workgroup of the Population Health Assessment in Cancer Center Catchment AreasCrossRef
go back to reference Lord, F. M. (1977). A study of item bias, using item characteristic curve theory. In Y. H. Portinga (Ed.), Basic problems in cross-cultural psychology (pp. 19–29). Swets and Zeitlinger. Lord, F. M. (1977). A study of item bias, using item characteristic curve theory. In Y. H. Portinga (Ed.), Basic problems in cross-cultural psychology (pp. 19–29). Swets and Zeitlinger.
go back to reference Mendoza, J. A., Miller, C. A., Martin, K. J., Resnicow, K., Iachan, R., Faseru, B., McDaniels-Davidson, C., Deng, Y., Martinez, M. E., Demark-Wahnefried, W., Leader, A. E., Lazovich, D., Jensen, J. D., Briant, K. J., & Fuemmeler, B. F. (In press). Examining the Association of Food Insecurity and Being Up-To-Date for Breast and Colorectal Cancer Screenings. Cancer Epidemiology, Biomarkers and Prevention. Mendoza, J. A., Miller, C. A., Martin, K. J., Resnicow, K., Iachan, R., Faseru, B., McDaniels-Davidson, C., Deng, Y., Martinez, M. E., Demark-Wahnefried, W., Leader, A. E., Lazovich, D., Jensen, J. D., Briant, K. J., & Fuemmeler, B. F. (In press). Examining the Association of Food Insecurity and Being Up-To-Date for Breast and Colorectal Cancer Screenings. Cancer Epidemiology, Biomarkers and Prevention.
go back to reference National Association of Community Health Centers, I (2016). PRAPARE: Protocol for Responding to and Assessing Patient Assets, Risks, and Experiences. In. National Association of Community Health Centers, I (2016). PRAPARE: Protocol for Responding to and Assessing Patient Assets, Risks, and Experiences. In.
go back to reference National Academies of Sciences, E., &, & Medicine (2019). Integrating social care into the delivery of health care. Moving upstream to improve the nation’s health. National Academies of Sciences, E., &, & Medicine (2019). Integrating social care into the delivery of health care. Moving upstream to improve the nation’s health.
go back to reference Phojanakong, P., Brown Weida, E., Grimaldi, G., Le-Scherban, F., & Chilton, M. (2019). Experiences of racial and ethnic discrimination are Associated with Food Insecurity and Poor Health. International Journal Of Environmental Research And Public Health, 16(22), https://doi.org/10.3390/ijerph16224369. Phojanakong, P., Brown Weida, E., Grimaldi, G., Le-Scherban, F., & Chilton, M. (2019). Experiences of racial and ethnic discrimination are Associated with Food Insecurity and Poor Health. International Journal Of Environmental Research And Public Health, 16(22), https://​doi.​org/​10.​3390/​ijerph16224369.
go back to reference Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., Thissen, D., Revicki, D. A., Weiss, D. J., Hambleton, R. K., Liu, H., Gershon, R., Reise, S. P., Lai, J. S., Cella, D., & Group, P. C. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the patient-reported outcomes Measurement Information System (PROMIS). Medical Care, 45(5 Suppl 1), S22–31. https://doi.org/10.1097/01.mlr.0000250483.85507.04.CrossRef Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., Thissen, D., Revicki, D. A., Weiss, D. J., Hambleton, R. K., Liu, H., Gershon, R., Reise, S. P., Lai, J. S., Cella, D., & Group, P. C. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the patient-reported outcomes Measurement Information System (PROMIS). Medical Care, 45(5 Suppl 1), S22–31. https://​doi.​org/​10.​1097/​01.​mlr.​0000250483.​85507.​04.CrossRef
go back to reference Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement, 34(4). Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement, 34(4).
go back to reference Shete, S., Deng, Y., Shannon, J., Faseru, B., Middleton, D., Iachan, R., Bernardo, B., Balkrishnan, R., Kim, S. J., Huang, B., Millar, M. M., Fuemmler, B., Jensen, J. D., Mendoza, J. A., Hu, J., Lazovich, D., Robertson, L., Demark-Wahnefried, W., & Paskett, E. D. (2021). Differences in breast and Colorectal Cancer Screening Adherence among Women Residing in Urban and Rural Communities in the United States. JAMA Netw Open, 4(10), e2128000. https://doi.org/10.1001/jamanetworkopen.2021.28000. Rural Workgroup of the Population Health Assessment in Cancer Center Catchment Areas.CrossRef Shete, S., Deng, Y., Shannon, J., Faseru, B., Middleton, D., Iachan, R., Bernardo, B., Balkrishnan, R., Kim, S. J., Huang, B., Millar, M. M., Fuemmler, B., Jensen, J. D., Mendoza, J. A., Hu, J., Lazovich, D., Robertson, L., Demark-Wahnefried, W., & Paskett, E. D. (2021). Differences in breast and Colorectal Cancer Screening Adherence among Women Residing in Urban and Rural Communities in the United States. JAMA Netw Open, 4(10), e2128000. https://​doi.​org/​10.​1001/​jamanetworkopen.​2021.​28000. Rural Workgroup of the Population Health Assessment in Cancer Center Catchment Areas.CrossRef
go back to reference Solar, O., & Irwin, A. (2007). A conceptual Framework for Action on the Social Determinants of Health. World Health Organization. Solar, O., & Irwin, A. (2007). A conceptual Framework for Action on the Social Determinants of Health. World Health Organization.
go back to reference Yang, T. C., Chen, D., & Park, K. Perceived Housing Discrimination and Self-Reported Health: How Do Neighborhood Features Matter? (1532–4796 (Electronic)). Yang, T. C., Chen, D., & Park, K. Perceived Housing Discrimination and Self-Reported Health: How Do Neighborhood Features Matter? (1532–4796 (Electronic)).
Metadata
Title
Feasibility and Validity of Using Item Response Theory to Assess Cumulative Social Risk
Authors
Salene M.W. Jones
Katherine J. Briant
Cecy Corona
Jason A. Mendoza
Publication date
24-08-2023
Publisher
Springer Netherlands
Published in
Social Indicators Research / Issue 3/2023
Print ISSN: 0303-8300
Electronic ISSN: 1573-0921
DOI
https://doi.org/10.1007/s11205-023-03189-4

Other articles of this Issue 3/2023

Social Indicators Research 3/2023 Go to the issue

Premium Partner