Skip to main content
Top
Published in: Quality of Life Research 8/2011

01-10-2011

Concordance in the measurement of quality of life and health indicators between two methods of computer-assisted interviews: self-administered and by telephone

Authors: Joanne Klevens, William E. Trick, Romina Kee, Francisco Angulo, Diana Garcia, Laura S. Sadowski

Published in: Quality of Life Research | Issue 8/2011

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Purpose

The aim of this study was to establish the concordance for quality of life (QOL), disability, and use of health service indicators between two modes of computer-assisted interviews: audio-computer-assisted self-interview (A-CASI) and computer-assisted telephone interview (CATI). High concordance between these modes of data collection would allow comparisons and interchangeable use in cross-sectional or longitudinal assessments.

Methods

Adult English-speaking women (n = 126) were enrolled from women’s health clinics at a public hospital. QOL using the short form 12 version 2, disability (days missed from work, inability to do household activities), and utilization of health services (number of emergency room visits and hospitalizations) were assessed first with A-CASI at the time of enrollment and again (n = 102) with CATI 1 week later. Participants assessed with both modes were 38 years old on average, predominantly African-American, 41% had a high school education or less, and 61% were uninsured. Lin’s concordance correlation coefficient or Cohen’s kappa was calculated to establish concordance between paired A-CASI and CATI assessments.

Results

Concordance between the two interview methods ranged from fair to substantial for the QOL components, (concordance correlation coefficient [CCC] of .76 and .87, respectively), the QOL subscales, and disability indices (CCC range; .53–.91). For health services utilization, there was moderate concordance for emergency room visits (CCC = .70) but only slight concordance for the number of hospitalizations in the past year (CCC = .37).

Conclusions

Administering surveys through a telephone or self-administered computer-assisted interview resulted in moderate to substantial agreement for the short form QOL components and fair to substantial for the QOL subscales and disability measures. These findings suggest A-CASI and CATI can be used interchangeably for some QOL scales.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference O’Reilly, J. M., Hubbard, M. L., Lessler, J. T., Biemer, P. P., & Turner, C. F. (1994). Audio and video computer assisted self interviewing: Preliminary tests of new technologies for data collection. Journal of Official Statistics, 10(2), 197–214. O’Reilly, J. M., Hubbard, M. L., Lessler, J. T., Biemer, P. P., & Turner, C. F. (1994). Audio and video computer assisted self interviewing: Preliminary tests of new technologies for data collection. Journal of Official Statistics, 10(2), 197–214.
2.
go back to reference Turner, C. F., Ku, L., Rogers, S. M., Lindberg, L. D., Pleck, J. H., & Sonenstein, F. L. (1998). Adolescent sexual behavior, drug use, and violence: Increased reporting with computer survey technology. Science, 280(5365), 867–873.PubMedCrossRef Turner, C. F., Ku, L., Rogers, S. M., Lindberg, L. D., Pleck, J. H., & Sonenstein, F. L. (1998). Adolescent sexual behavior, drug use, and violence: Increased reporting with computer survey technology. Science, 280(5365), 867–873.PubMedCrossRef
3.
go back to reference Gerbert, B., Bronstone, A., Pantilat, S., McPhee, S., Allerton, M., & Moe, J. (1999). When asked, patients tell: Disclosure of sensitive health-risk behaviors. Medical Care, 37(1), 104–111.PubMedCrossRef Gerbert, B., Bronstone, A., Pantilat, S., McPhee, S., Allerton, M., & Moe, J. (1999). When asked, patients tell: Disclosure of sensitive health-risk behaviors. Medical Care, 37(1), 104–111.PubMedCrossRef
4.
go back to reference Des Jarlais, D. C., Paone, D., & Millikenm, J. (1999). Audio-computer interviewing to measure risk behavior for HIV among injecting drug users: A quasi-randomised trial. Lancet, 353(9165), 1657–1661.PubMedCrossRef Des Jarlais, D. C., Paone, D., & Millikenm, J. (1999). Audio-computer interviewing to measure risk behavior for HIV among injecting drug users: A quasi-randomised trial. Lancet, 353(9165), 1657–1661.PubMedCrossRef
5.
go back to reference Gribble, J. N., Miller, H. G., Cooley, P. C., Catania, J. S., Pollack, L., & Turner, C. F. (2000). The impact of T-CASI interviewing on reported drug use among men who have sex with men. Substance Use and Misuse, 35(6–8), 869–890.PubMedCrossRef Gribble, J. N., Miller, H. G., Cooley, P. C., Catania, J. S., Pollack, L., & Turner, C. F. (2000). The impact of T-CASI interviewing on reported drug use among men who have sex with men. Substance Use and Misuse, 35(6–8), 869–890.PubMedCrossRef
6.
go back to reference Newman, J. C., Des Jarlais, D. C., Turner, C. F., Gribble, J., Cooley, P., & Paone, D. (2002). The differential effects of face-to-face and computer interview modes. American Journal of Public Health, 92(2), 294–297.PubMedCrossRef Newman, J. C., Des Jarlais, D. C., Turner, C. F., Gribble, J., Cooley, P., & Paone, D. (2002). The differential effects of face-to-face and computer interview modes. American Journal of Public Health, 92(2), 294–297.PubMedCrossRef
7.
go back to reference Paperny, D., Aono, J., Lehman, R., Hammar, S., & Risser, J. (1990). Computer-assisted detection and intervention in adolescent high risk behaviors. Journal of Pediatrics, 116(3), 456–462.PubMedCrossRef Paperny, D., Aono, J., Lehman, R., Hammar, S., & Risser, J. (1990). Computer-assisted detection and intervention in adolescent high risk behaviors. Journal of Pediatrics, 116(3), 456–462.PubMedCrossRef
8.
go back to reference Lapham, S., Kring, M., & Skipper, B. (1991). Prenatal risk screening by computer in a health maintenance organization-based prenatal care clinic. American Journal of Obstetrics and Gynecology, 165(3), 506–514.PubMed Lapham, S., Kring, M., & Skipper, B. (1991). Prenatal risk screening by computer in a health maintenance organization-based prenatal care clinic. American Journal of Obstetrics and Gynecology, 165(3), 506–514.PubMed
9.
go back to reference Rhodes, K. V., Lauderdale, D. S., He, T., Howes, D. S., & Levinson, W. (2002). “Between me and the computer”: Increased detection of intimate partner violence using a computer questionnaire. Annals of Emergency Medicine, 40(5), 476–484.PubMedCrossRef Rhodes, K. V., Lauderdale, D. S., He, T., Howes, D. S., & Levinson, W. (2002). “Between me and the computer”: Increased detection of intimate partner violence using a computer questionnaire. Annals of Emergency Medicine, 40(5), 476–484.PubMedCrossRef
10.
go back to reference Clark, M. A., Rogers, M. L., Armstrong, G. F., Rakowski, W., & Kviz, F. J. (2008). Differential response effects of data collection mode in a cancer screening study of unmarried women ages 40–75 years: A randomized trial. BioMedCentral Medical Research Methodology. doi:10.1186/1471-2288-8-10. Clark, M. A., Rogers, M. L., Armstrong, G. F., Rakowski, W., & Kviz, F. J. (2008). Differential response effects of data collection mode in a cancer screening study of unmarried women ages 40–75 years: A randomized trial. BioMedCentral Medical Research Methodology. doi:10.​1186/​1471-2288-8-10.
11.
go back to reference Ellen, J. M., Gurvey, J. E., Pasch, L., Tschann, J., Nanda, J. P., & Catania, J. (2002). A randomized comparison of A-CASI and phone interviews to asses STD/HIV-related risk behaviors in teens. Journal of Adolescent Health, 31(1), 26–30.PubMedCrossRef Ellen, J. M., Gurvey, J. E., Pasch, L., Tschann, J., Nanda, J. P., & Catania, J. (2002). A randomized comparison of A-CASI and phone interviews to asses STD/HIV-related risk behaviors in teens. Journal of Adolescent Health, 31(1), 26–30.PubMedCrossRef
12.
go back to reference Kalfs, N., & Saris, W. (1998). Large differences in time use for three data collection systems. Social Indicators Research, 44(3), 267–290.CrossRef Kalfs, N., & Saris, W. (1998). Large differences in time use for three data collection systems. Social Indicators Research, 44(3), 267–290.CrossRef
13.
go back to reference Abramson, J. H. (2004). WINPEPI (PEPI-for-Windows): Computer program for epidemiologists. Epidemiologic Perspectives and Innovations. doi:10.1186/1742-5573-1-6. Abramson, J. H. (2004). WINPEPI (PEPI-for-Windows): Computer program for epidemiologists. Epidemiologic Perspectives and Innovations. doi:10.​1186/​1742-5573-1-6.
14.
go back to reference Ware, J. E., Kosinski, M., & Keller, S. D. (1996). A 12-item short-form health survey: Construction of scales and preliminary tests of reliability and validity. Medical Care, 34(3), 220–233.PubMedCrossRef Ware, J. E., Kosinski, M., & Keller, S. D. (1996). A 12-item short-form health survey: Construction of scales and preliminary tests of reliability and validity. Medical Care, 34(3), 220–233.PubMedCrossRef
15.
go back to reference Lin, L. I. (1989). A concordance correlation coefficient to evaluate reproducibility. Biometrics, 45(1), 255–268.PubMedCrossRef Lin, L. I. (1989). A concordance correlation coefficient to evaluate reproducibility. Biometrics, 45(1), 255–268.PubMedCrossRef
16.
go back to reference Cohen, J. A. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37–46.CrossRef Cohen, J. A. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37–46.CrossRef
17.
go back to reference Rabe-Hesketh, S., & Skrondal, A. (2008). Multilevel and longitudinal modeling using stata (2nd ed.). College Station, TX: Stata Press. Rabe-Hesketh, S., & Skrondal, A. (2008). Multilevel and longitudinal modeling using stata (2nd ed.). College Station, TX: Stata Press.
18.
go back to reference Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174.PubMedCrossRef Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174.PubMedCrossRef
19.
go back to reference Shrout, P. E. (1998). Measurement reliability and agreement in psychiatry. Statistical Methods in Medical Research, 7(3), 301–317.PubMedCrossRef Shrout, P. E. (1998). Measurement reliability and agreement in psychiatry. Statistical Methods in Medical Research, 7(3), 301–317.PubMedCrossRef
20.
go back to reference King, T. S., & Chinchilli, V. M. (2001). A generalized concordance correlation coefficient for continuous and categorical data. Statistics in Medicine, 20(14), 2131–2147.PubMedCrossRef King, T. S., & Chinchilli, V. M. (2001). A generalized concordance correlation coefficient for continuous and categorical data. Statistics in Medicine, 20(14), 2131–2147.PubMedCrossRef
21.
go back to reference McNutt, L. A., Waltermauer, E., McCauley, J., Campbell, J., & Ford, D. E. (2005). Rationale for and development of the intimate partner violence screen for primary care. Family Violence Prevention and Health Practice, (3) 1–13. McNutt, L. A., Waltermauer, E., McCauley, J., Campbell, J., & Ford, D. E. (2005). Rationale for and development of the intimate partner violence screen for primary care. Family Violence Prevention and Health Practice, (3) 1–13.
22.
go back to reference Groves, R. M., Fowler, F. J., Couper, M. P., Lepkowski, J. M., & Singer, E. (2009). Survey methods (2nd ed.). Hoboken, NJ: John Wiley and Sons. Groves, R. M., Fowler, F. J., Couper, M. P., Lepkowski, J. M., & Singer, E. (2009). Survey methods (2nd ed.). Hoboken, NJ: John Wiley and Sons.
Metadata
Title
Concordance in the measurement of quality of life and health indicators between two methods of computer-assisted interviews: self-administered and by telephone
Authors
Joanne Klevens
William E. Trick
Romina Kee
Francisco Angulo
Diana Garcia
Laura S. Sadowski
Publication date
01-10-2011
Publisher
Springer Netherlands
Published in
Quality of Life Research / Issue 8/2011
Print ISSN: 0962-9343
Electronic ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-011-9862-2

Other articles of this Issue 8/2011

Quality of Life Research 8/2011 Go to the issue

Premium Partner