Skip to main content
Top
Published in: Quality of Life Research 2/2015

01-02-2015

Incorporating patient-reported outcome measures into the electronic health record for research: application using the Patient Health Questionnaire (PHQ-9)

Authors: Sandra D. Griffith, Nicolas R. Thompson, Jaivir S. Rathore, Lara E. Jehi, George E. Tesar, Irene L. Katzan

Published in: Quality of Life Research | Issue 2/2015

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Purpose

Electronic health records (EHRs) present an opportunity to access large stores of data for research, but mapping raw EHR data to clinical phenotypes is complex. We propose adding patient-reported data to the EHR to improve phenotyping performance and describe a retrospective cohort study demonstrating a test case in depressive disorder.

Methods

We compared four EHR-phenotyping methods based on International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) codes, medication records, and the Patient Health Questionnaire 9 (PHQ-9) regarding the ability to identify cases with depression and characteristics of patients identified with depression. Our sample included 168,884 patients seen (2007–2013) at our neurological institute. We assessed the diagnostic performance in a subset of 225 patients who had a reference standard measurement available.

Results

ICD-9-CM codes identified the fewest number of patients as depressed (4,658), followed by PHQ-9 (46,565), and medication data (50,505). The presence of at least one of these criteria identified the largest number (78,322). The PHQ-9 identified a higher proportion of elderly, disabled, Medicaid, and rural patients, as compared to ICD-9-CM codes. ICD-9-CM codes were least sensitive (6.7 % sensitivity), whereas the method using at least one of the criteria identified the highest number of truly depressed patients (93.3 % sensitivity); however, specificity dropped from 97.7 to 58.1 %.

Conclusions

The choice of phenotyping method may disproportionately exclude patient groups from research. Patient-reported data hold potential to improve sensitivity while maintaining an acceptable loss of specificity, depending on the context. Researchers should consider including patient-reported data in EHR-driven phenotyping methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
5.
go back to reference Shivade, C., Raghavan, P., Fosler-Lussier, E., Embi, P. J., Elhadad, N., Johnson, S. B., et al. (2013). A review of approaches to identifying patient phenotype cohorts using electronic health records. Journal of the American Medical Informatics Association, 21(2), 221–230. doi:10.1136/amiajnl-2013-001935.PubMedCentralPubMedCrossRef Shivade, C., Raghavan, P., Fosler-Lussier, E., Embi, P. J., Elhadad, N., Johnson, S. B., et al. (2013). A review of approaches to identifying patient phenotype cohorts using electronic health records. Journal of the American Medical Informatics Association, 21(2), 221–230. doi:10.​1136/​amiajnl-2013-001935.PubMedCentralPubMedCrossRef
6.
7.
go back to reference Jakobsen, K. D., Hansen, T., Dam, H., Larsen, E. B., Gether, U., & Werge, T. (2008). Reliability of clinical ICD-10 diagnoses among electroconvulsive therapy patients with chronic affective disorders. European Journal of Psychiatry, 22(3), 161–172. doi:10.4321/S0213-61632008000300005. Jakobsen, K. D., Hansen, T., Dam, H., Larsen, E. B., Gether, U., & Werge, T. (2008). Reliability of clinical ICD-10 diagnoses among electroconvulsive therapy patients with chronic affective disorders. European Journal of Psychiatry, 22(3), 161–172. doi:10.​4321/​S0213-6163200800030000​5.
8.
go back to reference Kho, A. N., Pacheco, J., Peissig, P. L., Rasmussen, L., Newton, K. M., Weston, N., et al. (2011). Electronic medical records for genetic research: Results of the eMERGE consortium. Science Translational Medicine, 3(79re1), 1–7. doi:10.1126/scitranslmed.3001807. Kho, A. N., Pacheco, J., Peissig, P. L., Rasmussen, L., Newton, K. M., Weston, N., et al. (2011). Electronic medical records for genetic research: Results of the eMERGE consortium. Science Translational Medicine, 3(79re1), 1–7. doi:10.​1126/​scitranslmed.​3001807.
9.
go back to reference Newton, K. M., Peissig, P. L., Kho, A. N., Bielinski, S. J., Berg, R. L., Choudhary, V., et al. (2013). Validation of electronic medical record-based phenotyping algorithms: Results and lessons learned from the eMERGE network. Journal of the American Medical Informatics Association, 20, e147–e154. doi:10.1136/amiajnl-2012-000896.PubMedCentralPubMedCrossRef Newton, K. M., Peissig, P. L., Kho, A. N., Bielinski, S. J., Berg, R. L., Choudhary, V., et al. (2013). Validation of electronic medical record-based phenotyping algorithms: Results and lessons learned from the eMERGE network. Journal of the American Medical Informatics Association, 20, e147–e154. doi:10.​1136/​amiajnl-2012-000896.PubMedCentralPubMedCrossRef
10.
go back to reference Williams, C., Templin, T., & Mosely-Williams, A. (2004). Usability of a computer-assisted interview system for the unaided self-entry of patient data in an urban rheumatology clinic. Journal of the American Medical Informatics Association, 11(4), 249–260. doi:10.1197/jamia.M1527.PubMedCentralPubMedCrossRef Williams, C., Templin, T., & Mosely-Williams, A. (2004). Usability of a computer-assisted interview system for the unaided self-entry of patient data in an urban rheumatology clinic. Journal of the American Medical Informatics Association, 11(4), 249–260. doi:10.​1197/​jamia.​M1527.PubMedCentralPubMedCrossRef
13.
go back to reference Katzan, I., Speck, M., Dopler, C., Urchek, J., Bielawski, K., Dunphy, C., et al. (2011). The Knowledge Program: An innovative, comprehensive electronic data capture system and warehouse. AMIA Annual Symposium Proceedings, 2011, 683–692.PubMedCentralPubMed Katzan, I., Speck, M., Dopler, C., Urchek, J., Bielawski, K., Dunphy, C., et al. (2011). The Knowledge Program: An innovative, comprehensive electronic data capture system and warehouse. AMIA Annual Symposium Proceedings, 2011, 683–692.PubMedCentralPubMed
14.
go back to reference Broderick, J. E., DeWitt, M. M., Rothrock, N., Crane, P. K., & Forrest, C. B. (2013). Advances in patient reported outcomes: The NIH PROMIS measures. eGEMS (Generating Evidence & Methods to Improve Patient Outcomes), 1(1), 12. doi:10.13063/2327-9214.1015. Broderick, J. E., DeWitt, M. M., Rothrock, N., Crane, P. K., & Forrest, C. B. (2013). Advances in patient reported outcomes: The NIH PROMIS measures. eGEMS (Generating Evidence & Methods to Improve Patient Outcomes), 1(1), 12. doi:10.​13063/​2327-9214.​1015.
15.
go back to reference Snyder, C., Blackford, A., Wolff, A., Carducci, M., Herman, J., & Wu, A. (2013). Feasibility and value of PatientViewpoint: A web system for patient-reported outcomes assessment in clinical practice. Psycho-Oncology, 22, 895–901. doi:10.1002/pon.3087.PubMedCentralPubMedCrossRef Snyder, C., Blackford, A., Wolff, A., Carducci, M., Herman, J., & Wu, A. (2013). Feasibility and value of PatientViewpoint: A web system for patient-reported outcomes assessment in clinical practice. Psycho-Oncology, 22, 895–901. doi:10.​1002/​pon.​3087.PubMedCentralPubMedCrossRef
20.
go back to reference Perlis, R. H., Iosifescu, D. V., Castro, V. M., Murphy, S. N., Gainer, V. S., Minnier, J., et al. (2012). Using electronic medical records to enable large-scale studies in psychiatry: Treatment resistant depression as a model. Psychological Medicine, 42(1), 41–50. doi:10.1017/S0033291711000997.PubMedCrossRef Perlis, R. H., Iosifescu, D. V., Castro, V. M., Murphy, S. N., Gainer, V. S., Minnier, J., et al. (2012). Using electronic medical records to enable large-scale studies in psychiatry: Treatment resistant depression as a model. Psychological Medicine, 42(1), 41–50. doi:10.​1017/​S003329171100099​7.PubMedCrossRef
21.
go back to reference Valuck, R. J., Anderson, H. O., Libby, A. M., Brandt, E., Bryan, C., Allen, R. R., et al. (2012). Enhancing electronic health record measurement of depression severity and suicide ideation: A distributed ambulatory research in therapeutics network (DARTNet) study. The Journal of the American Board of Family Medicine, 25(5), 582–593. doi:10.3122/jabfm.2012.05.110053.CrossRef Valuck, R. J., Anderson, H. O., Libby, A. M., Brandt, E., Bryan, C., Allen, R. R., et al. (2012). Enhancing electronic health record measurement of depression severity and suicide ideation: A distributed ambulatory research in therapeutics network (DARTNet) study. The Journal of the American Board of Family Medicine, 25(5), 582–593. doi:10.​3122/​jabfm.​2012.​05.​110053.CrossRef
22.
go back to reference Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16, 606–613.PubMedCentralPubMedCrossRef Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16, 606–613.PubMedCentralPubMedCrossRef
23.
go back to reference Sheehan, D., Lecrubier, Y., Sheehan, K., Amorim, P., Janava, J., Wieller, E., et al. (1998). The mini international neuropsychiatric interview (MINI): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. Journal of Clinical Psychiatry, 59(Suppl 20), 22–33.PubMed Sheehan, D., Lecrubier, Y., Sheehan, K., Amorim, P., Janava, J., Wieller, E., et al. (1998). The mini international neuropsychiatric interview (MINI): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. Journal of Clinical Psychiatry, 59(Suppl 20), 22–33.PubMed
24.
go back to reference Rathore, J. S., Jehi, L. E., Fan, Y., Patel, S. I., Foldvary-Schaefer, N., Ramirez, M. J., et al. (2014). Validation of the Patient Health Questionnaire-9 (PHQ-9) for depression screening in adults with epilepsy. Epilepsy & Behavior, 37, 215–220. doi:10.1016/j.yebeh.2014.06.030. Rathore, J. S., Jehi, L. E., Fan, Y., Patel, S. I., Foldvary-Schaefer, N., Ramirez, M. J., et al. (2014). Validation of the Patient Health Questionnaire-9 (PHQ-9) for depression screening in adults with epilepsy. Epilepsy & Behavior, 37, 215–220. doi:10.​1016/​j.​yebeh.​2014.​06.​030.
28.
go back to reference R Core Team. (2013). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing. R Core Team. (2013). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing.
31.
go back to reference Gilliam, F. G., Barry, J. J., Hermann, B. P., Meador, K. J., Vahle, V., & Kanner, A. M. (2006). Rapid detection of major depression in epilepsy: A multicentre study. Lancet Neurology, 5(5), 399–405. doi:10.1016/S1474-4422(06)70415-X.CrossRef Gilliam, F. G., Barry, J. J., Hermann, B. P., Meador, K. J., Vahle, V., & Kanner, A. M. (2006). Rapid detection of major depression in epilepsy: A multicentre study. Lancet Neurology, 5(5), 399–405. doi:10.​1016/​S1474-4422(06)70415-X.CrossRef
32.
go back to reference Zhou, X., McClish, D., & Obuchowski, N. (2009). Statistical methods in diagnostic medicine. Hoboken, NJ: Wiley-Interscience. Zhou, X., McClish, D., & Obuchowski, N. (2009). Statistical methods in diagnostic medicine. Hoboken, NJ: Wiley-Interscience.
Metadata
Title
Incorporating patient-reported outcome measures into the electronic health record for research: application using the Patient Health Questionnaire (PHQ-9)
Authors
Sandra D. Griffith
Nicolas R. Thompson
Jaivir S. Rathore
Lara E. Jehi
George E. Tesar
Irene L. Katzan
Publication date
01-02-2015
Publisher
Springer International Publishing
Published in
Quality of Life Research / Issue 2/2015
Print ISSN: 0962-9343
Electronic ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-014-0764-y

Other articles of this Issue 2/2015

Quality of Life Research 2/2015 Go to the issue

Premium Partner