Skip to main content
Erschienen in: Quality & Quantity 2/2014

01.03.2014

Guidance for deciding upon use of primary mixed methods studies in research synthesis: lessons learned in childhood trauma

verfasst von: H. Boeije, F. van Wesel, M. Slagt

Erschienen in: Quality & Quantity | Ausgabe 2/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

When reviewing literature, mixed methods studies (MMS) are increasingly retrieved, yet it is unclear how they should be dealt with in a research synthesis. In this article we examine the inclusion of primary MMS in research synthesis, based on experiences with a meta-analysis (MA) and a qualitative evidence synthesis (QES) in childhood trauma. The aim is to offer guidance for reviewers in deciding upon the use of MMS. This review article examines (1) the qualitative component, (2) the quantitative component, as well as (3) the third component of combined yield for use in a MA, a QES or a mixed studies review. A systematic search for MMS in the field of childhood trauma from January 1980 to October 2011 resulted in twelve MMS. Eight qualitative components, six quantitative components and one combined yield could have been included in a MA or QES. Exclusion of qualitative components was due to insufficient quality. Quantitative components were excluded because sample sizes were too small, different outcome measures than ours were used or no adequate statistics were provided. Yield could not be included because it was absent, outside the scope or otherwise unspecified. Finally, we offer flow charts with clear steps to assist researchers in deciding upon the use of components of MMS. Our study demonstrates that MMS can cover new areas and therefore cannot be neglected in a research synthesis.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
Zurück zum Zitat Alise, M.A., Teddlie, C.: A continuation of the paradigm wars? Prevalence rates of methodological approaches across the social/behavioral sciences. J. Mix. Methods Res. 4(2), 103–126 (2010)CrossRef Alise, M.A., Teddlie, C.: A continuation of the paradigm wars? Prevalence rates of methodological approaches across the social/behavioral sciences. J. Mix. Methods Res. 4(2), 103–126 (2010)CrossRef
Zurück zum Zitat Alisic, E., Jongmans, M.J., van Wesel, F., Kleber, R.J.: Building child trauma theory from longitudinal studies: a meta-analysis. Clin. Psychol. Rev. 31, 736–747 (2011) Alisic, E., Jongmans, M.J., van Wesel, F., Kleber, R.J.: Building child trauma theory from longitudinal studies: a meta-analysis. Clin. Psychol. Rev. 31, 736–747 (2011)
Zurück zum Zitat Boeije, H.R., Slagt, M., van Wesel, F.: The contribution of mixed methods research to the field of childhood trauma: a narrative review focused on data integration. J. Mix. Methods Res. (in preparation) Boeije, H.R., Slagt, M., van Wesel, F.: The contribution of mixed methods research to the field of childhood trauma: a narrative review focused on data integration. J. Mix. Methods Res. (in preparation)
Zurück zum Zitat Bryman, A.: Barriers to integrating quantitative and qualitative research. J. Mix. Methods Res. 1(1), 8–22 (2007)CrossRef Bryman, A.: Barriers to integrating quantitative and qualitative research. J. Mix. Methods Res. 1(1), 8–22 (2007)CrossRef
Zurück zum Zitat Bryman, A., Becker, S., Sempik, J.: Quality criteria for quantitative, qualitative and mixed methods research: a view from social policy. Int. J. Soc. Res. Method. 11(4), 261–276 (2008)CrossRef Bryman, A., Becker, S., Sempik, J.: Quality criteria for quantitative, qualitative and mixed methods research: a view from social policy. Int. J. Soc. Res. Method. 11(4), 261–276 (2008)CrossRef
Zurück zum Zitat Candy, B., King, M., Jones, L., Oliver, S.: Using qualitative synthesis to explore heterogeneity of complex interventions. BMC Med. Res. Methodol. 11, 124–132 (2011)CrossRef Candy, B., King, M., Jones, L., Oliver, S.: Using qualitative synthesis to explore heterogeneity of complex interventions. BMC Med. Res. Methodol. 11, 124–132 (2011)CrossRef
Zurück zum Zitat Caracelli, V.J., Greene, J.C.: Crafting mixed-method evaluation designs. In: Greene, J.C., Caracelli, V.J. (eds.) Advances in Mixed-Method Evaluation: The Challenges and Benefits of Integrating Diverse Paradigms, pp. 19–32. Jossey-Bass, San Francisco (1997) Caracelli, V.J., Greene, J.C.: Crafting mixed-method evaluation designs. In: Greene, J.C., Caracelli, V.J. (eds.) Advances in Mixed-Method Evaluation: The Challenges and Benefits of Integrating Diverse Paradigms, pp. 19–32. Jossey-Bass, San Francisco (1997)
Zurück zum Zitat Charles, N., Butera-Prinzi, F., Perlesz, A.: Families living with acquired brain injury: a multiple family group experience. NeuroRehabilitation 22, 61–76 (2007) Charles, N., Butera-Prinzi, F., Perlesz, A.: Families living with acquired brain injury: a multiple family group experience. NeuroRehabilitation 22, 61–76 (2007)
Zurück zum Zitat Creswell, J.W., Plano Clark, V.L.: Designing and Conducting Mixed Methods Research. Sage, Thousand Oaks (2007) Creswell, J.W., Plano Clark, V.L.: Designing and Conducting Mixed Methods Research. Sage, Thousand Oaks (2007)
Zurück zum Zitat Dixon-Woods, M., Fitzpatrick, R., Roberts, K.: Including qualitative research in systematic reviews: opportunities and problems. J. Eval. Clin. Pract. 7(2), 125–133 (2001) Dixon-Woods, M., Fitzpatrick, R., Roberts, K.: Including qualitative research in systematic reviews: opportunities and problems. J. Eval. Clin. Pract. 7(2), 125–133 (2001)
Zurück zum Zitat Feeney, T.J., Ylvisaker, M.: Context-sensitive behavioral supports for young children with TBI. Short-term effects and long-term outcome. J. Head. Trauma. Rehabil. 18(1), 33–51 (2003)CrossRef Feeney, T.J., Ylvisaker, M.: Context-sensitive behavioral supports for young children with TBI. Short-term effects and long-term outcome. J. Head. Trauma. Rehabil. 18(1), 33–51 (2003)CrossRef
Zurück zum Zitat Finfgeld, D.L.: Metasynthesis: the state of the art—so far. Qual. Health. Res. 13(7), 893–904 (2003)CrossRef Finfgeld, D.L.: Metasynthesis: the state of the art—so far. Qual. Health. Res. 13(7), 893–904 (2003)CrossRef
Zurück zum Zitat Gaskell, S.L.: The challenge of evaluating rehabilitative activity holidays for burn-injured children: qualitative and quantitative outcome data from a Burns Camp over a five-year period. Dev. Neurohabil. 10(2), 149–160 (2007)CrossRef Gaskell, S.L.: The challenge of evaluating rehabilitative activity holidays for burn-injured children: qualitative and quantitative outcome data from a Burns Camp over a five-year period. Dev. Neurohabil. 10(2), 149–160 (2007)CrossRef
Zurück zum Zitat Green, J.C.: Is mixed methods social inquiry a distinctive methodology? J. Mix. Methods Res. 2(7), 7–22 (2008)CrossRef Green, J.C.: Is mixed methods social inquiry a distinctive methodology? J. Mix. Methods Res. 2(7), 7–22 (2008)CrossRef
Zurück zum Zitat Haight, W., Black, J., Sheridan, K.: A mental health intervention for rural, foster children from methamphetamine-involved families: experimental assessment with qualitative elaboration. Child Youth Serv. Rev. 32, 1446–1457 (2010)CrossRef Haight, W., Black, J., Sheridan, K.: A mental health intervention for rural, foster children from methamphetamine-involved families: experimental assessment with qualitative elaboration. Child Youth Serv. Rev. 32, 1446–1457 (2010)CrossRef
Zurück zum Zitat Harden, A., Brunton, G., Fletcher, A., Oakley, A.: Teenage pregnancy and social disadvantage: systematic review integrating controlled trials and qualitative studies. Br. Med. J. 339, b4254 (2009)CrossRef Harden, A., Brunton, G., Fletcher, A., Oakley, A.: Teenage pregnancy and social disadvantage: systematic review integrating controlled trials and qualitative studies. Br. Med. J. 339, b4254 (2009)CrossRef
Zurück zum Zitat Harden, A., Thomas, J.: Methodological issues in combining diverse study types in systematic reviews. Int. J. Soc. Res. Method. 8(3), 257–271 (2005) Harden, A., Thomas, J.: Methodological issues in combining diverse study types in systematic reviews. Int. J. Soc. Res. Method. 8(3), 257–271 (2005)
Zurück zum Zitat Jones, L., Kafetsios, K.: Assessing adolescent mental health in war-effected societies: the significance of symptoms. Child Abuse Negl. 26, 1059–1080 (2002)CrossRef Jones, L., Kafetsios, K.: Assessing adolescent mental health in war-effected societies: the significance of symptoms. Child Abuse Negl. 26, 1059–1080 (2002)CrossRef
Zurück zum Zitat Jones, L., Kafetsios, K.: Exposure to political well-being in Bosnian adolescents: a mixed method approach. Clin. Child Psychol. Psychiatr. 10(2), 157–176 (2005)CrossRef Jones, L., Kafetsios, K.: Exposure to political well-being in Bosnian adolescents: a mixed method approach. Clin. Child Psychol. Psychiatr. 10(2), 157–176 (2005)CrossRef
Zurück zum Zitat Leech, N.L., Onwuegbuzie, A.J.: A typology of mixed methods research designs. Qual. Quant. 43, 265–275 (2009)CrossRef Leech, N.L., Onwuegbuzie, A.J.: A typology of mixed methods research designs. Qual. Quant. 43, 265–275 (2009)CrossRef
Zurück zum Zitat Lewin, S., Glenton, C., Oxman, A.D.: Use of qualitative methods alongside randomized controlled trials of complex healthcare interventions: methodological study. Br. Med. J. 339, b3496 (2009)CrossRef Lewin, S., Glenton, C., Oxman, A.D.: Use of qualitative methods alongside randomized controlled trials of complex healthcare interventions: methodological study. Br. Med. J. 339, b3496 (2009)CrossRef
Zurück zum Zitat London, Bocknek E., Sanderson, J.: Ambiguous loss and posttraumatic stress in school-age children of prisoners. J. Child Fam. Stud. 18, 323–333 (2008) London, Bocknek E., Sanderson, J.: Ambiguous loss and posttraumatic stress in school-age children of prisoners. J. Child Fam. Stud. 18, 323–333 (2008)
Zurück zum Zitat Madsen, K., Poulsen, H.S.: Needs for everyday life support for brain tumor patients’ relatives: systematic literature review. Eur. J. Cancer Care 20, 33–43 (2011)CrossRef Madsen, K., Poulsen, H.S.: Needs for everyday life support for brain tumor patients’ relatives: systematic literature review. Eur. J. Cancer Care 20, 33–43 (2011)CrossRef
Zurück zum Zitat Mays, N., Pope, C., Popay, J.: Systematically reviewing qualitative and quantitative evidence to inform management and policy-making in the health field. J. Health Serv. Res. Policy 10(1), 6–20 (2005)CrossRef Mays, N., Pope, C., Popay, J.: Systematically reviewing qualitative and quantitative evidence to inform management and policy-making in the health field. J. Health Serv. Res. Policy 10(1), 6–20 (2005)CrossRef
Zurück zum Zitat Miller, K.E.: The effects of state terrorism and exile on indigenous Guatemalan refugee children: a mental health assessment and an analysis of children’s narratives. Child. Dev. 67, 89–106 (1996)CrossRef Miller, K.E.: The effects of state terrorism and exile on indigenous Guatemalan refugee children: a mental health assessment and an analysis of children’s narratives. Child. Dev. 67, 89–106 (1996)CrossRef
Zurück zum Zitat Miller, K.E., Fernando, G.A., Berger, D.E.: Daily stressors in the lives of Sri Lankan youth: a mixed methods approach to assessment in a context of war and natural disaster. Intervention 9(3), 187–203 (2009)CrossRef Miller, K.E., Fernando, G.A., Berger, D.E.: Daily stressors in the lives of Sri Lankan youth: a mixed methods approach to assessment in a context of war and natural disaster. Intervention 9(3), 187–203 (2009)CrossRef
Zurück zum Zitat Molina-Azorín, J.F.: The use and added value of mixed methods in management research. J. Mix. Methods Res. 5(1), 7–24 (2011)CrossRef Molina-Azorín, J.F.: The use and added value of mixed methods in management research. J. Mix. Methods Res. 5(1), 7–24 (2011)CrossRef
Zurück zum Zitat Nicolson, D.J.: Studies that mix methods and don’t identify as “Mixed methods research”: a nuisance for systematic reviews and a challenge for mixed methods research. Paper presented at: The 6th International Mixed Methods Conference, Baltimore (2010) Nicolson, D.J.: Studies that mix methods and don’t identify as “Mixed methods research”: a nuisance for systematic reviews and a challenge for mixed methods research. Paper presented at: The 6th International Mixed Methods Conference, Baltimore (2010)
Zurück zum Zitat Nyamukapa, C.A., Gregson, S., Wambe, M., Mushore, P., Lopman, B., Mupambireyi, Z., Nhongo, K., Jukes, M.C.H.: Causes and consequences of psychological distress among orphans in eastern Zimbabwe. AIDS Care 22(8), 988–996 (2011)CrossRef Nyamukapa, C.A., Gregson, S., Wambe, M., Mushore, P., Lopman, B., Mupambireyi, Z., Nhongo, K., Jukes, M.C.H.: Causes and consequences of psychological distress among orphans in eastern Zimbabwe. AIDS Care 22(8), 988–996 (2011)CrossRef
Zurück zum Zitat O’Cathain, A., Murphy, E., Nicholl, J.: Integration and publications as indicators of “yield” from mixed methods studies. J. Mix. Methods Res. 1, 147–163 (2007)CrossRef O’Cathain, A., Murphy, E., Nicholl, J.: Integration and publications as indicators of “yield” from mixed methods studies. J. Mix. Methods Res. 1, 147–163 (2007)CrossRef
Zurück zum Zitat O’Cathain, A., Murphy, E., Nicholl, J.: The quality of mixed methods studies in health services research. J. Health Serv. Res. Policy 13(2), 92–98 (2008) O’Cathain, A., Murphy, E., Nicholl, J.: The quality of mixed methods studies in health services research. J. Health Serv. Res. Policy 13(2), 92–98 (2008)
Zurück zum Zitat Ostler, T., Haight, W., Black, J., Choi, G., Kingery, L., Sheridan, K.: Case series: mental health needs and perspectives of rural children reared by parents who abuse methamphetamine. J. Am. Acad. Child Psychiatr. 46(4), 500–507 (2007)CrossRef Ostler, T., Haight, W., Black, J., Choi, G., Kingery, L., Sheridan, K.: Case series: mental health needs and perspectives of rural children reared by parents who abuse methamphetamine. J. Am. Acad. Child Psychiatr. 46(4), 500–507 (2007)CrossRef
Zurück zum Zitat Pace, R., Pluye, P., Bartlett, G., Macaulay, A.C., Salsberg, J., Jagosh, J., Seller, R.: Testing the reliability and efficiency of the pilot Mixed Methods Appraisal Tool (MMAT) for systematic mixed studies review. Int. J. Nurs. Stud. 49, 47–53 (2012) Pace, R., Pluye, P., Bartlett, G., Macaulay, A.C., Salsberg, J., Jagosh, J., Seller, R.: Testing the reliability and efficiency of the pilot Mixed Methods Appraisal Tool (MMAT) for systematic mixed studies review. Int. J. Nurs. Stud. 49, 47–53 (2012)
Zurück zum Zitat Paterson, B.L.: It looks great but how do I know if it fits? An introduction to meta-synthesis research, choosing the right approach. In: Hannes, K., Lockwood, C. (eds.) Synthesizing Qualitative Research, pp. 1–20. Wiley-Blackwell, Oxford (2012)CrossRef Paterson, B.L.: It looks great but how do I know if it fits? An introduction to meta-synthesis research, choosing the right approach. In: Hannes, K., Lockwood, C. (eds.) Synthesizing Qualitative Research, pp. 1–20. Wiley-Blackwell, Oxford (2012)CrossRef
Zurück zum Zitat Petticrew, M., Roberts, H.: Systematic Reviews in the Social Sciences. A Practical Guide. Blackwell, Oxford (2006)CrossRef Petticrew, M., Roberts, H.: Systematic Reviews in the Social Sciences. A Practical Guide. Blackwell, Oxford (2006)CrossRef
Zurück zum Zitat Pluye, P., Gagnon, M., Griffiths, F., Johnson-Lafleur, J.: A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in mixed studies reviews. Int. J. Nurs. Stud. 46, 529–546 (2009)CrossRef Pluye, P., Gagnon, M., Griffiths, F., Johnson-Lafleur, J.: A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in mixed studies reviews. Int. J. Nurs. Stud. 46, 529–546 (2009)CrossRef
Zurück zum Zitat Pope, C., Mays, N., Popay, J.: Synthesizing Qualitative and Quantitative Health Evidence. A Guide to Methods. Open University, Berkshire (2007) Pope, C., Mays, N., Popay, J.: Synthesizing Qualitative and Quantitative Health Evidence. A Guide to Methods. Open University, Berkshire (2007)
Zurück zum Zitat Roberts, Y.H., Mitchell, M.J., Witman, M.M.N., Taffaro, C.: Mental health symptoms in youth affected by hurricane Katrina. Prof. Psychol. Res. Pract. 41(1), 10–18 (2010)CrossRef Roberts, Y.H., Mitchell, M.J., Witman, M.M.N., Taffaro, C.: Mental health symptoms in youth affected by hurricane Katrina. Prof. Psychol. Res. Pract. 41(1), 10–18 (2010)CrossRef
Zurück zum Zitat Sale, J.E.M., Brazil, K.: A strategy to identify critical appraisal criteria for primary mixed-method studies. Qual. Quant. 38, 351–365 (2004)CrossRef Sale, J.E.M., Brazil, K.: A strategy to identify critical appraisal criteria for primary mixed-method studies. Qual. Quant. 38, 351–365 (2004)CrossRef
Zurück zum Zitat Salter, K., Hellings, C., Floey, N., Teasell, R.: The experience of living with stroke: a qualitative meta-synthesis. J. Rehabil. Med. 40, 595–602 (2008)CrossRef Salter, K., Hellings, C., Floey, N., Teasell, R.: The experience of living with stroke: a qualitative meta-synthesis. J. Rehabil. Med. 40, 595–602 (2008)CrossRef
Zurück zum Zitat Sandelowski, M., Voils, C.I., Barroso, J.: Defining and designing mixed research synthesis studies. Res. Schools 13(1), 29–40 (2006) Sandelowski, M., Voils, C.I., Barroso, J.: Defining and designing mixed research synthesis studies. Res. Schools 13(1), 29–40 (2006)
Zurück zum Zitat Small, M.L.: How to conduct a mixed methods study: recent trends in a rapidly growing literature. Annu. Rev. Sociol. 37, 57–86 (2011)CrossRef Small, M.L.: How to conduct a mixed methods study: recent trends in a rapidly growing literature. Annu. Rev. Sociol. 37, 57–86 (2011)CrossRef
Zurück zum Zitat Sommer, Harrits G.: More than method? A discussion of paradigm differences within mixed methods research. J. Mix. Methods Res. 5(2), 150–166 (2011)CrossRef Sommer, Harrits G.: More than method? A discussion of paradigm differences within mixed methods research. J. Mix. Methods Res. 5(2), 150–166 (2011)CrossRef
Zurück zum Zitat Spillane, J.P., Stitziel, Pareja A.: Mixing methods in randomized controlled trials (RCTs): validation, contextualization, triangulation, and control. Educ. Assess. Eval. Account. 22, 5–28 (2010)CrossRef Spillane, J.P., Stitziel, Pareja A.: Mixing methods in randomized controlled trials (RCTs): validation, contextualization, triangulation, and control. Educ. Assess. Eval. Account. 22, 5–28 (2010)CrossRef
Zurück zum Zitat Talseth, A., Gilje, F.L.: Nurses’ responses to suicide and suicidal patients: a critical interpretive synthesis. J. Clin. Nurs. 20, 1651–1667 (2011)CrossRef Talseth, A., Gilje, F.L.: Nurses’ responses to suicide and suicidal patients: a critical interpretive synthesis. J. Clin. Nurs. 20, 1651–1667 (2011)CrossRef
Zurück zum Zitat van Wesel, F., Boeije, H.R., Alisic, E., Drost S.: I’ll be working my way back: a qualitative synthesis on the trauma experiences of children. Psychological trauma: theory, research, practice, and policy. 4(5), 516–526 (2012) van Wesel, F., Boeije, H.R., Alisic, E., Drost S.: I’ll be working my way back: a qualitative synthesis on the trauma experiences of children. Psychological trauma: theory, research, practice, and policy. 4(5), 516–526 (2012)
Zurück zum Zitat Vervoort, S., Borleffs, J.C.C., Hoepelman, A.I.M., Grypdonck, M.H.F.: Adherence in antiretroviral therapy: a review of qualitative studies. AIDS 21(3), 271–281 (2007)CrossRef Vervoort, S., Borleffs, J.C.C., Hoepelman, A.I.M., Grypdonck, M.H.F.: Adherence in antiretroviral therapy: a review of qualitative studies. AIDS 21(3), 271–281 (2007)CrossRef
Zurück zum Zitat Voils, C.I., Sandelowski, M., Barroso, J., Hasselblad, V.: Making sense of qualitative and quantitative findings in mixed research synthesis studies. Field Method. 20(1), 3–25 (2008)CrossRef Voils, C.I., Sandelowski, M., Barroso, J., Hasselblad, V.: Making sense of qualitative and quantitative findings in mixed research synthesis studies. Field Method. 20(1), 3–25 (2008)CrossRef
Zurück zum Zitat Wiggins, B.J.: Confronting the dilemma of mixed methods. J. Theor. Philos. Psychol. 31(1), 44–60 (2011)CrossRef Wiggins, B.J.: Confronting the dilemma of mixed methods. J. Theor. Philos. Psychol. 31(1), 44–60 (2011)CrossRef
Metadaten
Titel
Guidance for deciding upon use of primary mixed methods studies in research synthesis: lessons learned in childhood trauma
verfasst von
H. Boeije
F. van Wesel
M. Slagt
Publikationsdatum
01.03.2014
Verlag
Springer Netherlands
Erschienen in
Quality & Quantity / Ausgabe 2/2014
Print ISSN: 0033-5177
Elektronische ISSN: 1573-7845
DOI
https://doi.org/10.1007/s11135-012-9825-x

Weitere Artikel der Ausgabe 2/2014

Quality & Quantity 2/2014 Zur Ausgabe

Premium Partner