Skip to main content
Erschienen in: Quality & Quantity 3/2022

08.07.2021

Improving the reproducibility of findings by updating research methodology

verfasst von: Joseph Klein

Erschienen in: Quality & Quantity | Ausgabe 3/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The literature discusses causes of low reproducibility of scientific publications. Our article adds another main cause—uncritical adherence to accepted research procedures. This is evident in: (1) anachronistically requiring researchers to base themselves on theoretical background even if the studies cited were not tested for reproducibility; (2) conducting studies suffering from a novelty effect bias; (3) forcing researchers who use data mining methods and field-based theory, with no preliminary theoretical rationale, to present a theoretical background that allegedly guided their work—as a precondition for publication of their findings. It is possible to increase research validity in relation to the above problems by the following means: (1) Conducting a longitudinal study on the same participants and only on them; (2) Trying to shorten the time period between laboratory experiments and those on humans, based on cost–benefit considerations, anchored in ethical norms; (3) Reporting the theoretical background in a causal modular format; (4) Giving incentives to those who meet the above criteria while moderating the pressure for fast output.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Anderson, R.G., Greene, W.H., McCullough, B.D., Vinod, H.D.: The role of data/code archives in the future of economic research. J. Econ. Methodol. 15(1), 99–119 (2008)CrossRef Anderson, R.G., Greene, W.H., McCullough, B.D., Vinod, H.D.: The role of data/code archives in the future of economic research. J. Econ. Methodol. 15(1), 99–119 (2008)CrossRef
Zurück zum Zitat Allen, C., Mehler, D.M.: Open science challenges, benefits and tips in early career and beyond. PLoS Biol. 17(5), e3000246 (2019)CrossRef Allen, C., Mehler, D.M.: Open science challenges, benefits and tips in early career and beyond. PLoS Biol. 17(5), e3000246 (2019)CrossRef
Zurück zum Zitat Apostolopoulos, Y., Lemke, M.K., Barry, A.E., Lich, K.H.: Moving alcohol prevention research forward—Part I: introducing a complex systems paradigm. Addiction 113(2), 353–362 (2018)CrossRef Apostolopoulos, Y., Lemke, M.K., Barry, A.E., Lich, K.H.: Moving alcohol prevention research forward—Part I: introducing a complex systems paradigm. Addiction 113(2), 353–362 (2018)CrossRef
Zurück zum Zitat Ashar, Y.K., Chang, L.J., Wager, T.D.: Brain mechanisms of the placebo effect: an affective appraisal account. Annu. Rev. Clin. Psychol. 13, 73–98 (2017)CrossRef Ashar, Y.K., Chang, L.J., Wager, T.D.: Brain mechanisms of the placebo effect: an affective appraisal account. Annu. Rev. Clin. Psychol. 13, 73–98 (2017)CrossRef
Zurück zum Zitat Baker, M.: 1,500 scientists lift the lid on reproducibility. Nat. News 533(7604), 452–454 (2016)CrossRef Baker, M.: 1,500 scientists lift the lid on reproducibility. Nat. News 533(7604), 452–454 (2016)CrossRef
Zurück zum Zitat Bakker, M., van Dijk, A., Wicherts, J.M.: The rules of the game called psychological science. Perspect. Psychol. Sci. 7, 543–554 (2012)CrossRef Bakker, M., van Dijk, A., Wicherts, J.M.: The rules of the game called psychological science. Perspect. Psychol. Sci. 7, 543–554 (2012)CrossRef
Zurück zum Zitat Begley, C.G., Ellis, L.M.: Drug development: raise standards for preclinical cancer research. Nature 483(7391), 531–533 (2012)CrossRef Begley, C.G., Ellis, L.M.: Drug development: raise standards for preclinical cancer research. Nature 483(7391), 531–533 (2012)CrossRef
Zurück zum Zitat Benedetti, F.: Placebo and the new physiology of the doctor-patient relationship. Physiol. Rev. 93(3), 1207–1246 (2013)CrossRef Benedetti, F.: Placebo and the new physiology of the doctor-patient relationship. Physiol. Rev. 93(3), 1207–1246 (2013)CrossRef
Zurück zum Zitat Belton, C.A., Sugden, R.: Attention and novelty: an experimental investigation of order effects in multiple valuation tasks. J. Econ. Psychol. 67, 103–115 (2018)CrossRef Belton, C.A., Sugden, R.: Attention and novelty: an experimental investigation of order effects in multiple valuation tasks. J. Econ. Psychol. 67, 103–115 (2018)CrossRef
Zurück zum Zitat Brandt, M.J., IJzerman, H., Dijksterhuis, A., Farach, F.J., Geller, J., Giner-Sorolla, R., Van’t Veer, A.: The replication recipe: What makes for a convincing replication? J. Exp. Soc. Psychol. 50, 217–224 (2014)CrossRef Brandt, M.J., IJzerman, H., Dijksterhuis, A., Farach, F.J., Geller, J., Giner-Sorolla, R., Van’t Veer, A.: The replication recipe: What makes for a convincing replication? J. Exp. Soc. Psychol. 50, 217–224 (2014)CrossRef
Zurück zum Zitat Caplan, A.L., Redman, B.K. (eds.): Getting to Good: Research Integrity in the Biomedical Sciences. Springer (2018) Caplan, A.L., Redman, B.K. (eds.): Getting to Good: Research Integrity in the Biomedical Sciences. Springer (2018)
Zurück zum Zitat Castellani, B.: Focus: complexity and the failure of quantitative social science. Focus 12, 12 (2014) Castellani, B.: Focus: complexity and the failure of quantitative social science. Focus 12, 12 (2014)
Zurück zum Zitat Corrêa, E.A., Jr., Silva, F.N., Costa, L.D.F., Amancio, D.R.: Patterns of authors contribution in scientific manuscripts. J. Informet. 11(2), 498–510 (2017)CrossRef Corrêa, E.A., Jr., Silva, F.N., Costa, L.D.F., Amancio, D.R.: Patterns of authors contribution in scientific manuscripts. J. Informet. 11(2), 498–510 (2017)CrossRef
Zurück zum Zitat Domjan, M.: Introduction to food neophobia: historical and conceptual foundations. In: Reilly, S. (ed.) Food Neophobia: Behavioral and Biological Influences, pp. 15–30. Elsevier, Amsterdam (2018) Domjan, M.: Introduction to food neophobia: historical and conceptual foundations. In: Reilly, S. (ed.) Food Neophobia: Behavioral and Biological Influences, pp. 15–30. Elsevier, Amsterdam (2018)
Zurück zum Zitat Dreber, A., Pfeiffer, T., Almenberg, J., Isaksson, S., Wilson, B., Chen, Y., Nosek, B.A., Magnus Johannesson, M.: Using prediction markets to estimate the reproducibility of scientific research. Proc. Natl. Acad. Sci. 112(50), 15343–15347 (2015)CrossRef Dreber, A., Pfeiffer, T., Almenberg, J., Isaksson, S., Wilson, B., Chen, Y., Nosek, B.A., Magnus Johannesson, M.: Using prediction markets to estimate the reproducibility of scientific research. Proc. Natl. Acad. Sci. 112(50), 15343–15347 (2015)CrossRef
Zurück zum Zitat Ferguson, C.J., Heene, M.: A vast graveyard of undead theories publication bias and psychological science’s aversion to the null. Perspect Psychol Sci 7(6), 555–561 (2012)CrossRef Ferguson, C.J., Heene, M.: A vast graveyard of undead theories publication bias and psychological science’s aversion to the null. Perspect Psychol Sci 7(6), 555–561 (2012)CrossRef
Zurück zum Zitat Field, S.M., Wagenmakers, E.J., Kiers, H.A., Hoekstra, R., Ernst, A.F., van Ravenzwaaij, D.: The effect of preregistration on trust in empirical research findings: results of a registered report. Royal Society Open Science 7(4), 181351 (2020)CrossRef Field, S.M., Wagenmakers, E.J., Kiers, H.A., Hoekstra, R., Ernst, A.F., van Ravenzwaaij, D.: The effect of preregistration on trust in empirical research findings: results of a registered report. Royal Society Open Science 7(4), 181351 (2020)CrossRef
Zurück zum Zitat Flexner, A.: The Usefulness of Useless Knowledge. Princeton University Press (2017)CrossRef Flexner, A.: The Usefulness of Useless Knowledge. Princeton University Press (2017)CrossRef
Zurück zum Zitat Funder, D.C., Levine, J.M., Mackie, D.M., Morf, C.C., Sansone, C., Vazire, S., West, S.G.: Improving the dependability of research in personality and social psychology: recommendations for research and educational practice. Personal. Soc. Psychol. Rev. 18, 3–12 (2014)CrossRef Funder, D.C., Levine, J.M., Mackie, D.M., Morf, C.C., Sansone, C., Vazire, S., West, S.G.: Improving the dependability of research in personality and social psychology: recommendations for research and educational practice. Personal. Soc. Psychol. Rev. 18, 3–12 (2014)CrossRef
Zurück zum Zitat Frith, U.: Fast lane to slow science. Trends Cogn. Sci. 24(1), 1–2 (2020)CrossRef Frith, U.: Fast lane to slow science. Trends Cogn. Sci. 24(1), 1–2 (2020)CrossRef
Zurück zum Zitat Haws, B.E., Khechen, B., Movassaghi, K., Yom, K.H., Guntin, J.A., Cardinal, K.L., Singh, K.: Authorship trends in Spine publications from 2000 to 2015. Spine 43(17), 1225–1230 (2018)CrossRef Haws, B.E., Khechen, B., Movassaghi, K., Yom, K.H., Guntin, J.A., Cardinal, K.L., Singh, K.: Authorship trends in Spine publications from 2000 to 2015. Spine 43(17), 1225–1230 (2018)CrossRef
Zurück zum Zitat Génova, G., de la Vara, J.L.: The problem is not professional publishing, but the publish-or-perish culture. Sci. Eng. Ethics 25(2), 617–619 (2019)CrossRef Génova, G., de la Vara, J.L.: The problem is not professional publishing, but the publish-or-perish culture. Sci. Eng. Ethics 25(2), 617–619 (2019)CrossRef
Zurück zum Zitat Johannes, M.: Big Data for Big Pharma: An Accelerator for the Research and Development Engine?, vol. 19. ibidem-Verlag/ibidem Press (2016a) Johannes, M.: Big Data for Big Pharma: An Accelerator for the Research and Development Engine?, vol. 19. ibidem-Verlag/ibidem Press (2016a)
Zurück zum Zitat Gilbert, D.T., King, G., Pettigrew, S., Wilson, T.D.: Comment on “Estimating the reproducibility of psychological science.” Science 351(6277), 1037–1037 (2016)CrossRef Gilbert, D.T., King, G., Pettigrew, S., Wilson, T.D.: Comment on “Estimating the reproducibility of psychological science.” Science 351(6277), 1037–1037 (2016)CrossRef
Zurück zum Zitat Gill, S.V., Vessali, M., Pratt, J.A., Watts, S., Pratt, J.S., Raghavan, P., DeSilva, J.M.: The importance of interdisciplinary research training and community dissemination. Clin. Transl. Sci. 8(5), 611–614 (2015)CrossRef Gill, S.V., Vessali, M., Pratt, J.A., Watts, S., Pratt, J.S., Raghavan, P., DeSilva, J.M.: The importance of interdisciplinary research training and community dissemination. Clin. Transl. Sci. 8(5), 611–614 (2015)CrossRef
Zurück zum Zitat Glaser, B.G., Strauss, A.L.: Discovery of Grounded Theory: Strategies for Qualitative Research. Taylor and Francis, London (2017)CrossRef Glaser, B.G., Strauss, A.L.: Discovery of Grounded Theory: Strategies for Qualitative Research. Taylor and Francis, London (2017)CrossRef
Zurück zum Zitat Gravetter, F.J., Forzano, L.A.B.: Research Methods for the Behavioral Sciences. Cengage Learning (2018) Gravetter, F.J., Forzano, L.A.B.: Research Methods for the Behavioral Sciences. Cengage Learning (2018)
Zurück zum Zitat Hüffmeier, J., Mazei, J., Schultze, T.: Reconceptualizing replication as a sequence of different studies: a replication typology. J. Exp. Soc. Psychol. 66, 81–92 (2016)CrossRef Hüffmeier, J., Mazei, J., Schultze, T.: Reconceptualizing replication as a sequence of different studies: a replication typology. J. Exp. Soc. Psychol. 66, 81–92 (2016)CrossRef
Zurück zum Zitat Ioannidis, J.P.: Why most published research findings are false. PloS Med 2(8), e124 (2005)CrossRef Ioannidis, J.P.: Why most published research findings are false. PloS Med 2(8), e124 (2005)CrossRef
Zurück zum Zitat John, L.K., Loewenstein, G., Prelec, D.: Measuring the prevalence of questionable research practices with incentives for truth telling. Psychol. Sci. 23, 524–532 (2012)CrossRef John, L.K., Loewenstein, G., Prelec, D.: Measuring the prevalence of questionable research practices with incentives for truth telling. Psychol. Sci. 23, 524–532 (2012)CrossRef
Zurück zum Zitat Kaplan, R.M., Irvin, V.L.: Likelihood of null effects of large NHLBI clinical trials has increased over time. PLoS ONE 10(8), e0132382 (2015)CrossRef Kaplan, R.M., Irvin, V.L.: Likelihood of null effects of large NHLBI clinical trials has increased over time. PLoS ONE 10(8), e0132382 (2015)CrossRef
Zurück zum Zitat Kiai, A.: To protect credibility in science, banish “publish or perish.” Nat. Hum. Behav. 3(10), 1017–1018 (2019)CrossRef Kiai, A.: To protect credibility in science, banish “publish or perish.” Nat. Hum. Behav. 3(10), 1017–1018 (2019)CrossRef
Zurück zum Zitat King, G.: Replication, replication. PS Polit. Sci. Polit. 28(3), 444–452 (1995)CrossRef King, G.: Replication, replication. PS Polit. Sci. Polit. 28(3), 444–452 (1995)CrossRef
Zurück zum Zitat Larivière, V., Desrochers, N., Macaluso, B., Mongeon, P., Paul-Hus, A., Sugimoto, C.R.: Contributorship and division of labor in knowledge production. Soc. Stud. Sci. 46(3), 417–435 (2016)CrossRef Larivière, V., Desrochers, N., Macaluso, B., Mongeon, P., Paul-Hus, A., Sugimoto, C.R.: Contributorship and division of labor in knowledge production. Soc. Stud. Sci. 46(3), 417–435 (2016)CrossRef
Zurück zum Zitat Leek, J.T., Peng, R.D.: Opinion: reproducible research can still be wrong: adopting a prevention approach. Proc. Natl. Acad. Sci. 112(6), 1645–1646 (2015)CrossRef Leek, J.T., Peng, R.D.: Opinion: reproducible research can still be wrong: adopting a prevention approach. Proc. Natl. Acad. Sci. 112(6), 1645–1646 (2015)CrossRef
Zurück zum Zitat Lehman, J.D., Schairer, W.W., Gu, A., Blevins, J.L., Sculco, P.K.: Authorship trends in 30 years of the Journal of Arthroplasty. J. Arthroplasty 32(5), 1684–1687 (2017)CrossRef Lehman, J.D., Schairer, W.W., Gu, A., Blevins, J.L., Sculco, P.K.: Authorship trends in 30 years of the Journal of Arthroplasty. J. Arthroplasty 32(5), 1684–1687 (2017)CrossRef
Zurück zum Zitat Linden, A., Yarnold, P.R.: Using data mining techniques to characterize participation in observational studies. J. Eval. Clin. Pract. 22(6), 839–847 (2016a). (This was in Hebrew but not English)CrossRef Linden, A., Yarnold, P.R.: Using data mining techniques to characterize participation in observational studies. J. Eval. Clin. Pract. 22(6), 839–847 (2016a). (This was in Hebrew but not English)CrossRef
Zurück zum Zitat Lu, Y., Meisami, A., Tewari, A., Yan, W.: Regret analysis of Bandit problems with causal background knowledge. In: Conference on Uncertainty in Artificial Intelligence, pp. 141–150. PMLR (2020)‏ Lu, Y., Meisami, A., Tewari, A., Yan, W.: Regret analysis of Bandit problems with causal background knowledge. In: Conference on Uncertainty in Artificial Intelligence, pp. 141–150. PMLR (2020)‏
Zurück zum Zitat Landy, J.F., Jia, M.L., Ding, I.L., Viganola, D., Tierney, W., Dreber, A., Ly, A.: Crowdsourcing hypothesis tests: making transparent how design choices shape research results. Psychol. Bull. 146(5), 451–479 (2020). https://doi.org/10.1037/bul0000220. (Epub 2020 Jan 16)CrossRef Landy, J.F., Jia, M.L., Ding, I.L., Viganola, D., Tierney, W., Dreber, A., Ly, A.: Crowdsourcing hypothesis tests: making transparent how design choices shape research results. Psychol. Bull. 146(5), 451–479 (2020). https://​doi.​org/​10.​1037/​bul0000220. (Epub 2020 Jan 16)CrossRef
Zurück zum Zitat Lakens, D., Hilgard, J., Staaks, J.: On the reproducibility of meta-analyses: six practical recommendations. BMC Psychol. 4(1), 24 (2016)CrossRef Lakens, D., Hilgard, J., Staaks, J.: On the reproducibility of meta-analyses: six practical recommendations. BMC Psychol. 4(1), 24 (2016)CrossRef
Zurück zum Zitat Linden, A., Yarnold, P.R.: Using data mining techniques to characterize participation in observational studies. J. Eval. Clin. Pract. 22(6), 839–847 (2016b)CrossRef Linden, A., Yarnold, P.R.: Using data mining techniques to characterize participation in observational studies. J. Eval. Clin. Pract. 22(6), 839–847 (2016b)CrossRef
Zurück zum Zitat Makel, M.C., Plucker, J.A.: Facts are more important than novelty: replication in the education sciences. Educ. Res. 43(6), 304–316 (2014)CrossRef Makel, M.C., Plucker, J.A.: Facts are more important than novelty: replication in the education sciences. Educ. Res. 43(6), 304–316 (2014)CrossRef
Zurück zum Zitat Munafò, M.R., Smith, G.D.: Robust research needs many lines of evidence. Nature 553, 399–401 (2018)CrossRef Munafò, M.R., Smith, G.D.: Robust research needs many lines of evidence. Nature 553, 399–401 (2018)CrossRef
Zurück zum Zitat Munafò, M.R., Nosek, B.A., Bishop, D.V., Button, K.S., Chambers, C.D., Du Sert, N.P., Simonsohn, U., Wagenmakers, E.J., Ioannidis, J.P.: A manifesto for reproducible science. Nat. Hum. Behav. 1(1), 21 (2017)CrossRef Munafò, M.R., Nosek, B.A., Bishop, D.V., Button, K.S., Chambers, C.D., Du Sert, N.P., Simonsohn, U., Wagenmakers, E.J., Ioannidis, J.P.: A manifesto for reproducible science. Nat. Hum. Behav. 1(1), 21 (2017)CrossRef
Zurück zum Zitat Munafò, M.R., Chambers, C.D., Collins, A.M., Fortunato, L., Macleod, M.R.: Research culture and reproducibility. Trends Cogn. Sci. 24(2), 91–93 (2020)CrossRef Munafò, M.R., Chambers, C.D., Collins, A.M., Fortunato, L., Macleod, M.R.: Research culture and reproducibility. Trends Cogn. Sci. 24(2), 91–93 (2020)CrossRef
Zurück zum Zitat Maxwell, S.E., Lau, M.Y., Howard, G.S.: Is psychology suffering from a replication crisis? What does “failure to replicate” really mean? Am Psychol 70(6), 487–498 (2015)CrossRef Maxwell, S.E., Lau, M.Y., Howard, G.S.: Is psychology suffering from a replication crisis? What does “failure to replicate” really mean? Am Psychol 70(6), 487–498 (2015)CrossRef
Zurück zum Zitat Nosek, B.A., Spies, J.R., Motyl, M.: Scientific Utopia II: restructuring incentives and practices to promote truth over publishability. Perspect. Psychol. Sci. 7, 615–631 (2012)CrossRef Nosek, B.A., Spies, J.R., Motyl, M.: Scientific Utopia II: restructuring incentives and practices to promote truth over publishability. Perspect. Psychol. Sci. 7, 615–631 (2012)CrossRef
Zurück zum Zitat Nosek, B.A., Alter, G., Banks, G.C., Borsboom, D., Bowman, S.D., Breckler, S.J., Buck, S., Chambers, C.D., Chin, G., Christensen, G., Contestabile, M., Dafoe, A., Eich, E., Freese, J., Glennerster, R., Goroff, D., Green, D.P., Hesse, B., Humphreys, M., Ishiyama, J., Karlan, D., Kraut, A., Lupia, A., Mabry, P., Madon, T.A., Malhotra, N., Mayo-Wilson, E., McNutt, M., Miguel, E., Paluck, E.L., Simonsohn, U., Soderberg, C., Spellman, B.A., Turitto, J., VandenBos, G., Vazire, S., Wagenmakers, E.J., Wilson, R., Yarkoni, T.: Promoting an open research culture. Science 348(6242), 1422–1425 )2015) Nosek, B.A., Alter, G., Banks, G.C., Borsboom, D., Bowman, S.D., Breckler, S.J., Buck, S., Chambers, C.D., Chin, G., Christensen, G., Contestabile, M., Dafoe, A., Eich, E., Freese, J., Glennerster, R., Goroff, D., Green, D.P., Hesse, B., Humphreys, M., Ishiyama, J., Karlan, D., Kraut, A., Lupia, A., Mabry, P., Madon, T.A., Malhotra, N., Mayo-Wilson, E., McNutt, M., Miguel, E., Paluck, E.L., Simonsohn, U., Soderberg, C., Spellman, B.A., Turitto, J., VandenBos, G., Vazire, S., Wagenmakers, E.J., Wilson, R., Yarkoni, T.: Promoting an open research culture. Science 348(6242), 1422–1425 )2015)
Zurück zum Zitat Pavlou, M.P., Diamandis, E.P., Blasutig, I.M.: The long journey of cancer biomarkers from the bench to the clinic. Clin. Chem. 59(1), 147–157 (2013)CrossRef Pavlou, M.P., Diamandis, E.P., Blasutig, I.M.: The long journey of cancer biomarkers from the bench to the clinic. Clin. Chem. 59(1), 147–157 (2013)CrossRef
Zurück zum Zitat Poldrack, R.A.: The costs of reproducibility. Neuron 101(1), 11–14 (2019)CrossRef Poldrack, R.A.: The costs of reproducibility. Neuron 101(1), 11–14 (2019)CrossRef
Zurück zum Zitat Pulverer, B.: Reproducibility Blues. EMBO J. 34(22), 2721–2724 (2015)CrossRef Pulverer, B.: Reproducibility Blues. EMBO J. 34(22), 2721–2724 (2015)CrossRef
Zurück zum Zitat Pusztai, L., Hatzis, C., Andre, F.: Reproducibility of research and preclinical validation: problems and solutions. Nat. Rev. Clin. Oncol. 10(12), 720 (2013)CrossRef Pusztai, L., Hatzis, C., Andre, F.: Reproducibility of research and preclinical validation: problems and solutions. Nat. Rev. Clin. Oncol. 10(12), 720 (2013)CrossRef
Zurück zum Zitat Resnik, D.B., Shamoo, A.E.: Reproducibility and research integrity. Account. Res. 24(2), 116–123 (2017)CrossRef Resnik, D.B., Shamoo, A.E.: Reproducibility and research integrity. Account. Res. 24(2), 116–123 (2017)CrossRef
Zurück zum Zitat Rosema, N.A., Hennequin-Hoenderdos, N.L., Berchier, C.E., Slot, D.E., Lyle, D.M., van der Weijden, G.A.: The effect of different interdental cleaning devices on gingival bleeding. J. Int. Acad. Periodontol. 13(1), 2–10 (2011) Rosema, N.A., Hennequin-Hoenderdos, N.L., Berchier, C.E., Slot, D.E., Lyle, D.M., van der Weijden, G.A.: The effect of different interdental cleaning devices on gingival bleeding. J. Int. Acad. Periodontol. 13(1), 2–10 (2011)
Zurück zum Zitat Rousseau, D.M., Fried, Y.: Location, location, location: contextualizing organizational research. J. Organ. Behav. 22(1), 1–13 (2001)CrossRef Rousseau, D.M., Fried, Y.: Location, location, location: contextualizing organizational research. J. Organ. Behav. 22(1), 1–13 (2001)CrossRef
Zurück zum Zitat Santos, P.V.C., Oliveira, S.R.I., Jezus, S.V.: Perception and performance of the interdisciplinary team In serving drug dependents in specialized network of mental health, Sinop, Mato Grosso. Sci. Electron. Arch. 10(4), 81–86 (2017) Santos, P.V.C., Oliveira, S.R.I., Jezus, S.V.: Perception and performance of the interdisciplinary team In serving drug dependents in specialized network of mental health, Sinop, Mato Grosso. Sci. Electron. Arch. 10(4), 81–86 (2017)
Zurück zum Zitat Schmidt, F.L., Oh, I.S.: The crisis of confidence in research findings in psychology: Is lack of replication the real problem? Or is it something else? Arch. Sci. Psychol. 4(1), 32 (2016) Schmidt, F.L., Oh, I.S.: The crisis of confidence in research findings in psychology: Is lack of replication the real problem? Or is it something else? Arch. Sci. Psychol. 4(1), 32 (2016)
Zurück zum Zitat Schweinsberg, M., Madan, N., Vianello, M., Sommer, S.A., Jordan, J., Tierney, W., Srinivasan, M.: The pipeline project: Pre-publication independent replications of a single laboratory’s research pipeline. J. Exp. Soc. Psychol. 66, 55–67 (2016)CrossRef Schweinsberg, M., Madan, N., Vianello, M., Sommer, S.A., Jordan, J., Tierney, W., Srinivasan, M.: The pipeline project: Pre-publication independent replications of a single laboratory’s research pipeline. J. Exp. Soc. Psychol. 66, 55–67 (2016)CrossRef
Zurück zum Zitat Simons, D.J.: The value of direct replication. Perspect. Psychol. Sci. 9, 76–80 (2014)CrossRef Simons, D.J.: The value of direct replication. Perspect. Psychol. Sci. 9, 76–80 (2014)CrossRef
Zurück zum Zitat Sönmez, S., Apostolopoulos, Y., Lemke, M.K., Hsieh, Y.C.J., Karwowski, W.: Complexity of occupational health in the hospitality industry: dynamic simulation modeling to advance immigrant worker health. Int. J. Hosp. Manag. 67, 95–105 (2017)CrossRef Sönmez, S., Apostolopoulos, Y., Lemke, M.K., Hsieh, Y.C.J., Karwowski, W.: Complexity of occupational health in the hospitality industry: dynamic simulation modeling to advance immigrant worker health. Int. J. Hosp. Manag. 67, 95–105 (2017)CrossRef
Zurück zum Zitat Thorgusen, S.R., Suchy, Y., Chelune, G.J., Baucom, B.R.: Neuropsychological practice effects in the context of cognitive decline: contributions from learning and task novelty. J. Int. Neuropsychol. Soc. 22(4), 453–466 (2016)CrossRef Thorgusen, S.R., Suchy, Y., Chelune, G.J., Baucom, B.R.: Neuropsychological practice effects in the context of cognitive decline: contributions from learning and task novelty. J. Int. Neuropsychol. Soc. 22(4), 453–466 (2016)CrossRef
Zurück zum Zitat Van Bavel, J.J., Mende-Siedlecki, P., Brady, W.J., Reinero, D.A.: Contextual sensitivity in scientific reproducibility. Proc. Natl. Acad. Sci. 113(23), 6454–6459 (2016)CrossRef Van Bavel, J.J., Mende-Siedlecki, P., Brady, W.J., Reinero, D.A.: Contextual sensitivity in scientific reproducibility. Proc. Natl. Acad. Sci. 113(23), 6454–6459 (2016)CrossRef
Zurück zum Zitat Ventegodt, S., Kandel, I., Ervin, D.A., Merrick, J.: Concepts of holistic care. In: Health Care for People with Intellectual and Developmental Disabilities across the Lifespan, pp. 1935–1941. Springer, Cham (2016) Ventegodt, S., Kandel, I., Ervin, D.A., Merrick, J.: Concepts of holistic care. In: Health Care for People with Intellectual and Developmental Disabilities across the Lifespan, pp. 1935–1941. Springer, Cham (2016)
Zurück zum Zitat Verma, N., Singh, K.: Authors productivity and degree of collaboration in journal of librarianship and information science (JOLIS) 2010–2016. Int. J. Libr. Inf. Stud. 7(4), 1–6 (2017) Verma, N., Singh, K.: Authors productivity and degree of collaboration in journal of librarianship and information science (JOLIS) 2010–2016. Int. J. Libr. Inf. Stud. 7(4), 1–6 (2017)
Zurück zum Zitat Wang, J., Mueller, K.: The visual causality analyst: an interactive interface for causal reasoning. IEEE Trans. vis. Comput. Graph. 22(1), 230–239 (2015)CrossRef Wang, J., Mueller, K.: The visual causality analyst: an interactive interface for causal reasoning. IEEE Trans. vis. Comput. Graph. 22(1), 230–239 (2015)CrossRef
Zurück zum Zitat Young, N.S., Ioannidis, J.P., Al-Ubaydli, O.: Why current publication practices may distort science. PLoS Med. 5(10), e201 (2008)CrossRef Young, N.S., Ioannidis, J.P., Al-Ubaydli, O.: Why current publication practices may distort science. PLoS Med. 5(10), e201 (2008)CrossRef
Zurück zum Zitat Zafrunnisha, N., Pulla Reddy, V.: Authorship pattern and degree of collaboration in psychology. Ann. Libr. Inf. Stud. 17(1), 255–261 (2009) Zafrunnisha, N., Pulla Reddy, V.: Authorship pattern and degree of collaboration in psychology. Ann. Libr. Inf. Stud. 17(1), 255–261 (2009)
Metadaten
Titel
Improving the reproducibility of findings by updating research methodology
verfasst von
Joseph Klein
Publikationsdatum
08.07.2021
Verlag
Springer Netherlands
Erschienen in
Quality & Quantity / Ausgabe 3/2022
Print ISSN: 0033-5177
Elektronische ISSN: 1573-7845
DOI
https://doi.org/10.1007/s11135-021-01196-6

Weitere Artikel der Ausgabe 3/2022

Quality & Quantity 3/2022 Zur Ausgabe

Premium Partner