Skip to main content
Erschienen in: Quality & Quantity 5/2014

01.09.2014

Mixed strategies for improving data quality: the contribution of qualitative procedures to survey research

verfasst von: Sergio Mauceri

Erschienen in: Quality & Quantity | Ausgabe 5/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This article aims to illustrate how qualitative research strategies contribute to the implementation of the standard survey model by monitoring and improving the quality of collected data and thus the quality of survey findings as well. The methodological cycle for survey data-quality construction using qualitative strategies comprises three sequential stages that alternate with standard procedures: the pilot study, pretesting, and deviant case analysis. If the first two of these stages have enjoyed a certain recognition in the literature, the same cannot be said for deviant case analysis. Deviant case analysis is a research strategy originally proposed by Lazarsfeld and promoted within the Colombia School from the 1940s to the 1960s, unfortunately without subsequently receiving the attention it deserved within the area of survey research in general. It refers to searching outside the collected empirical base for clues concerning anomalous responses revealed by statistical analysis that either deviate from research hypotheses or produce contradictory classificatory results.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Now the Department of Communication and Social Research.
 
2
The main difference between the cognitive interview and the meta-interview is that in the latter procedure the verbal probing takes place in the field rather than in the laboratory.
 
3
The questionnaire consulted is from the fourth IARD report (Buzzi et al. 1997).
 
Literatur
Zurück zum Zitat Agnoli, M.S. (ed.): Lo straniero in immagine. Rappresentazione degli immigrati e pregiudizio etnico tra gli studenti del Lazio. Angeli, Milano (2004) Agnoli, M.S. (ed.): Lo straniero in immagine. Rappresentazione degli immigrati e pregiudizio etnico tra gli studenti del Lazio. Angeli, Milano (2004)
Zurück zum Zitat Agnoli, M.S. (ed.): Spazi, identità, relazioni. Indagine sulla convivenza multiculturale nelle residenze universitarie. Angeli, Milano (2010) Agnoli, M.S. (ed.): Spazi, identità, relazioni. Indagine sulla convivenza multiculturale nelle residenze universitarie. Angeli, Milano (2010)
Zurück zum Zitat Beatty, P.C.: Paradigms of cognitive interviewing practice, and their implications for developing standards of best practice. In: Proceedings of the 4th Conference on Questionnaire Evaluation Standards, Zentrum fur Umfragen Methoden un Analysen (ZUMA), pp. 8–25 (2004) Beatty, P.C.: Paradigms of cognitive interviewing practice, and their implications for developing standards of best practice. In: Proceedings of the 4th Conference on Questionnaire Evaluation Standards, Zentrum fur Umfragen Methoden un Analysen (ZUMA), pp. 8–25 (2004)
Zurück zum Zitat Beatty, P.C., Willis, B.G.: Research synthesis: the practice of cognitive interviewing. Public Opin. Q. 2, 287–311 (2007)CrossRef Beatty, P.C., Willis, B.G.: Research synthesis: the practice of cognitive interviewing. Public Opin. Q. 2, 287–311 (2007)CrossRef
Zurück zum Zitat Boudon, R., Lazarsfeld, P.F. (eds.): Méthodes de la sociologie: II. L’analyse empirique de la causalité. Mouton & Co, Paris (1966) Boudon, R., Lazarsfeld, P.F. (eds.): Méthodes de la sociologie: II. L’analyse empirique de la causalité. Mouton & Co, Paris (1966)
Zurück zum Zitat Buzzi, C., Cavalli, A., de Lillo, A.: Giovani verso il Duemila. Quarto Rapporto lard sulla condizione giovanile, il mulino, Bologna (1997) Buzzi, C., Cavalli, A., de Lillo, A.: Giovani verso il Duemila. Quarto Rapporto lard sulla condizione giovanile, il mulino, Bologna (1997)
Zurück zum Zitat Cantril, H., Gaudet, H., Herzog, H.: The Invasion from Mars. Harper & Row, New York (1966) Cantril, H., Gaudet, H., Herzog, H.: The Invasion from Mars. Harper & Row, New York (1966)
Zurück zum Zitat Capecchi, V.: Tre Castelli, una Casa e la Città inquieta. In: Cipolla, C., de Lillo, A. (eds.) Il sociologo e le sirene. La sfida dei metodi qualitativi, pp. 37–99. Angeli, Milano (1996) Capecchi, V.: Tre Castelli, una Casa e la Città inquieta. In: Cipolla, C., de Lillo, A. (eds.) Il sociologo e le sirene. La sfida dei metodi qualitativi, pp. 37–99. Angeli, Milano (1996)
Zurück zum Zitat Capecchi, V.: Il contributo di Lazarsfeld alla metodologia sociologica. In: Campelli, E., Fasanella, A., Lombardo, C. (eds.) Paul Felix Lazarsfeld: Un Classico Marginale, pp. 35–82. Angeli, Milano (1999) Capecchi, V.: Il contributo di Lazarsfeld alla metodologia sociologica. In: Campelli, E., Fasanella, A., Lombardo, C. (eds.) Paul Felix Lazarsfeld: Un Classico Marginale, pp. 35–82. Angeli, Milano (1999)
Zurück zum Zitat Dewey, J.: Logic, The Theory of Inquiry. Henry Holt and Co., New York (1938) Dewey, J.: Logic, The Theory of Inquiry. Henry Holt and Co., New York (1938)
Zurück zum Zitat Esposito, J.L., Campanelli, P.C., Rothgeb, J.M., Polivka, A.E.: Determining which questions are best: methodologies for evaluating survey questions. In: Proceedings of the Section on Survey Research Methods, , pp. 46–55. American Statistical Association, Alexandria (1991) Esposito, J.L., Campanelli, P.C., Rothgeb, J.M., Polivka, A.E.: Determining which questions are best: methodologies for evaluating survey questions. In: Proceedings of the Section on Survey Research Methods, , pp. 46–55. American Statistical Association, Alexandria (1991)
Zurück zum Zitat Esposito, J.L., Rothgeb, J.M.: Evaluating survey data: Making the transition from pretesting to quality assessment. In: Lyberg, L., Biemer, P., Collins, M., de Leeuw, E., Dippo, C., et al. (eds.) Survey Measurement and Process Quality, pp. 541–571. Wiley, New York (1997) Esposito, J.L., Rothgeb, J.M.: Evaluating survey data: Making the transition from pretesting to quality assessment. In: Lyberg, L., Biemer, P., Collins, M., de Leeuw, E., Dippo, C., et al. (eds.) Survey Measurement and Process Quality, pp. 541–571. Wiley, New York (1997)
Zurück zum Zitat Foddy, W.: An empirical evaluation of in-depth probes used to pretest survey questions. Sociol. Methods Res. 27, 103–133 (1998)CrossRef Foddy, W.: An empirical evaluation of in-depth probes used to pretest survey questions. Sociol. Methods Res. 27, 103–133 (1998)CrossRef
Zurück zum Zitat Glaser, B., Strauss, A.: The Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine, Chicago (1967) Glaser, B., Strauss, A.: The Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine, Chicago (1967)
Zurück zum Zitat Gobo, G., Mauceri, S.: Constructing Survey Data. A Pragmatist Approach. Sage Publications, London (2013) Gobo, G., Mauceri, S.: Constructing Survey Data. A Pragmatist Approach. Sage Publications, London (2013)
Zurück zum Zitat Green, J., Caplovitz, D.: Cases déviantes dans la relation entre deux indicateurs (1966). In: Boudon R., Lazarsfeld P.F. (eds.) Méthodes de la sociologie: II. L’analyse empirique de la causalité, (Italian tr.), pp. 183–186. Mouton & Co, Paris (1966) Green, J., Caplovitz, D.: Cases déviantes dans la relation entre deux indicateurs (1966). In: Boudon R., Lazarsfeld P.F. (eds.) Méthodes de la sociologie: II. L’analyse empirique de la causalité, (Italian tr.), pp. 183–186. Mouton & Co, Paris (1966)
Zurück zum Zitat Jahoda, M., Lazarsfeld, P.F., Zeisel, H.: Die Arbeitslosen von Marienthal. Leipzig, Hitzel (1933); Eng. tr. Marienthal. The Sociography of an Unemployed Community. Tavistock, London (1971) Jahoda, M., Lazarsfeld, P.F., Zeisel, H.: Die Arbeitslosen von Marienthal. Leipzig, Hitzel (1933); Eng. tr. Marienthal. The Sociography of an Unemployed Community. Tavistock, London (1971)
Zurück zum Zitat Kendall, P.L., Wolf, K.M.: The analysis of deviant cases in communication research. In: Lazarsfeld, P.F., Stanton, F.M. (eds.) Communication Research 1948–1949, pp. 152–157. Harper and Bros, New York (1949); republished in Lazarsfeld, P.F., Rosenberg, M., The Language of Social Research. A Reader in Methodology of Social Research, pp. 167–169. The Free Press, New York (1955) Kendall, P.L., Wolf, K.M.: The analysis of deviant cases in communication research. In: Lazarsfeld, P.F., Stanton, F.M. (eds.) Communication Research 1948–1949, pp. 152–157. Harper and Bros, New York (1949); republished in Lazarsfeld, P.F., Rosenberg, M., The Language of Social Research. A Reader in Methodology of Social Research, pp. 167–169. The Free Press, New York (1955)
Zurück zum Zitat Lazarsfeld, P.F.: The controversy over detailed interviews. Public Opin. Q. 1, 38–60 (1944); republished. In: Berelson, B., Janowitz, M. (eds.) Reader in Public Opinion and Communication. The Free Press, New York (1966) Lazarsfeld, P.F.: The controversy over detailed interviews. Public Opin. Q. 1, 38–60 (1944); republished. In: Berelson, B., Janowitz, M. (eds.) Reader in Public Opinion and Communication. The Free Press, New York (1966)
Zurück zum Zitat Lazarsfeld, P.F.: Evidence and inference in social research. Daedalus 4, 99–130 (1958) Lazarsfeld, P.F.: Evidence and inference in social research. Daedalus 4, 99–130 (1958)
Zurück zum Zitat Lazarsfeld, P.F.: Problems in methodology. In: Merton, R.K., Broom, L., Cottrell Jr, L.S. (eds.) Sociology Today, pp. 39–78. Basic Books, New York (1959) Lazarsfeld, P.F.: Problems in methodology. In: Merton, R.K., Broom, L., Cottrell Jr, L.S. (eds.) Sociology Today, pp. 39–78. Basic Books, New York (1959)
Zurück zum Zitat Lazarsfeld, P.F.: The sociology of empirical social research. Am. Sociol. Rev. 6, 757–767 (1962)CrossRef Lazarsfeld, P.F.: The sociology of empirical social research. Am. Sociol. Rev. 6, 757–767 (1962)CrossRef
Zurück zum Zitat Lazarsfeld, P.F., Rosenberg, M. (eds.): The Language of Social Research. A Reader in Methodology of Social Research. Free Press, New York (1955) Lazarsfeld, P.F., Rosenberg, M. (eds.): The Language of Social Research. A Reader in Methodology of Social Research. Free Press, New York (1955)
Zurück zum Zitat Lazarsfeld, P.F., Stanton, F.M. (eds.): Communication Research 1948–1949. Harper and Bros, New York (1949) Lazarsfeld, P.F., Stanton, F.M. (eds.): Communication Research 1948–1949. Harper and Bros, New York (1949)
Zurück zum Zitat Lazarsfeld, P.F., Thielens Jr, W.: The Academic Mind: Social Scientists in a Time of Crisis. The Free Press, Glencoe (1958) Lazarsfeld, P.F., Thielens Jr, W.: The Academic Mind: Social Scientists in a Time of Crisis. The Free Press, Glencoe (1958)
Zurück zum Zitat Lazarsfeld, P.F., Berelson, B., Mc Phee, W.N.: Voting: A Study in a Presidential Campaign. Columbia University Press, New York (1954) Lazarsfeld, P.F., Berelson, B., Mc Phee, W.N.: Voting: A Study in a Presidential Campaign. Columbia University Press, New York (1954)
Zurück zum Zitat Lazarsfeld, P.F., Berelson, B., Gaudet, H.: The People’s Choice. How, the Voter Makes Up his Mind in a Presidential Campaign. Columbia University Press, New York (1944) Lazarsfeld, P.F., Berelson, B., Gaudet, H.: The People’s Choice. How, the Voter Makes Up his Mind in a Presidential Campaign. Columbia University Press, New York (1944)
Zurück zum Zitat Leech, N.L., Onwuegbuzie, A.J.: A typology of mixed methods research. Qual. Quant. 43, 265–275 (2009)CrossRef Leech, N.L., Onwuegbuzie, A.J.: A typology of mixed methods research. Qual. Quant. 43, 265–275 (2009)CrossRef
Zurück zum Zitat Lutynski, J.: Un centro di ricerca sulle tecniche di raccolta dei dati. In: Marradi, A. (ed.) Costruire il dato. Angeli, Milano (1988) Lutynski, J.: Un centro di ricerca sulle tecniche di raccolta dei dati. In: Marradi, A. (ed.) Costruire il dato. Angeli, Milano (1988)
Zurück zum Zitat Marradi, A.: Fedeltà di un dato, affidabilità di una definizione operativa. Rassegna Italiana di Sociologia 1, 55–96 (1990) Marradi, A.: Fedeltà di un dato, affidabilità di una definizione operativa. Rassegna Italiana di Sociologia 1, 55–96 (1990)
Zurück zum Zitat Martin, E.: Vignettes and respondent debriefing for questionnaire design and evaluatin. In: Presser, S., Rothgeb, J., Cooper, M., Lessler, J., Martin, E., Martin, J., et al. (eds.) Methods for Testing and Evaluating Survey Questionnaires. Wiley, New York (2004) Martin, E.: Vignettes and respondent debriefing for questionnaire design and evaluatin. In: Presser, S., Rothgeb, J., Cooper, M., Lessler, J., Martin, E., Martin, J., et al. (eds.) Methods for Testing and Evaluating Survey Questionnaires. Wiley, New York (2004)
Zurück zum Zitat Mauceri, S.: La qualità del dato costruito nella ricerca sociale: il caso dell’intervista con questionario. Sociologia e ricerca sociale 65, 59–100 (2001) Mauceri, S.: La qualità del dato costruito nella ricerca sociale: il caso dell’intervista con questionario. Sociologia e ricerca sociale 65, 59–100 (2001)
Zurück zum Zitat Mauceri, S.: Per la qualità del dato nella ricerca sociale. Strategie di progettazione e conduzione dell’intervista con questionario. Angeli, Milano (2003) Mauceri, S.: Per la qualità del dato nella ricerca sociale. Strategie di progettazione e conduzione dell’intervista con questionario. Angeli, Milano (2003)
Zurück zum Zitat Mauceri, S. (ed.): Nello stesso luogo. Percorsi di ricerca sulle pratiche e le dinamiche della convivenza multiculturale. Bonanno, Acireale-Roma (2009) Mauceri, S. (ed.): Nello stesso luogo. Percorsi di ricerca sulle pratiche e le dinamiche della convivenza multiculturale. Bonanno, Acireale-Roma (2009)
Zurück zum Zitat Mauceri, S. (ed.): Arcipelago call center. Indagine sulla vita lavorativa degli operatori telefonici, Nova Logos, Aprilia (Lt) (2013) Mauceri, S. (ed.): Arcipelago call center. Indagine sulla vita lavorativa degli operatori telefonici, Nova Logos, Aprilia (Lt) (2013)
Zurück zum Zitat Merton, R.K.: Definitions of a situation. In: Lazarsfeld, P.F., Rosenberg, M. (eds.) The Language of Social Research. A Reader in Methodology of Social Research, pp. 170–172. The Free Press, New York (1955) Merton, R.K.: Definitions of a situation. In: Lazarsfeld, P.F., Rosenberg, M. (eds.) The Language of Social Research. A Reader in Methodology of Social Research, pp. 170–172. The Free Press, New York (1955)
Zurück zum Zitat Merton, R.K.: Social Theory and Social Structure. The Free Press, Glencloe (1957) Merton, R.K.: Social Theory and Social Structure. The Free Press, Glencloe (1957)
Zurück zum Zitat Merton, R.K., Kendall, P.L.: The focused interview. Am. J. Sociol. 51, 541–557 (1946)CrossRef Merton, R.K., Kendall, P.L.: The focused interview. Am. J. Sociol. 51, 541–557 (1946)CrossRef
Zurück zum Zitat Merton, R.K., Fiske, M., Curtis, A.: Mass Persuasion. The Social Psychology of a War Bond Drive. Harper & Brothers, New York (1946) Merton, R.K., Fiske, M., Curtis, A.: Mass Persuasion. The Social Psychology of a War Bond Drive. Harper & Brothers, New York (1946)
Zurück zum Zitat Morgan, D.L.: Combining qualitative and quantitative methods paradigms lost and pragmatism regained: methodological implications of combining qualitative and quantitative methods. J. Mixed Methods Res. 1, 48–76 (2007)CrossRef Morgan, D.L.: Combining qualitative and quantitative methods paradigms lost and pragmatism regained: methodological implications of combining qualitative and quantitative methods. J. Mixed Methods Res. 1, 48–76 (2007)CrossRef
Zurück zum Zitat Oksenberg, L., Cannell, C., Kalton, G.: New strategies for pretesting survey questions. J. Off. Stat. 7, 349–365 (1991) Oksenberg, L., Cannell, C., Kalton, G.: New strategies for pretesting survey questions. J. Off. Stat. 7, 349–365 (1991)
Zurück zum Zitat Royston, P., Bercini, D., Sirken, M., Mingay, D.: Questionnaire design research laboratory. In: Proceedings American Statistics Association, pp. 703–707 (1986) Royston, P., Bercini, D., Sirken, M., Mingay, D.: Questionnaire design research laboratory. In: Proceedings American Statistics Association, pp. 703–707 (1986)
Zurück zum Zitat Sale, J.M., Lohfeld, L.H., Brazil, K.: Revisiting the quantitative–qualitative debate: implications for mixed-methods research. Qual. Quant. 36, 43–53 (2002)CrossRef Sale, J.M., Lohfeld, L.H., Brazil, K.: Revisiting the quantitative–qualitative debate: implications for mixed-methods research. Qual. Quant. 36, 43–53 (2002)CrossRef
Zurück zum Zitat Sieber, S.D.: The integration of fieldwork and survey methods. Am. J. Sociol. 6, 1335–1359 (1973)CrossRef Sieber, S.D.: The integration of fieldwork and survey methods. Am. J. Sociol. 6, 1335–1359 (1973)CrossRef
Zurück zum Zitat Viswanathan, M.: Mesaurement Error and Research Design. Sage, London (2005) Viswanathan, M.: Mesaurement Error and Research Design. Sage, London (2005)
Zurück zum Zitat Willis, G.P.: Cognitive Interviewing. A Tool for Improving Questionnaire Design. Sage, London (2005) Willis, G.P.: Cognitive Interviewing. A Tool for Improving Questionnaire Design. Sage, London (2005)
Metadaten
Titel
Mixed strategies for improving data quality: the contribution of qualitative procedures to survey research
verfasst von
Sergio Mauceri
Publikationsdatum
01.09.2014
Verlag
Springer Netherlands
Erschienen in
Quality & Quantity / Ausgabe 5/2014
Print ISSN: 0033-5177
Elektronische ISSN: 1573-7845
DOI
https://doi.org/10.1007/s11135-013-9923-4

Weitere Artikel der Ausgabe 5/2014

Quality & Quantity 5/2014 Zur Ausgabe

Premium Partner