Skip to main content
Erschienen in: Quality & Quantity 4/2016

09.05.2015

The rise of cross-national survey data harmonization in the social sciences: emergence of an interdisciplinary methodological field

verfasst von: Joshua Kjerulf Dubrow, Irina Tomescu-Dubrow

Erschienen in: Quality & Quantity | Ausgabe 4/2016

Einloggen

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Cross-national survey data harmonization combines surveys conducted in multiple countries and across many time periods into a single, coherent dataset. Methodologically, ex post survey data harmonization is especially complex because it combines projects that were not specifically designed to be comparable. We examine the institutional and intellectual history of nine large scale ex post survey data harmonization (SDH) projects in the social sciences from the 1980s to the 2010s. An interdisciplinary methodological field of SDH slowly emerges, facilitated in part by a partnership between academia and government and from the coordinated contributions of social scientists, survey methodologists and computer scientists. While there has been a learning process, it is in terms of accumulated practicalities, and not with the coordination or institutional apparatus one would expect from a 30 year effort.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
We are thankful for the anonymous reviewer who provided the above insights.
 
4
http://​www.​lisdatacenter.​org/​wps/​liswps/​12.​pdf. Accessed February 7, 2014. Harmonization speeds forward via technological advance. Since its inception, LIS faced a major problem in supplying its data to interested researchers. By 1987, LIS began to solve the problem of data access through the then new system called BITNET, described as “an electronic mail and file transfer network” that linked about 400 academic and research institutions around the world (Rainwater and Smeeding 1987, p. 9). It was the early internet.
 
5
Data had to be available for 1979, the baseline for all datasets. They transgressed that rule by including 1981 data from Germany and Canada, which they justified on practical grounds (see Smeeding et al. 1985: Footnote 3, p. F-1).
 
6
“…(as measured by response rates and other indicators of nonsampling error)” (Smeeding et al. 1985, p. 4). They begin to discuss data quality in detail on p. 18.
 
7
Household, family or both. This problem required some harmonization of what “household” versus “family” means.
 
8
Classifications Newsletter, Number 27, August 2011, p. 5. ISCED was not updated again until 1997, and then again in 2011. http://​www.​uis.​unesco.​org/​Education/​Documents/​UNSD_​newsletter_​27e_​ISCED.​pdf. Accessed February 7, 2014. Sometime afterward, LIS began to also use ISCED http://​www.​lisdatacenter.​org/​wp-content/​uploads/​standardisation-of-education-levels.​pdf. Accessed February 7, 2014.
 
9
The LIS harmonization process is described here: http://​www.​lisdatacenter.​org/​wp-content/​uploads/​our-lis-documentation-harmonisation-guidelines.​pdf. According to the LIS Guidelines (p. 12): “Socio-demographic variables… are all individual level variables and report the major socio-demographic characteristics of the household members.” They are: Living arrangements, demographics, immigration, health, and education. LIS’ wealth data also has harmonization guidelines, but as of this writing, they are not available on the website. Instead, they have a document on “behavioral variable mapping” http://​www.​lisdatacenter.​org/​wp-content/​uploads/​2011/​02/​behavioural-variable-mapping-2011-03.​pdf.
 
10
MTUS has time use data from the 1960s to the present.
 
11
Burkhauser and Lillard (2005, p. 10).
 
13
Frick et al (2007, p. 630) write: “The original core variables to be harmonized were income and demographic characteristics of respondents to the PSID and the German Socio-Economic Panel SOEP, and reflects the objectives of the original project that motivated the creation of the CNEF to compare and understand income-based inequality and income mobility in the US and Germany.”
 
14
“The effort to harmonize existing panel studies share one significant organizational feature: active researchers conceived, planned, and carried out how the data would be harmonized. While data managers, some in government statistical agencies, were often involved in the process, it was researchers who decided how to define equivalently the variables of interest.”
 
15
Burkhauser and Lillard (2005, p. 12): “Researchers guided by theory and concepts flowing from the research pertinent to the object of their studies are best able to make the assumptions necessary to harmonize data across countries.”
 
16
We are thankful to one of the reviewers who formulated these four principles of sustained SDH success.
 
17
Again, we are thankful for the reviewer who pointed this out to us.
 
18
For more discussion on the shortcomings of ECHP, see Burkhauser and Lillard (2005, pp. 14–15); CHER 2014, pp. 6–7; and undated CHINTEX document, p. 5; for more information on ECHP (2011), see the EuroPanel Users Network. http://​epunet.​essex.​ac.​uk/​echp.​php.​html. Accessed February 13, 2014.
 
20
“Furthermore, the project investigates important hypotheses about the data quality of panel surveys (non-response, reporting errors and panel effects) which are of general interest for survey statisticians.” (CHINEX data unknown, p. 1).
 
22
See CROS, a website maintained by the European Commission. http://​www.​cros-portal.​eu/​content/​chintex. “The CROS Portal is a content management system based on Drupal and stands for "Portal on Collaboration in Research and Methodology for Official Statistics". http://​www.​cros-portal.​eu/​page/​about-cros-portal. “The European Commission maintains this website to enhance public access to information about its initiatives and European Union policies in general.” http://​www.​cros-portal.​eu/​page/​legal-notice.
 
23
“One objective of this chapter is to establish a simple framework of harmonisation which is useful to pinpoint the research issues of CHINTEX and to highlight the differences to other issues of harmonisation”.
 
25
http://​ec.​europa.​eu/​research/​social-sciences/​projects/​010_​en.​html. Accessed February 13, 2014. According to CEPS’ website, “CEPS/INSTEAD is a centre of reference for research in the social and economic sciences in the Grand Duchy of Luxembourg, a public institution under the jurisdiction of the Ministry of Higher Education and Research.” http://​www.​ceps.​lu/​?​type=​module&​id=​53. Accessed February 13, 2014.
 
26
There is no official information about the fate of CHER. From existing documents, it seems to have ended in 2003 when they submitted their final report to the European Commission. To get more information, and since CHER was a CEPS project, I emailed a colleague to ask when CHER ended. They wrote, “The project has been on for a while as an experiment to test whether various national level panel studies could be homogeneized and merged in one big dataset. I don't know exactly the date when the CHER was closed. Probably it was 2003, but the data it contains should be older, probably dating to 1999. As a matter of fact, it was a nice data-set but I've never used it because it was too old. Not by chance only 16 papers have been produced with CHER.” Anonymous, Personal Communication, February 13, 2014.
 
27
As of April 2006, EPUnet “is now finished,” according to its website. “Jean-Marc Museux from EUROSTAT has produced three papers on EU-SILC, the successor to the ECHP”. http://​epunet.​essex.​ac.​uk/​view_​news.​php%3FID=​36.​html. Accessed February 13, 2014.
 
28
“The EU-SILC project was launched in 2003 on the basis of a "gentlemen's agreement" in six Member States (Belgium, Denmark, Greece, Ireland, Luxembourg and Austria) and Norway. The start of the EU-SILC instrument was in 2004 for the EU-15 (except Germany, the Netherlands, the United Kingdom) and Estonia, Norway and Iceland.” http://​epp.​eurostat.​ec.​europa.​eu/​portal/​page/​portal/​microdata/​eu_​silc. Accessed February 13, 2014.
 
29
Most SDH is about economics and was run by economists. Only the TUS, ISMF, GBS and now, the Harmonization Project, are not explicitly about economics; they are run by sociologists and political scientists.
 
30
Schröder and Ganzeboom (2013), “Measuring and Modeling Levels of Education in European Societies”. European Sociological Review.
 
31
Of the founding date, the only evidence we’ve found is that, in 1993, Ganzeboom and Treiman published a paper in which they reference the ISMF (Ganzeboom and Treiman 1993, p. 470). In a book chapter in the International Handbook of Sociology (2000) Treiman and Ganzeboom describe the history of social stratification and mobility research. They presented a clear trend toward cross-national surveys and attempts at standardizing measurement of stratification variables (see also Ganzeboom and Treiman 2000).
 
33
Ganzeboom and Treiman (2000) Ascription and achievement after career entry. Paper presented at the 2000 meeting of ISA’s RC 28.
 
36
This is a problem with social science in general: Social researchers rarely keep good records on the research process and are reluctant—for whatever reasons—to share enough the ups-and-downs of their scientific pursuit.
 
Literatur
Zurück zum Zitat Balsiger, P.W.: Supradisciplinary research practices: history, objectives and rationale. Futures 36, 407–421 (2004)CrossRef Balsiger, P.W.: Supradisciplinary research practices: history, objectives and rationale. Futures 36, 407–421 (2004)CrossRef
Zurück zum Zitat Börsch-Supan, A., Martina, B., Hunkler, C., Kneip, T., Korbmacher, J., Malter, F., Schaan, B., Stuck, S., Zuber, S., On Behalf of the SHARE Central Coordination Team: Data resource profile: the survey of health, ageing and retirement in Europe (SHARE). Int. J. Epidemiol. (2013). doi:10.1093/ije/dyt088 Börsch-Supan, A., Martina, B., Hunkler, C., Kneip, T., Korbmacher, J., Malter, F., Schaan, B., Stuck, S., Zuber, S., On Behalf of the SHARE Central Coordination Team: Data resource profile: the survey of health, ageing and retirement in Europe (SHARE). Int. J. Epidemiol. (2013). doi:10.​1093/​ije/​dyt088
Zurück zum Zitat Doiron, D., Raina, P., Ferretti, V., L’Heureux, F., Fortier, I.: Facilitating collaborative research—implementing a platform supporting data harmonization and pooling. Norsk Epidemiologi 21(2), 221–224 (2012)CrossRef Doiron, D., Raina, P., Ferretti, V., L’Heureux, F., Fortier, I.: Facilitating collaborative research—implementing a platform supporting data harmonization and pooling. Norsk Epidemiologi 21(2), 221–224 (2012)CrossRef
Zurück zum Zitat Dubrow, J.K.: Sociology and American Studies: A Case Study in the Limits of Interdisciplinarity. Am. Sociol. 42(4), 303–315 (2011) Dubrow, J.K.: Sociology and American Studies: A Case Study in the Limits of Interdisciplinarity. Am. Sociol. 42(4), 303–315 (2011)
Zurück zum Zitat Dubrow, J.K., Kolczynska, M.: A quem pertence o estudo da democracia? Sociologia, ciência política e a promessa da interdisciplinaridade na Sociologia política desde 1945 (Who Owns the Study of Democracy? Sociology, Political Science, and the Interdisciplinary Promise of Political Sociology since 1945). Sociologias 17(38), 92–120 (2015) Dubrow, J.K., Kolczynska, M.: A quem pertence o estudo da democracia? Sociologia, ciência política e a promessa da interdisciplinaridade na Sociologia política desde 1945 (Who Owns the Study of Democracy? Sociology, Political Science, and the Interdisciplinary Promise of Political Sociology since 1945). Sociologias 17(38), 92–120 (2015)
Zurück zum Zitat Fisher, K., Gershuny. J.: Multinational time use study. User’s guide and documentation. Version 6, 16 July (2013) Fisher, K., Gershuny. J.: Multinational time use study. User’s guide and documentation. Version 6, 16 July (2013)
Zurück zum Zitat Friendly, M., Denis, D.: The early origins and development of the scatterplot. J. Hist. Behav. Sci. 41(2), 103–130 (2005)CrossRef Friendly, M., Denis, D.: The early origins and development of the scatterplot. J. Hist. Behav. Sci. 41(2), 103–130 (2005)CrossRef
Zurück zum Zitat Ganzeboom, H.B.G., Treiman, D.J.: Ascription and achievement after career entry. Paper presented at the 2000 meeting of the RC28 (2000) Ganzeboom, H.B.G., Treiman, D.J.: Ascription and achievement after career entry. Paper presented at the 2000 meeting of the RC28 (2000)
Zurück zum Zitat Ganzeboom, H.B.G., Treiman, D.J.: Three internationally standardised measures for comparative research on occupational status. In: Hoffmeyer-Zlotnik, J.H.P., Wolf, C. (eds.) Advances in cross-national comparison. A European working book for demographic and socio-economic variables, pp. 159–193. Kluwer Academic Press, New York (2003)CrossRef Ganzeboom, H.B.G., Treiman, D.J.: Three internationally standardised measures for comparative research on occupational status. In: Hoffmeyer-Zlotnik, J.H.P., Wolf, C. (eds.) Advances in cross-national comparison. A European working book for demographic and socio-economic variables, pp. 159–193. Kluwer Academic Press, New York (2003)CrossRef
Zurück zum Zitat Granda, P., Wolf, C., Hadorn, R.: Harmonizing survey data. In: Harkness, J.A., Braun, M., Edwards, B., Johnson, T.P., Lyberg, L., Mohler, P.P., Pennell, B.-E., Smith, T.W. (eds.) Survey Methods in Multinational, Multiregional, and Multicultural Contexts, pp. 315–334. Wiley, New York (2010)CrossRef Granda, P., Wolf, C., Hadorn, R.: Harmonizing survey data. In: Harkness, J.A., Braun, M., Edwards, B., Johnson, T.P., Lyberg, L., Mohler, P.P., Pennell, B.-E., Smith, T.W. (eds.) Survey Methods in Multinational, Multiregional, and Multicultural Contexts, pp. 315–334. Wiley, New York (2010)CrossRef
Zurück zum Zitat Hoffmeyer-Zlotnik, J.H.P., Wolf, C.: Comparing demographic and socio-economic variables across nations: synthesis and recommendations. In: Hoffmeyer-Zlotnik, J.H.P., Wolf, C. (eds.) Advances in Cross-national Comparison: A European Working Book for Demographic and Socio-Economic Variables, pp. 389–406. Springer, New York (2003)CrossRef Hoffmeyer-Zlotnik, J.H.P., Wolf, C.: Comparing demographic and socio-economic variables across nations: synthesis and recommendations. In: Hoffmeyer-Zlotnik, J.H.P., Wolf, C. (eds.) Advances in Cross-national Comparison: A European Working Book for Demographic and Socio-Economic Variables, pp. 389–406. Springer, New York (2003)CrossRef
Zurück zum Zitat Hout, M., DiPrete, T.A.: What we have learned: RC28’s contributions to knowledge about social stratification. Res. Soc. Stratif. Mobil. 24(2006), 1–20 (2006)CrossRef Hout, M., DiPrete, T.A.: What we have learned: RC28’s contributions to knowledge about social stratification. Res. Soc. Stratif. Mobil. 24(2006), 1–20 (2006)CrossRef
Zurück zum Zitat Jacobs, J.A.: In Defense of Disciplines: Interdisciplinarity and Specialization in the Research University. University of Chicago Press, Chicago (2014) Jacobs, J.A.: In Defense of Disciplines: Interdisciplinarity and Specialization in the Research University. University of Chicago Press, Chicago (2014)
Zurück zum Zitat Lee, R.M.: The secret life of focus groups: Robert Merton and the diffusion of a research method. Am. Sociol. 41, 115–141 (2010)CrossRef Lee, R.M.: The secret life of focus groups: Robert Merton and the diffusion of a research method. Am. Sociol. 41, 115–141 (2010)CrossRef
Zurück zum Zitat Nissen, Sylke: The eurobarometer and the process of european integration: methodological foundations and weaknesses of the largest european survey. Qual. Quant. 48, 713–727 (2014)CrossRef Nissen, Sylke: The eurobarometer and the process of european integration: methodological foundations and weaknesses of the largest european survey. Qual. Quant. 48, 713–727 (2014)CrossRef
Zurück zum Zitat Marcum, J.A.: Instituting science: discovery or construction of scientific knowledge? Int. Stud. Phil. Sci. 22(2), 185–210 (2008)CrossRef Marcum, J.A.: Instituting science: discovery or construction of scientific knowledge? Int. Stud. Phil. Sci. 22(2), 185–210 (2008)CrossRef
Zurück zum Zitat National Academies.: Facilitating Interdisciplinary Research. National Academies Press, Washington (2004) National Academies.: Facilitating Interdisciplinary Research. National Academies Press, Washington (2004)
Zurück zum Zitat Platt, J.: The development of the ‘Participant Observation’ method in sociology: origin myth and history. J. Hist. Behav. Sci. 19, 379–393 (1983)CrossRef Platt, J.: The development of the ‘Participant Observation’ method in sociology: origin myth and history. J. Hist. Behav. Sci. 19, 379–393 (1983)CrossRef
Zurück zum Zitat Schröder, H., Ganzeboom, H.B.G.: Measuring and modeling levels of education in european societies. Eur Sociol Rev 30, 119–136 (2013)CrossRef Schröder, H., Ganzeboom, H.B.G.: Measuring and modeling levels of education in european societies. Eur Sociol Rev 30, 119–136 (2013)CrossRef
Zurück zum Zitat Slomczynski, K.M., Tomescu-Dubrow, I.: Survey data recycling: towards a formalized approach to ex-post harmonization of international projects. In: Harmonization: newsletter on survey data harmonization in the social sciences, vol. 1, pp. 10–13 (2015) Slomczynski, K.M., Tomescu-Dubrow, I.: Survey data recycling: towards a formalized approach to ex-post harmonization of international projects. In: Harmonization: newsletter on survey data harmonization in the social sciences, vol. 1, pp. 10–13 (2015)
Zurück zum Zitat Smith, T.W.: Refining the total survey error perspective. Int. J. Pub. Opin. Res. 23(4), 464–484 (2011)CrossRef Smith, T.W.: Refining the total survey error perspective. Int. J. Pub. Opin. Res. 23(4), 464–484 (2011)CrossRef
Zurück zum Zitat Thomas, E.A.: Herbert Blumer’s critique of the polish peasant: a post mortem on the life history approach in sociology. J. Hist. Behav. Sci. 14, 124–131 (1978)CrossRef Thomas, E.A.: Herbert Blumer’s critique of the polish peasant: a post mortem on the life history approach in sociology. J. Hist. Behav. Sci. 14, 124–131 (1978)CrossRef
Zurück zum Zitat Treiman, D.J., Ganzeboom, H.B.G.: Cross-National comparative status attainment research. Res. Soc. Stratif. Mobil. (9), 105–127 (1990) Treiman, D.J., Ganzeboom, H.B.G.: Cross-National comparative status attainment research. Res. Soc. Stratif. Mobil. (9), 105–127 (1990)
Zurück zum Zitat Treiman, D.J., Ganzeboom, H.B.G.: The fourth generation of comparative stratification research. In: Quah, S.R., Sales, A. (eds.) The International Handbook of Sociology, pp. 122–150. Sage, London (2000) Treiman, D.J., Ganzeboom, H.B.G.: The fourth generation of comparative stratification research. In: Quah, S.R., Sales, A. (eds.) The International Handbook of Sociology, pp. 122–150. Sage, London (2000)
Zurück zum Zitat Tomescu-Dubrow, I., Slomczynski, K.M.: Democratic Values and Protest Behavior: Data Harmonization, Measurement Comparability, and Multi-Leve Modeling in Cross-National Perspective. Ask. Res. Methods. 23(1), 103–114 (2014) Tomescu-Dubrow, I., Slomczynski, K.M.: Democratic Values and Protest Behavior: Data Harmonization, Measurement Comparability, and Multi-Leve Modeling in Cross-National Perspective. Ask. Res. Methods. 23(1), 103–114 (2014)
Zurück zum Zitat Van de Vijver, F.J.R., Matsumoto, D.: Introduction to the methodological issues associated with cross-cultural research. In Matsumoto, D., van de Vijver, F.J.R. (eds.) Cross-cultural research methods in psychology, pp. 1–16. Cambridge University Press, New York (2011) Van de Vijver, F.J.R., Matsumoto, D.: Introduction to the methodological issues associated with cross-cultural research. In Matsumoto, D., van de Vijver, F.J.R. (eds.) Cross-cultural research methods in psychology, pp. 1–16. Cambridge University Press, New York (2011)
Zurück zum Zitat Wagner, C.S., Roessner, J.D., Bobb, K., Klein, J.T., Boyack, K.W., Keyton, J., Rafols, I., Börner, K.: Approaches to understanding and measuring interdisciplinary scientific research (IDR): A review of the literature. J. Infometrics. 165, 14–26 (2011) Wagner, C.S., Roessner, J.D., Bobb, K., Klein, J.T., Boyack, K.W., Keyton, J., Rafols, I., Börner, K.: Approaches to understanding and measuring interdisciplinary scientific research (IDR): A review of the literature. J. Infometrics. 165, 14–26 (2011)
Metadaten
Titel
The rise of cross-national survey data harmonization in the social sciences: emergence of an interdisciplinary methodological field
verfasst von
Joshua Kjerulf Dubrow
Irina Tomescu-Dubrow
Publikationsdatum
09.05.2015
Verlag
Springer Netherlands
Erschienen in
Quality & Quantity / Ausgabe 4/2016
Print ISSN: 0033-5177
Elektronische ISSN: 1573-7845
DOI
https://doi.org/10.1007/s11135-015-0215-z

Weitere Artikel der Ausgabe 4/2016

Quality & Quantity 4/2016 Zur Ausgabe