Skip to main content
Erschienen in: Quality & Quantity 2/2017

23.02.2016

Comparing acquiescent and extreme response styles in face-to-face and web surveys

verfasst von: Mingnan Liu, Frederick G. Conrad, Sunghee Lee

Erschienen in: Quality & Quantity | Ausgabe 2/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Likert scales are popular for measuring attitudes, but response style, a source of measurement error associated with this type of question, can result in measurement bias. This study investigates the effect of data collection mode on both types of response styles using data from the 2012 American National Election Studies (ANES). 2012 was the 1 year in which ANES conducted two parallel surveys, one through face-to-face interviews and another through Web, using two independent national probability samples and an identical questionnaire. We used three sets of balanced Likert scales from the survey to measure the acquiescent and extreme response styles. Using the latent class analysis modeling approach, we find that: (1) both acquiescent and extreme response styles exist in both face-to-face and Web survey modes; (2) face-to-face respondents demonstrate more acquiescent and extreme response styles than Web respondents; (3) the mode effect is similar for white, black and Hispanic respondents.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
Content factor 1 class sizes: 0.15, 0.52, 0.23, 0.10; content factor 2 class sizes: 0.14, 0.46, 0.25, 0.15; Content factor 3 class sizes: 0.13, 0.60, 0.19, 0.08).
 
2
The results for Model 6, which has the smallest BIC, are presented in the appendix. The results remain the same as Model 6b, meaning that the findings reported in this paper are not an artifact of the selected model.
 
Literatur
Zurück zum Zitat Aday, L.A., Chiu, G.Y., Andersen, R.: Methodological issues in health care surveys of the Spanish heritage population. Am. J. Public Health 70(4), 367–374 (1980)CrossRef Aday, L.A., Chiu, G.Y., Andersen, R.: Methodological issues in health care surveys of the Spanish heritage population. Am. J. Public Health 70(4), 367–374 (1980)CrossRef
Zurück zum Zitat Bachman, J.G., O’Malley, P.M.: Black-white differences in self-esteem: are they affected by response styles? Am. J. Sociol. 90(3), 624–639 (1984a)CrossRef Bachman, J.G., O’Malley, P.M.: Black-white differences in self-esteem: are they affected by response styles? Am. J. Sociol. 90(3), 624–639 (1984a)CrossRef
Zurück zum Zitat Bachman, J.G., O’Malley, P.M.: Yea-saying, nay-saying, and going to extremes: black-white differences in response styles. Public Opin. Q. 48(2), 491–509 (1984b)CrossRef Bachman, J.G., O’Malley, P.M.: Yea-saying, nay-saying, and going to extremes: black-white differences in response styles. Public Opin. Q. 48(2), 491–509 (1984b)CrossRef
Zurück zum Zitat Baumgartner, H., Steenkamp, J.-B.E.M.: Response styles in marketing research: a cross-national investigation. J. Mark. Res. 38(2), 143–156 (2001)CrossRef Baumgartner, H., Steenkamp, J.-B.E.M.: Response styles in marketing research: a cross-national investigation. J. Mark. Res. 38(2), 143–156 (2001)CrossRef
Zurück zum Zitat Billiet, J.B., Davidov, E.: Testing the stability of an acquiescence style factor behind two interrelated substantive variables in a panel design. Sociol. Methods Res. 36(4), 542–562 (2008). doi:10.1177/0049124107313901 CrossRef Billiet, J.B., Davidov, E.: Testing the stability of an acquiescence style factor behind two interrelated substantive variables in a panel design. Sociol. Methods Res. 36(4), 542–562 (2008). doi:10.​1177/​0049124107313901​ CrossRef
Zurück zum Zitat Carr, L.G.: The srole items and acquiescence. Am. Sociol. Rev. 36(2), 287–293 (1971)CrossRef Carr, L.G.: The srole items and acquiescence. Am. Sociol. Rev. 36(2), 287–293 (1971)CrossRef
Zurück zum Zitat Clarke III, I.: Extreme response style in cross-cultural research. Int. Mark. Rev. 18(3), 301–324 (2001)CrossRef Clarke III, I.: Extreme response style in cross-cultural research. Int. Mark. Rev. 18(3), 301–324 (2001)CrossRef
Zurück zum Zitat Couch, A., Keniston, K.: Yeasayers and naysayers: agreeing response set as a personality variable. J. Abnorm. Soc. Psychol. 60(2), 151–174 (1960)CrossRef Couch, A., Keniston, K.: Yeasayers and naysayers: agreeing response set as a personality variable. J. Abnorm. Soc. Psychol. 60(2), 151–174 (1960)CrossRef
Zurück zum Zitat Cronbach, L.J.: Studies of acquiescence as a factor in the true-false test. J. Educ. Psychol. 33(6), 401–415 (1942)CrossRef Cronbach, L.J.: Studies of acquiescence as a factor in the true-false test. J. Educ. Psychol. 33(6), 401–415 (1942)CrossRef
Zurück zum Zitat Davis, R.E., Resnicow, K., Couper, M.P.: survey response styles, acculturation, and culture among a sample of mexican american adults. J. Cross-Cult. Psychol. 42(7), 1219–1236 (2010). doi:10.1177/0022022110383317 CrossRef Davis, R.E., Resnicow, K., Couper, M.P.: survey response styles, acculturation, and culture among a sample of mexican american adults. J. Cross-Cult. Psychol. 42(7), 1219–1236 (2010). doi:10.​1177/​0022022110383317​ CrossRef
Zurück zum Zitat De Leeuw, E.D.: To mix or not to mix data collection modes in surveys. J. Off. Stat. 21(5), 233–255 (2005) De Leeuw, E.D.: To mix or not to mix data collection modes in surveys. J. Off. Stat. 21(5), 233–255 (2005)
Zurück zum Zitat de Spinoza, B., Shirley, S., Feldman, S.: The Ethics and Selected Letters. Hackett Pub. Co, Indianapolis (1982) de Spinoza, B., Shirley, S., Feldman, S.: The Ethics and Selected Letters. Hackett Pub. Co, Indianapolis (1982)
Zurück zum Zitat Gibbons, J.L., Zellner, J.A., Rudek, D.J.: Effects of language and meaningfulness on the use of extreme response style by Spanish–English bilinguals. Cross-Cult. Res. 33(4), 369–381 (1999)CrossRef Gibbons, J.L., Zellner, J.A., Rudek, D.J.: Effects of language and meaningfulness on the use of extreme response style by Spanish–English bilinguals. Cross-Cult. Res. 33(4), 369–381 (1999)CrossRef
Zurück zum Zitat Gilbert, D.T.: How mental systems believe. Am. Psychol. 46(2), 107–119 (1991)CrossRef Gilbert, D.T.: How mental systems believe. Am. Psychol. 46(2), 107–119 (1991)CrossRef
Zurück zum Zitat Heerwegh, D., Loosveldt, G.: Face-to-face versus web surveying in a high-internet-coverage population differences in response quality. Public Opin. Q. 72(5), 836–846 (2008). doi:10.1093/poq/nfn045 CrossRef Heerwegh, D., Loosveldt, G.: Face-to-face versus web surveying in a high-internet-coverage population differences in response quality. Public Opin. Q. 72(5), 836–846 (2008). doi:10.​1093/​poq/​nfn045 CrossRef
Zurück zum Zitat Heerwegh, D., Loosveldt, G.: Assessing mode effects in a national crime victimization survey using structural equation models: social desirability bias and acquiescence. J. Off. Stat. 27(1), 49 (2011) Heerwegh, D., Loosveldt, G.: Assessing mode effects in a national crime victimization survey using structural equation models: social desirability bias and acquiescence. J. Off. Stat. 27(1), 49 (2011)
Zurück zum Zitat Jordan, L.A., Marcus, A.C., Reeder, L.G.: Response styles in telephone and household interviewing: a field experiment. Public Opin. Q. 44(2), 210–222 (1980)CrossRef Jordan, L.A., Marcus, A.C., Reeder, L.G.: Response styles in telephone and household interviewing: a field experiment. Public Opin. Q. 44(2), 210–222 (1980)CrossRef
Zurück zum Zitat Kankaraš, M., Moors, G.: Measurement equivalence in solidarity attitudes in Europe insights from a multiple-group latent-class factor approach. Int. Sociol. 24(4), 557–579 (2009). doi:10.1177/0268580909334502 CrossRef Kankaraš, M., Moors, G.: Measurement equivalence in solidarity attitudes in Europe insights from a multiple-group latent-class factor approach. Int. Sociol. 24(4), 557–579 (2009). doi:10.​1177/​0268580909334502​ CrossRef
Zurück zum Zitat Knowles, E.S., Condon, C.A.: Why people say yes: a dual-process theory of acquiescence. J. Pers. Soc. Psychol. 77(2), 379–386 (1999)CrossRef Knowles, E.S., Condon, C.A.: Why people say yes: a dual-process theory of acquiescence. J. Pers. Soc. Psychol. 77(2), 379–386 (1999)CrossRef
Zurück zum Zitat Krosnick, J.A.: Response strategies for coping with the cognitive demands of attitude measures in surveys. Appl. Cogn. Psychol. 5(3), 213–236 (1991)CrossRef Krosnick, J.A.: Response strategies for coping with the cognitive demands of attitude measures in surveys. Appl. Cogn. Psychol. 5(3), 213–236 (1991)CrossRef
Zurück zum Zitat Leary, M.R., Kowalski, R.M.: Impression management: a literature review and two-component model. Psychol. Bull. 107(1), 34–47 (1990)CrossRef Leary, M.R., Kowalski, R.M.: Impression management: a literature review and two-component model. Psychol. Bull. 107(1), 34–47 (1990)CrossRef
Zurück zum Zitat Marin, G., Gamba, R.J., Marin, B.V.: extreme response style and acquiescence among hispanics the role of acculturation and education. J. Cross-Cult. Psychol. 23(4), 498–509 (1992). doi:10.1177/0022022192234006 CrossRef Marin, G., Gamba, R.J., Marin, B.V.: extreme response style and acquiescence among hispanics the role of acculturation and education. J. Cross-Cult. Psychol. 23(4), 498–509 (1992). doi:10.​1177/​0022022192234006​ CrossRef
Zurück zum Zitat Moors, G.: Diagnosing response style behavior by means of a latent-class factor approach. Socio-demographic correlates of gender role attitudes and perceptions of ethnic discrimination reexamined. Qual. Quant. 37(3), 277–302 (2003). doi:10.1023/A:1024472110002 CrossRef Moors, G.: Diagnosing response style behavior by means of a latent-class factor approach. Socio-demographic correlates of gender role attitudes and perceptions of ethnic discrimination reexamined. Qual. Quant. 37(3), 277–302 (2003). doi:10.​1023/​A:​1024472110002 CrossRef
Zurück zum Zitat Moors, G.: ranking the ratings: a latent-class regression model to control for overall agreement in opinion research. Int. J. Public Opin. Res. 22(1), 93–119 (2010). doi:10.1093/ijpor/edp036 CrossRef Moors, G.: ranking the ratings: a latent-class regression model to control for overall agreement in opinion research. Int. J. Public Opin. Res. 22(1), 93–119 (2010). doi:10.​1093/​ijpor/​edp036 CrossRef
Zurück zum Zitat Moors, G., Kieruj, N.D., Vermunt, J.K.: The effect of labeling and numbering of response scales on the likelihood of response bias. Sociol. Methodol. (2014). doi:10.1177/0081175013516114 Moors, G., Kieruj, N.D., Vermunt, J.K.: The effect of labeling and numbering of response scales on the likelihood of response bias. Sociol. Methodol. (2014). doi:10.​1177/​0081175013516114​
Zurück zum Zitat Morren, M., Gelissen, J.P.T.M., Vermunt, J.K.: dealing with extreme response style in cross-cultural research: a restricted latent class factor analysis approach: extreme response style in cross-cultural research. Sociol. Methodol. 41(1), 13–47 (2011). doi:10.1111/j.1467-9531.2011.01238.x CrossRef Morren, M., Gelissen, J.P.T.M., Vermunt, J.K.: dealing with extreme response style in cross-cultural research: a restricted latent class factor analysis approach: extreme response style in cross-cultural research. Sociol. Methodol. 41(1), 13–47 (2011). doi:10.​1111/​j.​1467-9531.​2011.​01238.​x CrossRef
Zurück zum Zitat Ross, C.E., Mirowsky, J.: Socially-desirable response and acquiescence in a cross-cultural survey of mental health. J. Health Soc. Behav. 25(2), 189–197 (1984)CrossRef Ross, C.E., Mirowsky, J.: Socially-desirable response and acquiescence in a cross-cultural survey of mental health. J. Health Soc. Behav. 25(2), 189–197 (1984)CrossRef
Zurück zum Zitat Saris, W.E., Revilla, M., Krosnick, J.A., Shaeffer, E.M.: Comparing questions with agree/disagree response options to questions with item-specific response options. Surv. Res. Methods 4(1), 61–79 (2010) Saris, W.E., Revilla, M., Krosnick, J.A., Shaeffer, E.M.: Comparing questions with agree/disagree response options to questions with item-specific response options. Surv. Res. Methods 4(1), 61–79 (2010)
Zurück zum Zitat Van Vaerenbergh, Y., Thomas, T.D.: Response styles in survey research: a literature review of antecedents, consequences, and remedies. Int. J. Public Opin. Res. 25(2), 195–217 (2013). doi:10.1093/ijpor/eds021 CrossRef Van Vaerenbergh, Y., Thomas, T.D.: Response styles in survey research: a literature review of antecedents, consequences, and remedies. Int. J. Public Opin. Res. 25(2), 195–217 (2013). doi:10.​1093/​ijpor/​eds021 CrossRef
Zurück zum Zitat Warnecke, R.B., Johnson, T.P., Chávez, N., Sudman, S., O’rourke, D.P., Lacey, L., Horm, J.: Improving question wording in surveys of culturally diverse populations. Ann. Epidemiol. 7(5), 334–342 (1997) Warnecke, R.B., Johnson, T.P., Chávez, N., Sudman, S., O’rourke, D.P., Lacey, L., Horm, J.: Improving question wording in surveys of culturally diverse populations. Ann. Epidemiol. 7(5), 334–342 (1997)
Zurück zum Zitat Weijters, B., Geuens, M., Schillewaert, N.: The individual consistency of acquiescence and extreme response style in self-report questionnaires. Appl. Psychol. Meas. 34(2), 105–121 (2010). doi:10.1177/0146621609338593 CrossRef Weijters, B., Geuens, M., Schillewaert, N.: The individual consistency of acquiescence and extreme response style in self-report questionnaires. Appl. Psychol. Meas. 34(2), 105–121 (2010). doi:10.​1177/​0146621609338593​ CrossRef
Zurück zum Zitat Welkenhuysen-Gybels, J., Billiet, J., Cambré, B.: Adjustment for acquiescence in the assessment of the construct equivalence of likert-type score items. J. Cross-Cult. Psychol. 34(6), 702–722 (2003). doi:10.1177/0022022103257070 CrossRef Welkenhuysen-Gybels, J., Billiet, J., Cambré, B.: Adjustment for acquiescence in the assessment of the construct equivalence of likert-type score items. J. Cross-Cult. Psychol. 34(6), 702–722 (2003). doi:10.​1177/​0022022103257070​ CrossRef
Zurück zum Zitat Yang, Y., Harkness, J.A., Chin, T.-Y., Villar, A.: Response styles and culture. In: Survey Methods in Multinational, Multiregional, and Multicultural Contexts, 203–223 (2010) Yang, Y., Harkness, J.A., Chin, T.-Y., Villar, A.: Response styles and culture. In: Survey Methods in Multinational, Multiregional, and Multicultural Contexts, 203–223 (2010)
Metadaten
Titel
Comparing acquiescent and extreme response styles in face-to-face and web surveys
verfasst von
Mingnan Liu
Frederick G. Conrad
Sunghee Lee
Publikationsdatum
23.02.2016
Verlag
Springer Netherlands
Erschienen in
Quality & Quantity / Ausgabe 2/2017
Print ISSN: 0033-5177
Elektronische ISSN: 1573-7845
DOI
https://doi.org/10.1007/s11135-016-0320-7

Weitere Artikel der Ausgabe 2/2017

Quality & Quantity 2/2017 Zur Ausgabe

Premium Partner