Skip to main content
Top
Published in: Quality & Quantity 2/2015

01-03-2015

Likert versus Q-approaches in survey methodologies: discrepancies in results with same respondents

Authors: Kyle Eyvindson, Annika Kangas, Teppo Hujala, Pekka Leskinen

Published in: Quality & Quantity | Issue 2/2015

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Surveys are constantly used within forest policy processes to obtain information regarding the opinions of stakeholders and the public. Survey outcomes are dependent on what questions are asked, how the answers are structured and analyzed and how interpretations and conclusions are aligned. The most common forms of surveys can be grouped into two categories: the Likert attitude survey, which allows the respondent to freely select an integer value between a minimum and maximum (typically from 1 to 5 or 7), and the Q sort survey, which requires the respondent to sort and classify the importance of questions based on a predefined standard (typically pyramid-shape distribution from disagree to agree). Using similar Likert and Q sort surveys on the same group of respondents in the case of a regional (sub-national) forest policy process, this paper investigates the variability of obtained responses and determines if the choice of survey method would impact the information and potential interpretations provided to the policy makers. The results indicate that survey outcomes may indeed be sensitive to methodology, although respondents would be consistent. When informing policies, it is advisable to carefully consider the purpose and the conduct of the survey, and to make interpretations with prudence.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
go back to reference Addams, H.: Q Methodology. In: Addams, H., Proops, J. (eds.) Social Discourse and Environmental Policy: An Application of Q Methodology. Edward Elgar Publishing Inc., Northampton (2000) Addams, H.: Q Methodology. In: Addams, H., Proops, J. (eds.) Social Discourse and Environmental Policy: An Application of Q Methodology. Edward Elgar Publishing Inc., Northampton (2000)
go back to reference Brown, S.R.: Political Subjectivity: Applications of Q Methodology in Political Science. Yale University Press, New Haven (1980) Brown, S.R.: Political Subjectivity: Applications of Q Methodology in Political Science. Yale University Press, New Haven (1980)
go back to reference Chess, C.: Evaluating environmental public participation: methodological questions. J. Environ. Plan. Manage. 43(6), 769–784 (2000)CrossRef Chess, C.: Evaluating environmental public participation: methodological questions. J. Environ. Plan. Manage. 43(6), 769–784 (2000)CrossRef
go back to reference Costello, A.B., Osborne, J.W.: Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Pract. Assess. Res. Eval. 10(7), 1–9 (2005) Costello, A.B., Osborne, J.W.: Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Pract. Assess. Res. Eval. 10(7), 1–9 (2005)
go back to reference Cottle, C.E., McKeown, B.F.: The forced-free distinction in Q technique a note on unused categories in the Q sort continuum. Operant Subj. 3, 58–63 (1980) Cottle, C.E., McKeown, B.F.: The forced-free distinction in Q technique a note on unused categories in the Q sort continuum. Operant Subj. 3, 58–63 (1980)
go back to reference Danielson, S.: Q method and surveys: three ways to combine Q and R. Field Methods 21(3), 219–237 (2009)CrossRef Danielson, S.: Q method and surveys: three ways to combine Q and R. Field Methods 21(3), 219–237 (2009)CrossRef
go back to reference Favada, I.M., Karppinen, H., Kuuluvainen, J., Mikkola, J., Stavness, C.: Effects of timber prices, ownership objectives, and owner characteristics on timber supply. For. Sci. 55(6), 512–523 (2009) Favada, I.M., Karppinen, H., Kuuluvainen, J., Mikkola, J., Stavness, C.: Effects of timber prices, ownership objectives, and owner characteristics on timber supply. For. Sci. 55(6), 512–523 (2009)
go back to reference Ficko, A., Bončina, A.: Ensuring the validity of private forest owner typologies by controlling for response style bias and the robustness of statistical methods. Scand. J. For. Res. (2013) Ficko, A., Bončina, A.: Ensuring the validity of private forest owner typologies by controlling for response style bias and the robustness of statistical methods. Scand. J. For. Res. (2013)
go back to reference Germain, R., Floyd, D., Stehman, S.: Public perceptions of the USDA Forest Service public participation process. For. Policy Econ. 3, 113–124 (2001)CrossRef Germain, R., Floyd, D., Stehman, S.: Public perceptions of the USDA Forest Service public participation process. For. Policy Econ. 3, 113–124 (2001)CrossRef
go back to reference Glaser, B., Strauss, A.: The Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine, Chicago (1967) Glaser, B., Strauss, A.: The Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine, Chicago (1967)
go back to reference Hair, J., Black, W., Babin, B., Anderson, R., Tatham, R.: Multivariate Data Analysis, 6th edn. Pearson Prentice Hall, New Jersey (2006) Hair, J., Black, W., Babin, B., Anderson, R., Tatham, R.: Multivariate Data Analysis, 6th edn. Pearson Prentice Hall, New Jersey (2006)
go back to reference Kangas, A., Saarinen, N., Saarikoski, H., Leskinen, L.A., Hujala, T., Tikkanen, J.: Stakeholder perspectives about proper participation for Regional Forest Programmes in Finland. For. Policy Econ. 12, 213–222 (2010)CrossRef Kangas, A., Saarinen, N., Saarikoski, H., Leskinen, L.A., Hujala, T., Tikkanen, J.: Stakeholder perspectives about proper participation for Regional Forest Programmes in Finland. For. Policy Econ. 12, 213–222 (2010)CrossRef
go back to reference Karppinen, H.: Values and objectives of non-industrial private forest owners in Finland. Silva Fennica 32(1), 43–59 (1998)CrossRef Karppinen, H.: Values and objectives of non-industrial private forest owners in Finland. Silva Fennica 32(1), 43–59 (1998)CrossRef
go back to reference Kuipers, B.T., Shivan, G.C., Potter-Witter, K.: Identifying appropriate communication means for reaching nonindustrial private forest landowners. J. For. 111(1), 34–41 (2013) Kuipers, B.T., Shivan, G.C., Potter-Witter, K.: Identifying appropriate communication means for reaching nonindustrial private forest landowners. J. For. 111(1), 34–41 (2013)
go back to reference Kuuluvainen, J., Karppinen, H., Ovaskainen, V.: Landowner objectives and nonindustrial private timber supply. For. Sci. 42(3), 300–309 (1996) Kuuluvainen, J., Karppinen, H., Ovaskainen, V.: Landowner objectives and nonindustrial private timber supply. For. Sci. 42(3), 300–309 (1996)
go back to reference Laitala, M., Saarinen, N., Saarikoski, H., Tikkanen, J.: Sidosryhmien näkemyksiä alueellisesta metsäohjelmatyöstä. Metsätieteen aikakauskirja 3(2009), 227–244 (2009) Laitala, M., Saarinen, N., Saarikoski, H., Tikkanen, J.: Sidosryhmien näkemyksiä alueellisesta metsäohjelmatyöstä. Metsätieteen aikakauskirja 3(2009), 227–244 (2009)
go back to reference Lauber, B., Knuth, B.: Refining our vision of citizen participation: lessons from a moose reintroduction proposal. Soc. Nat. Res. 11, 411–424 (1998)CrossRef Lauber, B., Knuth, B.: Refining our vision of citizen participation: lessons from a moose reintroduction proposal. Soc. Nat. Res. 11, 411–424 (1998)CrossRef
go back to reference Leskinen, P., Leskinen, L., Tikkanen, J.: Assessing objectives of regional forest policy in northern Finland. Scand. J. For. Res. 19, 180–190 (2004)CrossRef Leskinen, P., Leskinen, L., Tikkanen, J.: Assessing objectives of regional forest policy in northern Finland. Scand. J. For. Res. 19, 180–190 (2004)CrossRef
go back to reference McComas, K., Scherer, C.: Providing balanced risk information in surveys used as citizen participation mechanisms. Soc. Nat. Res. 12, 104–119 (1999) McComas, K., Scherer, C.: Providing balanced risk information in surveys used as citizen participation mechanisms. Soc. Nat. Res. 12, 104–119 (1999)
go back to reference McKeown, B., Thomas, D.: Q Methodology. Sage, Newbury Park (1988) McKeown, B., Thomas, D.: Q Methodology. Sage, Newbury Park (1988)
go back to reference Miles, M., Huberman, A.: Qualitative Data Analysis : A Sourcebook of New Methods. Sage, Beverly Hills (1984) Miles, M., Huberman, A.: Qualitative Data Analysis : A Sourcebook of New Methods. Sage, Beverly Hills (1984)
go back to reference Moote, M., McClaran, M., Chickering, D.: Theory in practice: applying participatory democracy theory to public land planning. Environ. Manage. 21(6), 877–889 (1997)CrossRef Moote, M., McClaran, M., Chickering, D.: Theory in practice: applying participatory democracy theory to public land planning. Environ. Manage. 21(6), 877–889 (1997)CrossRef
go back to reference Robbins, P., Krueger, R.: Beyond bias? The promise and limits of Q method in human geography. Prof. Geogr. 52(4), 636–648 (2000)CrossRef Robbins, P., Krueger, R.: Beyond bias? The promise and limits of Q method in human geography. Prof. Geogr. 52(4), 636–648 (2000)CrossRef
go back to reference Robson, M., Hawley, A., Robinson, D.: Comparing the social values of forest dependent, provincial and national publics for socially sustainable forest management. For. Chron. 76, 615–622 (2000)CrossRef Robson, M., Hawley, A., Robinson, D.: Comparing the social values of forest dependent, provincial and national publics for socially sustainable forest management. For. Chron. 76, 615–622 (2000)CrossRef
go back to reference Schaaf, K.A., Broussard, S.R.: Private forest policy tools: a national survey exploring the American public’s perceptions and support. For. Policy Econ. 9, 316–334 (2006)CrossRef Schaaf, K.A., Broussard, S.R.: Private forest policy tools: a national survey exploring the American public’s perceptions and support. For. Policy Econ. 9, 316–334 (2006)CrossRef
go back to reference Stephenson, W.: Application of Q method to the measurement of public opinion. Psychol. Rec. 14(3), 265–273 (1964) Stephenson, W.: Application of Q method to the measurement of public opinion. Psychol. Rec. 14(3), 265–273 (1964)
go back to reference ten Klooster, P., Visser, M., de John, M.D.T.: Comparing two image research instruments: the Q sort method versus the Likert attitude questionnaire. Food Qual. Prefer. 19, 511–518 (2008)CrossRef ten Klooster, P., Visser, M., de John, M.D.T.: Comparing two image research instruments: the Q sort method versus the Likert attitude questionnaire. Food Qual. Prefer. 19, 511–518 (2008)CrossRef
go back to reference Thompson, A.W., Dumyahn, S., Prokopy, L.S., Amberg, S., Baumgart-Getz, A., Jackson-Tyree, J., Perry-Hill, R., Reimer, A., Robinson, K.: Comparing random sample Q and R methods for understanding natural resource attitudes. Field Methods 25(1), 25–46 (2013)CrossRef Thompson, A.W., Dumyahn, S., Prokopy, L.S., Amberg, S., Baumgart-Getz, A., Jackson-Tyree, J., Perry-Hill, R., Reimer, A., Robinson, K.: Comparing random sample Q and R methods for understanding natural resource attitudes. Field Methods 25(1), 25–46 (2013)CrossRef
go back to reference Tuler, S., Webler, T.: Voices from the forest: what participants expect of a public participation process. Soc. Nat. Resour. 12, 437–453 (1999)CrossRef Tuler, S., Webler, T.: Voices from the forest: what participants expect of a public participation process. Soc. Nat. Resour. 12, 437–453 (1999)CrossRef
go back to reference Urquhart, J., Courtney, P.: Seeing the owner behind the trees: a typology of small-scale private woodland owners in England. For. Policy Econ. 13(7), 535–544 (2011)CrossRef Urquhart, J., Courtney, P.: Seeing the owner behind the trees: a typology of small-scale private woodland owners in England. For. Policy Econ. 13(7), 535–544 (2011)CrossRef
go back to reference Urquhart, J., Courtney, P., Slee, P.: Private woodland owners’ perspectives on multifunctionality in English woodlands. J. Rural Stud. 28(1), 95–106 (2012)CrossRef Urquhart, J., Courtney, P., Slee, P.: Private woodland owners’ perspectives on multifunctionality in English woodlands. J. Rural Stud. 28(1), 95–106 (2012)CrossRef
go back to reference Watts, S., Stenner, P.: Doing Q methodology: theory, method and interpretation. Qual. Res. Psychol. 2(1), 67–91 (2005)CrossRef Watts, S., Stenner, P.: Doing Q methodology: theory, method and interpretation. Qual. Res. Psychol. 2(1), 67–91 (2005)CrossRef
go back to reference Webler, T., Tuler, S., Krueger, R.: What is a good public participation process? Five perspectives from the public. Environ. Manage. 27(3), 435–450 (2001)CrossRef Webler, T., Tuler, S., Krueger, R.: What is a good public participation process? Five perspectives from the public. Environ. Manage. 27(3), 435–450 (2001)CrossRef
go back to reference Webler, T., Tuler, S.: Four perspectives on public participation process in environmental assessment and decision making: combined results from 10 case studies. Policy Stud. J. 34(4), 699–722 (2006)CrossRef Webler, T., Tuler, S.: Four perspectives on public participation process in environmental assessment and decision making: combined results from 10 case studies. Policy Stud. J. 34(4), 699–722 (2006)CrossRef
go back to reference Weller, S.: Cultural consensus theory: applications and frequently asked questions. Field Methods 19(4), 339–368 (2007)CrossRef Weller, S.: Cultural consensus theory: applications and frequently asked questions. Field Methods 19(4), 339–368 (2007)CrossRef
Metadata
Title
Likert versus Q-approaches in survey methodologies: discrepancies in results with same respondents
Authors
Kyle Eyvindson
Annika Kangas
Teppo Hujala
Pekka Leskinen
Publication date
01-03-2015
Publisher
Springer Netherlands
Published in
Quality & Quantity / Issue 2/2015
Print ISSN: 0033-5177
Electronic ISSN: 1573-7845
DOI
https://doi.org/10.1007/s11135-014-0006-y

Other articles of this Issue 2/2015

Quality & Quantity 2/2015 Go to the issue

Premium Partner