Skip to main content
Top
Published in: Quality & Quantity 6/2016

13-10-2015

Open narrative questions in PC and smartphones: is the device playing a role?

Authors: Melanie Revilla, Carlos Ochoa

Published in: Quality & Quantity | Issue 6/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Most survey questions are closed questions, where respondents have to select an answer from a proposed set of alternatives. However, a lot of surveys also include, at least occasionally, some open questions. Open questions that call for elaborated and developed answers, called “open narrative questions”, are used when the researchers want to go deeper into what the respondents think. This paper compares the answers to open narrative questions when the respondent is participating in a PC survey, in a smartphone-not-optimised survey or in a smartphone-optimised survey. The experiment was carried out in Spain using data collected by the Netquest online access panel. Respondents were assigned randomly to each type of device and survey format, in two successive waves. Because respondents have to type in their answer, we expect differences between devices, linked with the size and the kind of keyboards (i.e. physical versus digital, touch-screen or not). Differences are observed between answers that come from PCs and smartphones for the response time per written character, for the number of total characters and for the use of abbreviations, but not for the non-answer and non-substantive responses. No differences are observed between optimised and not optimised versions for smartphones, except for the response time per character written.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
A large part of the questions were inspired by the study of Mavletova and Couper (2013), but not the open narrative questions used in this study.
 
Literature
go back to reference Buskirk, T.D., Andrus, C.H.: Making mobile browser surveys smarter: results from a randomized experiment comparing online surveys completed via computer or smartphone. Field Methods 26(4), 322–342 (2014). doi:10.1177/1525822X14526146 CrossRef Buskirk, T.D., Andrus, C.H.: Making mobile browser surveys smarter: results from a randomized experiment comparing online surveys completed via computer or smartphone. Field Methods 26(4), 322–342 (2014). doi:10.​1177/​1525822X14526146​ CrossRef
go back to reference Christian, L.M., Dillman, D.A.: The influence of graphical and symbolic language manipulations on responses to self-administered questions. Public Opin. Q. 68(1), 57–80 (2004)CrossRef Christian, L.M., Dillman, D.A.: The influence of graphical and symbolic language manipulations on responses to self-administered questions. Public Opin. Q. 68(1), 57–80 (2004)CrossRef
go back to reference Couper, M.P., Kennedy, C., Conrad, F.G., Tourangeau, R.: Designing input fields for non-narrative open-ended responses in web surveys. J. Off. Stat. 27(1), 65–85 (2011) Couper, M.P., Kennedy, C., Conrad, F.G., Tourangeau, R.: Designing input fields for non-narrative open-ended responses in web surveys. J. Off. Stat. 27(1), 65–85 (2011)
go back to reference de Bruijne, M, Wijnant A.: Can mobile web surveys be taken on computers? a discussion on a multi-device survey design. Surv. Pract. 6(4) (2013) de Bruijne, M, Wijnant A.: Can mobile web surveys be taken on computers? a discussion on a multi-device survey design. Surv. Pract. 6(4) (2013)
go back to reference de Bruijne, M., Wijnant, A.: Mobile response in web panels. Soc. Sci. Comput. Rev. 32(6), 728–742 (2014a)CrossRef de Bruijne, M., Wijnant, A.: Mobile response in web panels. Soc. Sci. Comput. Rev. 32(6), 728–742 (2014a)CrossRef
go back to reference Emde, M., Fuchs M.: Using adaptive questionnaire design in open-ended questions: a field experiment. In: JSM Proceedings, Statistical Computing Section. American Statistical Association, Alexandria (2012) Emde, M., Fuchs M.: Using adaptive questionnaire design in open-ended questions: a field experiment. In: JSM Proceedings, Statistical Computing Section. American Statistical Association, Alexandria (2012)
go back to reference Israel, G.D.: Effects of answer space size on responses to open-ended questions in mail surveys. J. Off. Stat. 26(2), 271–285 (2010) Israel, G.D.: Effects of answer space size on responses to open-ended questions in mail surveys. J. Off. Stat. 26(2), 271–285 (2010)
go back to reference Kaikkonen, A.: Mobile internet: past, present, and the future. Int. J. Mob. Hum. Comput. Interact. 1, 29–44 (2009)CrossRef Kaikkonen, A.: Mobile internet: past, present, and the future. Int. J. Mob. Hum. Comput. Interact. 1, 29–44 (2009)CrossRef
go back to reference Mavletova, A.: Data quality in PC and mobile web surveys. Soc. Sci. Comput. Rev. 31(4), 725–743 (2013)CrossRef Mavletova, A.: Data quality in PC and mobile web surveys. Soc. Sci. Comput. Rev. 31(4), 725–743 (2013)CrossRef
go back to reference Peytchev, A., Hill, C.A.: Experiments in mobile web survey design: similarities to other modes and unique considerations. Soc. Sci. Comput. Rev. 28(3), 319–335 (2010)CrossRef Peytchev, A., Hill, C.A.: Experiments in mobile web survey design: similarities to other modes and unique considerations. Soc. Sci. Comput. Rev. 28(3), 319–335 (2010)CrossRef
go back to reference Revilla, M., Toninelli, D., Ochoa, C., Loewe, G.: Do online access panels really need to allow and adapt surveys to mobile devices? Internet Res. (fothcoming) Revilla, M., Toninelli, D., Ochoa, C., Loewe, G.: Do online access panels really need to allow and adapt surveys to mobile devices? Internet Res. (fothcoming)
go back to reference Smyth, J.D., Dillman, D.A., Christian, L.M., Mcbride, M.: Open-ended questions in web surveys. Can increasing the size of answer boxes and providing extra verbal instructions improve response quality? Public Opin. Q. 73(2), 325–337 (2009)CrossRef Smyth, J.D., Dillman, D.A., Christian, L.M., Mcbride, M.: Open-ended questions in web surveys. Can increasing the size of answer boxes and providing extra verbal instructions improve response quality? Public Opin. Q. 73(2), 325–337 (2009)CrossRef
go back to reference Toepoel, V., Lugtig, P.: What happens if you offer a mobile option to your web panel? Evidence from a probability-based panel of Internet users. Soc. Sci. Comput. Rev. 32(4), 1–17 (2014)CrossRef Toepoel, V., Lugtig, P.: What happens if you offer a mobile option to your web panel? Evidence from a probability-based panel of Internet users. Soc. Sci. Comput. Rev. 32(4), 1–17 (2014)CrossRef
go back to reference Wells, T., Bailey, J.T., Link, M.W.: Filling the void: Gaining a better understanding of tablet-based surveys. Surv. Pract. 6 (2013) Wells, T., Bailey, J.T., Link, M.W.: Filling the void: Gaining a better understanding of tablet-based surveys. Surv. Pract. 6 (2013)
go back to reference Wells, T., Bailey, J.T., Link, M.W.: Comparison of smartphone and online computer survey administration. Soc. Sci. Comput. Rev. 32(2), 238–255 (2014)CrossRef Wells, T., Bailey, J.T., Link, M.W.: Comparison of smartphone and online computer survey administration. Soc. Sci. Comput. Rev. 32(2), 238–255 (2014)CrossRef
go back to reference Zahariev, M., Ferneyhough, C., Ryan, C.: Best practices in mobile research. Paper presented at ESOMAR Online Research, Chicago, Oct 26–28 (2009) Zahariev, M., Ferneyhough, C., Ryan, C.: Best practices in mobile research. Paper presented at ESOMAR Online Research, Chicago, Oct 26–28 (2009)
Metadata
Title
Open narrative questions in PC and smartphones: is the device playing a role?
Authors
Melanie Revilla
Carlos Ochoa
Publication date
13-10-2015
Publisher
Springer Netherlands
Published in
Quality & Quantity / Issue 6/2016
Print ISSN: 0033-5177
Electronic ISSN: 1573-7845
DOI
https://doi.org/10.1007/s11135-015-0273-2

Other articles of this Issue 6/2016

Quality & Quantity 6/2016 Go to the issue

Premium Partner