Skip to main content

2022 | OriginalPaper | Buchkapitel

Understanding the Design Effects of Progress Indicators on Online Surveys

verfasst von : Wonyoung Park, Jaemyung Lee, Sangsu Lee

Erschienen in: [ ] With Design: Reinventing Design Modes

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A progress indicator (PI) is often used to inform respondents of the task completion status of online surveys. When researchers conduct online surveys, reducing the dropout rate and the participants’ cognitive loads is important for improving the surveys’ efficiency. Although many studies have investigated the effect of using PIs with online surveys, it is unclear which PI design should be used to reduce the dropout rate and the participants’ perceived task load. Moreover, even in the Web content accessibility guidelines (WCAG), which should be followed in the building of websites to improve accessibility, the design guidelines for PIs are vague compared to those for other graphic elements. We noted that PIs have various designs and then created 25 types of PIs by combining design factors, labels, and bar graphs. We conducted an online survey through mTurk and collected 1,948 participants’ data. The online survey study results showed that the PI’s label design had a significant effect on the number of items the participants answered. In addition, we found that the respondents’ mental load changed significantly according to the combination of bar graph and label designs of the PI. This study provides strong support for designing the way a PI communicates the task process without reducing the speed of progress, which encourages respondents to answer more items and decreases their mental loads in online survey environments.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Becker, L.J.: Joint effect of feedback and goal setting on performance: A field study of residential energy conservation. J. Appl. Psychol. 63(4), 428 (1978)CrossRef Becker, L.J.: Joint effect of feedback and goal setting on performance: A field study of residential energy conservation. J. Appl. Psychol. 63(4), 428 (1978)CrossRef
Zurück zum Zitat Buhrmester, M., Kwang, T., Gosling, S.D.: Amazon’s mechanical turk: a new source of inexpensive, yet high-quality data? (2016) Buhrmester, M., Kwang, T., Gosling, S.D.: Amazon’s mechanical turk: a new source of inexpensive, yet high-quality data? (2016)
Zurück zum Zitat Chang, J.C., Amershi, S., Kamar, E.: Revolt: collaborative crowdsourcing for labeling machine learning datasets. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. CHI 2017, pp. 2334–2346. Association for Computing Machinery, Denver, Colorado, USA (2017). https://doi.org/10.1145/3025453.3026044, isbn: 9781450346559 Chang, J.C., Amershi, S., Kamar, E.: Revolt: collaborative crowdsourcing for labeling machine learning datasets. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. CHI 2017, pp. 2334–2346. Association for Computing Machinery, Denver, Colorado, USA (2017). https://​doi.​org/​10.​1145/​3025453.​3026044, isbn: 9781450346559
Zurück zum Zitat Conrad, F., et al.: Impact of progress feedback on task completion: first impressions matter. In: CHI 2005 Extended Abstracts on Human Factors in Computing Systems. CHI EA 2005, pp. 1921–1924. Association for Computing Machinery, Portland, OR, USA (2005). https://doi.org/10.1145/1056808.1057057, isbn: 1595930027 Conrad, F., et al.: Impact of progress feedback on task completion: first impressions matter. In: CHI 2005 Extended Abstracts on Human Factors in Computing Systems. CHI EA 2005, pp. 1921–1924. Association for Computing Machinery, Portland, OR, USA (2005). https://​doi.​org/​10.​1145/​1056808.​1057057, isbn: 1595930027
Zurück zum Zitat Conrad, F.G., et al.: The impact of progress indicators on task completion. Interact. Comput. 22(5), 417–427 (2010)CrossRef Conrad, F.G., et al.: The impact of progress indicators on task completion. Interact. Comput. 22(5), 417–427 (2010)CrossRef
Zurück zum Zitat Couper, M.P.: Discussion: what can CAI learn from HCI. In: Proceedings of the Seminar on New Directions in Statistical Methodology, pp. 363–377 (1994) Couper, M.P.: Discussion: what can CAI learn from HCI. In: Proceedings of the Seminar on New Directions in Statistical Methodology, pp. 363–377 (1994)
Zurück zum Zitat Dillman, D.A., Smyth, J.D., Christian, L.M.: Internet, Phone, Mail, and Mixed-Mode Surveys: the Tailored Design Method. Wiley, Hoboken (2014) Dillman, D.A., Smyth, J.D., Christian, L.M.: Internet, Phone, Mail, and Mixed-Mode Surveys: the Tailored Design Method. Wiley, Hoboken (2014)
Zurück zum Zitat Dillman, D.A., Tortora, R.D., Bowker, D.: Principles for constructing web surveys. J. Meetings Am. Stat. Assoc. 64, 1–16 (1998) Dillman, D.A., Tortora, R.D., Bowker, D.: Principles for constructing web surveys. J. Meetings Am. Stat. Assoc. 64, 1–16 (1998)
Zurück zum Zitat Drutsa, A., et al.: Crowdsourcing practice for efficient data labeling: aggregation, incremental relabeling, and pricing. In: Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data. SIGMOD 2020, pp. 2623–2627. Association for Computing Machinery, Portland, OR, USA (2020). https://doi.org/10.1145/3318464.3383127, isbn: 9781450367356 Drutsa, A., et al.: Crowdsourcing practice for efficient data labeling: aggregation, incremental relabeling, and pricing. In: Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data. SIGMOD 2020, pp. 2623–2627. Association for Computing Machinery, Portland, OR, USA (2020). https://​doi.​org/​10.​1145/​3318464.​3383127, isbn: 9781450367356
Zurück zum Zitat Egeln, L.S., Joseph, J.A.: Shopping cart abandonment in online shopping. Atlantic Mark. J. 1(1), 1 (2012) Egeln, L.S., Joseph, J.A.: Shopping cart abandonment in online shopping. Atlantic Mark. J. 1(1), 1 (2012)
Zurück zum Zitat Galesic, M.: Dropouts on the web: effects of interest and burden experienced during an online survey. J. Official Stat. 22(2), 313 (2006) Galesic, M.: Dropouts on the web: effects of interest and burden experienced during an online survey. J. Official Stat. 22(2), 313 (2006)
Zurück zum Zitat Gleicher, M., et al.: Perception of average value in multiclass scatterplots. IEEE Trans. Vis. Comput. Graph. 19(12), 2316–2325 (2013)CrossRef Gleicher, M., et al.: Perception of average value in multiclass scatterplots. IEEE Trans. Vis. Comput. Graph. 19(12), 2316–2325 (2013)CrossRef
Zurück zum Zitat Healey, B., Macpherson, T., Kuijten, B.: An empirical evaluation of three web survey design principles. Mark. Bull. 16 (2005) Healey, B., Macpherson, T., Kuijten, B.: An empirical evaluation of three web survey design principles. Mark. Bull. 16 (2005)
Zurück zum Zitat Heerwegh, D.: Using progress indicators in web surveys. In: 59th AAPOR conference, Phoenix, Arizona (2004) Heerwegh, D.: Using progress indicators in web surveys. In: 59th AAPOR conference, Phoenix, Arizona (2004)
Zurück zum Zitat Heerwegh, D., Loosveldt, G.: An experimental study on the effects of personalization, survey length statements, progress indicators, and survey sponsor logos in web surveys. J. Official Stat. 22(2), 191 (2006) Heerwegh, D., Loosveldt, G.: An experimental study on the effects of personalization, survey length statements, progress indicators, and survey sponsor logos in web surveys. J. Official Stat. 22(2), 191 (2006)
Zurück zum Zitat Soomin, K., Lee, J., Gweon, G.: Comparing data from Chatbot and web surveys: effects of platform and conversational style on survey response quality. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. CHI 2019, pp. 1–12. Association for Computing Machinery, Glasgow, Scotland, UK (2019). https://doi.org/10.1145/3290605.3300316, isbn: 9781450359702 Soomin, K., Lee, J., Gweon, G.: Comparing data from Chatbot and web surveys: effects of platform and conversational style on survey response quality. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. CHI 2019, pp. 1–12. Association for Computing Machinery, Glasgow, Scotland, UK (2019). https://​doi.​org/​10.​1145/​3290605.​3300316, isbn: 9781450359702
Zurück zum Zitat Komatsu, T., Yamada, S.: Exploring auditory information to change users’ perception of time passing as shorter. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. CHI 2020, pp. 1–12. Association for Computing Machinery, Honolulu, HI, USA (2020). https://doi.org/10.1145/3313831.3376157, isbn: 9781450367080 Komatsu, T., Yamada, S.: Exploring auditory information to change users’ perception of time passing as shorter. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. CHI 2020, pp. 1–12. Association for Computing Machinery, Honolulu, HI, USA (2020). https://​doi.​org/​10.​1145/​3313831.​3376157, isbn: 9781450367080
Zurück zum Zitat Locke, E.A.: The motivation to work: what we know. In: Advances in motivation and achievement, vol. 10, no. 2, pp. 375–412 (1997) Locke, E.A.: The motivation to work: what we know. In: Advances in motivation and achievement, vol. 10, no. 2, pp. 375–412 (1997)
Zurück zum Zitat Matejka, J., et al.: The effect of visual appearance on the performance of continuous sliders and visual analogue scales. In: CHI 2016, pp. 5421–5432. Association for Computing Machinery, San Jose, California, USA (2016). https://doi.org/10.1145/2858036.2858063, isbn: 9781450333627 Matejka, J., et al.: The effect of visual appearance on the performance of continuous sliders and visual analogue scales. In: CHI 2016, pp. 5421–5432. Association for Computing Machinery, San Jose, California, USA (2016). https://​doi.​org/​10.​1145/​2858036.​2858063, isbn: 9781450333627
Zurück zum Zitat Matzat, U., Snijders, C., van der Horst, W.: Effects of different types of progress indicators on dropout rates in web surveys. Soc. Psychol. 40(1), 43–52 (2009)CrossRef Matzat, U., Snijders, C., van der Horst, W.: Effects of different types of progress indicators on dropout rates in web surveys. Soc. Psychol. 40(1), 43–52 (2009)CrossRef
Zurück zum Zitat Nielsen, J.: Usability Engineering. Morgan Kaufmann, Burlington (1994) Nielsen, J.: Usability Engineering. Morgan Kaufmann, Burlington (1994)
Zurück zum Zitat Nielsen, J., Rolf, M.: Heuristic evaluation of user inter-faces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. CHI 1990, pp. 249–256. Association for Computing Machinery Seattle, Washington, USA (1990).https://doi.org/10.1145/97243.97281, isbn: 0201509326 Nielsen, J., Rolf, M.: Heuristic evaluation of user inter-faces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. CHI 1990, pp. 249–256. Association for Computing Machinery Seattle, Washington, USA (1990).https://​doi.​org/​10.​1145/​97243.​97281, isbn: 0201509326
Zurück zum Zitat Oviatt, S.: Human-centered design meets cognitive load theory: designing interfaces that help people think. In: Proceedings of the 14thACM International Conference on Multimedia. MM 2006, pp. 871–880. Association for Computing Machinery, Santa Barbara, CA, USA (2006). https://doi.org/10.1145/1180639.1180831, isbn: 1595934472 Oviatt, S.: Human-centered design meets cognitive load theory: designing interfaces that help people think. In: Proceedings of the 14thACM International Conference on Multimedia. MM 2006, pp. 871–880. Association for Computing Machinery, Santa Barbara, CA, USA (2006). https://​doi.​org/​10.​1145/​1180639.​1180831, isbn: 1595934472
Zurück zum Zitat Paolacci, G., Chandler, J., Ipeirotis, P.G.: Running experiments on amazon mechanical Turk. Judgment Decis. Making 5(5), 411–419 (2010)CrossRef Paolacci, G., Chandler, J., Ipeirotis, P.G.: Running experiments on amazon mechanical Turk. Judgment Decis. Making 5(5), 411–419 (2010)CrossRef
Zurück zum Zitat Ross, J., et al.: Who are the Crowdworkers? Shifting demographics in mechanical turk. In: CHI 2010 Extended Abstracts on Human Factors in Computing Systems. CHI EA 2010, pp. 2863–2872. Association for Computing Machinery, Atlanta, Georgia, USA (2010). https://doi.org/10.1145/1753846.1753873, isbn: 9781605589305 Ross, J., et al.: Who are the Crowdworkers? Shifting demographics in mechanical turk. In: CHI 2010 Extended Abstracts on Human Factors in Computing Systems. CHI EA 2010, pp. 2863–2872. Association for Computing Machinery, Atlanta, Georgia, USA (2010). https://​doi.​org/​10.​1145/​1753846.​1753873, isbn: 9781605589305
Zurück zum Zitat Sarraf, S., Tukibayeva, M.: Survey page length and progress indicators: what are their relationships to item nonresponse? New Dir. Inst. Res. 161, 83–97 (2014) Sarraf, S., Tukibayeva, M.: Survey page length and progress indicators: what are their relationships to item nonresponse? New Dir. Inst. Res. 161, 83–97 (2014)
Zurück zum Zitat Smyth, J.D., et al.: Effects of using visual design principles to group response options in web surveys (2006) Smyth, J.D., et al.: Effects of using visual design principles to group response options in web surveys (2006)
Zurück zum Zitat Strang, H.R., Lawrence, E.C., Fowler, P.C.: Effects of assigned goal level and knowledge of results on arithmetic computation: a laboratory study. J. Appl. Psychol. 63(4), 446 (1978)CrossRef Strang, H.R., Lawrence, E.C., Fowler, P.C.: Effects of assigned goal level and knowledge of results on arithmetic computation: a laboratory study. J. Appl. Psychol. 63(4), 446 (1978)CrossRef
Zurück zum Zitat Tourangeau, R., Conrad, F.G., Couper, M.P.: The Science of Web Surveys. Oxford University Press, Oxford (2013)CrossRef Tourangeau, R., Conrad, F.G., Couper, M.P.: The Science of Web Surveys. Oxford University Press, Oxford (2013)CrossRef
Zurück zum Zitat Tukibayeva, M., Sarraf, S.: The relationships between survey page length, progress indicators, and item completion rates. Am. Educ. Res. Assoc. Annu. Meeting (2012) Tukibayeva, M., Sarraf, S.: The relationships between survey page length, progress indicators, and item completion rates. Am. Educ. Res. Assoc. Annu. Meeting (2012)
Zurück zum Zitat Yentes, R.D., et al.: Effects of survey progress bars on data quality and enjoyment. In: 27th annual meeting of the Society for Industrial and Organizational Psychology (2012) Yentes, R.D., et al.: Effects of survey progress bars on data quality and enjoyment. In: 27th annual meeting of the Society for Industrial and Organizational Psychology (2012)
Zurück zum Zitat Yentes, R.D., et al.: Attention and data quality in online surveys: the role of survey length, progress bars, and time disclosure (2015) Yentes, R.D., et al.: Attention and data quality in online surveys: the role of survey length, progress bars, and time disclosure (2015)
Metadaten
Titel
Understanding the Design Effects of Progress Indicators on Online Surveys
verfasst von
Wonyoung Park
Jaemyung Lee
Sangsu Lee
Copyright-Jahr
2022
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-19-4472-7_92