Skip to main content
Top

2024 | OriginalPaper | Chapter

Continuous Experimentation and Human Factors

An Exploratory Study

Authors : Amna Pir Muhammad, Eric Knauss, Jonas Bärgman, Alessia Knauss

Published in: Product-Focused Software Process Improvement

Publisher: Springer Nature Switzerland

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In today’s rapidly evolving technological landscape, the success of tools and systems relies heavily on their ability to meet the needs and expectations of users. User-centered design approaches, with a focus on human factors, have gained increasing attention as they prioritize the human element in the development process. With the increasing complexity of software-based systems, companies are adopting agile development methodologies and emphasizing continuous software experimentation. However, there is limited knowledge on how to effectively execute continuous experimentation with respect to human factors within this context. This research paper presents an exploratory qualitative study for integrating human factors in continuous experimentation, aiming to uncover distinctive characteristics of human factors and continuous software experiments, practical challenges for integrating human factors in continuous software experiments, and best practices associated with the management of continuous human factors experimentation.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
Key terms of this study are defined in Table 1.
 
Literature
1.
go back to reference Abrahamsson, P., Salo, O., Ronkainen, J., Warsta, J.: Agile software development methods: review and analysis. arXiv preprint arXiv:1709.08439 (2017) Abrahamsson, P., Salo, O., Ronkainen, J., Warsta, J.: Agile software development methods: review and analysis. arXiv preprint arXiv:​1709.​08439 (2017)
2.
go back to reference Boy, G.A.: Human-centered design of complex systems: an experience-based approach. Design Sci. 3, e8 (2017)CrossRef Boy, G.A.: Human-centered design of complex systems: an experience-based approach. Design Sci. 3, e8 (2017)CrossRef
3.
go back to reference Charlton, S.G., O’Brien, T.G.: Handbook of Human Factors Testing and Evaluation. CRC Press, Boca Raton (2019)CrossRef Charlton, S.G., O’Brien, T.G.: Handbook of Human Factors Testing and Evaluation. CRC Press, Boca Raton (2019)CrossRef
4.
go back to reference Clarke, V., Braun, V., Hayfield, N.: Thematic analysis. Qual. Psychol.: Pract. Guide Res. Methods 3, 222–248 (2015) Clarke, V., Braun, V., Hayfield, N.: Thematic analysis. Qual. Psychol.: Pract. Guide Res. Methods 3, 222–248 (2015)
5.
go back to reference Fabijan, A., Dmitriev, P., Olsson, H.H., Bosch, J.: The evolution of continuous experimentation in software product development: from data to a data-driven organization at scale. In: 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE), pp. 770–780. IEEE (2017) Fabijan, A., Dmitriev, P., Olsson, H.H., Bosch, J.: The evolution of continuous experimentation in software product development: from data to a data-driven organization at scale. In: 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE), pp. 770–780. IEEE (2017)
6.
go back to reference Fagerholm, F., Guinea, A.S., Mäenpää, H., Münch, J.: The right model for continuous experimentation. J. Syst. Softw. 123, 292–305 (2017)CrossRef Fagerholm, F., Guinea, A.S., Mäenpää, H., Münch, J.: The right model for continuous experimentation. J. Syst. Softw. 123, 292–305 (2017)CrossRef
7.
go back to reference Feitelson, D.G., Frachtenberg, E., Beck, K.L.: Development and deployment at Facebook. IEEE Internet Comput. 17(4), 8–17 (2013)CrossRef Feitelson, D.G., Frachtenberg, E., Beck, K.L.: Development and deployment at Facebook. IEEE Internet Comput. 17(4), 8–17 (2013)CrossRef
9.
go back to reference Gandevia, S.: A human factor in ‘good’ experiments. Br. J. Philos. Sci. 37(4), 463–466 (1986)CrossRef Gandevia, S.: A human factor in ‘good’ experiments. Br. J. Philos. Sci. 37(4), 463–466 (1986)CrossRef
10.
go back to reference Hancock, P., Caird, J.K.: Experimental evaluation of a model of mental workload. Hum. Factors 35(3), 413–429 (1993)CrossRef Hancock, P., Caird, J.K.: Experimental evaluation of a model of mental workload. Hum. Factors 35(3), 413–429 (1993)CrossRef
11.
go back to reference Hancock, P.A.: Some pitfalls in the promises of automated and autonomous vehicles. Ergonomics 62(4), 479–495 (2019)CrossRef Hancock, P.A.: Some pitfalls in the promises of automated and autonomous vehicles. Ergonomics 62(4), 479–495 (2019)CrossRef
13.
go back to reference Kevic, K., Murphy, B., Williams, L., Beckmann, J.: Characterizing experimentation in continuous deployment: a case study on bing. In: 39th International Conference on Software Engineering (ICSE-SEIP). IEEE (2017) Kevic, K., Murphy, B., Williams, L., Beckmann, J.: Characterizing experimentation in continuous deployment: a case study on bing. In: 39th International Conference on Software Engineering (ICSE-SEIP). IEEE (2017)
14.
go back to reference Kohavi, R., Henne, R.M., Sommerfield, D.: Practical guide to controlled experiments on the web: listen to your customers not to the hippo. In: Proceedings of the 13th ACM SIGKDD, pp. 959–967 (2007) Kohavi, R., Henne, R.M., Sommerfield, D.: Practical guide to controlled experiments on the web: listen to your customers not to the hippo. In: Proceedings of the 13th ACM SIGKDD, pp. 959–967 (2007)
15.
go back to reference Kohavi, R., et al.: Online experimentation at Microsoft. Data Min. Case Stud. 11(2009), 39 (2009) Kohavi, R., et al.: Online experimentation at Microsoft. Data Min. Case Stud. 11(2009), 39 (2009)
18.
go back to reference Madni, A.M.: Integrating humans with and within complex systems. CrossTalk 5 (2011) Madni, A.M.: Integrating humans with and within complex systems. CrossTalk 5 (2011)
19.
go back to reference Maruping, L.M., Matook, S.: The evolution of software development orchestration: current state and an agenda for future research. Eur. J. Inf. Syst. 29(5), 443–457 (2020)CrossRef Maruping, L.M., Matook, S.: The evolution of software development orchestration: current state and an agenda for future research. Eur. J. Inf. Syst. 29(5), 443–457 (2020)CrossRef
20.
go back to reference Maxwell, J.A.: Qualitative Research Design: An Interactive Approach. Sage Publications (2012) Maxwell, J.A.: Qualitative Research Design: An Interactive Approach. Sage Publications (2012)
21.
go back to reference Muhammad, A.P., Knauss, E., Bärgman, J.: Human factors in developing automated vehicles: a requirements engineering perspective. J. Syst. Softw. 111810 (2023) Muhammad, A.P., Knauss, E., Bärgman, J.: Human factors in developing automated vehicles: a requirements engineering perspective. J. Syst. Softw. 111810 (2023)
22.
go back to reference Muhammad, A.P., Knauss, E., Bärgman, J., Knauss, A.: Towards challenges and practices with managing human factors in automated vehicle development. In: 31st IEEE International Requirements Engineering Conference (RE 2023). IEEE (2023) Muhammad, A.P., Knauss, E., Bärgman, J., Knauss, A.: Towards challenges and practices with managing human factors in automated vehicle development. In: 31st IEEE International Requirements Engineering Conference (RE 2023). IEEE (2023)
23.
go back to reference Nakao, Y., Moriguchi, M., Noda, H.: Using agile software development methods to support human-centered design. NEC Tech. J. 8(3), 37–40 (2014) Nakao, Y., Moriguchi, M., Noda, H.: Using agile software development methods to support human-centered design. NEC Tech. J. 8(3), 37–40 (2014)
24.
go back to reference Norman, D.: Design of Everyday Things, Revised and Expanded. Basic books (2013) Norman, D.: Design of Everyday Things, Revised and Expanded. Basic books (2013)
25.
go back to reference Olsson, H.H., Alahyari, H., Bosch, J.: Climbing the “stairway to heaven”-a mulitiple-case study exploring barriers in the transition from agile development towards continuous deployment of software. In: 2012 38th Euromicro Conference on Software Engineering and Advanced Applications, pp. 392–399. IEEE (2012) Olsson, H.H., Alahyari, H., Bosch, J.: Climbing the “stairway to heaven”-a mulitiple-case study exploring barriers in the transition from agile development towards continuous deployment of software. In: 2012 38th Euromicro Conference on Software Engineering and Advanced Applications, pp. 392–399. IEEE (2012)
26.
go back to reference Rissanen, O., Münch, J.: Continuous experimentation in the b2b domain: a case study. In: 2015 IEEE/ACM 2nd International Workshop on Rapid Continuous Software Engineering, pp. 12–18. IEEE (2015) Rissanen, O., Münch, J.: Continuous experimentation in the b2b domain: a case study. In: 2015 IEEE/ACM 2nd International Workshop on Rapid Continuous Software Engineering, pp. 12–18. IEEE (2015)
27.
go back to reference Royer, M., Houser, K., Durmus, D., Esposito, T., Wei, M.: Recommended methods for conducting human factors experiments on the subjective evaluation of colour rendition. Light. Res. Technol. 54(3), 199–236 (2022)CrossRef Royer, M., Houser, K., Durmus, D., Esposito, T., Wei, M.: Recommended methods for conducting human factors experiments on the subjective evaluation of colour rendition. Light. Res. Technol. 54(3), 199–236 (2022)CrossRef
28.
go back to reference Sætren, G.B., Hogenboom, S., Laumann, K.: A study of a technological development process: human factors-the forgotten factors? Cogn. Technol. Work 18, 595–611 (2016)CrossRef Sætren, G.B., Hogenboom, S., Laumann, K.: A study of a technological development process: human factors-the forgotten factors? Cogn. Technol. Work 18, 595–611 (2016)CrossRef
29.
go back to reference Shneiderman, B.: Human factors experiments in designing interactive systems. Computer 12(12), 9–19 (1979)CrossRef Shneiderman, B.: Human factors experiments in designing interactive systems. Computer 12(12), 9–19 (1979)CrossRef
30.
go back to reference Steinberg, R., Grumman, N.: Human factors at the speed of relevance for agile engineering. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 66. SAGE Publications, Los Angeles (2022) Steinberg, R., Grumman, N.: Human factors at the speed of relevance for agile engineering. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 66. SAGE Publications, Los Angeles (2022)
31.
go back to reference Verhoef, P.C., et al.: Digital transformation: a multidisciplinary reflection and research agenda. J. Bus. Res. 122, 889–901 (2021)CrossRef Verhoef, P.C., et al.: Digital transformation: a multidisciplinary reflection and research agenda. J. Bus. Res. 122, 889–901 (2021)CrossRef
32.
go back to reference Wickens, C.D., Gordon, S.E., Liu, Y., Lee, J.: An Introduction to Human Factors Engineering, vol. 2. Pearson Prentice Hall, Upper Saddle River (2004) Wickens, C.D., Gordon, S.E., Liu, Y., Lee, J.: An Introduction to Human Factors Engineering, vol. 2. Pearson Prentice Hall, Upper Saddle River (2004)
33.
go back to reference Williams, K.W.: Impact of aviation highway-in-the-sky displays on pilot situation awareness. Hum. Factors 44(1), 18–27 (2002)CrossRef Williams, K.W.: Impact of aviation highway-in-the-sky displays on pilot situation awareness. Hum. Factors 44(1), 18–27 (2002)CrossRef
34.
go back to reference Yaman, S.G.: Initiating the transition towards continuous experimentation: empirical studies with software development teams and practitioners. Ser. Publ. A (2019) Yaman, S.G.: Initiating the transition towards continuous experimentation: empirical studies with software development teams and practitioners. Ser. Publ. A (2019)
35.
go back to reference Yaman, S.G., et al.: Introducing continuous experimentation in large software-intensive product and service organisations. J. Syst. Softw. 133, 195–211 (2017)CrossRef Yaman, S.G., et al.: Introducing continuous experimentation in large software-intensive product and service organisations. J. Syst. Softw. 133, 195–211 (2017)CrossRef
Metadata
Title
Continuous Experimentation and Human Factors
Authors
Amna Pir Muhammad
Eric Knauss
Jonas Bärgman
Alessia Knauss
Copyright Year
2024
DOI
https://doi.org/10.1007/978-3-031-49266-2_35

Premium Partner