Abheeshta Putta
ABSTRACT
Background: The benefits of agile methods in small, co-located projects have inspired their adoption in large firms and projects. Scaling frameworks, such as Large-Scale Scrum (LeSS) and the Scaled Agile Framework (SAFe), have been proposed by practitioners to scale agile to larger contexts, and become rather widely adopted in the industry. Despite the popularity of the frameworks, the knowledge on the reasons, expected benefits, and satisfaction of organizations adopting them is still limited.
Aims: This paper presents a study of practitioners who have adopted an agile scaling framework in their organization and investigates the reasons for, expected benefits of, and the satisfaction level with the adoption of the selected framework.
Method: We conducted a survey of software practitioners. We received data from 204 respondents representing ten frameworks adopted in 26 countries and located in six continents.
Results: The results show that SAFe is the most widely adopted framework among our respondents. The two most commonly mentioned reasons for adopting agile scaling frameworks are to scale to more people and to remain competitive in the market. The most common expected benefits are improving the collaboration and dependency management between teams. We also found some unique reasons and expected benefits for the framework adoption, such as inculcating an agile mindset, addressing the needs of regulated environments, dissolving silos, and technical excellence. Our findings indicated statistically significant differences for reasons, expected benefits, and satisfaction between different frameworks. Most of our respondents report that the selected framework met their expectations.
Conclusions: This paper offers the first quantitative assessment of reasons, expected benefits, and satisfaction of firms for adopting agile scaling frameworks. Future studies comparing scaling frameworks could help firms in selecting the most suitable framework fitting their needs.
- Mashal Alqudah and Rozilawati Razali. 2016. A Review of Scaling Agile Methods in Large Software Development. International Journal on Advanced Science, Engineering and Information Technology 6, 6 (2016), 828--837.Google Scholar
Cross Ref
- Scott W Ambler. 2007. Agile software development at scale. In IFIP Central and East European Conference on Software Engineering Techniques. Springer, 1--12.Google Scholar
- Arpitha Badanahatti and Sapna Pillutla. 2020. Interleaving Software Craftsmanship Practices in Medical Device Agile Development. In Proceedings of the 13th Innovations in Software Engineering Conference on Formerly known as India Software Engineering Conference. 1--5. Google ScholarDigital Library
- Julian M Bass. 2019. Future Trends in Agile at Scale: A Summary of the 7 th International Workshop on Large-Scale Agile Development. In International Conference on Agile Software Development. Springer, 75--80.Google ScholarCross Ref
- Barry Boehm. 2002. Get ready for agile methods, with care. Computer 35, 1 (2002), 64--69. Google ScholarDigital Library
- The LeSS Company B.V. [n.d.]. Large Scale Scrum. https://less.works/case-studies/index.html.Google Scholar
- The LeSS Company B.V. [n.d.]. LeSS Framework Training and Courses. https://less.works/courses/less-courses. [Online; accessed 10-MAY-2021].Google Scholar
- Noel Carroll and Kieran Conboy. 2019. Applying Normalization Process Theory to Explain Large-Scale Agile Transformations. In Proceedings of the 14th International Research Workshop on IT Project Management.Google Scholar
- Kieran Conboy and Noel Carroll. 2019. Implementing Large-Scale Agile Frameworks: Challenges and Recommendations. IEEE Software 36, 2 (2019), 44--50. Google ScholarDigital Library
- William Jay Conover. 1998. Practical nonparametric statistics. Vol. 350. John Wiley & Sons.Google Scholar
- Juliet M. Corbin and Anselm L. Strauss. 2008. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory (3rd ed ed.). Sage Publications, Inc., Los Angeles, Calif.Google Scholar
- Steph Adolph Curtis Michelson. 2019. Experience reports from agile alliance Bias From The Bottom: A Different Way to Bootup A SAFe Train. In International Conference on Agile Software Development. AgileAlliance.Google Scholar
- Philipp Diebold, Anna Schmitt, and Sven Theobald. 2018. Scaling agile: how to select the most appropriate framework. In Proceedings of the 19th International Conference on Agile Software Development: Companion. 1--4. Google ScholarDigital Library
- Kim Dikert, Maria Paasivaara, and Casper Lassenius. 2016. Challenges and success factors for large-scale agile transformations: A systematic literature review. Journal of Systems and Software 119 (2016), 87--108. https://doi.org/10.1016/j.jss.2016.06.013 Google ScholarDigital Library
- Torgeir Dingsøyr, Tor Erlend Fægri, and Juha Itkonen. 2014. What Is Large in Large-Scale? A Taxonomy of Scale for Agile Software Development. In Proceedings of the 15th International Conference on Product-Focused Software Process Improvement. Springer, Cham.Google ScholarCross Ref
- Torgeir Dingsøyr, Nils Brede Moe, Tor Erlend Fægri, and Eva Amdahl Seim. 2018. Exploring software development at the very large-scale: a revelatory case study and research agenda for agile method adaptation. Empirical Software Engineering 23, 1 (2018), 490--520. Google ScholarDigital Library
- Torgeir Dingsøyr, Sridhar Nerur, VenuGopal Balijepally, and Nils Brede Moe. 2012. A decade of agile methodologies: Towards explaining agile software development. Journal of Systems and Software 85, 6 (2012), 1213--1221. Special Issue: Agile Development. Google ScholarDigital Library
- Tore Dybå and Torgeir Dingsøyr. 2008. Empirical studies of agile software development: A systematic review. Information and software technology 50, 9-10 (2008), 833--859. Google ScholarDigital Library
- Alan C Elliott and Linda S Hynan. 2011. A SAS® macro implementation of a multiple comparison post hoc test for a Kruskal-Wallis analysis. Computer methods and programs in biomedicine 102, 1 (2011), 75--80. Google ScholarDigital Library
- Christoph Fuchs and Thomas Hess. 2018. Becoming agile in the digital transformation: The process of a large-scale agile transformation. In Proceedings of the 39th International Conference on Information Systems (ICIS).Google Scholar
- Tomas Gustavsson. 2019. Dynamics of Inter-Team Coordination Routines in Large-Scale Agile Software Development. In Proceedings of the 27th European Conference on Information Systems (ECIS).Google Scholar
- Tomas Gustavsson and Linda Bergkvist. 2019. Perceived Impacts of Using the Scaled Agile Framework for Large-Scale Agile Software Development. (2019).Google Scholar
- Scrum Inc. [n.d.]. Scrum at Scale Courses. https://www.scrumatscale.com/scrum-at-scale-practitioner-course/. [Online; accessed 10-APR-2021].Google Scholar
- Scaled Agile Inc. [n.d.]. Intel Case study. http://www.scaledagileframework.com/case-study-intel/. [Online; accessed 06-APR-2020].Google Scholar
- Scaled Agile Inc. 2016. Amdocs Case Study. http://www.scaledagileframework.com/amdocs-case-study. [Online; accessed 06-APR-2020].Google Scholar
- Scaled Agile Inc. 2016. HPE Case Study. http://www.scaledagileframework.com/hpe-case-study/. [Online; accessed 06-APR-2020].Google Scholar
- Scaled Agile Inc. 2017. Capital One Case Study. http://www.scaledagileframework.com/capital-one-case-study/. [Online; accessed 06-APR-2020].Google Scholar
- Petri Kettunen. 2007. Extending Software Project Agility with New Product Development Enterprise Agility. Software Process: Improvement and Practice 12, 6 (2007), 541--548. Google ScholarDigital Library
- Barbara Kitchenham and Shari Lawrence Pfleeger. 2002. Principles of survey research: part 5: populations and samples. ACM SIGSOFT Software Engineering Notes 27, 5 (2002), 17--20. https://doi.org/10.1145/571681.571686 Google ScholarDigital Library
- Marco Kuhrmann, Philipp Diebold, Jürgen Münch, Paolo Tell, Vahid Garousi, Michael Felderer, Kitija Trektere, Fergal McCaffery, Oliver Linssen, Eckhart Hanser, et al. 2017. Hybrid software and system development in practice: waterfall, scrum, and beyond. In Proceedings of the 2017 International Conference on Software and System Process. 30--39. Google ScholarDigital Library
- Maarit Laanti and Petri Kettunen. 2019. SAFe adoptions in Finland: a survey research. In Proceedings of the 20th International Conference on Agile Software Development: Agile Processes in Software Engineering and Extreme Programming - Workshops. Springer, Cham, 81--87. https://doi.org/10.1007/978-3-030-301262_10Google ScholarCross Ref
- Hubert W Lilliefors. 1967. On the Kolmogorov-Smirnov test for normality with mean and variance unknown. J. Amer. Statist. Assoc. 62, 318 (1967), 399--402.Google ScholarCross Ref
- Chuck Maples. 2009. Enterprise Agile Transformation: The Two-Year Wall. In Proceedings of the 2009 Agile Conference. IEEE, 90--95. Google ScholarDigital Library
- David McMunn and Phillip Manketo. 2017. Building Strong Foundations... Underwriting Fannie Mae's Agile Transformation. In International Conference on Agile Software Development. AgileAlliance.Google Scholar
- Maria Paasivaara. 2017. Adopting SAFe to Scale Agile in a Globally Distributed Organization. In Proceedings of the 2017 IEEE 12th International Conference on Global Software Engineering. IEEE, 36--40. https://doi.org/10.1109/ICGSE.2017.15 Google ScholarDigital Library
- Maria Paasivaara, Benjamin Behm, Casper Lassenius, and Minna Hallikainen. 2018. Large-scale agile transformation at Ericsson: a case study. Empirical Software Engineering 23, 5 (2018), 2550--2596. Google ScholarDigital Library
- Maria Paasivaara, Ville Heikkilä, and Casper Lassenius. 2012. Experiences in Scaling the Product Owner Role in Large-Scale Globally Distributed Scrum. In Proceedings of the 7th International Conference on Global Software Engineering (ICGSE). Institute of Electrical and Electronics Engineers (IEEE), 174--178. https://doi.org/10.1109/ICGSE.2012.41 Google ScholarDigital Library
- Maria Paasivaara and Casper Lassenius. 2016. Scaling Scrum in a Large Globally Distributed Organization: A Case Study. In 2016 IEEE 11th International Conference on Global Software Engineering. IEEE, 74--83. https://doi.org/10.1109/ICGSE.2016.34Google ScholarCross Ref
- Vaishnavi Patil, S Panicker, and M Kv. 2016. Use of agile methodology for mobile applications. Int. J. Latest Technol. Eng. Manag. Appl. Sci. 5, 10 (2016), 73--77.Google Scholar
- Jan Pries-Heje and Malene M Krohn. 2017. The SAFe Way to the Agile Organization. In Proceedings of the XP2017 Scientific Workshops. ACM, 1--4. Google ScholarDigital Library
- Jan Pries-Heje and Malene M Krohn. 2017. The SAFe way to the agile organization. In Proceedings of the XP2017 Scientific Workshops. ACM, 18. Google ScholarDigital Library
- Abheeshta Putta. 2018. Scaling Agile Software Development to Large and Globally Distributed Large-Scale Organizations. In Proceedings of the 13th International Conference on Global Software Engineering. ACM, 141--144. https://doi.org/10.1145/3196369.3196386 Google ScholarDigital Library
- Abheeshta Putta, Maria Paasivaara, and Casper Lassenius. 2018. Benefits and Challenges of Adopting the Scaled Agile Framework (SAFe): Preliminary Results from a Multivocal Literature Review. In Proceedings of the 19th International Conference on Product-Focused Software Process Improvement. Springer, Cham, 334--351. https://doi.org/10.1007/978-3-030-03673-7_24Google ScholarCross Ref
- Abheeshta Putta, Maria Paasivaara, and Casper Lassenius. 2019. How Are Agile Release Trains Formed in Practice? A Case Study in a Large Financial Corporation. In Proceedings of the 20th International Conference on Agile Software Development: Agile Processes in Software Engineering and Extreme Programming. Springer, Cham, 154--170. https://doi.org/10.1007/978-3-030-19034-7_10Google ScholarCross Ref
- Abheeshta Putta, Ömer Uludağ, Maria Paasivaara, and Shun-Long Hong. 2021. Benefits and Challenges of Adopting SAFe-An Empirical Survey. In International Conference on Agile Software Development. Springer, Cham, 172--187.Google Scholar
- Abdallah Salameh and Julian M Bass. 2019. Spotify tailoring for promoting effectiveness in cross-functional autonomous squads. In International Conference on Agile Software Development. Springer, 20--28.Google ScholarCross Ref
- Dilshat Salikhov, Giancarlo Succi, and Alexander Tormasov. 2020. An empirical analysis of success factors in the adaption of the scaled agile framework-first outcomes from an empirical study. arXiv preprint arXiv:2012.11144 (2020).Google Scholar
- Dilshat Salikhov, Giancarlo Succi, and Alexander Tormasov. 2020. An empirical analysis of success factors in the adaption of the scaled agile framework-first outcomes from an empirical study. arXiv preprint arXiv:2012.11144 (2020).Google Scholar
- Inc. Scaled Agile. [n.d.]. SAFe Courses. https://www.scaledagile.com/certifications/which-course-is-right-for-me/. [Online; accessed 10-APR-2021].Google Scholar
- Scaled Agile Inc. [n.d.]. SAFe Home Page. https://www.scaledagileframework.com/.Google Scholar
- J. Schongot and Y. Man. 2018. Lean engineering at elbit systems aerospace division - Implementation journey. In Annual Forum Proceedings - AHS International, Vol. 2018-May. www.scopus.comGoogle Scholar
- Scrum Inc. [n.d.]. Scrum at Scale. https://www.scrumatscale.com/.Google Scholar
- Sven Theobald, Anna Schmitt, and Philipp Diebold. 2019. Comparing scaling agile frameworks based on underlying practices. In Proceedings of the 7th International Workshop on Large-Scale Agile (XP). Springer, 88--96. https://doi.org/10.1007/978-3-030-30126-2_11Google ScholarCross Ref
- Ömer Uludağ, Martin Kleehaus, Christoph Caprano, and Florian Matthes. 2018. Identifying and Structuring Challenges in Large-Scale Agile Development Based on a Structured Literature Review. In 2018 IEEE 22nd International Enterprise Distributed Object Computing Conference. IEEE, 191--197. https://doi.org/10.1109/EDOC.2018.00032Google ScholarCross Ref
- Ömer Uludağ, Martin Kleehaus, Niklas Dreymann, Christian Kabelin, and Florian Matthes. 2019. Investigating the Adoption and Application of Large-Scale Scrum at a German Automobile Manufacturer. In Proceedings of the 2019 ACM/IEEE 14th International Conference on Global Software Engineering. IEEE, 22--29. https://doi.org/10.1109/ICGSE.2019.00019 Google ScholarDigital Library
- Ömer Uludağ, Martin Kleehaus, Xian Xu, and Florian Matthes. 2017. Investigating the Role of Architects in Scaling Agile Frameworks. In 2017 IEEE 21st International Enterprise Distributed Object Computing Conference (EDOC). IEEE, 123--132. https://doi.org/10.1109/EDOC.2017.25Google Scholar
- Ömer Uludağ and Florian Matthes. 2019. Identifying and Documenting Recurring Concerns and Best Practices of Agile Coaches and Scrum Masters in Large-Scale Agile Development. In Proceedings of the 26th International Conference on Pattern Languages of Programs. ACM. Google ScholarDigital Library
- Ömer Uludağ, Pascal Philipp, Abheeshta Putta, Maria Paasivaara, Casper Lassenius, and Florian Matthes. 2021. Revealing the State-of-the-Art in Large-Scale Agile Development: A Systematic Mapping Study. arXiv preprint arXiv:2007.05578 (2021).Google Scholar
- Ömer Uludağ, Abheeshta Putta, Maria Paasivaara, and Florian Matthes. 2021. Evolution of the Agile Scaling Frameworks. In International Conference on Agile Software Development. Springer, Cham, 123--139.Google Scholar
- Version One. [n.d.]. 13th State of Agile Survey. https://bit.ly/3sadydS. last accessed on 03-11-2021.Google Scholar
- Version One. [n.d.]. State of Agile Survey. https://stateofagile.com/#ufh-i-613554519-9th-annual-state-of-agile-report/7027494.Google Scholar
- VersionOne. 2020. 14th Annual State of Agile Survey. =https://stateofagile.com/#ufh-i-615706098-14th-annual-state-of-agile-report/7027494. last accessed on: 05-11-2021.Google Scholar
- Ewelina Wińska and Włodzimierz Dąbrowski. 2020. Software development artifacts in large agile organizations: a comparison of scaling agile methods. In Data-Centric Business and Applications. Springer, 101--116.Google Scholar
- Claes Wohlin, Per Runeson, Martin Höst, Magnus C Ohlsson, Björn Regnell, and Anders Wesslén. 2012. Experimentation in Software Engineering. Springer Science & Business Media. Google ScholarCross Ref
Index Terms
- Why Do Organizations Adopt Agile Scaling Frameworks?: A Survey of Practitioners
Recommendations
Scaling agile software development to large and globally distributed large-scale organizations
ICGSE '18: Proceedings of the 13th International Conference on Global Software EngineeringThere has been a tremendous increase in the rate of agile method adoption across large and globally distributed large organizations. Despite of several challenges, organizations have shown profound interest due to the potential benefits of agile at ...
Scaling agile development in mechatronic organizations: a comparative case study
ICSE-SEIP '17: Proceedings of the 39th International Conference on Software Engineering: Software Engineering in Practice TrackAgile software development principles enable companies to successfully and quickly deliver software by meeting their customers' expectations while focusing on high quality. Many companies working with pure software systems have adopted these principles, ...
Comments