Skip to main content
Top
Published in: Software Quality Journal 1/2022

17-01-2021

TestDCat 3.0: catalog of test debt subtypes and management activities

Authors: Bruno S. Aragão, Rossana M. C. Andrade, Ismayle S. Santos, Rute N. S. Castro, Valéria Lelli, Ticianne G. R. Darin

Published in: Software Quality Journal | Issue 1/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

When deadlines and resources of software projects become scarce, testing is usually in the first row to have its activities aborted or reduced; however, if defects cannot be found, product quality can be affected. In the software development process, aborted or reduced activities that can bring short-term benefits, but can be harmful to the project in the long run, are considered Technical Debt (TD) and, when the TDs impact testing activities, they are called Test Debt. Although there are several studies dealing with Test Debt, current solutions often deal with specific types of tests (e.g., exploratory and automated tests) and do not address the whole software testing process. Aiming to fill these gaps, this work then proposes a Test Debt Catalog, called TestDCat, with subtypes of Test Debts and Technical Debt management activities. This catalog is built based on the results of an empirical study, a literature review and semi-structured interviews conducted with practitioners who perform testing activities on five projects from industry. For the TestDCat evaluation, a case study is conducted in real projects in order to identify if the catalog is user-friendly and if its use helps the Test Debt management during the execution of test activities in these software development projects.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Footnotes
1
GREat stands for Group of Computer Networks, Software Engineering and Systems and works on research and development software projects, developing web and mobile tools that are continually being tested by the GREat Test Factory team.
 
3
Survey applied after conducting the case study - https://​forms.​gle/​4Gn1jqpV9cHmgvcj​8
 
Literature
go back to reference Alves, N. S., Mendes, T. S., de Mendonca, M. G., Spinola, R. O., Shull, F., Seaman, C. (2016). Identification and management of Technical Debt: A systematic mapping study. Information and Software Technology, 70, 100–121.CrossRef Alves, N. S., Mendes, T. S., de Mendonca, M. G., Spinola, R. O., Shull, F., Seaman, C. (2016). Identification and management of Technical Debt: A systematic mapping study. Information and Software Technology, 70, 100–121.CrossRef
go back to reference Andrade, R. M., Lelli, V., Castro, R. N., Santos, I. S. (2017). Fifteen years of industry and academia partnership: lessons learned from a Brazilian research group. In 2017 IEEE/ACM 4th International Workshop on Software Engineering Research and Industrial Practice (SER&IP)(pp. 10-16). IEEE. https://doi.org/10.1109/SER-IP.2017..2. Andrade, R. M., Lelli, V., Castro, R. N., Santos, I. S. (2017). Fifteen years of industry and academia partnership: lessons learned from a Brazilian research group. In 2017 IEEE/ACM 4th International Workshop on Software Engineering Research and Industrial Practice (SER&IP)(pp. 10-16). IEEE. https://​doi.​org/​10.​1109/​SER-IP.​2017.​.​2.
go back to reference Andrade, R. M. C., Santos, I. S., Lelli, V., de Oliveira, K. M. da Rocha, A .R. C. (2017). Software testing process in a test factory - from ad hoc activities to an organizational standard. In ICEIS. Andrade, R. M. C., Santos, I. S., Lelli, V., de Oliveira, K. M. da Rocha, A .R. C. (2017). Software testing process in a test factory - from ad hoc activities to an organizational standard. In ICEIS.
go back to reference Aragão, B. S., de Castro, R. N. S., de Sousa Santos, I., Lelli, V., Andrade, R. M. (2019). Test Debts identification in a test factory. In Proceedings of the XVIII Brazilian Symposium on Software Quality (pp. 296-305). Association for Computing Machinery, New York, USA. https://doi.org/10.1145/3364641.3364676. Aragão, B. S., de Castro, R. N. S., de Sousa Santos, I., Lelli, V., Andrade, R. M. (2019). Test Debts identification in a test factory. In Proceedings of the XVIII Brazilian Symposium on Software Quality (pp. 296-305). Association for Computing Machinery, New York, USA. https://​doi.​org/​10.​1145/​3364641.​3364676.
go back to reference Aragão, B. S., Andrade, R. M. C., Santos, I. S., Castro, R. N. S., Lelli, V., Darin, T. G. R. (2019). Testdcat: Catalog of Test Debt subtypes and management activities. In C. Gaston, N. Kosmatov, P. Le Gall (Eds.) Testing Software and Systems (pp. 279-295). Springer International Publishing, Cham. Aragão, B. S., Andrade, R. M. C., Santos, I. S., Castro, R. N. S., Lelli, V., Darin, T. G. R. (2019). Testdcat: Catalog of Test Debt subtypes and management activities. In C. Gaston, N. Kosmatov, P. Le Gall (Eds.) Testing Software and Systems (pp. 279-295). Springer International Publishing, Cham.
go back to reference Bangor, A., Kortum, P., & Miller, J.A. (2008). The System Usability Scale (SUS): An Empirical Evaluation, International Journal of Human-Computer Interaction, 24(6). Bangor, A., Kortum, P., & Miller, J.A. (2008). The System Usability Scale (SUS): An Empirical Evaluation, International Journal of Human-Computer Interaction, 24(6).
go back to reference Brooke, J. (1996). Sus-a quick and dirty usability scale. Usability evaluation in industry, 189(194), 4–7. Brooke, J. (1996). Sus-a quick and dirty usability scale. Usability evaluation in industry, 189(194), 4–7.
go back to reference Chung, L., Nixon, B. A., Yu, E., Mylopoulos, J. (2012). Non-functional requirements in software engineering (Vol. 5). Springer Science & Business Media. Chung, L., Nixon, B. A., Yu, E., Mylopoulos, J. (2012). Non-functional requirements in software engineering (Vol. 5). Springer Science & Business Media.
go back to reference Fernandes, F., Sousa, S., Lopes, I. D. S. (2013). On the use of quality tools: a case study. In World Congress on Engineering 2013 (Vol. 1, pp. 634-639). Newswood Limited Publisher. Fernandes, F., Sousa, S., Lopes, I. D. S. (2013). On the use of quality tools: a case study. In World Congress on Engineering 2013 (Vol. 1, pp. 634-639). Newswood Limited Publisher.
go back to reference Gorschek, T., Garre, P., Larsson, S., Wohlin, C. (2006). A model for technology transfer in practice. IEEE software, 23(6), 88–95.CrossRef Gorschek, T., Garre, P., Larsson, S., Wohlin, C. (2006). A model for technology transfer in practice. IEEE software, 23(6), 88–95.CrossRef
go back to reference Kruchten, P., Nord, R. L., Ozkaya, I., Visser, J. (2012). Technical Debt in software development: From metaphor to theory report on the third international workshop on managing Technical Debt. SIGSOFT Softw. Eng. Notes, 37(5), 36–38. https://doi.org/10.1145/2347696.2347698. Kruchten, P., Nord, R. L., Ozkaya, I., Visser, J. (2012). Technical Debt in software development: From metaphor to theory report on the third international workshop on managing Technical Debt. SIGSOFT Softw. Eng. Notes, 37(5), 36–38. https://​doi.​org/​10.​1145/​2347696.​2347698.
go back to reference Krueger, R. A., & Casey, M. A. (2002). Designing and conducting focus group interviews. Krueger, R. A., & Casey, M. A. (2002). Designing and conducting focus group interviews.
go back to reference Lazic, L., & Mastorakis, N. (2008). Cost effective software test metrics. WSEAS Transactions on Computers, 7(6), 599–619. Lazic, L., & Mastorakis, N. (2008). Cost effective software test metrics. WSEAS Transactions on Computers, 7(6), 599–619.
go back to reference Li, Z., Avgeriou, P., Liang, P. (2015). A systematic mapping study on Technical Debt and its management. Journal of Systems and Software, 101, 193–220. Li, Z., Avgeriou, P., Liang, P. (2015). A systematic mapping study on Technical Debt and its management. Journal of Systems and Software, 101, 193–220.
go back to reference Runeson, P., & Höst, M. (2009). Guidelines for conducting and reporting case study research in software engineering. Empirical software engineering, 14(2), 131.CrossRef Runeson, P., & Höst, M. (2009). Guidelines for conducting and reporting case study research in software engineering. Empirical software engineering, 14(2), 131.CrossRef
go back to reference Samarthyam, G., Muralidharan, M., & Anna, R. K. (2017). Understanding Test Debt. In Trends in Software Testing (pp. 1-17). Springer. Samarthyam, G., Muralidharan, M., & Anna, R. K. (2017). Understanding Test Debt. In Trends in Software Testing (pp. 1-17). Springer.
go back to reference Shah, S. M. A., Torchiano, M., Vetro, A., Morisio, M. (2014). Exploratory testing as a source of Technical Debt. IT Professional, 16(3), 44–51. Shah, S. M. A., Torchiano, M., Vetro, A., Morisio, M. (2014). Exploratory testing as a source of Technical Debt. IT Professional, 16(3), 44–51.
go back to reference Sousa, C. L. D. (2016). Mapa de apoio à gestão de divida tècnica no processo de teste de software. Master thesis, Universidade Federal de Pernambuco. Sousa, C. L. D. (2016). Mapa de apoio à gestão de divida tècnica no processo de teste de software. Master thesis, Universidade Federal de Pernambuco.
go back to reference Standard, I. (1998). Ergonomic requirements for office work with visual display terminals (VDTs) part 11: Guidance on usability. iso standard 9241-11:1998. International Organization for Standardization. Standard, I. (1998). Ergonomic requirements for office work with visual display terminals (VDTs) part 11: Guidance on usability. iso standard 9241-11:1998. International Organization for Standardization.
go back to reference Wiklund, K., Eldh, S., Sundmark, D., Lundqvist, K. (2017). Impediments for software test au- tomation: A systematic literature review. Software Testing, Verification and Reliability, 27(8). Wiklund, K., Eldh, S., Sundmark, D., Lundqvist, K. (2017). Impediments for software test au- tomation: A systematic literature review. Software Testing, Verification and Reliability, 27(8).
go back to reference Wohlin, C., Runeson, P., Hst, M., Ohlsson, M. C., Regnell, B., Wessln, A. (2012). Experimentation in Software Engineering. Incorporated: Springer Publishing Company.CrossRef Wohlin, C., Runeson, P., Hst, M., Ohlsson, M. C., Regnell, B., Wessln, A. (2012). Experimentation in Software Engineering. Incorporated: Springer Publishing Company.CrossRef
Metadata
Title
TestDCat 3.0: catalog of test debt subtypes and management activities
Authors
Bruno S. Aragão
Rossana M. C. Andrade
Ismayle S. Santos
Rute N. S. Castro
Valéria Lelli
Ticianne G. R. Darin
Publication date
17-01-2021
Publisher
Springer US
Published in
Software Quality Journal / Issue 1/2022
Print ISSN: 0963-9314
Electronic ISSN: 1573-1367
DOI
https://doi.org/10.1007/s11219-020-09533-y

Other articles of this Issue 1/2022

Software Quality Journal 1/2022 Go to the issue

EditorialNotes

Editorial

Premium Partner