Skip to main content
SpringerLink
Log in

Towards virtualized and automated software performance test architecture

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this paper, we propose the towards virtualized and automated software performance test architecture. In general, test engineers use the public performance testwares such as Load Runner, Silk Performer to validate the performance efficiency of their own systems. In case that they do not allowed to use the performance testwares due to the technical limitations in the testwares, most testers should perform the testing in manually. According to the waste of computer and human resources resulted from the situation, we need to propose the test automation scheme by using the virtualization technology to prevent the dissipation in the test environment which has limited resources. The system architecture considered efficient usage of computer resources and test automation to reduce human acts are addressed mainly in this paper. we describe our proposed method which deals with the system architecture and test automation procedures. In our system architecture, we will show how to use the virtual machines and the types of the virtual machines for performance measurement. In addition, the six steps of the test automation are introduced for the automated testing procedures. Finally, a number of experiments show that the proposed schemes allow offering the possibility for automated software performance testing by using the virtualization.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Balsamo S, Di Marco A, Inverardi P, Simeoni M (2004) Model-based performance prediction in software development: a survey. IEEE Trans Softw Eng 30(5):295–310

    Article  Google Scholar 

  2. Banga G, Druschel P (1999) Measuring the capacity of a Web server under realistic loads. World Wide Web 2(1):69–83

    Article  Google Scholar 

  3. Barber S (2004) User community modeling language (UCML 1.1™) for performance test workloads. Rational Developer Network

  4. Barford P, Crovella M (1998, June) Generating representative web workloads for network and server performance evaluation. In: ACM SIGMETRICS performance evaluation review (vol. 26, no. 1, pp. 151–160). ACM

  5. Chung KY (2013) Effect of facial makeup style recommendation on visual sensibility. Multimed Tools Appl. doi:10.1007/s11042-013-1355-6

    Google Scholar 

  6. Chung L, do Prado Leite J (2009) On non-functional requirements in software engineering. Concept Model Found Appl 363–379

  7. Compuware, “applied performance management survey”, Oct, 2006

  8. http://en.wikipedia.org/wiki/Virtualization

  9. http://www.borland.com/us/products/silk/silkperformer/index.html

  10. http://www.microsoft.com/resources/documentation/windows/xp/all/proddocs/en-us/nt_command_perfmon.mspx?mfr=true

  11. http://www.microsoft.com/Windows/products/winfamily/virtualpc/default.mspx

  12. http://www.parallels.com/

  13. http://www.teamquest.com/

  14. http://www.virtualbox.org/

  15. http://www.vmware.com/

  16. http://www.vmware.com/products/vsphere/esxi-and-esx/index.html

  17. http://www.vmware.com/products/workstation/

  18. https://h10078.www1.hp.com/cda/hpms/display/main/hpms_content.jsp?zn=bto&cp=1-11-126-17%5E8_4000_100__

  19. Jung YG, Han MS, Chung KY, Lee SJ (2011) A study of a valid frequency range using correlation analysis of throat signal. Inf Int Interdisc J 14(11):3791–3799

    Google Scholar 

  20. Kim SH, Chung KY (2013) 3D simulator for stability analysis of finite slope causing plane activity. Multimed Tools Appl. doi:10.1007/s11042-013-1356-5

    Google Scholar 

  21. Kim JH, Chung KY (2013) Ontology-based healthcare context information model to implement ubiquitous environment. Multimed Tools Appl. doi:10.1007/s11042-011-0919-6

    Google Scholar 

  22. Kim GH, Kim YG, Shin SK (2012) Software performance test automation by using the virtualization, Proc. of the 2th International Conference IT Convergence and Security 2012, LNEE 215, pp. 35–42, Springer

  23. Kim JH, Lee D, Chung KY (2013) Item recommendation based on context-aware model for personalized u-healthcare service. Multimed Tools Appl. doi:10.1007/s11042-011-0920-0

    Google Scholar 

  24. Lee H (2008) Server virtualization overview and related solution areas. Commun Korean Inst Inf Sci Eng 26(10):5–13

    Google Scholar 

  25. Lee KD, Nam MY, Chung KY, Lee YH, Kang UG (2013) Context and profile based cascade classifier for efficient people detection and safety care system. Multimed Tools Appl 63(1):27–44

    Article  Google Scholar 

  26. Li P (2010) Selecting and using virtualization solutions: our experiences with VMware and VirtualBox. J Comput Sci Coll 25(3):11–17

    MATH  Google Scholar 

  27. Mosberger D, Jin T (1998) httperf—a tool for measuring web server performance. ACM SIGMETRICS Perform Eval Rev 26(3):31–37

    Article  Google Scholar 

  28. Song CW, Chung KY, Jung JJ, Rim KW, Lee JH (2011) Localized approximation method using inertial compensation in WSNs. Inf Int Interdisc J 14(11):3591–3600

    Google Scholar 

  29. Song CW, Lee D, Chung KY, Rim KW, Lee JH (2013) Interactive middleware architecture for lifelog based context awareness. Multimed Tools Appl. doi:10.1007/s11042-013-1362-7

    Google Scholar 

  30. Turban E, King D, Lee J, Viehland D (2008) Chapter 19: building E-commerce applications and infrastructure. Electronic Commerce A Managerial Perspective (5th ed.). Prentice-Hall, 27

  31. Woodside M, Franks G, Petriu DC (2007, May) The future of software performance engineering. In: Future of software engineering, 2007. FOSE’07 (pp. 171-187). IEEE

  32. Younge AJ, Henschel R, Brown JT, von Laszewski G, Qiu J, Fox GC (2011, July) Analysis of virtualization technologies for high performance computing environments. In: Cloud computing (CLOUD), 2011 IEEE International Conference on (pp. 9–16). IEEE

  33. Zheng G, Wilmarth T, Jagadishprasad P, Kalé LV (2005) Simulation-based performance prediction for large parallel machines. Int J Parallel Prog 33(2):183–207

    Article  Google Scholar 

Download references

Acknowledgment

This research was supported by Basic Science Research Program through the National Research Foundation of Korea funded by the Ministry of Education, Science and Technology (No. 2012-0004478).

Author information

Authors and Affiliations

  1. Software Testing & Certification Laboratory, Telecommunications Technology Association (TTA), 267-2, Seohyeon-dong, Bundang-gu, Seongnam-si, Gyonggi-do, 463-824, Korea

    Gwang-Hun Kim

  2. Defense Avionics Technology Center, Agency for Defense Development (ADD), Yuseong-gu, P.O.Box 35, Daejeon-si, Chungcheonnam-do, 305-600, Korea

    Yeon-Gyun Kim

  3. School of Computer Information Engineering, Sangji University, Usan-dong, Wonju-si, Gangwon-do, 220-702, Korea

    Kyung-Yong Chung

Authors
  1. Gwang-Hun Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yeon-Gyun Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kyung-Yong Chung
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kyung-Yong Chung.

Additional information

This paper is significantly revised from an earlier version presented at the International Conference IT Convergence and Security.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kim, GH., Kim, YG. & Chung, KY. Towards virtualized and automated software performance test architecture. Multimed Tools Appl 74, 8745–8759 (2015). https://doi.org/10.1007/s11042-013-1536-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-013-1536-3

Keywords

Search

Navigation