George Candea
Stefan Bucur
Cristian Zamfir
ABSTRACT
This paper makes the case for TaaS--automated software testing as a cloud-based service. We present three kinds of TaaS: a "programmer's sidekick" enabling developers to thoroughly and promptly test their code with minimal upfront resource investment; a "home edition" on-demand testing service for consumers to verify the software they are about to install on their PC or mobile device; and a public "certification service," akin to Underwriters Labs, that independently assesses the reliability, safety, and security of software.
TaaS automatically tests software, without human involvement from the service user's or provider's side. This is unlike today's "testing as a service" businesses, which employ humans to write tests. Our goal is to take recently proposed techniques for automated testing--even if usable only on to y programs--and make them practical by modifying them to harness the resources of compute clouds. Preliminary work suggests it is technically feasible to do so, and we find that TaaS is also compelling from a social and business point of view.
- C. Cadar, D. Dunbar, and D. R. Engler. KLEE: Unassisted and automatic generation of high-coverage tests for complex systems programs. In Symp. on Operating Systems Design and Implementation, 2008. Google Scholar
Digital Library
- C. Cadar, V. Ganesh, P. M. Pawlowski, D. L. Dill, and D. R. Engler. EXE: Automatically generating inputs of death. In Conf. on Computer and Communication Security, 2006. Google ScholarDigital Library
- L. Ciortea, C. Zamfir, S. Bucur, V. Chipounov, and G. Candea. Cloud9: A software testing service. In Workshop on Large Scale Distributed Systems and Middleware, 2009.Google Scholar
- P. Godefroid, N. Klarlund, and K. Sen. DART: Directed automated random testing. In Conf. on Programming Language Design and Implementation, 2005. Google ScholarDigital Library
- P. Godefroid, M. Y. Levin, and D. Molnar. Automated whitebox fuzz testing. Technical Report MSR-TR-2007-58, Microsoft Research, 2007.Google Scholar
- P. Godefroid, M. Y. Levin, and D. Molnar. Automated Whitebox Fuzz Testing. In Network and Distributed System Security Symp., 2008.Google Scholar
- Google Knol. http://knol.google.com.Google Scholar
- P. J. Guo and D. Engler. Linux kernel developer responses to static analysis bug reports. In USENIX Annual Technical Conf., 2009. Google ScholarDigital Library
- G. J. Holzmann and D. Bosnacki. Multi-core model checking with SPIN. In Intl. Parallel and Distributed Processing Symp., 2007.Google ScholarCross Ref
- J. C. King. Symbolic execution and program testing. Communications of the ACM, 1976. Google ScholarDigital Library
- V. Kuznetsov, V. Chipounov, and G. Candea. Testing closed-source binary device drivers with DDT. In USENIX Annual Technical Conf., 2010. Google ScholarDigital Library
- R. Majumdar and K. Sen. Hybrid concolic testing. In Intl. Conf. on Software Engineering, 2007. Google ScholarDigital Library
- S. McConnell. Code Complete. Microsoft Press, 2004.Google Scholar
- Microsoft. Driver verifier. http://www.microsoft.com/whdc/DevTools/tools, 2009.Google Scholar
- S. Misailovic, A. Milicevic, N. Petrovic, S. Khurshid, and D. Marinov. Parallel test generation and execution with Korat. In Symp. on the Foundations of Software Eng., 2007. Google ScholarDigital Library
- Redhat security. http://www.redhat.com/security/updates/classification, 2005.Google Scholar
- D. Saff and M. D. Ernst. Reducing wasted development time via continuous testing. In Intl. Symp. on Software Reliability Engineering, 2003. Google ScholarDigital Library
- C. Zamfir and G. Candea. Execution synthesis: A technique for automated debugging. In EUROSYS Conf., 2010. Google ScholarDigital Library
Index Terms
- Automated software testing as a service
Recommendations
Test as a Service: A Framework for Web Security TaaS Service in Cloud Environment
SOSE '14: Proceedings of the 2014 IEEE 8th International Symposium on Service Oriented System EngineeringAs its name suggests, cloud testing is a form of software testing which uses cloud infrastructure. Its effective unlimited storage, quick availability of the infrastructure with scalability, flexibility and availability of distributed testing ...
Automated Mobile Testing as a Service (AM-TaaS)
SERVICES '15: Proceedings of the 2015 IEEE World Congress on ServicesDue high popularization of cloud services and the use of a wide range of mobile devices with different environments and platforms, a new model to offer software test service emerged, called Testing as a Service (TaaS). It uses cloud infrastructure to ...
The Study on an Intelligent General-Purpose Automated Software Testing Suite
ICICTA '10: Proceedings of the 2010 International Conference on Intelligent Computation Technology and Automation - Volume 03To make the labor intensive manual software testing automated, we present the design and implementation of an intelligent general-purpose automated software testing suite. With the two main tools in the suite: an automated software testing scheduler, ...
Comments