skip to main content
10.1145/1755913.1755925acmconferencesArticle/Chapter ViewAbstractPublication PageseurosysConference Proceedingsconference-collections
research-article

Splitter: a proxy-based approach for post-migration testing of web applications

Published:13 April 2010Publication History

ABSTRACT

The benefits of virtualized IT environments, such as compute clouds, have drawn interested enterprises to migrate their applications onto new platforms to gain the advantages of reduced hardware and energy costs, increased flexibility and deployment speed, and reduced management complexity. However, the process of migrating a complex application takes a considerable amount of effort, particularly when performing post-migration testing to verify that the application still functions correctly in the target environment. The traditional approach of test case generation and execution can take weeks and synthetic test cases may not adequately reflect actual application usage.

In this paper, we propose and evaluate a black-box approach for post-migration testing of Web applications without manually creating test cases. A Web proxy is put in front of the production application to intercept all requests from real users, and these requests are simultaneously sent to the production and migrated applications. Results generated by both applications are then compared, and mismatches due to migration problems can be easily detected and presented to testing teams for resolution. We implement this approach in Splitter, a software module that is deployed as a reverse Web proxy. Through our evaluation using a number of real applications, we show that it Splitter can effectively automate post-migration testing while also reduce the number of mismatches that must be manually inspected. Equally important, it imposes a relatively small performance overhead on the production environment.

References

  1. AlertSite. Dejaclick by AlertSite. http://www.dejaclick.com.Google ScholarGoogle Scholar
  2. Michael Benedikt, Juliana Freire, and Patrice Godefroid. VeriWeb: Automatically testing dynamic Web sites. In WWW '02, 2002.Google ScholarGoogle Scholar
  3. BMC Software Inc. BMC discovery. http://www.bmc.com/products/offering/bmc-discovery.html.Google ScholarGoogle Scholar
  4. Miguel Castro and Barbara Liskov. Practical byzantine fault tolerance. In OSDI '99, pages 173--186, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Sudarshan S. Chawathe, Anand Rajaraman, Hector Garcia-Molina, and Jennifer Widom. Change detection in hierarchically structured information. SIGMOD Rec., 25 (2): 493--504, 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Gregory Cobena, Serge Abiteboul, and Amelie Marian. Detecting changes in XML documents. In ICDE '02, 2002.Google ScholarGoogle ScholarCross RefCross Ref
  7. Sebastian Elbaum, Srikanth Karre, and Gregg Rothermel. Improving web application testing with user session data. In ICSE '03, pages 49--59, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Indrani Ghatare. Using WebSphere DataStage with ibm DataMirror change data capture. http://www.ibm.com /developerworks/edu/dm-dw-dm-0805ghatare-i.html.Google ScholarGoogle Scholar
  9. Hayes 2008 Brian Hayes. Cloud computing. Commun. ACM, 51 (7): 9--11, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. IBM. Tivoli application dependency discovery manager. http://www-01.ibm.com/software/tivoli/products/taddm/.Google ScholarGoogle Scholar
  11. IBM. Tivoli provisioning manager. http://www.ibm.com/software/tivoli/products/prov-mgr/.Google ScholarGoogle Scholar
  12. Imad Khoury, Rami M. El-Mawas, Oussama El-Rawas, Elias F. Mounayar, and Hassan Artail. An efficient Web page change detection system based on an optimized hungarian algorithm. IEEE TKDE, 19 (5): 599--613, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Erwin Leonardi and Sourav S. Bhowmick. Detecting changes on unordered \mboxXML documents using relational databases: a schema-conscious approach. In CIKM '05, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Giuseppe A. Di Lucca, Anna Rita Fasolino, Francesco Faralli, and Ugo de Carlini. Testing Web applications. In ICSM '02, pages 310--319, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Morris Marden. An architectural evaluation of java TPC-W. In HPCA '01, page 229, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Kiran Nagaraja, Fábio Oliveira, Ricardo Bianchini, Richard P. Martin, and Thu D. Nguyen. Understanding and dealing with operator mistakes in internet services. In OSDI'04, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Novell Inc. PlateSpin migrate. http://www.novell.com/products/migrate/.Google ScholarGoogle Scholar
  18. D. Ohst, M. Welle, and U. Kelter. Difference tools for analysis and design documents. In ICSM '03, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Fábio Oliveira, Kiran Nagaraja, Rekha Bachwani, Ricardo Bianchini, Richard P. Martin, and Thu D. Nguyen. Understanding and validating database system administration. In USENIX'06, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Filippo Ricca and Paolo Tonella. Analysis and testing of Web applications. In ICSE '01, pages 25--34, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Sreedevi Sampath, Valentin Mihaylov, Amie Souter, and Lori Pollock. Composing a framework to automate testing of operational Web-based software. In ICSM '04, Washington, DC, USA, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Squid Developers. Squid proxy cache. http://www.squid-cache.org/.Google ScholarGoogle Scholar
  23. Y. Wang, D.J. DeWitt, and J.-Y. Cai. X-Diff: an effective change detection algorithm for XML documents. In ICDE '03, pages 519--530, 2003.Google ScholarGoogle ScholarCross RefCross Ref
  24. A. Williams, M. Arlitt, C. Williamson, and K. Barker. Web workload characterization: Ten years later. In Web Content Delivery, pages 3--21. Springer, 2005.Google ScholarGoogle ScholarCross RefCross Ref
  25. Lauren Wood, Vidur Apparao, Steve Byrne, Mike Champion, and Scott Isaacs. Document object model (DOM) level 1 specification (second edition), 2000. http://www.w3.org/TR/2000/WD-DOM-Level-1-20000929/.Google ScholarGoogle Scholar
  26. Ian T. Young. Proof without prejudice: use of the kolmogorov-smirnov test for the analysis of histograms from flow systems and other sources. The Journal of Histochemistry and Cytochemistry, 25 (7): 935--941, 1977.Google ScholarGoogle ScholarCross RefCross Ref
  27. Wei Zheng, Ricardo Bianchini, G. John Janakiraman, J. Renato Santos, and Yoshio Turner. JustRunIt: Experiment-based management of virtualized data centers. In USENIX'09, June 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Splitter: a proxy-based approach for post-migration testing of web applications

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in
            • Published in

              cover image ACM Conferences
              EuroSys '10: Proceedings of the 5th European conference on Computer systems
              April 2010
              388 pages
              ISBN:9781605585772
              DOI:10.1145/1755913

              Copyright © 2010 ACM

              Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 13 April 2010

              Permissions

              Request permissions about this article.

              Request Permissions

              Check for updates

              Qualifiers

              • research-article

              Acceptance Rates

              Overall Acceptance Rate241of1,308submissions,18%

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader