Ivan T. Bowman
Kenneth Salem
ABSTRACT
Streams of relational queries submitted by client applications to database servers contain patterns that can be used to predict future requests. We present the Scalpel system, which detects these patterns and optimizes request streams using context-based predictions of future requests. Scalpel uses its predictions to provide a form of semantic prefetching, which involves combining a predicted series of requests into a single request that can be issued immediately. Scalpel's semantic prefetching reduces not only the latency experienced by the application but also the total cost of query evaluation. We describe how Scalpel learns to predict optimizable request patterns by observing the application's request stream during a training phase. We also describe the types of query pattern rewrites that Scalpel's cost-based optimizer considers. Finally, we present empirical results that show the costs and benefits of Scalpel's optimizations.
- P. A. Bernstein, S. Pal, and D. Shutt. Context-based prefetch for implementing objects on relations. In VLDB, 1999. Google Scholar
Digital Library
- L. Fegaras and D. Maier. Optimizing object queries using an effective calculus. TODS, 25(4), 2000. Google ScholarDigital Library
- M. F. Fernández, A. Morishima, and D. Suciu. Efficient evaluation of XML middle-ware queries. In SIGMOD, 2001. Google ScholarDigital Library
- D. Florescu, A. Y. Levy, D. Suciu, and K. Yagoub. Optimization of run-time management of data intensive web-sites. In VLDB, pages 627--638, 1999. Google ScholarDigital Library
- International Standards Organization. Database language SQL---Part 2: Foundation (SQL / Foundation). ISO/IEC 9075-2:1999, Sept. 1999.Google Scholar
- T. Mayr and P. Seshadri. Client-site query extensions. In SIGMOD, 1999. Google ScholarDigital Library
- T. K. Sellis. Multiple-query optimization. TODS, 13(1):23--52, 1988. Google ScholarDigital Library
- P. Seshadri, H. Pirahesh, and T. Y. C. Leung. Complex query decorrelation. In ICDE, Feb. 1996. Google ScholarDigital Library
- J. Shanmugasundaram, E. J. Shekita, R. Barr, M. J. Carey, B. G. Lindsay, H. Pirahesh, and B. Reinwald. Efficiently publishing relational data as XML documents. VLDB Journal, 10(2--3), 2001. Google ScholarDigital Library
- Optimization of query streams using semantic prefetching
Recommendations
Optimization of query streams using semantic prefetching
Special Issue: SIGMOD/PODS 2004Streams of relational queries submitted by client applications to database servers contain patterns that can be used to predict future requests. We present the Scalpel system, which detects these patterns and optimizes request streams using context-...
Stealth prefetching
Proceedings of the 2006 ASPLOS ConferencePrefetching in shared-memory multiprocessor systems is an increasingly difficult problem. As system designs grow to incorporate larger numbers of faster processors, memory latency and interconnect traffic increase. While aggressive prefetching ...
Comments