Skip to main content
Erschienen in: The VLDB Journal 1/2017

18.08.2016 | Special Issue Paper

Multi-objective parametric query optimization

verfasst von: Immanuel Trummer, Christoph Koch

Erschienen in: The VLDB Journal | Ausgabe 1/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Classical query optimization compares query plans according to one cost metric and associates each plan with a constant cost value. In this paper, we introduce the multi-objective parametric query optimization (MPQO) problem where query plans are compared according to multiple cost metrics and the cost of a given plan according to a given metric is modeled as a function that depends on multiple parameters. The cost metrics may, for instance, include execution time or monetary fees; a parameter may represent the selectivity of a query predicate that is unspecified at optimization time. MPQO generalizes parametric query optimization (which allows multiple parameters but only one cost metric) and multi-objective query optimization (which allows multiple cost metrics but no parameters). We formally analyze the novel MPQO problem and show why existing algorithms are inapplicable. We present a generic algorithm for MPQO and a specialized version for MPQO with piecewise-linear plan cost functions. We prove that both algorithms find all relevant query plans and experimentally evaluate the performance of our second algorithm in multiple scenarios.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
To simplify the pseudo-code, we made the strong assumption that the cost function of the final join is always linear in parameter space regions in which the cost functions of the two sub-plans are linear. This is not true in general, but the code can easily be generalized by first accumulating the cost of the sub-plans, and then accumulating the resulting cost and the join cost in a second step.
 
Literatur
1.
Zurück zum Zitat Abhirama, M., Bhaumik, S., Dey, A.: On the stability of plan costs and the costs of plan stability. VLDB 3(1), 1137–1148 (2010) Abhirama, M., Bhaumik, S., Dey, A.: On the stability of plan costs and the costs of plan stability. VLDB 3(1), 1137–1148 (2010)
2.
Zurück zum Zitat Abul-Basher, Z., Feng, Y., Godfrey, P.: Alternative query optimization for workload management. In: Database and Expert Systems Applications (2012) Abul-Basher, Z., Feng, Y., Godfrey, P.: Alternative query optimization for workload management. In: Database and Expert Systems Applications (2012)
3.
Zurück zum Zitat Agarwal, S., Iyer, A., Panda, A.: Blink and it’s done: interactive queries on very large data. VLDB 5, 1902–1905 (2012) Agarwal, S., Iyer, A., Panda, A.: Blink and it’s done: interactive queries on very large data. VLDB 5, 1902–1905 (2012)
4.
Zurück zum Zitat Babcock, B., Chaudhuri, S.: Towards a robust query optimizer: a principled and practical approach. In: SIGMOD, pp. 119–130 (2005) Babcock, B., Chaudhuri, S.: Towards a robust query optimizer: a principled and practical approach. In: SIGMOD, pp. 119–130 (2005)
5.
Zurück zum Zitat Babu, S., Bizarro, P., DeWitt, D.: Proactive re-optimization. In: SIGMOD, pp. 107–118, New York, New York, USA, ACM Press (2005) Babu, S., Bizarro, P., DeWitt, D.: Proactive re-optimization. In: SIGMOD, pp. 107–118, New York, New York, USA, ACM Press (2005)
6.
Zurück zum Zitat Bemporad, A., Fukuda, K., Torrisi, F.: Convexity recognition of the union of polyhedra. Comput. Geom. 18(3), 141–154 (2001)MathSciNetCrossRefMATH Bemporad, A., Fukuda, K., Torrisi, F.: Convexity recognition of the union of polyhedra. Comput. Geom. 18(3), 141–154 (2001)MathSciNetCrossRefMATH
7.
Zurück zum Zitat Bizarro, P., Bruno, N., DeWitt, D.: Progressive parametric query optimization. KDE 21(4), 582–594 (2009) Bizarro, P., Bruno, N., DeWitt, D.: Progressive parametric query optimization. KDE 21(4), 582–594 (2009)
8.
Zurück zum Zitat Bruno, N.: Polynomial heuristics for query optimization. In: ICDE, pp. 589–600 (2010) Bruno, N.: Polynomial heuristics for query optimization. In: ICDE, pp. 589–600 (2010)
9.
Zurück zum Zitat Bruno, N., Nehme, R.V.: Configuration-parametric query optimization for physical design tuning. SIGMOD (2008) Bruno, N., Nehme, R.V.: Configuration-parametric query optimization for physical design tuning. SIGMOD (2008)
10.
Zurück zum Zitat Chaudhuri, S., Dalvi, N., Kaushik, R.: Robust cardinality and cost estimation for skyline operator. In: ICDE, pp. 64–73 (2006) Chaudhuri, S., Dalvi, N., Kaushik, R.: Robust cardinality and cost estimation for skyline operator. In: ICDE, pp. 64–73 (2006)
11.
Zurück zum Zitat Chu, F., Halpern, J., Gehrke, J.: Least expected cost query optimization: what can we expect? SIGMOD (2002) Chu, F., Halpern, J., Gehrke, J.: Least expected cost query optimization: what can we expect? SIGMOD (2002)
12.
Zurück zum Zitat Cole, R., Graefe, G.: Optimization of dynamic query evaluation plans. In: SIGMOD, pp. 150–160 (1994) Cole, R., Graefe, G.: Optimization of dynamic query evaluation plans. In: SIGMOD, pp. 150–160 (1994)
13.
Zurück zum Zitat Dey, A., Bhaumik, S., Haritsa, J.: Efficiently approximating query optimizer plan diagrams. In: VLDB, pp. 1325–1336 (2008) Dey, A., Bhaumik, S., Haritsa, J.: Efficiently approximating query optimizer plan diagrams. In: VLDB, pp. 1325–1336 (2008)
14.
Zurück zum Zitat Ganguly, S.: Design and analysis of parametric query optimization algorithms. In: VLDB, pp. 228–238 (1998) Ganguly, S.: Design and analysis of parametric query optimization algorithms. In: VLDB, pp. 228–238 (1998)
15.
Zurück zum Zitat Ganguly, S., Hasan, W., Krishnamurthy, R.: Query optimization for parallel execution. In: SIGMOD, pp. 9–18 (1992) Ganguly, S., Hasan, W., Krishnamurthy, R.: Query optimization for parallel execution. In: SIGMOD, pp. 9–18 (1992)
16.
Zurück zum Zitat Garofalakis, M., Ioannidis, Y.: Multi-dimensional resource scheduling for parallel queries. In: SIGMOD (1996) Garofalakis, M., Ioannidis, Y.: Multi-dimensional resource scheduling for parallel queries. In: SIGMOD (1996)
17.
Zurück zum Zitat Graefe, G., Ward, K.: Dynamic query evaluation plans. In: SIGMOD, pp. 358–366 (1989) Graefe, G., Ward, K.: Dynamic query evaluation plans. In: SIGMOD, pp. 358–366 (1989)
18.
Zurück zum Zitat Hulgeri, A., Sudarshan, S.: Parametric query optimization for linear and piecewise linear cost functions. In: VLDB, pp. 167–178 (2002) Hulgeri, A., Sudarshan, S.: Parametric query optimization for linear and piecewise linear cost functions. In: VLDB, pp. 167–178 (2002)
19.
Zurück zum Zitat Hulgeri, A., Sudarshan, S.: AniPQO: almost non-intrusive parametric query optimization for nonlinear cost functions. In: VLDB, pp. 766–777 (2003) Hulgeri, A., Sudarshan, S.: AniPQO: almost non-intrusive parametric query optimization for nonlinear cost functions. In: VLDB, pp. 766–777 (2003)
20.
Zurück zum Zitat Ioannidis, Y.E., Ng, R.T., Shim, K., Sellis, T.K.: Parametric query optimization. VLDBJ 6(2), 132–151 (1997)CrossRef Ioannidis, Y.E., Ng, R.T., Shim, K., Sellis, T.K.: Parametric query optimization. VLDBJ 6(2), 132–151 (1997)CrossRef
21.
Zurück zum Zitat Kaibel, V., Pfetsch, M.: Some algorithmic problems in polytope theory. Algebra, Geometry and Software Systems 1 (2003) Kaibel, V., Pfetsch, M.: Some algorithmic problems in polytope theory. Algebra, Geometry and Software Systems 1 (2003)
22.
Zurück zum Zitat Kambhampati, S., Nambiar, U., Nie, Z., Vaddi, S.: Havasu: A multi-objective. Adaptive Query Processing Framework for Web Data Integration, ASU CSE (2002) Kambhampati, S., Nambiar, U., Nie, Z., Vaddi, S.: Havasu: A multi-objective. Adaptive Query Processing Framework for Web Data Integration, ASU CSE (2002)
23.
Zurück zum Zitat Kllapi, H., Sitaridi, E., Tsangaris, M.M., Ioannidis, Y.E.: Schedule optimization for data processing flows on the cloud. In: SIGMOD, (2011) Kllapi, H., Sitaridi, E., Tsangaris, M.M., Ioannidis, Y.E.: Schedule optimization for data processing flows on the cloud. In: SIGMOD, (2011)
24.
Zurück zum Zitat Muralikrishna, M.: Improved unnesting algorithms for join aggregate SQL queries. VLDB, pp. 91–102 (1992) Muralikrishna, M.: Improved unnesting algorithms for join aggregate SQL queries. VLDB, pp. 91–102 (1992)
25.
Zurück zum Zitat Ono, K., Lohman, G.: Measuring the complexity of join enumeration in query optimization. In: VLDB, pp. 314–325 (1990) Ono, K., Lohman, G.: Measuring the complexity of join enumeration in query optimization. In: VLDB, pp. 314–325 (1990)
26.
Zurück zum Zitat Papadimitriou, C., Yannakakis, M.: Multiobjective query optimization. In: PODS, pp. 52–59 (2001) Papadimitriou, C., Yannakakis, M.: Multiobjective query optimization. In: PODS, pp. 52–59 (2001)
27.
Zurück zum Zitat Reddy, N., Haritsa, J.: Analyzing plan diagrams of database query optimizers. VLDB, pp. 1228–1239 (2005) Reddy, N., Haritsa, J.: Analyzing plan diagrams of database query optimizers. VLDB, pp. 1228–1239 (2005)
28.
Zurück zum Zitat Selinger, P.G., Astrahan, M.M., Chamberlin, D.D., Lorie, R.A., Price, T.G.: Access path selection in a relational database management system. In: SIGMOD, pp. 23–34 (1979) Selinger, P.G., Astrahan, M.M., Chamberlin, D.D., Lorie, R.A., Price, T.G.: Access path selection in a relational database management system. In: SIGMOD, pp. 23–34 (1979)
29.
Zurück zum Zitat Shang, H., Kitsuregawa, M.: Parametric query optimization. VLDB 6(9), 649–660 (2013) Shang, H., Kitsuregawa, M.: Parametric query optimization. VLDB 6(9), 649–660 (2013)
30.
Zurück zum Zitat Simitsis, A., Vassiliadis, P., Sellis, T.: State-space optimization of ETL workflows. Trans. KDE 17(10), 1404–1419 (2005) Simitsis, A., Vassiliadis, P., Sellis, T.: State-space optimization of ETL workflows. Trans. KDE 17(10), 1404–1419 (2005)
31.
Zurück zum Zitat Simitsis, A., Wilkinson, K., Castellanos, M., Dayal, U.: Optimizing analytic data flows for multiple execution engines. SIGMOD (2012) Simitsis, A., Wilkinson, K., Castellanos, M., Dayal, U.: Optimizing analytic data flows for multiple execution engines. SIGMOD (2012)
32.
Zurück zum Zitat Steinbrunn, M., Moerkotte, G., Kemper, A.: Heuristic and randomized optimization for the join ordering problem. VLDB J. 6(3), 191–208 (1997)CrossRef Steinbrunn, M., Moerkotte, G., Kemper, A.: Heuristic and randomized optimization for the join ordering problem. VLDB J. 6(3), 191–208 (1997)CrossRef
33.
Zurück zum Zitat Trummer, I., Koch, C.: Approximation schemes for many-objective query optimization. In: SIGMOD, pp. 1299–1310 (2014) Trummer, I., Koch, C.: Approximation schemes for many-objective query optimization. In: SIGMOD, pp. 1299–1310 (2014)
34.
Zurück zum Zitat Trummer, I., Koch, C.: Multi-objective parametric query optimization. VLDB 8(3), 221–232 (2015) Trummer, I., Koch, C.: Multi-objective parametric query optimization. VLDB 8(3), 221–232 (2015)
35.
Zurück zum Zitat Xu, Z., Tu, Y.C., Wang, X.: PET: reducing database energy cost via query optimization. VLDB 5(12), 1954–1957 (2012) Xu, Z., Tu, Y.C., Wang, X.: PET: reducing database energy cost via query optimization. VLDB 5(12), 1954–1957 (2012)
Metadaten
Titel
Multi-objective parametric query optimization
verfasst von
Immanuel Trummer
Christoph Koch
Publikationsdatum
18.08.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
The VLDB Journal / Ausgabe 1/2017
Print ISSN: 1066-8888
Elektronische ISSN: 0949-877X
DOI
https://doi.org/10.1007/s00778-016-0439-0

Weitere Artikel der Ausgabe 1/2017

The VLDB Journal 1/2017 Zur Ausgabe