Skip to main content

2010 | OriginalPaper | Buchkapitel

16. A Bayesian Method of Online Automatic Tuning

verfasst von : Reiji Suda

Erschienen in: Software Automatic Tuning

Verlag: Springer New York

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This chapter discusses mathematical methods for online automatic tuning. After formulating the abstract model of automatic tuning, we review the proposed method, which comprises several novel concepts of automatic tuning, such as online automatic tuning, Bayesian data analysis for quantitative treatments of uncertainties, Bayesian suboptimal sequential experimental design, asymptotic optimality, finite startup, and infinite dilution. Experimental results reveal that the Bayesian sequential experimental design has advantages over random sampling, although random sampling combined with an accurate cost function model can be as good as the Bayesian sequential experimental design.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Whaley RC, Dongarra JJ (1998) Automatically tuned linear algebra software. In: Proceedings of SC98 (CD-ROM) Whaley RC, Dongarra JJ (1998) Automatically tuned linear algebra software. In: Proceedings of SC98 (CD-ROM)
2.
Zurück zum Zitat Frigo M, Johnson SG (1998) FFTW: an adaptive software architecture for the FFT. In: Proceedings of ICASSP ’98, vol 3, pp 1381–1384 Frigo M, Johnson SG (1998) FFTW: an adaptive software architecture for the FFT. In: Proceedings of ICASSP ’98, vol 3, pp 1381–1384
3.
Zurück zum Zitat Püschel M et al (2005) SPIRAL: code generation for DSP transforms. Proc. IEEE 93(2):1–42CrossRef Püschel M et al (2005) SPIRAL: code generation for DSP transforms. Proc. IEEE 93(2):1–42CrossRef
4.
Zurück zum Zitat Imamura T (2007) Recursive multi-factoring algorithm for MPI allreduce. In: Proc. IASTED int’l conf. parallel and distributed computing and networks (PDCN 2007), pp (551)135–145 Imamura T (2007) Recursive multi-factoring algorithm for MPI allreduce. In: Proc. IASTED int’l conf. parallel and distributed computing and networks (PDCN 2007), pp (551)135–145
5.
Zurück zum Zitat Katagiri T, Voemel C, Demmel J (2007) Automatic performance tuning for the multi-section with multiple eigenvalues method for the symmetric eigenproblem. In: Selected papers of PARA’06, Lecture Notes in Computer Science, vol 4699. Springer, Berlin, pp 938–948 Katagiri T, Voemel C, Demmel J (2007) Automatic performance tuning for the multi-section with multiple eigenvalues method for the symmetric eigenproblem. In: Selected papers of PARA’06, Lecture Notes in Computer Science, vol 4699. Springer, Berlin, pp 938–948
6.
Zurück zum Zitat Naono K, Sakurai T, Egi M (2008) Research trends on automatic tuning methods for matrix computations and proposal of a new run-time automatic tuning method. In: Int’l workshop on par. mat. alg. appl. (PMAA08) Naono K, Sakurai T, Egi M (2008) Research trends on automatic tuning methods for matrix computations and proposal of a new run-time automatic tuning method. In: Int’l workshop on par. mat. alg. appl. (PMAA08)
7.
Zurück zum Zitat Fukaya T, Yamamoto Y, Zhang S-L (2008) A dynamic programming approach to optimizing the blocking strategy for the householder QR decomposition. In: Proceedings of IEEE international conference on cluster computing 2008 (Proc. int’l workshop on automatic performance tuning (iWAPT2008)), pp 402–410 Fukaya T, Yamamoto Y, Zhang S-L (2008) A dynamic programming approach to optimizing the blocking strategy for the householder QR decomposition. In: Proceedings of IEEE international conference on cluster computing 2008 (Proc. int’l workshop on automatic performance tuning (iWAPT2008)), pp 402–410
8.
Zurück zum Zitat Katagiri T, Kise K, Honda H, Yuba T (2006) ABCLibScript: a directive to support specification of an auto-tuning facility for numerical software. Parallel Comput. 32(1):92–112CrossRef Katagiri T, Kise K, Honda H, Yuba T (2006) ABCLibScript: a directive to support specification of an auto-tuning facility for numerical software. Parallel Comput. 32(1):92–112CrossRef
9.
Zurück zum Zitat Vuduc R, Demmel JW, Bilmes JA (2004) Statistical models for empirical search-based performance tuning. Int. J. High Perform. Comput. Appl. 18(1):65–94CrossRef Vuduc R, Demmel JW, Bilmes JA (2004) Statistical models for empirical search-based performance tuning. Int. J. High Perform. Comput. Appl. 18(1):65–94CrossRef
10.
Zurück zum Zitat Eijkhout V (2006) A self-adapting system for linear solver selection. In: Proc. 1st int’l workshop on automatic performance tuning (iWAPT2006), pp 44–53 Eijkhout V (2006) A self-adapting system for linear solver selection. In: Proc. 1st int’l workshop on automatic performance tuning (iWAPT2006), pp 44–53
11.
Zurück zum Zitat Suda R (2007) A Bayesian method for online code selection: toward efficient and robust methods of automatic tuning. In: Proc. 2nd int’l workshop on automatic performance tuning (iWAPT2007), pp 23–32 Suda R (2007) A Bayesian method for online code selection: toward efficient and robust methods of automatic tuning. In: Proc. 2nd int’l workshop on automatic performance tuning (iWAPT2007), pp 23–32
12.
Zurück zum Zitat Suda R (2008) A Bayesian approach to automatic performance tuning. In: 13th SIAM conf. para. proc. sci. comp. (PP08) (oral presentation) Suda R (2008) A Bayesian approach to automatic performance tuning. In: 13th SIAM conf. para. proc. sci. comp. (PP08) (oral presentation)
13.
Zurück zum Zitat Carlin BP, Louis TA (2000) Bayes and empirical Bayes methods for data analysis, 2nd edn. Chapman and Hall, Boco RatonMATHCrossRef Carlin BP, Louis TA (2000) Bayes and empirical Bayes methods for data analysis, 2nd edn. Chapman and Hall, Boco RatonMATHCrossRef
14.
Zurück zum Zitat Govindarajulu Z (2004) Sequential statistics. World Scientific, SingaporeMATH Govindarajulu Z (2004) Sequential statistics. World Scientific, SingaporeMATH
15.
Zurück zum Zitat Auer P, Cesa-Bianchi N (2002) Fischer P Finite-time analysis of the multi-armed bandit problem. Mach. Learn. 47:235–256MATHCrossRef Auer P, Cesa-Bianchi N (2002) Fischer P Finite-time analysis of the multi-armed bandit problem. Mach. Learn. 47:235–256MATHCrossRef
16.
Zurück zum Zitat Berry DA, Fristedt B (1985) Bandit problem. Chapman and Hall, Boco RatonCrossRef Berry DA, Fristedt B (1985) Bandit problem. Chapman and Hall, Boco RatonCrossRef
17.
Zurück zum Zitat Kubokawa T (2000) Estimation of variance and covariance components in elliptically contoured distributions. J. Japan Stat. Soc. 30:143–176MathSciNetMATH Kubokawa T (2000) Estimation of variance and covariance components in elliptically contoured distributions. J. Japan Stat. Soc. 30:143–176MathSciNetMATH
18.
Zurück zum Zitat Vermorel J (2005) Mohri M Multi-armed bandit algorithms and empirical evaluation. In: Proc. Euro. conf. machine learning (ECML 2005), Lecture Notes in Computer Science, vol 3720. Springer, Berlin, pp 437–448 Vermorel J (2005) Mohri M Multi-armed bandit algorithms and empirical evaluation. In: Proc. Euro. conf. machine learning (ECML 2005), Lecture Notes in Computer Science, vol 3720. Springer, Berlin, pp 437–448
Metadaten
Titel
A Bayesian Method of Online Automatic Tuning
verfasst von
Reiji Suda
Copyright-Jahr
2010
Verlag
Springer New York
DOI
https://doi.org/10.1007/978-1-4419-6935-4_16

Neuer Inhalt