Skip to main content

2018 | OriginalPaper | Buchkapitel

Runtime Distributions and Criteria for Restarts

verfasst von : Jan-Hendrik Lorenz

Erschienen in: SOFSEM 2018: Theory and Practice of Computer Science

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Randomized algorithms sometimes employ a restart strategy. After a certain number of steps, the current computation is aborted and restarted with a new, independent random seed. In some cases, this results in an improved overall expected runtime. This work introduces properties of the underlying runtime distribution which determine whether restarts are advantageous. The most commonly used probability distributions admit the use of a scale and a location parameter. Location parameters shift the density function to the right, while scale parameters affect the spread of the distribution. It is shown that for all distributions scale parameters do not influence the usefulness of restarts and that location parameters only have a limited influence. This result simplifies the analysis of the usefulness of restarts. The most important runtime probability distributions are the log-normal, the Weibull, and the Pareto distribution. In this work, these distributions are analyzed for the usefulness of restarts. Secondly, a condition for the optimal restart time (if it exists) is provided. The log-normal, the Weibull, and the generalized Pareto distribution are analyzed in this respect. Moreover, it is shown that the optimal restart time is also not influenced by scale parameters and that the influence of location parameters is only linear.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Arbelaez, A., Truchet, C., Codognet, P.: Using sequential runtime distributions for the parallel speedup prediction of SAT local search. Theory Pract. Logic Program. 13(4–5), 625–639 (2013)MathSciNetCrossRefMATH Arbelaez, A., Truchet, C., Codognet, P.: Using sequential runtime distributions for the parallel speedup prediction of SAT local search. Theory Pract. Logic Program. 13(4–5), 625–639 (2013)MathSciNetCrossRefMATH
2.
Zurück zum Zitat Arbelaez, A., Truchet, C., O’Sullivan, B.: Learning sequential and parallel runtime distributions for randomized algorithms. In: ICTAI 2016: 28th International Conference on Tools with Artificial Intelligence, San Jose, California, USA, pp. 655–662. IEEE (2016) Arbelaez, A., Truchet, C., O’Sullivan, B.: Learning sequential and parallel runtime distributions for randomized algorithms. In: ICTAI 2016: 28th International Conference on Tools with Artificial Intelligence, San Jose, California, USA, pp. 655–662. IEEE (2016)
3.
Zurück zum Zitat Balkema, A.A., De Haan, L.: Residual life time at great age. Ann. Probab. 792–804 (1974) Balkema, A.A., De Haan, L.: Residual life time at great age. Ann. Probab. 792–804 (1974)
4.
Zurück zum Zitat Barrero, D.F., Muñoz, P., Camacho, D., R-Moreno, M.D.: On the statistical distribution of the expected run-time in population-based search algorithms. Soft. Comput. 19(10), 2717–2734 (2015)CrossRef Barrero, D.F., Muñoz, P., Camacho, D., R-Moreno, M.D.: On the statistical distribution of the expected run-time in population-based search algorithms. Soft. Comput. 19(10), 2717–2734 (2015)CrossRef
5.
Zurück zum Zitat Caniou, Y., Codognet, P.: Sequential and parallel restart policies for constraint-based local search. In: Proceedings of the 2013 IEEE 27th International Symposium on Parallel and Distributed Processing Workshops and Ph.D. Forum, pp. 1754–1763. IEEE Computer Society (2013) Caniou, Y., Codognet, P.: Sequential and parallel restart policies for constraint-based local search. In: Proceedings of the 2013 IEEE 27th International Symposium on Parallel and Distributed Processing Workshops and Ph.D. Forum, pp. 1754–1763. IEEE Computer Society (2013)
6.
Zurück zum Zitat Crovella, M.E., Taqqu, M.S., Bestavros, A.: Heavy-tailed probability distributions in the World Wide Web. Pract. Guide Heavy Tails 1, 3–26 (1998)MATH Crovella, M.E., Taqqu, M.S., Bestavros, A.: Heavy-tailed probability distributions in the World Wide Web. Pract. Guide Heavy Tails 1, 3–26 (1998)MATH
7.
Zurück zum Zitat Evans, M.R., Majumdar, S.N.: Diffusion with stochastic resetting. Phys. Rev. Lett. 106(16), 160601 (2011)CrossRef Evans, M.R., Majumdar, S.N.: Diffusion with stochastic resetting. Phys. Rev. Lett. 106(16), 160601 (2011)CrossRef
8.
Zurück zum Zitat Frost, D., Rish, I., Vila, L.: Summarizing CSP hardness with continuous probability distributions. In: Proceedings of the Fourteenth National Conference on Artificial Intelligence and Ninth Conference on Innovative Applications of Artificial Intelligence, AAAI 1997/IAAI 1997, pp. 327–333. AAAI Press (1997) Frost, D., Rish, I., Vila, L.: Summarizing CSP hardness with continuous probability distributions. In: Proceedings of the Fourteenth National Conference on Artificial Intelligence and Ninth Conference on Innovative Applications of Artificial Intelligence, AAAI 1997/IAAI 1997, pp. 327–333. AAAI Press (1997)
10.
Zurück zum Zitat Hoos, H.H., Stützle, T.: Evaluating las vegas algorithms: pitfalls and remedies. In: Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence, pp. 238–245. Morgan Kaufmann Publishers Inc. (1998) Hoos, H.H., Stützle, T.: Evaluating las vegas algorithms: pitfalls and remedies. In: Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence, pp. 238–245. Morgan Kaufmann Publishers Inc. (1998)
11.
Zurück zum Zitat Kotz, S., Nadarajah, S.: Extreme Value Distributions: Theory and Applications. World Scientific, Singapore (2000)CrossRefMATH Kotz, S., Nadarajah, S.: Extreme Value Distributions: Theory and Applications. World Scientific, Singapore (2000)CrossRefMATH
12.
Zurück zum Zitat Lorenz, J.H.: Completion probabilities and parallel restart strategies under an imposed deadline. PloS one 11(10), e0164605 (2016)CrossRef Lorenz, J.H.: Completion probabilities and parallel restart strategies under an imposed deadline. PloS one 11(10), e0164605 (2016)CrossRef
13.
Zurück zum Zitat Lorenz, M.O.: Methods of measuring the concentration of wealth. Publ. Am. Stat. Assoc. 9(70), 209–219 (1905) Lorenz, M.O.: Methods of measuring the concentration of wealth. Publ. Am. Stat. Assoc. 9(70), 209–219 (1905)
14.
15.
Zurück zum Zitat Meyer, J.: Two-moment decision models and expected utility maximization. Am. Econ. Rev. 421–430 (1987) Meyer, J.: Two-moment decision models and expected utility maximization. Am. Econ. Rev. 421–430 (1987)
16.
Zurück zum Zitat Van Moorsel, A.P., Wolter, K.: Analysis and algorithms for restart. In: Proceedings of the First International Conference on the Quantitative Evaluation of Systems, pp. 195–204 (2004) Van Moorsel, A.P., Wolter, K.: Analysis and algorithms for restart. In: Proceedings of the First International Conference on the Quantitative Evaluation of Systems, pp. 195–204 (2004)
18.
Zurück zum Zitat Norman, L., Kotz, S., Balakrishnan, N.: Continuous Univariate Distributions, vol. 1. Wiley Series in Probability and Mathematical Statistics: Applied Probability and Statistics (1994) Norman, L., Kotz, S., Balakrishnan, N.: Continuous Univariate Distributions, vol. 1. Wiley Series in Probability and Mathematical Statistics: Applied Probability and Statistics (1994)
19.
Zurück zum Zitat Paxson, V., Allman, M., Chu, J., Sargent, M.: Computing TCP’s retransmission timer. Technical report (2011) Paxson, V., Allman, M., Chu, J., Sargent, M.: Computing TCP’s retransmission timer. Technical report (2011)
20.
Zurück zum Zitat Reuveni, S., Urbakh, M., Klafter, J.: Role of substrate unbinding in Michaelis-Menten enzymatic reactions. Proc. Natl. Acad. Sci. U.S.A. 111(12), 4391–4396 (2014)CrossRef Reuveni, S., Urbakh, M., Klafter, J.: Role of substrate unbinding in Michaelis-Menten enzymatic reactions. Proc. Natl. Acad. Sci. U.S.A. 111(12), 4391–4396 (2014)CrossRef
21.
Zurück zum Zitat Schöning, U.: A probabilistic algorithm for k-SAT and constraint satisfaction problems. In: Proceedings of the 40th Annual Symposium on Foundations of Computer Science, FOCS 1999, p. 410. IEEE Computer Society, Washington, DC (1999) Schöning, U.: A probabilistic algorithm for k-SAT and constraint satisfaction problems. In: Proceedings of the 40th Annual Symposium on Foundations of Computer Science, FOCS 1999, p. 410. IEEE Computer Society, Washington, DC (1999)
23.
Zurück zum Zitat Wu, H.: Randomization and restart strategies. Master’s thesis, University of Waterloo (2006) Wu, H.: Randomization and restart strategies. Master’s thesis, University of Waterloo (2006)
Metadaten
Titel
Runtime Distributions and Criteria for Restarts
verfasst von
Jan-Hendrik Lorenz
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-73117-9_35