Top

Published in:

2024 | OriginalPaper | Chapter

A Racing Approach: The Evolution of Racing Techniques, A Systematic Literature Review

Authors : Hugo Silva, André S. Santos, Leonilde R. Varela, Magdalena Diering, Khrystyna Berladir

Published in: Advances in Manufacturing IV

Publisher: Springer Nature Switzerland

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Selecting the right values for an algorithm’s parameters usually is a difficult, critical, and time-intensive endeavor. Though parameters can be traditionally adjusted in an empirical way, recent research indicates that automated tuning methods can frequently identify superior parameter configurations. In this sense, Racing Techniques emerge as a method of tuning hyperparameters and finding the best configurations for an algorithm. It is a time and resource efficient method. One of the more explored techniques in racing is the F-Race.ones. This work is a systematic literature review. The first section provides the context surrounding Racing Techniques. The second section explores the literature currently available on overall Racing Techniques and F-race, introducing all the essential concepts. The third section presents the research problem. The fourth section relates case studies of other works, being complemented by a bibliometric review that shows the growth of the concepts presented. The fifth and last section completes the work with the future paths for Racing Techniques, where opportunities arise in different fields of study, and provides the conclusions drawn.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Potential of Graph Database Visualization of the Supplier Network to Increase Resilience in Multi-tier Supply Chains

next chapter The Impact of PLM Systems on the Digital Transformation of Manufacturing Companies

van Rijn, J.N., Holmes, G., Pfahringer, B., Vanschoren, J.: Algorithm selection on data streams. In: Džeroski, S., Panov, P., Kocev, D., Todorovski, L. (eds.) Discovery Science: 17th International Conference, DS 2014, Bled, Slovenia, 8–10 October 2014, Proceedings 17, DS 2014. LNCS, vol. 8777, pp. 325–336. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-11812-3_28

Adenso-Diaz, B., Laguna, M.: Fine-tuning of algorithms using fractional experimental designs and local search. Oper. Res. 54(1), 99–114 (2006)CrossRef

Hutter, F., Kotthoff, L., Vanschoren, J.: Automated Machine Learning: Methods, Systems, Challenges. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-05318-5

Becker, S., Gottlieb, J., Stützle, T.: Applications of racing algorithms: an industrial perspective. In: Talbi, E.G., Liardet, P., Collet, P., Lutton, E., Schoenauer, M. (eds.) Artificial Evolution, EA 2005. LNCS, vol. 3871, pp. 271–283. Springer, Cham (2005). https://doi.org/10.1007/11740698_24

Birattari, M., Kacprzyk, J.: Tuning Metaheuristics: A Machine Learning Perspective, vol. 197. Springer, Cham (2009). https://doi.org/10.1007/978-3-642-00483-4

Klazar, R., Engelbrecht, A.P.: Parameter optimization by means of statistical quality guides in F-Race. In: 2014 IEEE Congress on Evolutionary Computation (CEC), pp. 2547–2552. IEEE (2014)

Fisher, M.J., Marshall, A.P.: Understanding descriptive statistics. Aust. Crit. Care 22(2), 93–97 (2009)CrossRef

Byrne, G.: A statistical primer: understanding descriptive and inferential statistics. Evid. Based Libr. Inf. Pract. 2(1), 32–47 (2007)CrossRef

Berger, R.W., Benbow, D.W., Elshennawy, A.K., Walker, H.F.: The Certified Quality Engineer Handbook. ASQ Quality Press (2006)

10.

Kwak, S.G., Park, S.-H.: Normality test in clinical research. J. Rheum. Dis. 26(1), 5–11 (2019)CrossRef

11.

Ghosh, D., Vogt, A.: Outliers: an evaluation of methodologies. In: Joint Statistical Meetings (2012)

12.

Sahu, P.K., Pal, S.R., Das, A.K.: Estimation and Inferential Statistics. Springer, Cham (2015). https://doi.org/10.1007/978-81-322-2514-0

13.

Bagkavos, D., Patil, P.N.: Improving the Wilcoxon signed rank test by a kernel smooth probability integral transformation. Stat. Probab. Lett. 171, 109026 (2021)MathSciNetCrossRef

14.

Morgan, G.A., Gliner, J.A., Harmon, R.J.: Selection of inferential statistics: an overview. J. Am. Acad. Child Adolesc. Psychiatry 41(4), 478–481 (2002)CrossRef

15.

Hoos, H.H.: Automated algorithm configuration and parameter tuning. In: Hamadi, Y., Monfroy, E., Saubion, F. (eds.) Autonomous Search, pp. 37–71. Springer, Cham (2012). https://doi.org/10.1007/978-3-642-21434-9_3

16.

Maron, O., Moore, A.: Hoeffding races: accelerating model selection search for classification and function approximation. In: Advances in Neural Information Processing Systems, vol. 6 (1993)

17.

Balaprakash, P., Birattari, M., Stützle, T.: Improvement strategies for the F-Race algorithm: sampling design and iterative refinement. In: Bartz-Beielstein, T., et al. (eds.) Hybrid Metaheuristics: 4th International Workshop, HM 2007, Dortmund, Germany, 8–9 October 2007, Proceedings 4, HM 2007. LNCS, vol. 4771, pp. 108–122. Springer, Cham (2007). https://doi.org/10.1007/978-3-540-75514-2_9

18.

Gümüş, D.B., Özcan, E., Atkin, J., Drake, J.H.: An investigation of F-Race training strategies for cross domain optimisation with memetic algorithms. Inf. Sci. (N Y) 619, 153–171 (2023)CrossRef

19.

van Dijk, T., et al.: A unified race algorithm for offline parameter tuning. In: Proceedings of the Winter Simulation Conference 2014, pp. 3971–3982. IEEE (2014)

20.

Lacroix, B., McCall, J., Lonchampt, J.: Iterated racing algorithm for simulation-optimisation of maintenance planning. In: 2018 IEEE Congress on Evolutionary Computation (CEC). IEEE (2018)

21.

Silva, H., Santos, A.S., Varela, L.R., Trojanowska, J., Berladir, K.: Design of experiments: an overview and future paths. In: Burduk, A., Batako, A., Machado, J., Wyczółkowski, R., Antosz, K., Gola, A. (eds.) Advances in Production, ISPEM 2023. LNNS, vol. 790, pp. 328–341. Springer, Cham (2023). https://doi.org/10.1007/978-3-031-45021-1_25

22.

Diering, M., Dyczkowski, K., Hamrol, A.: Rating system analysis in quality engineering based on fuzzy similarity. J. Multiple-Valued Logic Soft Comput. 32(3–4), 277–292 (2019)

23.

Liu, S., Yin, L., Mocanu, D.C., Pechenizkiy, M.: Do we actually need dense over-parameterization? In-time over-parameterization in sparse training. In: International Conference on Machine Learning, pp. 6989–7000. PMLR (2021)

24.

Pavlenko, I., et al.: Using regression analysis for automated material selection in smart manufacturing. Mathematics 10(11), 1888 (2022). https://doi.org/10.3390/math10111888

25.

Choi, G.P.T., Lui, L.M.: Recent developments of surface parameterization methods using quasi-conformal geometry. In: Handbook of Mathematical Models and Algorithms in Computer Vision and Imaging: Mathematical Imaging and Vision, pp. 1–41 (2022)

26.

Kaščak, J., Husár, J., Knapčíková, L., Trojanowska, J., Ivanov, V.: Conceptual use of augmented reality in the maintenance of manufacturing facilities. In: Trojanowska, J., Kujawińska, A., Machado, J., Pavlenko, I. (eds.) Advances in Manufacturing III, vol. 2 – Production Engineering: Research and Technology Innovations, Industry 4.0, pp. 241–252. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-99310-8_19

27.

Doerr, B., Eremeev, A., Horoba, C., Neumann, F., Theile, M.: Evolutionary algorithms and dynamic programming. In: Proceedings of the 11th Annual Conference on Genetic and Evolutionary Computation, pp. 771–778 (2009)

28.

Zhou, E., Chen, X.: Sequential Monte Carlo simulated annealing. J. Global Optim. 55, 101–124 (2013)MathSciNetCrossRef

29.

Pavlenko, I., Verbovyi, A., Neamtu, C., Ivanov, V., Ciszak, O., Trojanowska, J.: Fractional-order mathematical model of single-mass rotor dynamics and stability. Alexandria Eng. J. 76, 91–100 (2023). https://doi.org/10.1016/j.aej.2023.06.024

30.

Falkner, S., Klein, A., Hutter, F.: Combining hyperband and Bayesian optimization. In: NIPS 2017 Bayesian Optimization Workshop, December 2017

Title: A Racing Approach: The Evolution of Racing Techniques, A Systematic Literature Review
Authors: Hugo Silva
André S. Santos
Leonilde R. Varela
Magdalena Diering
Khrystyna Berladir
Publisher: Springer Nature Switzerland
Book: Advances in Manufacturing IV
Print ISBN: 978-3-031-56446-8

Electronic ISBN: 978-3-031-56444-4

Copyright Year: 2024
DOI: https://doi.org/10.1007/978-3-031-56444-4_11

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner