Skip to main content
Top
Published in: Wireless Networks 8/2020

18-12-2019

A sequential surrogate-based multiobjective optimization method: effect of initial data set

Authors: Maria Guadalupe Villarreal-Marroquin, Jose Daniel Mosquera-Artamonov, Celso E. Cruz, Jose M. Castro

Published in: Wireless Networks | Issue 8/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Process optimization based on high-fidelity computer simulations or real experimentation is commonly expensive. Therefore, surrogate models are frequently used to reduce the computational or experimental cost. However, surrogate models need to achieve a maximum accuracy with a limited number of sampled points. Sequential sampling is a procedure in which sequentially surrogates are fitted and each surrogate defines the points that need to be sampled and used to fit the next model. For optimization purposes, points are sampled on regions of high potential for the optimal solutions. In this work, we first compared the effect of using different initial sets of points (experimental designs) in a sequential surrogate-based multiobjective optimization method. The optimization method is tested on five benchmark problems and the performance is quantified based on the total number of function evaluations and the quality of the final Pareto Front. Then an industrial applications on titanium welding is presented to show the use of the method. The case study is based on real experimental data.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Dong, S., Chunsheng, E., Fan, B., Danai, K., & Kazmer, D. O. (2007). Process-driven input profiling for plastics processing. Journal of Manufacturing Science and Engineering, 129(4), 802–809.CrossRef Dong, S., Chunsheng, E., Fan, B., Danai, K., & Kazmer, D. O. (2007). Process-driven input profiling for plastics processing. Journal of Manufacturing Science and Engineering, 129(4), 802–809.CrossRef
2.
go back to reference Wang, G. G., & Shan, S. (2007). Review of metamodeling techniques in support of engineering design optimization. The Journal of Mechanical Design, 129(4), 370–380.CrossRef Wang, G. G., & Shan, S. (2007). Review of metamodeling techniques in support of engineering design optimization. The Journal of Mechanical Design, 129(4), 370–380.CrossRef
3.
go back to reference Litvinchev, I., López, F., Escalante, H. J., & Mata, M. (2011). A milp bi-objective model for static portfolio selection of R&D projects with synergies. Journal of Computer and Systems Sciences International, 50(6), 942–952.MathSciNetMATHCrossRef Litvinchev, I., López, F., Escalante, H. J., & Mata, M. (2011). A milp bi-objective model for static portfolio selection of R&D projects with synergies. Journal of Computer and Systems Sciences International, 50(6), 942–952.MathSciNetMATHCrossRef
4.
go back to reference Zhou, H. (2012). Computer modeling for injection molding: Simulation, optimization, and control (pp. 230–260). Hoboken: Wiley. Zhou, H. (2012). Computer modeling for injection molding: Simulation, optimization, and control (pp. 230–260). Hoboken: Wiley.
5.
go back to reference Villarreal-Marroquin, M. G., Po-Hsu, C., Mulyana, R., Santner, T. J., Dean, A. M., & Castro, J. M. (2016). Multiobjective optimization of injection molding using a calibrated predictor based on physical and simulated data. Polymer Engineering and Science, 57(3), 248–257.CrossRef Villarreal-Marroquin, M. G., Po-Hsu, C., Mulyana, R., Santner, T. J., Dean, A. M., & Castro, J. M. (2016). Multiobjective optimization of injection molding using a calibrated predictor based on physical and simulated data. Polymer Engineering and Science, 57(3), 248–257.CrossRef
6.
go back to reference Montalvo-Urquizo, J., Niebuhr, C., Schmidt, A., & Villarreal-Marroquin, M. G. (2018). Reducing deformation, stress, and tool wear during milling processes using simulation-based multiobjective optimization. The International Journal of Advanced Manufacturing Technology, 96(4–8), 1859–1873.CrossRef Montalvo-Urquizo, J., Niebuhr, C., Schmidt, A., & Villarreal-Marroquin, M. G. (2018). Reducing deformation, stress, and tool wear during milling processes using simulation-based multiobjective optimization. The International Journal of Advanced Manufacturing Technology, 96(4–8), 1859–1873.CrossRef
7.
go back to reference Kok, S. W., & Tapabrata, R. (2005). A framework for design optimization using surrogates. Engineering Optimization, 37(7), 685–703.MathSciNetCrossRef Kok, S. W., & Tapabrata, R. (2005). A framework for design optimization using surrogates. Engineering Optimization, 37(7), 685–703.MathSciNetCrossRef
8.
go back to reference Barton, R. R. (2009). Simulation optimization using metamodels. In: Winter simulation conference (pp. 230–238). Barton, R. R. (2009). Simulation optimization using metamodels. In: Winter simulation conference (pp. 230–238).
9.
go back to reference Li, Y. F., Ng, S. H., Xie, M., & Goh, T. N. (2010). A systematic comparison of metamodeling techniques for simulation optimization in decision support systems. Applied Soft Computing, 10(4), 1257–1273.CrossRef Li, Y. F., Ng, S. H., Xie, M., & Goh, T. N. (2010). A systematic comparison of metamodeling techniques for simulation optimization in decision support systems. Applied Soft Computing, 10(4), 1257–1273.CrossRef
10.
go back to reference Avila-Torres, P., Caballero, R., Litvinchev, I., Lopez-Irarragorri, F., & Vasant, P. (2018). The urban transport planning with uncertainty in demand and travel time: A comparison of two defuzzification methods. Journal of Ambient Intelligence and Humanized Computing, 9(3), 843–856.CrossRef Avila-Torres, P., Caballero, R., Litvinchev, I., Lopez-Irarragorri, F., & Vasant, P. (2018). The urban transport planning with uncertainty in demand and travel time: A comparison of two defuzzification methods. Journal of Ambient Intelligence and Humanized Computing, 9(3), 843–856.CrossRef
11.
go back to reference Cheng, J., Zhenyu, L., & Jianrong, T. (2013). Multiobjective optimization of injection molding parameters based on soft computing and variable complexity method. The International Journal of Advanced Manufacturing Technology, 66(5), 907–916.CrossRef Cheng, J., Zhenyu, L., & Jianrong, T. (2013). Multiobjective optimization of injection molding parameters based on soft computing and variable complexity method. The International Journal of Advanced Manufacturing Technology, 66(5), 907–916.CrossRef
12.
go back to reference Mosquera-Artamonov, J. D., Vasco-Leal, J. F., Acosta-Osorio, A. A., Hernandez-Rios, I., d Ventura-Ramos, E., Gutiérrez-Cortez, E., et al. (2016). Optimization of castor seed oil extraction process using response surface methodology. Ingeniería e Investigación, 36(3), 82–88.CrossRef Mosquera-Artamonov, J. D., Vasco-Leal, J. F., Acosta-Osorio, A. A., Hernandez-Rios, I., d Ventura-Ramos, E., Gutiérrez-Cortez, E., et al. (2016). Optimization of castor seed oil extraction process using response surface methodology. Ingeniería e Investigación, 36(3), 82–88.CrossRef
13.
go back to reference Simpson, T. W., Poplinski, J. D., Koch, P. N., & Allen, J. K. (2001). Metamodels for computer-based engineering design: Survey and recommendations. Engineering With Computers, 17(2), 129–150.MATHCrossRef Simpson, T. W., Poplinski, J. D., Koch, P. N., & Allen, J. K. (2001). Metamodels for computer-based engineering design: Survey and recommendations. Engineering With Computers, 17(2), 129–150.MATHCrossRef
14.
go back to reference Litvinchev, I., Rios, Y. A., Özdemir, D., & Hernández-Landa, L. G. (2014). Multiperiod and stochastic formulations for a closed loop supply chain with incentives. Journal of Computer and Systems Sciences International, 53(2), 201–211.MathSciNetMATHCrossRef Litvinchev, I., Rios, Y. A., Özdemir, D., & Hernández-Landa, L. G. (2014). Multiperiod and stochastic formulations for a closed loop supply chain with incentives. Journal of Computer and Systems Sciences International, 53(2), 201–211.MathSciNetMATHCrossRef
15.
go back to reference Mehmani, A., Zhang, J.,Chowdhury, S., & Messac, A. (2012). Surrogate-based design optimization with adaptive sequential sampling. In: 53rd AIAA/ASME/ASCE/AHS/ASC Structures, structural dynamics and materials conference 20th AIAA/ASME/AHS adaptive structures conference 14th AIAA, 1527. Mehmani, A., Zhang, J.,Chowdhury, S., & Messac, A. (2012). Surrogate-based design optimization with adaptive sequential sampling. In: 53rd AIAA/ASME/ASCE/AHS/ASC Structures, structural dynamics and materials conference 20th AIAA/ASME/AHS adaptive structures conference 14th AIAA, 1527.
16.
go back to reference Jin, R., Chen, W., & Sudjianto, A. (2002). On sequential sampling for global metamodeling in engineering design. In: ASME 2002 international design engineering technical conferences and computers and information in engineering conference (pp. 539–548). Jin, R., Chen, W., & Sudjianto, A. (2002). On sequential sampling for global metamodeling in engineering design. In: ASME 2002 international design engineering technical conferences and computers and information in engineering conference (pp. 539–548).
17.
go back to reference Jiang, P., Longchao, C., Qi, Z., Zhongmei, G., Youmin, R., & Xinyu, S. (2016). Optimization of welding process parameters by combining Kriging surrogate with particle swarm optimization algorithm. The International Journal of Advanced Manufacturing Technology, 86(9), 2473–2483.CrossRef Jiang, P., Longchao, C., Qi, Z., Zhongmei, G., Youmin, R., & Xinyu, S. (2016). Optimization of welding process parameters by combining Kriging surrogate with particle swarm optimization algorithm. The International Journal of Advanced Manufacturing Technology, 86(9), 2473–2483.CrossRef
18.
go back to reference Liu, H.,Xu, S., & Wang, X. (2016). Sampling strategies and metamodeling techniques for engineering design: comparison and application. In: ASME Turbo Expo 2016: Turbomachinery technical conference and exposition. American Society of Mechanical Engineers. Liu, H.,Xu, S., & Wang, X. (2016). Sampling strategies and metamodeling techniques for engineering design: comparison and application. In: ASME Turbo Expo 2016: Turbomachinery technical conference and exposition. American Society of Mechanical Engineers.
19.
go back to reference Hu, W., Fan, Y., Enying, L., & Guangyao, L. (2016). A framework for design optimization using surrogates. Engineering Optimization, 48(8), 1432–1458.CrossRef Hu, W., Fan, Y., Enying, L., & Guangyao, L. (2016). A framework for design optimization using surrogates. Engineering Optimization, 48(8), 1432–1458.CrossRef
20.
go back to reference Teng, L., Di, L., Xin, C., Xiaosong, G., & Li, L. (2016). A deterministic sequential maximin Latin hypercube design method using successive local enumeration for meta-modelbased optimization. Engineering Optimization, 48(6), 1019–1036.MathSciNetCrossRef Teng, L., Di, L., Xin, C., Xiaosong, G., & Li, L. (2016). A deterministic sequential maximin Latin hypercube design method using successive local enumeration for meta-modelbased optimization. Engineering Optimization, 48(6), 1019–1036.MathSciNetCrossRef
21.
go back to reference Castelletti, A., Pianosi, A., Soncini-Sessa, R., & Antenucci, J. P. (2010). A multiobjective response surface approach for improved water quality planning in lakes and reservoirs. Water Resources Research, 46(6), 1–16.CrossRef Castelletti, A., Pianosi, A., Soncini-Sessa, R., & Antenucci, J. P. (2010). A multiobjective response surface approach for improved water quality planning in lakes and reservoirs. Water Resources Research, 46(6), 1–16.CrossRef
22.
go back to reference Li, Jun, Xiaoyong, Yang, Chengzu, Ren, Guang, Chen, & Wang, Yan. (2015). Multiobjective optimization of cutting parameters in Ti–6Al–4V milling process using nondominated sorting genetic algorithm-II. The International Journal of Advanced Manufacturing Technology, 76(5), 941–953.CrossRef Li, Jun, Xiaoyong, Yang, Chengzu, Ren, Guang, Chen, & Wang, Yan. (2015). Multiobjective optimization of cutting parameters in Ti–6Al–4V milling process using nondominated sorting genetic algorithm-II. The International Journal of Advanced Manufacturing Technology, 76(5), 941–953.CrossRef
23.
go back to reference Zhang, Junhong, Jian, Wang, Jiewei, Lin, Qian, Guo, Kongwu, Chen, & Liang, M. (2016). Multiobjective optimization of injection molding process parameters based on Opt LHD, EBFNN, and MOPSO. The International Journal of Advanced Manufacturing Technology, 85(9–12), 2857–2872.CrossRef Zhang, Junhong, Jian, Wang, Jiewei, Lin, Qian, Guo, Kongwu, Chen, & Liang, M. (2016). Multiobjective optimization of injection molding process parameters based on Opt LHD, EBFNN, and MOPSO. The International Journal of Advanced Manufacturing Technology, 85(9–12), 2857–2872.CrossRef
24.
go back to reference Guodong, C., Xu, H., Guiping, L., Chao, J., & Ziheng, Z. (2012). An efficient multi-objective optimization method for black-box functions using sequential approximate technique. Applied Soft Computing, 12(1), 14–27.CrossRef Guodong, C., Xu, H., Guiping, L., Chao, J., & Ziheng, Z. (2012). An efficient multi-objective optimization method for black-box functions using sequential approximate technique. Applied Soft Computing, 12(1), 14–27.CrossRef
25.
go back to reference Kitayama, S., Srirat, J., Arakawa, M., & Yamazaki, K. (2013). Sequential approximate multi-objective optimization using radial basis function network. Structural and Multidisciplinary Optimization, 48(3), 501–515.MathSciNetCrossRef Kitayama, S., Srirat, J., Arakawa, M., & Yamazaki, K. (2013). Sequential approximate multi-objective optimization using radial basis function network. Structural and Multidisciplinary Optimization, 48(3), 501–515.MathSciNetCrossRef
26.
go back to reference Yun, Y., Yoon, M., & Nakayama, H. (2009). Multi-objective optimization based on meta-modeling by using support vector regression. Optimization and Engineering, 10(2), 167–181.MathSciNetMATHCrossRef Yun, Y., Yoon, M., & Nakayama, H. (2009). Multi-objective optimization based on meta-modeling by using support vector regression. Optimization and Engineering, 10(2), 167–181.MathSciNetMATHCrossRef
27.
go back to reference Villarreal-Marroquin, M. G., Cabrera-Rios, M., & Castro, J. M. (2011). A multicriteria simulation optimization method for injection molding. Journal of Polymer Engineering, 31(5), 397–407. Villarreal-Marroquin, M. G., Cabrera-Rios, M., & Castro, J. M. (2011). A multicriteria simulation optimization method for injection molding. Journal of Polymer Engineering, 31(5), 397–407.
28.
go back to reference Villarreal-Marroquin, M. G., Svenson, J. D., Sun, F., Santne, T. J., Dean, A. M., & Castro, J. M. (2013). A comparison of two metamodel-based methodologies for multiple criteria simulation optimization using an injection molding case study. Journal of Polymer Engineering, 33(3), 193–209.CrossRef Villarreal-Marroquin, M. G., Svenson, J. D., Sun, F., Santne, T. J., Dean, A. M., & Castro, J. M. (2013). A comparison of two metamodel-based methodologies for multiple criteria simulation optimization using an injection molding case study. Journal of Polymer Engineering, 33(3), 193–209.CrossRef
29.
go back to reference Svenson, J. D. (2011). Computer experiments: Multiobjective optimization and sensitivity analysis. Ph.D Thesis, The Ohio State University, 76:5, pp. 941–953. Svenson, J. D. (2011). Computer experiments: Multiobjective optimization and sensitivity analysis. Ph.D Thesis, The Ohio State University, 76:5, pp. 941–953.
30.
go back to reference Williams, B. J.,Santner, T. J., Notz, W. I., & Lehman, J. S. (2010). Sequential design of computer experiments for constrained optimization. In: Statistical modelling and regression structures (pp. 449–472). Williams, B. J.,Santner, T. J., Notz, W. I., & Lehman, J. S. (2010). Sequential design of computer experiments for constrained optimization. In: Statistical modelling and regression structures (pp. 449–472).
31.
go back to reference Deb, K. (2011). Multi-objective optimisation using evolutionary algorithms: An introduction. In: Multi-objective evolutionary optimisation for product design and manufacturing (pp. 3–34). Deb, K. (2011). Multi-objective optimisation using evolutionary algorithms: An introduction. In: Multi-objective evolutionary optimisation for product design and manufacturing (pp. 3–34).
32.
go back to reference Zitzler, E., Thiele, L., Laumanns, M., Fonseca, C. M., & Fonseca, V. G. (2003). Performance assessment of multiobjective optimizers: An analysis and review. IEEE Transactions on Evolutionary Computation, 7(2), 117–132.CrossRef Zitzler, E., Thiele, L., Laumanns, M., Fonseca, C. M., & Fonseca, V. G. (2003). Performance assessment of multiobjective optimizers: An analysis and review. IEEE Transactions on Evolutionary Computation, 7(2), 117–132.CrossRef
33.
go back to reference Demsar, J. (2006). Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research, 7, 1–30.MathSciNetMATH Demsar, J. (2006). Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research, 7, 1–30.MathSciNetMATH
34.
go back to reference Garcia, S., & Herrera, F. (2008). An extension on statistical comparisons of classifiers over multiple data sets for all pairwise comparisons. Journal of Machine Learning Research, 9, 2677–2694.MATH Garcia, S., & Herrera, F. (2008). An extension on statistical comparisons of classifiers over multiple data sets for all pairwise comparisons. Journal of Machine Learning Research, 9, 2677–2694.MATH
35.
go back to reference Auger, A., Bader, J., . Brockhoff, D., & Zitzler E. (2009). Theory of the hypervolume indicator: Optimal \(\mu\)-distributions and the choice of the reference point. In: Proceedings of the tenth ACM SIGEVO workshop on foundations of genetic algorithms, FOGA ’09 (pp. 87–102). New York, NY. Auger, A., Bader, J., . Brockhoff, D., & Zitzler E. (2009). Theory of the hypervolume indicator: Optimal \(\mu\)-distributions and the choice of the reference point. In: Proceedings of the tenth ACM SIGEVO workshop on foundations of genetic algorithms, FOGA ’09 (pp. 87–102). New York, NY.
36.
go back to reference Deb, K., Pratap, A., Agarwal, S., & Meyarivan, T. (2002). A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation, 6(2), 182–197.CrossRef Deb, K., Pratap, A., Agarwal, S., & Meyarivan, T. (2002). A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation, 6(2), 182–197.CrossRef
37.
go back to reference Cruz, C., Hiyane, G., Mosquera-Artamonov, J. D., & Salgado, J. M. (2014). Optimization of the GTAW process for Ti6Al4V plates. Soldagem and Inspeção, 19, 2–9.CrossRef Cruz, C., Hiyane, G., Mosquera-Artamonov, J. D., & Salgado, J. M. (2014). Optimization of the GTAW process for Ti6Al4V plates. Soldagem and Inspeção, 19, 2–9.CrossRef
38.
go back to reference Cruz-Gonzalez, C. E., Gala-Barron, H. I., Mosquera-Artamonov, J. D., & Gamez-Cuatzin, H. (2016). Efecto de la corriente pulsada en el proceso de soldadura GTAW en titanio 6Al4V con y sin metal de aporte. Revista de Metalurgia, 52(3), 1–11. Cruz-Gonzalez, C. E., Gala-Barron, H. I., Mosquera-Artamonov, J. D., & Gamez-Cuatzin, H. (2016). Efecto de la corriente pulsada en el proceso de soldadura GTAW en titanio 6Al4V con y sin metal de aporte. Revista de Metalurgia, 52(3), 1–11.
39.
go back to reference Junaid, M., Baig, M. N., Shamir, M., Khan, F. N., Rehman, K., & Haider, J. (2017). A comparative study of pulsed laser and pulsed TIG welding of Ti–5Al–2.5 Sn titanium alloy sheet. Journal of Materials Processing Technology, 242, 24–38.CrossRef Junaid, M., Baig, M. N., Shamir, M., Khan, F. N., Rehman, K., & Haider, J. (2017). A comparative study of pulsed laser and pulsed TIG welding of Ti–5Al–2.5 Sn titanium alloy sheet. Journal of Materials Processing Technology, 242, 24–38.CrossRef
40.
go back to reference Nandagopa, K., & Kailasanathan, C. (2016). Analysis of mechanical properties and optimization of gas tungsten Arc welding (GTAW) parameters on dissimilar metal titanium (6Al 4V) and aluminium 7075 by Taguchi and ANOVA techniques. Journal of Alloys and Compounds, 682, 503–516.CrossRef Nandagopa, K., & Kailasanathan, C. (2016). Analysis of mechanical properties and optimization of gas tungsten Arc welding (GTAW) parameters on dissimilar metal titanium (6Al 4V) and aluminium 7075 by Taguchi and ANOVA techniques. Journal of Alloys and Compounds, 682, 503–516.CrossRef
41.
go back to reference Thepsonthi, Thanongsak, & Özel, Tuğrul. (2012). Multi-objective process optimization for micro-end milling of Ti–6Al–4V titanium alloy. The International Journal of Advanced Manufacturing Technology, 63(9), 903–914.CrossRef Thepsonthi, Thanongsak, & Özel, Tuğrul. (2012). Multi-objective process optimization for micro-end milling of Ti–6Al–4V titanium alloy. The International Journal of Advanced Manufacturing Technology, 63(9), 903–914.CrossRef
42.
go back to reference Wang, X., Shi, Y., Ding, D., & Gu, X. (2016). Double global optimum genetic algorithm–particle swarm optimization-based welding robot path planning. Engineering Optimization, 48(2), 299–316.MathSciNetCrossRef Wang, X., Shi, Y., Ding, D., & Gu, X. (2016). Double global optimum genetic algorithm–particle swarm optimization-based welding robot path planning. Engineering Optimization, 48(2), 299–316.MathSciNetCrossRef
Metadata
Title
A sequential surrogate-based multiobjective optimization method: effect of initial data set
Authors
Maria Guadalupe Villarreal-Marroquin
Jose Daniel Mosquera-Artamonov
Celso E. Cruz
Jose M. Castro
Publication date
18-12-2019
Publisher
Springer US
Published in
Wireless Networks / Issue 8/2020
Print ISSN: 1022-0038
Electronic ISSN: 1572-8196
DOI
https://doi.org/10.1007/s11276-019-02212-2

Other articles of this Issue 8/2020

Wireless Networks 8/2020 Go to the issue