Skip to main content
Erschienen in: Structural and Multidisciplinary Optimization 3/2024

01.03.2024 | Research Paper

Optimal design of frame structures with mixed categorical and continuous design variables using the Gumbel–Softmax method

verfasst von: Mehran Ebrahimi, Hyunmin Cheong, Pradeep Kumar Jayaraman, Farhad Javid

Erschienen in: Structural and Multidisciplinary Optimization | Ausgabe 3/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In optimizing real-world structures, due to fabrication or budgetary restraints, the design variables may be restricted to a set of standard engineering choices. Such variables, commonly called categorical variables, are discrete and unordered in essence, precluding the utilization of gradient-based optimizers for the problems containing them. In this paper, incorporating the Gumbel–Softmax (GSM) method, we propose a new gradient-based optimizer for handling such variables in the optimal design of large-scale frame structures. The GSM method provides a means to draw differentiable samples from categorical distributions, thereby enabling sensitivity analysis for the variables generated from such distributions. The sensitivity information can greatly reduce the computational cost of traversing high-dimensional and discrete design spaces in comparison to employing gradient-free optimization methods. In addition, since the developed optimizer is gradient-based, it can naturally handle the simultaneous optimization of categorical and continuous design variables. Through three numerical case studies, different aspects of the proposed optimizer are studied and its advantages over population-based optimizers, specifically a genetic algorithm, are demonstrated.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
Zurück zum Zitat Allaire G, Delgado G (2016) Stacking sequence and shape optimization of laminated composite plates via a level-set method. J Mech Phys Solids 97:168–196ADSMathSciNetCrossRef Allaire G, Delgado G (2016) Stacking sequence and shape optimization of laminated composite plates via a level-set method. J Mech Phys Solids 97:168–196ADSMathSciNetCrossRef
Zurück zum Zitat Angelov PP, Zhang Y, Wright JA, Hanby VI, Buswell RA (2003) Automatic design synthesis and optimization of component-based systems by evolutionary algorithms. Genetic and evolutionary computation conference. Springer, Berlin, pp 1938–1950 Angelov PP, Zhang Y, Wright JA, Hanby VI, Buswell RA (2003) Automatic design synthesis and optimization of component-based systems by evolutionary algorithms. Genetic and evolutionary computation conference. Springer, Berlin, pp 1938–1950
Zurück zum Zitat Baevski A, Schneider S, Auli M (2019) VQ-WAV2VEC: self-supervised learning of discrete speech representations. In International conference on learning representations, 2019 Baevski A, Schneider S, Auli M (2019) VQ-WAV2VEC: self-supervised learning of discrete speech representations. In International conference on learning representations, 2019
Zurück zum Zitat Barjhoux PJ, Diouane Y, Grihon S, Bettebghor D, Morlier J (2020) A bi-level methodology for solving large-scale mixed categorical structural optimization. Struct Multidisc Optim 62(1):337–351MathSciNetCrossRef Barjhoux PJ, Diouane Y, Grihon S, Bettebghor D, Morlier J (2020) A bi-level methodology for solving large-scale mixed categorical structural optimization. Struct Multidisc Optim 62(1):337–351MathSciNetCrossRef
Zurück zum Zitat Bendsøe MP, Sigmund O (2003) Topology optimization: theory, methods, and applications. Springer, Berlin Bendsøe MP, Sigmund O (2003) Topology optimization: theory, methods, and applications. Springer, Berlin
Zurück zum Zitat Cao Y, Li S, Petzold L, Serban R (2003) Adjoint sensitivity analysis for differential-algebraic equations: the adjoint DAE system and its numerical solution. SIAM J Sci Comput 24(3):1076–1089MathSciNetCrossRef Cao Y, Li S, Petzold L, Serban R (2003) Adjoint sensitivity analysis for differential-algebraic equations: the adjoint DAE system and its numerical solution. SIAM J Sci Comput 24(3):1076–1089MathSciNetCrossRef
Zurück zum Zitat Cesa-Bianchi N, Gentile C, Lugosi G, Neu G (2017) Boltzmann exploration done right. Adv Neural Inf Process Syst 30:1 Cesa-Bianchi N, Gentile C, Lugosi G, Neu G (2017) Boltzmann exploration done right. Adv Neural Inf Process Syst 30:1
Zurück zum Zitat Chapman CD, Saitou K, Jakiela MJ (1994) Genetic algorithms as an approach to configuration and topology design. J Mech Des 116:1005–1012CrossRef Chapman CD, Saitou K, Jakiela MJ (1994) Genetic algorithms as an approach to configuration and topology design. J Mech Des 116:1005–1012CrossRef
Zurück zum Zitat Cheong H, Ebrahimi M, Butscher A, Iorio F (2019) Configuration design of mechanical assemblies using an estimation of distribution algorithm and constraint programming. In: IEEE congress on evolutionary computation, pp 2339–2346, 2019 Cheong H, Ebrahimi M, Butscher A, Iorio F (2019) Configuration design of mechanical assemblies using an estimation of distribution algorithm and constraint programming. In: IEEE congress on evolutionary computation, pp 2339–2346, 2019
Zurück zum Zitat Cheong H, Ebrahimi M, Duggan T (2021) Optimal design of continuum robots with reachability constraints. IEEE Robot Automat Lett 6(2):3902–3909CrossRef Cheong H, Ebrahimi M, Duggan T (2021) Optimal design of continuum robots with reachability constraints. IEEE Robot Automat Lett 6(2):3902–3909CrossRef
Zurück zum Zitat Duan Z, Yan J, Lee I, Lund E, Wang J (2019) Discrete material selection and structural topology optimization of composite frames for maximum fundamental frequency with manufacturing constraints. Struct Multidisc Optim 60:1741–1758MathSciNetCrossRef Duan Z, Yan J, Lee I, Lund E, Wang J (2019) Discrete material selection and structural topology optimization of composite frames for maximum fundamental frequency with manufacturing constraints. Struct Multidisc Optim 60:1741–1758MathSciNetCrossRef
Zurück zum Zitat Ebrahimi M, Butscher A, Cheong H, Iorio F (2019) Design optimization of dynamic flexible multibody systems using the discrete adjoint variable method. Comput Struct 213:82–99CrossRef Ebrahimi M, Butscher A, Cheong H, Iorio F (2019) Design optimization of dynamic flexible multibody systems using the discrete adjoint variable method. Comput Struct 213:82–99CrossRef
Zurück zum Zitat Ebrahimi M, Butscher A, Cheong H (2021) A low order, torsion deformable spatial beam element based on the absolute nodal coordinate formulation and bishop frame. Multibody Syst Dyn 51(3):247–278MathSciNetCrossRef Ebrahimi M, Butscher A, Cheong H (2021) A low order, torsion deformable spatial beam element based on the absolute nodal coordinate formulation and bishop frame. Multibody Syst Dyn 51(3):247–278MathSciNetCrossRef
Zurück zum Zitat Fister Jr I, Yang XS, Fister I, Brest J, Fister D (2013) A brief review of nature-inspired algorithms for optimization. arXiv preprint arXiv:1307.4186 Fister Jr I, Yang XS, Fister I, Brest J, Fister D (2013) A brief review of nature-inspired algorithms for optimization. arXiv preprint arXiv:​1307.​4186
Zurück zum Zitat Gu J, Im DJ, Li VO (2018) Neural machine translation with Gumbel-greedy decoding. In: Proceedings of the AAAI conference on artificial intelligence, vol. 32, 2018 Gu J, Im DJ, Li VO (2018) Neural machine translation with Gumbel-greedy decoding. In: Proceedings of the AAAI conference on artificial intelligence, vol. 32, 2018
Zurück zum Zitat Gumbel EJ (1954) Statistical theory of extreme values and some practical applications: a series of lectures, vol 33. US Government Printing Office, 1954 Gumbel EJ (1954) Statistical theory of extreme values and some practical applications: a series of lectures, vol 33. US Government Printing Office, 1954
Zurück zum Zitat Guo P, Lee CY, Ulbricht D (2020) Learning to branch for multi-task learning. In: International conference on machine learning, pp 3854–3863, 2020 Guo P, Lee CY, Ulbricht D (2020) Learning to branch for multi-task learning. In: International conference on machine learning, pp 3854–3863, 2020
Zurück zum Zitat Haftka RT, Gürdal Z (2012) Elements of structural optimization, vol 11. Springer, Berlin Haftka RT, Gürdal Z (2012) Elements of structural optimization, vol 11. Springer, Berlin
Zurück zum Zitat Ho-Huu V, Nguyen-Thoi T, Vo-Duy T, Nguyen-Trang T (2016) An adaptive elitist differential evolution for optimization of truss structures with discrete design variables. Comput Struct 165:59–75CrossRef Ho-Huu V, Nguyen-Thoi T, Vo-Duy T, Nguyen-Trang T (2016) An adaptive elitist differential evolution for optimization of truss structures with discrete design variables. Comput Struct 165:59–75CrossRef
Zurück zum Zitat Huang MW, Arora JS (1997) Optimal design of steel structures using standard sections. Struct Optim 14(1):24–35CrossRef Huang MW, Arora JS (1997) Optimal design of steel structures using standard sections. Struct Optim 14(1):24–35CrossRef
Zurück zum Zitat Huijben IA, Kool W, Paulus MB, Van Sloun RJ (2022) A review of the Gumbel–Max trick and its extensions for discrete stochasticity in machine learning. In: IEEE transactions on pattern analysis and machine intelligence, 2022 Huijben IA, Kool W, Paulus MB, Van Sloun RJ (2022) A review of the Gumbel–Max trick and its extensions for discrete stochasticity in machine learning. In: IEEE transactions on pattern analysis and machine intelligence, 2022
Zurück zum Zitat Islam MJ, Li X, Deb K (2017) Multimodal truss structure design using bilevel and niching based evolutionary algorithms. In: Proceedings of the genetic and evolutionary computation conference, pp 274–281, 2017 Islam MJ, Li X, Deb K (2017) Multimodal truss structure design using bilevel and niching based evolutionary algorithms. In: Proceedings of the genetic and evolutionary computation conference, pp 274–281, 2017
Zurück zum Zitat Jang E, Gu S, Poole B (2017) Categorical reparameterization with Gumbel–Softmax. In: The international conference on learning representations, 2017 Jang E, Gu S, Poole B (2017) Categorical reparameterization with Gumbel–Softmax. In: The international conference on learning representations, 2017
Zurück zum Zitat Jenkins W (1992) Plane frame optimum design environment based on genetic algorithm. J Struct Eng 118(11):3103–3112CrossRef Jenkins W (1992) Plane frame optimum design environment based on genetic algorithm. J Struct Eng 118(11):3103–3112CrossRef
Zurück zum Zitat Kang M, Han B (2020) Operation-aware soft channel pruning using differentiable masks. In: International conference on machine learning, pp 5122–5131, 2020 Kang M, Han B (2020) Operation-aware soft channel pruning using differentiable masks. In: International conference on machine learning, pp 5122–5131, 2020
Zurück zum Zitat Kaveh A, Ghazaan MI (2015) A comparative study of CBO and ECBO for optimal design of skeletal structures. Comput Struct 153:137–147CrossRef Kaveh A, Ghazaan MI (2015) A comparative study of CBO and ECBO for optimal design of skeletal structures. Comput Struct 153:137–147CrossRef
Zurück zum Zitat Kaveh A, Kalatjari V (2004) Size/geometry optimization of trusses by the force method and genetic algorithm. ZAMM-J Appl Math Mech 84(5):347–357MathSciNetCrossRef Kaveh A, Kalatjari V (2004) Size/geometry optimization of trusses by the force method and genetic algorithm. ZAMM-J Appl Math Mech 84(5):347–357MathSciNetCrossRef
Zurück zum Zitat Kaveh A, Talatahari S (2009) A particle swarm ant colony optimization for truss structures with discrete variables. J Construct Steel Res 65(8–9):1558–1568CrossRef Kaveh A, Talatahari S (2009) A particle swarm ant colony optimization for truss structures with discrete variables. J Construct Steel Res 65(8–9):1558–1568CrossRef
Zurück zum Zitat Kaveh A, Talatahari S (2012) Charged system search for optimal design of frame structures. Appl Soft Comput 12(1):382–393CrossRef Kaveh A, Talatahari S (2012) Charged system search for optimal design of frame structures. Appl Soft Comput 12(1):382–393CrossRef
Zurück zum Zitat Kool W, Van Hoof H, Welling M (2019) Stochastic beams and where to find them: the Gumbel-top-k trick for sampling sequences without replacement. In: International conference on machine learning, pp 3499–3508, PMLR, 2019 Kool W, Van Hoof H, Welling M (2019) Stochastic beams and where to find them: the Gumbel-top-k trick for sampling sequences without replacement. In: International conference on machine learning, pp 3499–3508, PMLR, 2019
Zurück zum Zitat Kripka M (2004) Discrete optimization of trusses by simulated annealing. J Braz Soc Mech Sci Eng 26(2):170–173CrossRef Kripka M (2004) Discrete optimization of trusses by simulated annealing. J Braz Soc Mech Sci Eng 26(2):170–173CrossRef
Zurück zum Zitat Krogh C, Jungersen MH, Lund E, Lindgaard E (2017) Gradient-based selection of cross sections: a novel approach for optimal frame structure design. Struct Multidisc Optim 56(5):959–972CrossRef Krogh C, Jungersen MH, Lund E, Lindgaard E (2017) Gradient-based selection of cross sections: a novel approach for optimal frame structure design. Struct Multidisc Optim 56(5):959–972CrossRef
Zurück zum Zitat Lenstra JK, Kan AR (1979) Computational complexity of discrete optimization problems. In: Hammer P, Johnson E, Korte B (eds) Discrete optimization. I. Annals of discrete mathematics, vol 4. Elsevier, Amsterdam, pp 121–140 Lenstra JK, Kan AR (1979) Computational complexity of discrete optimization problems. In: Hammer P, Johnson E, Korte B (eds) Discrete optimization. I. Annals of discrete mathematics, vol 4. Elsevier, Amsterdam, pp 121–140
Zurück zum Zitat Li L, Huang Z, Liu F (2009) A heuristic particle swarm optimization method for truss structures with discrete variables. Comput Struct 87(7–8):435–443CrossRef Li L, Huang Z, Liu F (2009) A heuristic particle swarm optimization method for truss structures with discrete variables. Comput Struct 87(7–8):435–443CrossRef
Zurück zum Zitat Lund E, Stegmann J (2005) On structural optimization of composite shell structures using a discrete constitutive parametrization. Wind Energy 8(1):109–124ADSCrossRef Lund E, Stegmann J (2005) On structural optimization of composite shell structures using a discrete constitutive parametrization. Wind Energy 8(1):109–124ADSCrossRef
Zurück zum Zitat Maddison CJ, Tarlow D, Minka T (2014) A* sampling. Adv Neural Inf Process Syst 27:1 Maddison CJ, Tarlow D, Minka T (2014) A* sampling. Adv Neural Inf Process Syst 27:1
Zurück zum Zitat Maddison C, Mnih A, Teh Y (2017) The concrete distribution: a continuous relaxation of discrete random variables. In: The international conference on learning representations, 2017 Maddison C, Mnih A, Teh Y (2017) The concrete distribution: a continuous relaxation of discrete random variables. In: The international conference on learning representations, 2017
Zurück zum Zitat Martins JRRA, Ning A (2022) Engineering design optimization. Cambridge University Press, Cambridge Martins JRRA, Ning A (2022) Engineering design optimization. Cambridge University Press, Cambridge
Zurück zum Zitat McGuire W, Gallagher RH, Saunders H (1982) Matrix structural analysis. Wiley, New York McGuire W, Gallagher RH, Saunders H (1982) Matrix structural analysis. Wiley, New York
Zurück zum Zitat Park HS, Sung CW (2002) Optimization of steel structures using distributed simulated annealing algorithm on a cluster of personal computers. Comput Struct 80(14–15):1305–1316CrossRef Park HS, Sung CW (2002) Optimization of steel structures using distributed simulated annealing algorithm on a cluster of personal computers. Comput Struct 80(14–15):1305–1316CrossRef
Zurück zum Zitat Piacentini C, Cheong H, Ebrahimi M, Butscher A (2020) Multi-speed gearbox synthesis using global search and non-convex optimization. International conference on integration of constraint programming, artificial intelligence, and operations research. Springer, Berlin, pp 381–398 Piacentini C, Cheong H, Ebrahimi M, Butscher A (2020) Multi-speed gearbox synthesis using global search and non-convex optimization. International conference on integration of constraint programming, artificial intelligence, and operations research. Springer, Berlin, pp 381–398
Zurück zum Zitat Rohatgi VK, Saleh AME (2015) An introduction to probability and statistics. Wiley, New YorkCrossRef Rohatgi VK, Saleh AME (2015) An introduction to probability and statistics. Wiley, New YorkCrossRef
Zurück zum Zitat Sadollah A, Bahreininejad A, Eskandar H, Hamdi M (2012) Mine blast algorithm for optimization of truss structures with discrete variables. Comput Struct 102:49–63CrossRef Sadollah A, Bahreininejad A, Eskandar H, Hamdi M (2012) Mine blast algorithm for optimization of truss structures with discrete variables. Comput Struct 102:49–63CrossRef
Zurück zum Zitat Sadollah A, Eskandar H, Bahreininejad A, Kim JH (2015) Water cycle, mine blast and improved mine blast algorithms for discrete sizing optimization of truss structures. Comput Struct 149:1–16CrossRef Sadollah A, Eskandar H, Bahreininejad A, Kim JH (2015) Water cycle, mine blast and improved mine blast algorithms for discrete sizing optimization of truss structures. Comput Struct 149:1–16CrossRef
Zurück zum Zitat Shahabsafa M, Mohammad-Nezhad A, Terlaky T, Zuluaga L, He S, Hwang JT, Martins JR (2018) A novel approach to discrete truss design problems using mixed integer neighborhood search. Struct Multidisc Optim 58(6):2411–2429MathSciNetCrossRef Shahabsafa M, Mohammad-Nezhad A, Terlaky T, Zuluaga L, He S, Hwang JT, Martins JR (2018) A novel approach to discrete truss design problems using mixed integer neighborhood search. Struct Multidisc Optim 58(6):2411–2429MathSciNetCrossRef
Zurück zum Zitat Stolpe M (2016) Truss optimization with discrete design variables: a critical review. Struct Multidisc Optim 53(2):349–374MathSciNetCrossRef Stolpe M (2016) Truss optimization with discrete design variables: a critical review. Struct Multidisc Optim 53(2):349–374MathSciNetCrossRef
Zurück zum Zitat Stolpe M, Kawamoto A (2005) Design of planar articulated mechanisms using branch and bound. Math Program 103(2):357–397MathSciNetCrossRef Stolpe M, Kawamoto A (2005) Design of planar articulated mechanisms using branch and bound. Math Program 103(2):357–397MathSciNetCrossRef
Zurück zum Zitat Yan J, Duan Z, Lund E, Zhao G (2016) Concurrent multi-scale design optimization of composite frame structures using the Heaviside penalization of discrete material model. Acta Mech Sin 32:430–441ADSMathSciNetCrossRef Yan J, Duan Z, Lund E, Zhao G (2016) Concurrent multi-scale design optimization of composite frame structures using the Heaviside penalization of discrete material model. Acta Mech Sin 32:430–441ADSMathSciNetCrossRef
Zurück zum Zitat Yang J, Zhang Q, Ni B, Li L, Liu J, Zhou M, Tian Q (2019) Modeling point clouds with self-attention and Gumbel subset sampling. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 3323–3332, 2019 Yang J, Zhang Q, Ni B, Li L, Liu J, Zhou M, Tian Q (2019) Modeling point clouds with self-attention and Gumbel subset sampling. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 3323–3332, 2019
Zurück zum Zitat Yates D, Templeman A, Boffey T (1982) The complexity of procedures for determining minimum weight trusses with discrete member sizes. Int J Solids Struct 18(6):487–495CrossRef Yates D, Templeman A, Boffey T (1982) The complexity of procedures for determining minimum weight trusses with discrete member sizes. Int J Solids Struct 18(6):487–495CrossRef
Metadaten
Titel
Optimal design of frame structures with mixed categorical and continuous design variables using the Gumbel–Softmax method
verfasst von
Mehran Ebrahimi
Hyunmin Cheong
Pradeep Kumar Jayaraman
Farhad Javid
Publikationsdatum
01.03.2024
Verlag
Springer Berlin Heidelberg
Erschienen in
Structural and Multidisciplinary Optimization / Ausgabe 3/2024
Print ISSN: 1615-147X
Elektronische ISSN: 1615-1488
DOI
https://doi.org/10.1007/s00158-024-03745-7

Weitere Artikel der Ausgabe 3/2024

Structural and Multidisciplinary Optimization 3/2024 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.