Bio-inspired computation: Where we stand and what's next

https://doi.org/10.1016/j.swevo.2019.04.008Get rights and content

Abstract

In recent years, the research community has witnessed an explosion of literature dealing with the mimicking of behavioral patterns and social phenomena observed in nature towards efficiently solving complex computational tasks. This trend has been especially dramatic in what relates to optimization problems, mainly due to the unprecedented complexity of problem instances, arising from a diverse spectrum of domains such as transportation, logistics, energy, climate, social networks, health and industry 4.0, among many others. Notwithstanding this upsurge of activity, research in this vibrant topic should be steered towards certain areas that, despite their eventual value and impact on the field of bio-inspired computation, still remain insufficiently explored to date. The main purpose of this paper is to outline the state of the art and to identify open challenges concerning the most relevant areas within bio-inspired optimization. An analysis and discussion are also carried out over the general trajectory followed in recent years by the community working in this field, thereby highlighting the need for reaching a consensus and joining forces towards achieving valuable insights into the understanding of this family of optimization techniques.

Introduction

Over millions of years, Nature has evolved to give rise to intelligent behavioral characteristics and biological phenomena, where adaptability, self-learning, robustness, and efficiency enable biological agents (such as insects and birds) to undertake complex tasks. While cases exemplifying these capabilities are truly multi-fold, the most illustrative ones revolve around the social behavior of animals such as ant colonies, beehives and bird flocks, where concepts such as stigmergy and the collective swarming movement of organisms often lead to the so-called Swarm Intelligence (SI), where improved exploration mechanisms over complex search spaces can be achieved by agents obeying local rules without any central control. The overall functionalities of the swarm are much richer than the simple sum of individual actions. Similarly, other renowned examples arise from the genetic inheritance process, the immune system of the human body or the neural activity of the brain. We refer to Ref. [1] for a comprehensive material summarizing these inspirational sources found in Nature.

Inspired by different behaviors observed in biological systems, many researchers in the research community investigating on computational paradigms have emulated intelligent bio-inspired processes in the form of computational algorithms, in an attempt to mimic the inherent advantages of such biological systems to address complex modeling, simulation, and optimization problems. In this regard, special attention has been paid to optimization problems, whose complexity has unleashed a rich substratum where to grow many bio-inspired population-based heuristic approaches, each differently balancing between computational efficiency and optimality of solutions. While the first contributions in this area are largely based on observation and emulation of Darwinian evolutionary principles, nowadays the number of bio-inspired solvers in the literature has increased dramatically, with very diverse inspirational rationale underneath their algorithmic design. This spotted flourishing of novel bio-inspiration optimization methods becomes even more intense when shifting the focus on other aspects related to optimization, such as multi-objective criteria, evolving (dynamic) optimization problems or distributed computing schemes, to mention a few.

However, quantity and diversity do not necessarily reflect scientific value when it comes to science. The development of the field has lately undergone a gold rush for bio-inspired streamlines that stimulate new algorithmic strands, around which some controversy has sprung regarding their relevance and novelty [2]. Debates around this topic are counterproductive, for which they waste efforts towards research directions with scarce – or even null – added scientific value. The same may occur in other research subareas as the ones exemplified above, where most algorithmic contributions build upon empirical performance observations rather than upon a deep, thoughtful and rigorous analysis of their design and internal operation. Futile debates should set aside to allow the entire community to start over with a clean common ground on the key research directions to be pursued in the future. We must ally to focus our efforts on important unresolved questions that can potentially produce greater insights into bio-inspired optimization techniques, ultimately leading to valuable advances and improved methods. Without a consensus, research niches of acknowledged relevance in the field will remain largely unexplored and unfairly dominated by controversial discussions, subtle and incremental algorithmic proposals, and a worrying lack of fresh breezes and fertile prospects.

This work responds to this need for a common meeting point by suggesting the audience to pause and reflect on which research directions should be pursued in the future in regards to bio-inspired optimization and related areas. For this purpose we pay special attention to numerical optimization, which was underneath the advent of the first bio-inspired solvers that were later adapted to combinatorial optimization. In this manuscript we provide an informed insight of the status of this field from both descriptive (where we stand) and prescriptive (what's next) points of view. This manuscript suggests and highlights several key research challenges that should captivate newcomers and experienced researchers for years to come, with scientific soundness at the core of their raison d'être. We hope that our envisioned future for bio-inspired computation acts as a suggestive guiding light for the community, bringing together different views that have remained so far quite different from each other to date, and potentially unifying them into a comprehensive multi-disciplinary view of the field.

The remainder of the paper is structured as follows: first, Section 2 provides a brief albeit informative overview of the history of bio-inspired computation. Section 3 and subsections therein undertake a comprehensive analysis of several areas of the field, stressing on their current status, trends, and open challenges. Section 4 elaborates on the general issues and research niches of bio-inspired computation, and finally Section 5 concludes this paper.

Section snippets

Recent history of bio-inspired computation

Bio-inspired computation has emerged as one of the most studied branches of Artificial Intelligence during the last decades. Hundreds of novel approaches have been reported along the years, showcasing the adoptability of different bio-inspired behaviors and characteristics to yield a near-optimal performance over a wide range of complex academic and real-world problems. This growing attention has led to a continuous increase in the number of publications related to the field, mainly focusing on

Bio-inspired computation: where we stand and what's next

Bio-inspired computation is a broad field composed by multiple interconnected research areas. A thorough comprehensive review of the state of the art of all such areas would be counterproductive in our attempt at prioritizing research efforts in a global scale. For this reason, in this section, we stress on a reduced subset of research areas which, as shown in Fig. 2, have been particularly trendy in the last couple of years. Our analysis, schematically summarized in Fig. 3, emphasizes on the

Bio-inspired computation: a curly road ahead

In the previous section we have identified possible research paths to follow in important research areas within bio-inspired computation. Unfortunately, the field still undergoes general issues that threaten to jeopardize true advances in years to come. A synergistic push from the community should be made towards addressing these issues for the benefit of Science. We herein provide some thoughts so as to constructively foster research efforts in such directions:

Conclusion: an exciting future for bio-inspired computation

In this manuscript we have shared our envisioned status of bio-inspired computation, which calls for a profound reflection on the research paths that the community should follow in the future. To this end, we have briefly reviewed the history of this field from the very advent of EC to the plethora of new SI methods appearing in the late literature. Grounded on this historical perspective we have identified research paths for a number of selected areas within bio-inspired optimization that

Acknowledgements

Javier Del Ser and Eneko Osaba would like to thank the Basque Government for funding support received through the EMAITEK and ELKARTEK funding programs. The work of Sancho Salcedo-Sanz and David Camacho is partially supported by the Ministerio de Economía y Competitividad (MINECO) of Spain (grant no. TIN2017-85887-C2-2-P and TIN2017-85727-C4-3-P, respectively). The work of Daniel Molina and Francisco Herrera is supported by the Spanish Ministry of Science (grants TIN2016-8113-R and

References (452)

  • A.V. Kononova et al.

    Structural bias in population-based algorithms

    Inf. Sci.

    (2015)
  • A.P. Piotrowski et al.

    Some metaheuristics should be simplified

    Inf. Sci.

    (2018)
  • M. Mavrovouniotis et al.

    A survey of swarm intelligence for dynamic optimization: algorithms and applications

    Swarm Evolut. Comput.

    (2017)
  • H. Ma et al.

    Multi-population techniques in nature inspired optimization algorithms: a comprehensive survey

    Swarm Evolut. Comput.

    (2019)
  • T.T. Nguyen et al.

    Evolutionary dynamic optimization: a survey of the state of the art

    Swarm Evolut. Comput.

    (2012)
  • N.V. Sahinidis

    Optimization under uncertainty: State-of-the-art and opportunities

    Comput. Chem. Eng.

    (2004)
  • H.-G. Beyer et al.

    Robust optimization–a comprehensive survey

    Comput. Methods Appl. Mech. Eng.

    (2007)
  • İhsan Yanıkoğlu et al.

    A survey of adjustable robust optimization

    Eur. J. Oper. Res.

    (2019)
  • K. Kuhn et al.

    Bi-objective robust optimisation

    Eur. J. Oper. Res.

    (2016)
  • R. Bokrantz et al.

    Necessary and sufficient conditions for pareto efficiency in robust multiobjective optimization

    Eur. J. Oper. Res.

    (2017)
  • Z. Zhao et al.

    A health performance prediction method of large-scale stochastic linear hybrid systems with small failure probability

    Reliab. Eng. Syst. Saf.

    (2017)
  • J.H. Holland

    Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence

    (1975)
  • K. Sörensen

    Metaheuristics – the metaphor exposed

    Int. Trans. Oper. Res.

    (2015)
  • L.J. Fogel et al.

    Artificial Intelligence through Simulated Evolution

    (1966)
  • H.-P. Schwefel
    (1977)
  • I. Rechenberg
    (1973)
  • T. Bäck et al.

    Handbook of Evolutionary Computation

    (1997)
  • R. Storn et al.

    Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces

    J. Glob. Optim.

    (1997)
  • N. Hansen et al.

    Reducing the time complexity of the derandomized evolution strategy with covariance matrix adaptation (CMA-ES)

    Evol. Comput.

    (2003)
  • A. Auger et al.

    A restart CMA evolution strategy with increasing population size

  • R. Tanabe et al.

    Success-history based parameter adaptation for differential evolution

  • R. Thomsen

    Multimodal optimization using crowding-based differential evolution

  • J.J. Liang et al.

    Comprehensive learning particle swarm optimizer for global optimization of multimodal functions

    IEEE Trans. Evol. Comput.

    (2006)
  • X.-S. Yang

    Firefly algorithms for multimodal optimization

  • K. Deb et al.

    A fast and elitist multiobjective genetic algorithm: NSGA-II

    IEEE Trans. Evol. Comput.

    (2002)
  • Q. Zhang et al.

    MOEA/D: a multiobjective evolutionary algorithm based on decomposition

    IEEE Trans. Evol. Comput.

    (2007)
  • A.J. Nebro et al.

    SMPSO: A new PSO-based metaheuristic for multi-objective optimization

  • K. Deb
    (2001)
  • C. Coello Coello

    Evolutionary multi-objective optimization: A historical view of the field

    IEEE Comput. Intell. Mag.

    (2006)
  • H. Ishibuchi et al.

    Evolutionary many-objective optimization: a short review

  • E. Alba et al.
    (2013)
  • E. Bonabeau et al.

    Swarm Intelligence: from Natural to Artificial Systems

    (1999)
  • M. Dorigo

    Optimization, Learning and Natural Algorithms

    (1992)
  • R. Eberhart et al.

    A new optimizer using particle swarm theory

  • D. Simon

    Biogeography-based optimization

    IEEE Trans. Evol. Comput.

    (2008)
  • K.M. Passino

    Biomimicry of bacterial foraging for distributed optimization and control

    IEEE Control Syst.

    (2002)
  • D. Karaboga

    An Idea Based on Honey Bee Swarm for Numerical Optimization

    (2005)
  • X.-S. Yang

    Firefly algorithm, stochastic test functions and design optimisation

    Int. J. Bio-Inspired Comput.

    (2010)
  • K. Hussain et al.

    Metaheuristic research: A comprehensive survey

    Artif. Intell. Rev.

    (2018)
  • E. Atashpaz-Gargari et al.

    Imperialist competitive algorithm: An algorithm for optimization inspired by imperialistic competition

  • Cited by (472)

    View all citing articles on Scopus
    View full text