Elsevier

Automatica

Volume 40, Issue 10, October 2004, Pages 1647-1664
Automatica

Modeling, stability and control of biped robots—a general framework

https://doi.org/10.1016/j.automatica.2004.01.031Get rights and content

Abstract

The focus of this survey is the modeling and control of bipedal locomotion systems. More specifically, we seek to review the developments in the field within the framework of stability and control of systems subject to unilateral constraints. We place particular emphasis on three main issues that, in our view, form the underlying theory in the study of bipedal locomotion systems. Impact of the lower limbs with the walking surface and its effect on the walking dynamics was considered first. The key issue of multiple impacts is reviewed in detail. Next, we consider the dynamic stability of bipedal gait. We review the use of discrete maps in studying the stability of the closed orbits that represent the dynamics of a biped, which can be characterized as a hybrid system. Last, we consider the control schemes that have been used in regulating the motion of bipedal systems. We present an overview of the existing work and seek to identify the needed future developments. Due to the very large number of publications in the field, we made the choice to mainly focus on journal papers.

Introduction

In general, a bipedal locomotion system consists of several members that are interconnected with actuated joints. In essence, a man-made walking robot is nothing more than a robotic manipulator with a detachable and moving base. Design of bipedal robots has been largely influenced by the most sophisticated and versatile biped known to man, the man himself. Therefore, most of the models/machines developed bear a strong resemblance to the human body. Almost any model or machine can be characterized as having two lower limbs that are connected through a central member. Although the complexity of the system depends on the number of degrees of freedom, the existence of feet structures, upper limbs, etc., it is widely known that even extremely simple unactuated systems can generate ambulatory motion. A bipedal locomotion system can have a very simple structure with three point masses connected with massless links (Garcia, Chatterjee, Ruina, & Coleman, 1997) or very complex structure that mimics the human body (Vukobratovic, Borovac, Surla, & Stokic, 1990). In both cases, the system can walk several steps. The robotics community has been involved in the field of modeling and control of bipeds for many years. The books (Vukobratovic, 1976; Vukobratovic et al., 1990; Raibert, 1986; Todd, 1985) are worth reading as an introduction to the field. The interested reader may also refer to the following web pages:

http://www.androidworld.com/prod28.htm,

http://robby.caltech.edu/~kajita/bipedsite.html,

http://www.fzi.de/divisions/ipt/WMC/preface/preface.html,

http://www.kimura.is.uec.ac.jp/faculties/legged-robots.html.

Nevertheless, and despite the technological exploit achieved by Honda's engineers (Japan is certainly the country where bipedal locomotion has received the most attention and has the longest history), some fundamental modeling and control problems have still not been addressed nor solved in the related literature. One may notice, in particular, that the locomotion of Honda's P3 prototype remains far from classical human walking patterns at the same speeds. Although Honda (HONDA) did not publish many details either on the mechanical part or on the implemented control heuristic, it is easy to see on the available videos that P3's foot strike does not look natural and leads to some transient instability (http://www.honda-p3.com). The number of foot design patents taken out by Honda (up to an air-bag-like planter arch) reveals again that foot–ground impact remains one of the main difficulties one has to face in the design of robust control laws for walking robots. This will become the key issue with increasing horizontal velocity requirement. This problem, however, is more sensitive for two-legged robots than for multi-legged ones due to the almost straight leg configuration and the bigger load at impact time for the former, leading to stronger velocity jumps of the center of mass. While Honda's engineers seem to consider these velocity jumps as unwanted perturbations and thus appeal to mechanical astuteness to smooth the trajectory, we argue that impact is an intrinsic feature of mechanical systems like biped robots and should be taken as such in the controller design. Other bipedal robots have been designed. Among the most advanced projects, we cite the Waseda University Humanoid Robotics Institute biped, the MIT Leg Laboratory robots, the LMS-INRIA BIP system (Sardain, Rostami, & Bessonnet, 1998; Sardain, Rostami, Thomas, & Bessonnet, 1999), the CNRS-Rabbit project (Chevallereau et al., 2003), and the German Autonomous Walking programme (Gienger, Löffler, & Pfeiffer, 2003), which can be found at

http://www.humanoid.rise.waseda.ac.jp/booklet/kato_4.html,

http://www.ai.mit.edu/projects/leglab/robots/robots.html,

http://www.inrialpes.fr/bip,

http://www-lag.ensieg.inpg.fr/PRC-Bipedes/,

http://www.fzi.de/ids/dfg_schwerpunkt_laufen/start_page.html.

respectively. Among all these existing bipeds, the Honda robots seem to be the most advanced at the time of writing of this paper according to the information made available by the owners. However, the solution for control designed by Honda does not explain why a given trajectory works nor does it give any insight as to how to select, chain together, and blend various behaviors to effect locomotion through difficult terrain (Pratt, 2000). It is the feeling of the authors that the problem of feedback control of bipedal robots will not be solved properly as long as the dynamics of such systems is not thoroughly understood. In fact, the main motivation for the writing of this paper has been the following observation about walking: there is no analytical study of a stable controller with a complete stability proof available in the related literature. It is our belief that the main reason for this is the lack of a suitable model. We propose a framework that is not only simple enough to allow subsequent stability and control studies but also realistic as some experimental validations prove. In addition, the framework provides a unified modeling approach for mathematical, numerical, and control problems, which has been missing. It is for instance significant that the main efforts of the MIT Leg Lab (Pratt, 2000) have been directed toward technological (actuators) improvement and testing of heuristic control algorithms similar to Honda's works.

We should emphasize that the main thrust of this survey does overlook several practical aspects that may arise during the design and development of walking machines. Admittedly, a walking machine can be built without paying attention to many of the main ideas of this survey. There are numerous toys that walk in a certain fashion. There are quite a few bipedal robots that are designed to avoid impacts altogether during walking. The fact remains that the stability, agility, and versatility of any existing bipedal machine does not even come close to that of the human biped. The surveyed concepts will better enable the design and evaluation of such machines through more suitable control algorithms that take into account impact mechanics and stability. The practical issues that arise in the design and development actual machines deserve another survey article. In the ensuing part of this survey we, therefore, will mainly focus on a theoretical framework.

Section snippets

General description of a bipedal walker

A biped can be represented by an inverted pendulum system that has a constrained motion due to the forward and backward impacts of the swing limb with the ground (Cavagna, Heglund, & Taylor, 1977; Hurmuzlu & Moskowitz, 1986; Full & Koditschek, 1999). Although similar to the structure of vibration dampers in many aspects (Shaw & Shaw, 1989), which are relatively well studied, structure of bipedal systems have a fundamental difference arising from the unconstrained contact of the limbs with the

Dynamics of the complementarity model

Bipedal locomotion systems are unilaterally constrained dynamical systems. A way to model such systems is to introduce a set of unilateral constraints in the following form:F(q)⩾0,q∈Rp,F:RpRm,where q represents the complete vector of independent generalized coordinates. In other words, p denotes the number of degrees of freedom of the system without constraints, i.e. when F(q)>0. The constraints mean that the bodies that constitute the system cannot interpenetrate (irrespective of the fact

The stability framework

The most crucial problem concerning the dynamics of bipedal robots is their stability, see e.g. http://www.ercim.org/publication/Ercim_News/enw42/espiau.html. As has been explained in 2 General description of a bipedal walker, 3 Mathematical description of a biped as a system subject to unilateral constraints, a biped is far from being a simple set of (controlled) differential equations. Moreover, the objectives of walking are quite specific. One is therefore led to first answer the question:

Control of bipedal robots

The control problem of bipedal robots can be defined as choosing a proper input u in (S) such that the system behaves in a desired fashion. The key issue of controlling the motion of bipeds still hinges on the specification of a desired motion. There are numerous ways that one can specify the desired behavior of a biped, which in itself is an open question. The control problem can become very simple or extremely complex depending on the specified desired behavior and the structure of the

Conclusions and directions for future research

This survey is devoted to the problem of modeling and control of a class of non-smooth nonlinear mechanical systems, namely bipedal robots. It is proposed to recast these dynamical systems in the framework of mechanical systems subject to complementarity conditions. Unilateral constraints that represent possible detachment of the feet from the ground and Coulomb friction model can be written this way. In the language of Full and Koditschek (1999), this is a suitable template. Such a point of

Bernard Brogliato got his Ph.D. from the Institut National Polytechnique de Grenoble in January 1991. He is presently working for the French National Institute in Computer Science and Control (INRIA), in the Bipop project. His scientific interests are in non-smooth dynamical systems, modelling, stability and control. He is a member of the Euromech Non Linear Oscillations Conference committee (ENOCC), reviewer for Mathematical Reviews and the ASME Applied Mechanics Reviews, and is Associate

References (164)

  • V.V. Beletskii et al.

    Parametric optimization of motions of a bipedal walking robot

    Izvestiya AN SSSR Mekhanika Tverdogo Tela

    (1982)
  • V.V. Beletskii et al.

    Model estimation of the energetics of bipedal walking and running

    Mechanics of Solids

    (1983)
  • V.V. Beletskii et al.

    Parametric optimization in the problem of bipedal locomotion

    Izvestiya AN SSSR Mekhanika Tverdogo Tela

    (1977)
  • V.V. Beletskii et al.

    The linear stabilization problem for two legged ambulation

    Izvestiya AN SSSR Mekhanika Tverdogo Tela

    (1977)
  • V.V. Beletskii et al.

    Control of motion of a bipedal walking robot

    Izvestiya AN SSSR Mekhanika Tverdogo Tela

    (1980)
  • V.V. Beletskii et al.

    Plane linear models of biped locomotion

    Izvestiya AN SSSR Mekhanika Tverdogo Tela

    (1976)
  • W. Blajer et al.

    Walking without impacts as a motion/force control problem

    ASME Journal of Dynamic Systems, Measurement and Control

    (1992)
  • R. Blickman et al.

    Locomotion energetics of the ghost crab. II. Mechanics of the center of mass during walking and running

    Journal of Experimental Biology

    (1987)
  • Y.V. Bolotin

    Energetically optimal gaits of a bipedal walking robot

    Mechanics of Solids

    (1984)
  • B. Borovac et al.

    An approach to biped control synthesis

    Robotica

    (1989)
  • Bourgeot, J. M., & Brogliato, B. (2003). Tracking control of complementarity Lagrangian systems. International Journal...
  • Brogliato, B. (1999). Nonsmooth mechanics. Berlin: Springer, CCES (erratum and addendum at...
  • Brogliato, B. (2003). Some perspectives on the analysis and control of complementarity systems. IEEE Transactions on...
  • B. Brogliato et al.

    On the control of finite dimensional mechanical systems with unilateral constraints

    IEEE Transactions on Automatic Control

    (1997)
  • B. Brogliato et al.

    Numerical simulation of finite dimensional multibody nonsmooth mechanical systems

    ASME Applied Mechanics Reviews

    (2002)
  • B. Brogliato et al.

    On the control of complementary slackness juggling mechanical systems

    IEEE Transactions on Automatic Control

    (2000)
  • C. Budd et al.

    Chattering and related behaviour in impact oscillators

    Proceedings of the Royal Society of London A

    (1994)
  • G.A. Cavagna et al.

    Mechanical work in terrestrial locomotionTwo basic mechanisms for minimizing energy expandure

    American Journal of Physiology

    (1977)
  • T.H. Chang et al.

    Sliding control without reaching phase and its application to bipedal locomotion

    ASME Journal of Dynamic Systems, Measurement, and Control

    (1994)
  • P.H. Channon et al.

    Derivation of optimal walking motions for a bipedal walking robot

    Robotica

    (1992)
  • Channon, P. H., Hopkins, S. H., & Pham, D. T. (1996a). A gravity compensation technique for an n-legged robot....
  • P.H. Channon et al.

    Optimal Control of an n-legged robot

    Journal of Systems and Control Engineering

    (1996)
  • Channon, P. H., Hopkins, S. H., & Pham, D. T. (1996c). A variational approach to the optimization of gait for a bipedal...
  • A. Chatterjee et al.

    Small slope implies low speed in passive dynamic walking

    Dynamics and Stability of Systems

    (1998)
  • C. Chevallereau

    Time-scaling control of an underactuated biped robot

    IEEE Transactions on Robotics and Automation

    (2003)
  • Chevallereau, C., Abba, G., Aoustin, Y., Plestan, F., Westervelt, E. R., Canudas de Wit, C., & Grizzle, J. W. (2003)....
  • C. Chevallereau et al.

    Optimal reference trajectories for walking and running of a biped robot

    Robotica

    (2001)
  • Chevallereau, C., Formal'sky, A., & Perrin, B. (1997). Control of a walking robot with feet following a reference...
  • P.S. Chudinov

    One problem of angular stabilization of bipedal locomotion

    Izvestiya AN SSSR Mekhanika Tverdogo Tela

    (1980)
  • P.S. Chudinov

    Problem of angular stabilization of bipedal locomotion

    Izvestiya AN SSSR Mekhanika Tverdogo Tela

    (1984)
  • S. Collins et al.

    A 3-d passive-dynamic walking robot with two legs and knees

    International Journal of Robotics Research

    (2001)
  • R.W. Cottle et al.

    The linear complementarity problem

    (1992)
  • H. Dankowicz et al.

    3D passive walkersfinding periodic gaits in the presence of discontinuities

    Nonlinear Dynamics

    (2001)
  • H. Dankowicz et al.

    Exploiting discontinuities for stabilisation of recurrent motions

    Dynamical Systems: An International Journal

    (2002)
  • S.L. Das et al.

    An alternative stability analysis technique for the simplest walker

    Nonlinear Dynamics

    (2002)
  • E. Delassus

    Mémoire sur la théorie des liaisons finies unilatérales

    Annales Scientifiques de L Ecole Normale Superieurs

    (1917)
  • Dunn, E., & Howe, R. D. (1994). Toward smooth bipedal walking. IEEE international conferences on robotics and...
  • F. El Hafi et al.

    Behavioural approach for a bipedal robot stepping motion gait

    Robotica

    (1999)
  • Fallis, G. T. (1888). Walking toy. US Patents 376, 588, Washington,...
  • M.C. Ferris et al.

    Engineering and economic application of complementarity problems

    SIAM Review

    (1997)
  • Cited by (202)

    • Modeling, analysis and control of robot–object nonsmooth underactuated Lagrangian systems: A tutorial overview and perspectives

      2023, Annual Reviews in Control
      Citation Excerpt :

      Some dynamics are detailed in Appendix. Several classes of nonsmooth robotic systems (bipedal locomotion (Carpentier & Wieber, 2021; Grizzle et al., 2014; Gupta & Kumar, 2017; Holmes et al., 2006; Hurmuzlu et al., 2004; Mikolajczyk et al., 2022; Sugihara & Morisawa, 2020; Wieber et al., 2016; Yamamoto et al., 2020), manipulation (Du, Negenborn, & Reppa, 2022; Khamseh, Janabi-Sharifi, & Abdessameud, 2018; Kleeberger, Bormann, Kraus, & Huber, 2020; Marwan et al., 2021; Mason, 2018; Nadon, Valencia, & Payeur, 2018; Pan et al., 2022; Prattichizzo & Trinkle, 2016; Ruggiero, Lippiello et al., 2018), systems with joint clearance (Lagerberg, 2001; Nordin & Gutman, 2002), hopping robots (Sayyad et al., 2007), pushing tasks (Stüber, Zito, & Stolkin, 2020), quadruped robots (Biswal & Mohanty, 2021; Zhong, Wang, Feng, & Chen, 2019), snake robots (Transeth et al., 2009), cable-driven manipulators (Qian et al., 2018; Tang, 2014), spherical robots with internal rotors (Chase & Pandya, 2012)) have already been the object of survey articles in the Automatic Control or in the Robotics literature. It is therefore outside the scope of this article, to survey them exhaustively once again, since this would yield repetition and far too many references (probably several thousands).

    • Stability Analysis of Switched Linear Systems with Neural Lyapunov Functions

      2024, Proceedings of the AAAI Conference on Artificial Intelligence
    View all citing articles on Scopus

    Bernard Brogliato got his Ph.D. from the Institut National Polytechnique de Grenoble in January 1991. He is presently working for the French National Institute in Computer Science and Control (INRIA), in the Bipop project. His scientific interests are in non-smooth dynamical systems, modelling, stability and control. He is a member of the Euromech Non Linear Oscillations Conference committee (ENOCC), reviewer for Mathematical Reviews and the ASME Applied Mechanics Reviews, and is Associate Editor for Automatica since October 1999.

    Yildirim Hurmuzlu received his Ph.D. degree in Mechanical Engineering from Drexel University. Since 1987, he has been at the Southern Methodist University, Dallas, Texas, where he is a Professor and Chairman of the Department of Mechanical Engineering. His research focuses on nonlinear dynamical systems and Control, with emphasis on robotics, biomechanics, and vibration control. He has published more than 60 articles in these areas. Dr. Hurmuzlu is the associate Editor of the ASME Transactions on Dynamics Systems, Measurement and Control.

    Frank Génot was born in 1970 in Zweibrücken (Germany). He graduated from the Ecole Nationale Superieure d'Informatique et de Mathematiques Appliquées de Grenoble (France) in 1993. He got the Ph.D. degree from the Institut National Polytechnique de Grenoble in Computer Science in January 1998. Since September 2000, he has been an INRIA Researcher in the MACS research project at INRIA Rocquencourt (France). His main research interests include modelling and simulation issues of systems with unilateral constraints, in Mechanics and Finance, and Structural Control.

    This paper was not presented at any IFAC meeting. This paper was recommended for publication in revised form by Manfred Morari Editor. In this survey, we review research efforts in developing control algorithms to regulate the dynamics of bipedal gait. We focus on issues that are related to modeling, stability, and control of two legged locomotion systems.

    View full text