Skip to main content
Top

2017 | OriginalPaper | Chapter

7. Assistive Optimal Control-on-Request with Application in Standing Balance Therapy and Reinforcement

Authors : Anastasia Mavrommati, Alex Ansari, Todd D. Murphey

Published in: Trends in Control and Decision-Making for Human–Robot Collaboration Systems

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This chapter develops and applies a new control-on-request (COR) method to improve the capability of existing shared control interfaces. These COR enhanced interfaces allow users to request on-demand bursts of assistive computer control authority when manual/shared control tasks become too challenging. To enable the approach, we take advantage of the short duration of the desired control responses to derive an algebraic solution for the optimal switching control for differentiable nonlinear systems. Simulation studies show how COR interfaces present an opportunity for human–robot collaboration in standing balance therapy. In particular, we use the Robot Operating System (ROS) to show that optimal control-on-request achieves both therapy objectives of active patient participation and safety. Finally, we explore the potential of a COR interface as a vibrotactile feedback generator to dynamically reinforce standing balance through sensory augmentation.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
In this chapter a control action is a control vector with constant values applied for a (possibly infinitesimal) duration of time.
 
2
The notation, \(||\cdot ||_{M}^2\), indicates a norm on the argument where matrix, M, provides the metric (i.e., \(||x(t) ||_{Q}^2 = x(t)^T \, Q \, x(t)\)).
 
3
\(D_{x}f(\cdot )\) denotes the partial derivative \(\frac{\partial f(\cdot )}{\partial x}\).
 
4
At any specified application time, \(\tau _m\), of the COR interface, \(u_2^*(\tau _m)\) represents the optimal action that balances control authority and drives the mode insertion gradient to \(\alpha _d\) if activated around that time. Thus, \(u_2^*(t)\) is a schedule of optimal actions that can be switched to from NC, u(t), to produce a desired change in mode insertion gradient at \(\tau _m\).
 
5
Practically, this is not a very stringent requirement. Most spaces of interest are RKHS. Refer to [7] for more detail.
 
6
For equivalence, \(||\cdot ||\) refers to the \(\mathcal {L}_2\) norm and \(\mathcal {H}\) is additionally assumed to be an \(\mathcal {L}_2\) space.
 
7
A quadratic cost is assumed so that resulting equations emphasize the local similarity between burst control and LQR [2].
 
8
Interestingly, this scheme of intermittent instead of sustained control has been suggested to be natively used by the central nervous system (CNS) in human posture control in [31, 32].
 
9
As shown in Sect. 7.2, it is possible to provide parameters that guarantee local stability and convergence in the case when the Assistive Controller is continuously activated.
 
Literature
1.
go back to reference Abdallah M, Goswami A (2005) A biomechanically motivated two-phase strategy for biped upright balance control. In: IEEE international conference on robotics and automation, pp 1996–2001 Abdallah M, Goswami A (2005) A biomechanically motivated two-phase strategy for biped upright balance control. In: IEEE international conference on robotics and automation, pp 1996–2001
2.
go back to reference Anderson BDO, Moore JB (1990) Optimal control: linear quadratic methods. Prentice-Hall Inc, New JerseyMATH Anderson BDO, Moore JB (1990) Optimal control: linear quadratic methods. Prentice-Hall Inc, New JerseyMATH
3.
go back to reference Ansari A, Murphey T (2015) Control-on-request: short-burst assistive control for long time horizon improvement. In: American control conference, pp 1173–1180 Ansari A, Murphey T (2015) Control-on-request: short-burst assistive control for long time horizon improvement. In: American control conference, pp 1173–1180
4.
go back to reference Banala SK, Kim SH, Agrawal SK, Scholz JP (2009) Robot assisted gait training with active leg exoskeleton (ALEX). IEEE Trans Neural Syst Rehabil Eng 17(1):2–8CrossRef Banala SK, Kim SH, Agrawal SK, Scholz JP (2009) Robot assisted gait training with active leg exoskeleton (ALEX). IEEE Trans Neural Syst Rehabil Eng 17(1):2–8CrossRef
5.
6.
go back to reference Caldwell TM, Murphey TD (2013) Projection-based optimal mode scheduling. In: IEEE conference on decision and control (CDC) Caldwell TM, Murphey TD (2013) Projection-based optimal mode scheduling. In: IEEE conference on decision and control (CDC)
7.
go back to reference Chen Z, Haykin S (2002) On different facets of regularization theory. Neural Comput 14(12):2791–2846CrossRefMATH Chen Z, Haykin S (2002) On different facets of regularization theory. Neural Comput 14(12):2791–2846CrossRefMATH
8.
go back to reference Cipriani C, Zaccone F, Micera S, Carrozza MC (2008) On the shared control of an EMG-controlled prosthetic hand: analysis of user-prosthesis interaction. IEEE Trans Robot 24(1):170–184CrossRef Cipriani C, Zaccone F, Micera S, Carrozza MC (2008) On the shared control of an EMG-controlled prosthetic hand: analysis of user-prosthesis interaction. IEEE Trans Robot 24(1):170–184CrossRef
9.
go back to reference De Vito E, Rosasco L, Caponnetto A, Piana M, Verri A (2004) Some properties of regularized kernel methods. J Mach Learn Res 5:1363–1390MathSciNetMATH De Vito E, Rosasco L, Caponnetto A, Piana M, Verri A (2004) Some properties of regularized kernel methods. J Mach Learn Res 5:1363–1390MathSciNetMATH
10.
go back to reference Demeester E, Hüntemann A, Vanhooydonck D, Vanacker G, Van Brussel H, Nuttin M (2008) User-adapted plan recognition and user-adapted shared control: a bayesian approach to semi-autonomous wheelchair driving. Auton Robots 24(2):193–211CrossRef Demeester E, Hüntemann A, Vanhooydonck D, Vanacker G, Van Brussel H, Nuttin M (2008) User-adapted plan recognition and user-adapted shared control: a bayesian approach to semi-autonomous wheelchair driving. Auton Robots 24(2):193–211CrossRef
11.
go back to reference Deng-Peng X, Xu L (2011) Multiple balance strategies for humanoid standing control. Acta Autom Sin 37(2):228–233MathSciNet Deng-Peng X, Xu L (2011) Multiple balance strategies for humanoid standing control. Acta Autom Sin 37(2):228–233MathSciNet
12.
go back to reference Ding Z-Q, Chen I-M, Yeo SH (2010) The development of a real-time wearable motion replication platform with spatial sensing and tactile feedback. In: IEEE international conference on intelligent robots and systems, pp 3919–3924 Ding Z-Q, Chen I-M, Yeo SH (2010) The development of a real-time wearable motion replication platform with spatial sensing and tactile feedback. In: IEEE international conference on intelligent robots and systems, pp 3919–3924
13.
go back to reference Egerstedt M, Wardi Y, Axelsson H (2003) Optimal control of switching times in hybrid systems. In: IEEE international conference on methods and models in automation and robotics Egerstedt M, Wardi Y, Axelsson H (2003) Optimal control of switching times in hybrid systems. In: IEEE international conference on methods and models in automation and robotics
14.
go back to reference Egerstedt M, Wardi Y, Axelsson H (2006) Transition-time optimization for switched-mode dynamical systems. IEEE Trans Autom Control 51(1):110–115MathSciNetCrossRef Egerstedt M, Wardi Y, Axelsson H (2006) Transition-time optimization for switched-mode dynamical systems. IEEE Trans Autom Control 51(1):110–115MathSciNetCrossRef
15.
go back to reference Elbert T, Sterr A, Rockstroh B, Pantev C, Matthias MM, Edward T (2002) Expansion of the tonotopic area in the auditory cortex of the blind. J Neurosci 22(22):9941–9944 Elbert T, Sterr A, Rockstroh B, Pantev C, Matthias MM, Edward T (2002) Expansion of the tonotopic area in the auditory cortex of the blind. J Neurosci 22(22):9941–9944
16.
go back to reference Emken JL, Bobrow JE, Reinkensmeyer DJ (2005) Robotic movement training as an optimization problem: designing a controller that assists only as needed. In: IEEE international conference on rehabilitation robotics, pp 307–312 Emken JL, Bobrow JE, Reinkensmeyer DJ (2005) Robotic movement training as an optimization problem: designing a controller that assists only as needed. In: IEEE international conference on rehabilitation robotics, pp 307–312
17.
go back to reference Forster A, Young J (1995) Incidence and consequences offalls due to stroke: a systematic inquiry. Bmj 311(6997):83–86CrossRef Forster A, Young J (1995) Incidence and consequences offalls due to stroke: a systematic inquiry. Bmj 311(6997):83–86CrossRef
19.
go back to reference Greena SA, Billinghurstb M, Chena X, Chasea JG (2008) Human-robot collaboration: a literature review and augmented reality approach in design. Int J Adv Robot Syst 5(1) Greena SA, Billinghurstb M, Chena X, Chasea JG (2008) Human-robot collaboration: a literature review and augmented reality approach in design. Int J Adv Robot Syst 5(1)
20.
go back to reference Griffiths P, Brent Gillespie R (2004) Shared control between human and machine: haptic display of automation during manual control of vehicle heading. In: Proceedings 12th international symposium on haptic interfaces for virtual environment and teleoperator systems. IEEE, pp 358–366 Griffiths P, Brent Gillespie R (2004) Shared control between human and machine: haptic display of automation during manual control of vehicle heading. In: Proceedings 12th international symposium on haptic interfaces for virtual environment and teleoperator systems. IEEE, pp 358–366
21.
go back to reference Hansen PC (1999) The L-curve and its use in the numerical treatment of inverse problems. Technical Universityof Denmark, IMM, Department of Mathematical Modelling Hansen PC (1999) The L-curve and its use in the numerical treatment of inverse problems. Technical Universityof Denmark, IMM, Department of Mathematical Modelling
22.
go back to reference Hogan N (1984) Impedance control: an approach to manipulation. In: American control conference, pp 304–313 Hogan N (1984) Impedance control: an approach to manipulation. In: American control conference, pp 304–313
23.
go back to reference Hogan N, Krebs HI, Rohrer B, Palazzolo JJ, Dipietro L, Fasoli SE, Stein J, Hughes R, Frontera WR, Lynch D et al (2006) Motions or muscles? Some behavioral factors underlying robotic assistance of motor recovery. J Rehabil Res Dev 43(5):605CrossRef Hogan N, Krebs HI, Rohrer B, Palazzolo JJ, Dipietro L, Fasoli SE, Stein J, Hughes R, Frontera WR, Lynch D et al (2006) Motions or muscles? Some behavioral factors underlying robotic assistance of motor recovery. J Rehabil Res Dev 43(5):605CrossRef
24.
go back to reference Jezernik S, Colombo G, Keller T, Frueh H, Morari M (2003) Robotic orthosis lokomat: a rehabilitation and research tool. Neuromodul: Technol Neural. Interface 6(2):108–115 Jezernik S, Colombo G, Keller T, Frueh H, Morari M (2003) Robotic orthosis lokomat: a rehabilitation and research tool. Neuromodul: Technol Neural. Interface 6(2):108–115
25.
go back to reference Jezernik S, Colombo G, Morari M (2004) Automatic gait-pattern adaptation algorithms for rehabilitation with a 4-DOF robotic orthosis. IEEE Trans Robot Autom 20(3):574–582CrossRef Jezernik S, Colombo G, Morari M (2004) Automatic gait-pattern adaptation algorithms for rehabilitation with a 4-DOF robotic orthosis. IEEE Trans Robot Autom 20(3):574–582CrossRef
26.
go back to reference Krebs HI, Hogan N, Aisen ML, Volpe BT (1998) Robot-aided neurorehabilitation. IEEE Trans Rehabil Eng 6(1):75–87CrossRef Krebs HI, Hogan N, Aisen ML, Volpe BT (1998) Robot-aided neurorehabilitation. IEEE Trans Rehabil Eng 6(1):75–87CrossRef
27.
go back to reference Krebs HI, Palazzolo JJ, Dipietro L, Ferraro M, Krol J, Rannekleiv K, Volpe BT, Hogan N (2003) Rehabilitation robotics: performance-based progressive robot-assisted therapy. Auton Robots 15(1):7–20CrossRef Krebs HI, Palazzolo JJ, Dipietro L, Ferraro M, Krol J, Rannekleiv K, Volpe BT, Hogan N (2003) Rehabilitation robotics: performance-based progressive robot-assisted therapy. Auton Robots 15(1):7–20CrossRef
28.
29.
go back to reference Lieberman J, Breazeal C (2007) TIKL: development of a wearable vibrotactile feedback suit for improved human motor learning. IEEE Trans Robot 23(5):919–926CrossRef Lieberman J, Breazeal C (2007) TIKL: development of a wearable vibrotactile feedback suit for improved human motor learning. IEEE Trans Robot 23(5):919–926CrossRef
30.
go back to reference Liu C, Atkeson CG (2009) Standing balance control using a trajectory library. In: IEEE international conference on intelligent robots and systems, pp 3031–3036 Liu C, Atkeson CG (2009) Standing balance control using a trajectory library. In: IEEE international conference on intelligent robots and systems, pp 3031–3036
31.
go back to reference Loram ID, Gollee H, Lakie M, Gawthrop PJ (2011) Human control of an inverted pendulum: Is continuous control necessary? Is intermittent control effective? Is intermittent control physiological? J Physiol 589(2):307–324CrossRefMATH Loram ID, Gollee H, Lakie M, Gawthrop PJ (2011) Human control of an inverted pendulum: Is continuous control necessary? Is intermittent control effective? Is intermittent control physiological? J Physiol 589(2):307–324CrossRefMATH
32.
go back to reference Loram ID, Lakie M (2002) Human balancing of an inverted pendulum: position control by small, ballistic-like, throw and catch movements. J Physiol 540(3):1111–1124CrossRef Loram ID, Lakie M (2002) Human balancing of an inverted pendulum: position control by small, ballistic-like, throw and catch movements. J Physiol 540(3):1111–1124CrossRef
33.
go back to reference Mavrommati A, Ansari A, Murphey TD (2015) Optimal control-on-request: an application in real-time assistive balance control. In: IEEE international conference on robotics and automation (ICRA), pp 5928–5934 Mavrommati A, Ansari A, Murphey TD (2015) Optimal control-on-request: an application in real-time assistive balance control. In: IEEE international conference on robotics and automation (ICRA), pp 5928–5934
34.
go back to reference Milton J, Cabrera JL, Ohira T, Tajima S, Tonosaki Y, Eurich CW, Campbell SA (2009) The time-delayed inverted pendulum: implications for human balance control. Chaos: an interdisciplinary. J Nonlinear Sci 19(2):026110–026110MATH Milton J, Cabrera JL, Ohira T, Tajima S, Tonosaki Y, Eurich CW, Campbell SA (2009) The time-delayed inverted pendulum: implications for human balance control. Chaos: an interdisciplinary. J Nonlinear Sci 19(2):026110–026110MATH
35.
go back to reference Ott C, Roa MA, Hirzinger G (2011) Posture and balance control for biped robots based on contact force optimization. In: IEEE international conference on humanoid robots, pp 26–33 Ott C, Roa MA, Hirzinger G (2011) Posture and balance control for biped robots based on contact force optimization. In: IEEE international conference on humanoid robots, pp 26–33
36.
go back to reference Perry J, Garrett M, Gronley JK, Mulroy SJ (1995) Classification of walking handicap in the stroke population. Stroke 26(6):982–989CrossRef Perry J, Garrett M, Gronley JK, Mulroy SJ (1995) Classification of walking handicap in the stroke population. Stroke 26(6):982–989CrossRef
37.
go back to reference Philips J, Millan JdR, Vanacker G, Lew E, Galan F, Ferrez PW, Van Brussel H, Nuttin M (2007) Adaptive shared control of a brain-actuated simulated wheelchair. In: IEEE 10th international conference on rehabilitation robotics (ICORR), pp 408–414 Philips J, Millan JdR, Vanacker G, Lew E, Galan F, Ferrez PW, Van Brussel H, Nuttin M (2007) Adaptive shared control of a brain-actuated simulated wheelchair. In: IEEE 10th international conference on rehabilitation robotics (ICORR), pp 408–414
38.
go back to reference Rauschecker JP (1995) Compensatory plasticity and sensory substitution in the cerebral cortex. Trends Neurosci 18(1):36–43CrossRef Rauschecker JP (1995) Compensatory plasticity and sensory substitution in the cerebral cortex. Trends Neurosci 18(1):36–43CrossRef
40.
go back to reference Sekhon LHS, Fehlings MG (2001) Epidemiology, demographics, and pathophysiology of acute spinal cord injury. Spine 26(24S):S2–S12CrossRef Sekhon LHS, Fehlings MG (2001) Epidemiology, demographics, and pathophysiology of acute spinal cord injury. Spine 26(24S):S2–S12CrossRef
41.
go back to reference Sklar AE, Sarter NB (1999) Good vibrations: tactile feedback in support of attention allocation and human-automation coordination in event-driven domains. Hum Factors: J Hum Factors Ergon Soc 41(4):543–552CrossRef Sklar AE, Sarter NB (1999) Good vibrations: tactile feedback in support of attention allocation and human-automation coordination in event-driven domains. Hum Factors: J Hum Factors Ergon Soc 41(4):543–552CrossRef
42.
go back to reference Stephens B (2007) Integral control of humanoid balance. In: IEEE international conference on intelligent robots and systems, pp 4020–4027 Stephens B (2007) Integral control of humanoid balance. In: IEEE international conference on intelligent robots and systems, pp 4020–4027
43.
go back to reference Sun M, Ren X, Cao X (2010) Effects of multimodal error feedback on human performance in steering tasks. J Inf Process 18:284–292 Sun M, Ren X, Cao X (2010) Effects of multimodal error feedback on human performance in steering tasks. J Inf Process 18:284–292
44.
45.
go back to reference Tzorakoleftherakis E, Mussa-Ivaldi F, Scheidt R, Murphey TD (2014) Effects of optimal tactile feedback in balancing tasks: a pilot study. In: IEEE American control conference, pp 261–270 Tzorakoleftherakis E, Mussa-Ivaldi F, Scheidt R, Murphey TD (2014) Effects of optimal tactile feedback in balancing tasks: a pilot study. In: IEEE American control conference, pp 261–270
46.
go back to reference Tzorakoleftherakis E, Bengtson MC, Mussa-Ivaldi FA, Scheidt RA, Murphey TD (2015) Tactile proprioceptive input in robotic rehabilitation after stroke. In: IEEE international conference on robotics and automation Tzorakoleftherakis E, Bengtson MC, Mussa-Ivaldi FA, Scheidt RA, Murphey TD (2015) Tactile proprioceptive input in robotic rehabilitation after stroke. In: IEEE international conference on robotics and automation
47.
go back to reference Veneman JF, Kruidhof R, Hekman EEG, Ekkelenkamp R, Van Asseldonk EHF, Van Der Kooij H (2007) Design and evaluation of the lopes exoskeleton robot for interactive gait rehabilitation. IEEE Trans Neural Syst Rehabil Eng 15(3):379–386CrossRef Veneman JF, Kruidhof R, Hekman EEG, Ekkelenkamp R, Van Asseldonk EHF, Van Der Kooij H (2007) Design and evaluation of the lopes exoskeleton robot for interactive gait rehabilitation. IEEE Trans Neural Syst Rehabil Eng 15(3):379–386CrossRef
48.
go back to reference Wardi Y, Egerstedt M (2012) Algorithm for optimal mode scheduling in switched systems. In: American control conference, pp 4546–4551 Wardi Y, Egerstedt M (2012) Algorithm for optimal mode scheduling in switched systems. In: American control conference, pp 4546–4551
49.
go back to reference West RG (2004) Powered gait orthosis and method of utilizing same. US Patent 6,689,075, 10 Feb 2004 West RG (2004) Powered gait orthosis and method of utilizing same. US Patent 6,689,075, 10 Feb 2004
50.
go back to reference Winstein CJ, Gardner ER, McNeal DR, Barto PS, Nicholson DE (1989) Standing balance training: effect on balance and locomotion in hemiparetic adults. Arch Phys Med Rehabil 70(10):755–762 Winstein CJ, Gardner ER, McNeal DR, Barto PS, Nicholson DE (1989) Standing balance training: effect on balance and locomotion in hemiparetic adults. Arch Phys Med Rehabil 70(10):755–762
51.
go back to reference Winter DA (2009) Biomechanics and motor control of human movement. Wiley, New YorkCrossRef Winter DA (2009) Biomechanics and motor control of human movement. Wiley, New YorkCrossRef
52.
go back to reference Wolbrecht ET, Chan V, Reinkensmeyer DJ, Bobrow JE (2008) Optimizing compliant, model-based robotic assistance to promote neurorehabilitation. IEEE Trans Neural Syst Rehabil Eng 16(3):286–297CrossRef Wolbrecht ET, Chan V, Reinkensmeyer DJ, Bobrow JE (2008) Optimizing compliant, model-based robotic assistance to promote neurorehabilitation. IEEE Trans Neural Syst Rehabil Eng 16(3):286–297CrossRef
53.
go back to reference Wright SJ, Nocedal J (1999) Numerical optimization, vol 2. Springer New York Wright SJ, Nocedal J (1999) Numerical optimization, vol 2. Springer New York
54.
go back to reference Yu H, Matthew S, Steven D (2003) An adaptive shared control system for an intelligent mobility aid for the elderly. Auton Robots 15(1):53–66CrossRef Yu H, Matthew S, Steven D (2003) An adaptive shared control system for an intelligent mobility aid for the elderly. Auton Robots 15(1):53–66CrossRef
55.
go back to reference Zabczyk J (2009) Mathematical control theory: an introduction. Springer, BerlinMATH Zabczyk J (2009) Mathematical control theory: an introduction. Springer, BerlinMATH
Metadata
Title
Assistive Optimal Control-on-Request with Application in Standing Balance Therapy and Reinforcement
Authors
Anastasia Mavrommati
Alex Ansari
Todd D. Murphey
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-40533-9_7