Skip to main content

2019 | OriginalPaper | Buchkapitel

Practical Applications of Multiagent Shepherding for Human-Machine Interaction

verfasst von : Patrick Nalepka, Rachel W. Kallen, Anthony Chemero, Elliot Saltzman, Michael J. Richardson

Erschienen in: Advances in Practical Applications of Survivable Agents and Multi-Agent Systems: The PAAMS Collection

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The shepherding problem is interesting for multiagent systems research as it requires multiple actors (e.g., dogs, humans) to exert indirect control over autonomous agents (e.g., sheep, cattle) for containment or transportation. Accordingly, plenty of research has focused on designing algorithms for robotic agents to solve such tasks. Almost no research, however, has utilized this task to investigate human-human or human-machine interactions, even though the shepherding problem encapsulates desirable qualities for an experimental paradigm to investigate the dynamics of human group and mixed-group coordination in complex tasks. This paper summarizes our recent research that has employed the shepherding problem to study complex multiagent human-human and human-machine interaction. The paper concludes with a discussion of practical applications for using the shepherding problem for the design of assistive agents that can be incorporated into human groups or enhance training and human learning.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Cohen, D.J., James Nelson, W., Maharbiz, M.M.: Galvanotactic control of collective cell migration in epithelial monolayers. Nat. Mater. 13, 409–417 (2014)CrossRef Cohen, D.J., James Nelson, W., Maharbiz, M.M.: Galvanotactic control of collective cell migration in epithelial monolayers. Nat. Mater. 13, 409–417 (2014)CrossRef
2.
Zurück zum Zitat Lien, J.M., Rodríguez, S., Malric, J.P., Amato, N.M.: Shepherding behaviors with multiple shepherds. In: Proceedings 2005 IEEE International Conference on Robotics and Automation, pp. 3402–3407. IEEE, Piscataway (2005) Lien, J.M., Rodríguez, S., Malric, J.P., Amato, N.M.: Shepherding behaviors with multiple shepherds. In: Proceedings 2005 IEEE International Conference on Robotics and Automation, pp. 3402–3407. IEEE, Piscataway (2005)
3.
Zurück zum Zitat Lee, W., Kim, D.: Autonomous shepherding behaviors of multiple target steering robots. Sensors (Switzerland) 17 (2017) Lee, W., Kim, D.: Autonomous shepherding behaviors of multiple target steering robots. Sensors (Switzerland) 17 (2017)
4.
Zurück zum Zitat Pierson, A., Schwager, M.: Controlling noncooperative herds with robotic herders. IEEE Trans. Robot. 34, 517–525 (2018)CrossRef Pierson, A., Schwager, M.: Controlling noncooperative herds with robotic herders. IEEE Trans. Robot. 34, 517–525 (2018)CrossRef
5.
Zurück zum Zitat Licitra, R.A., Bell, Z.I., Doucette, E.A., Dixon, W.E.: Single agent indirect herding of multiple targets: a switched adaptive control approach. IEEE Control Syst. Lett. 2, 127–132 (2018)CrossRef Licitra, R.A., Bell, Z.I., Doucette, E.A., Dixon, W.E.: Single agent indirect herding of multiple targets: a switched adaptive control approach. IEEE Control Syst. Lett. 2, 127–132 (2018)CrossRef
6.
Zurück zum Zitat Strömbom, D., King, A.J.: Robot collection and transport of objects: a biomimetic process. Front. Robot. AI. 5, 48 (2018)CrossRef Strömbom, D., King, A.J.: Robot collection and transport of objects: a biomimetic process. Front. Robot. AI. 5, 48 (2018)CrossRef
7.
Zurück zum Zitat Vaughan, R., Sumpter, N., Henderson, J., Frost, A., Cameron, S.: Experiments in automatic flock control. Rob. Auton. Syst. 31, 109–117 (2000)CrossRef Vaughan, R., Sumpter, N., Henderson, J., Frost, A., Cameron, S.: Experiments in automatic flock control. Rob. Auton. Syst. 31, 109–117 (2000)CrossRef
8.
Zurück zum Zitat Paranjape, A.A., Chung, S.J., Kim, K., Shim, D.H.: Robotic herding of a flock of birds using an unmanned aerial vehicle. IEEE Trans. Robot. 34, 901–915 (2018)CrossRef Paranjape, A.A., Chung, S.J., Kim, K., Shim, D.H.: Robotic herding of a flock of birds using an unmanned aerial vehicle. IEEE Trans. Robot. 34, 901–915 (2018)CrossRef
9.
Zurück zum Zitat Özdemir, A., Gauci, M., Gross, R.: Shepherding with robots that do not compute. In: Proceedings of the 14th European Conference on Artificial Life, ECAL 2017, pp. 332–339. MIT Press, Cambridge (2017) Özdemir, A., Gauci, M., Gross, R.: Shepherding with robots that do not compute. In: Proceedings of the 14th European Conference on Artificial Life, ECAL 2017, pp. 332–339. MIT Press, Cambridge (2017)
10.
Zurück zum Zitat St. Clair, A., Mataric, M.: How robot verbal feedback can improve team performance in human-robot task collaborations. In: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction - HRI 2015, pp. 213–220. ACM Press, New York (2015) St. Clair, A., Mataric, M.: How robot verbal feedback can improve team performance in human-robot task collaborations. In: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction - HRI 2015, pp. 213–220. ACM Press, New York (2015)
11.
Zurück zum Zitat Nalepka, P., Kallen, R.W., Chemero, A., Saltzman, E., Richardson, M.J.: Herd those sheep: emergent multiagent coordination and behavioral-mode switching. Psychol. Sci. 28, 630–650 (2017)CrossRef Nalepka, P., Kallen, R.W., Chemero, A., Saltzman, E., Richardson, M.J.: Herd those sheep: emergent multiagent coordination and behavioral-mode switching. Psychol. Sci. 28, 630–650 (2017)CrossRef
12.
Zurück zum Zitat Nalepka, P., et al.: Human social motor solutions for human–machine interaction in dynamical task contexts. Proc. Natl. Acad. Sci. 116, 1437–1446 (2019)CrossRef Nalepka, P., et al.: Human social motor solutions for human–machine interaction in dynamical task contexts. Proc. Natl. Acad. Sci. 116, 1437–1446 (2019)CrossRef
13.
Zurück zum Zitat Richardson, M.J., et al.: Modeling embedded interpersonal and multiagent coordination. In: Muñoz, V.M., Gusikhin, O., Chang, V. (eds.) Proceedings of the 1st International Conference on Complex Information Systems, pp. 155–164. SciTePress, Setúbal (2016) Richardson, M.J., et al.: Modeling embedded interpersonal and multiagent coordination. In: Muñoz, V.M., Gusikhin, O., Chang, V. (eds.) Proceedings of the 1st International Conference on Complex Information Systems, pp. 155–164. SciTePress, Setúbal (2016)
14.
Zurück zum Zitat Ijspeert, A.J., Nakanishi, J., Hoffmann, H., Pastor, P., Schaal, S.: Dynamical movement primitives: learning attractor models for motor behaviors. Neural Comput. 25, 328–373 (2013)MathSciNetCrossRef Ijspeert, A.J., Nakanishi, J., Hoffmann, H., Pastor, P., Schaal, S.: Dynamical movement primitives: learning attractor models for motor behaviors. Neural Comput. 25, 328–373 (2013)MathSciNetCrossRef
15.
Zurück zum Zitat Schaal, S., Kotosaka, S., Sternad, D.: Nonlinear dynamical systems as movement primitives. In: Proceedings of the 1st IEEE-RAS International Conference on Humanoid Robotics. IEEE, Piscataway (2000) Schaal, S., Kotosaka, S., Sternad, D.: Nonlinear dynamical systems as movement primitives. In: Proceedings of the 1st IEEE-RAS International Conference on Humanoid Robotics. IEEE, Piscataway (2000)
16.
Zurück zum Zitat Warren, W.H.: The dynamics of perception and action. Psychol. Rev. 113, 358–389 (2006)CrossRef Warren, W.H.: The dynamics of perception and action. Psychol. Rev. 113, 358–389 (2006)CrossRef
17.
Zurück zum Zitat Bernstein, N.A.: The Co-ordination and Regulation of Movements. Pergamon Press, Oxford (1967) Bernstein, N.A.: The Co-ordination and Regulation of Movements. Pergamon Press, Oxford (1967)
18.
Zurück zum Zitat Saltzman, E., Kelso, J.A.S.: Skilled actions: a task-dynamic approach. Psychol. Rev. 94, 84–106 (1987)CrossRef Saltzman, E., Kelso, J.A.S.: Skilled actions: a task-dynamic approach. Psychol. Rev. 94, 84–106 (1987)CrossRef
19.
Zurück zum Zitat Warren, W., Fajen, B., Fuchs, A., Jirsa, V.: Behavioral dynamics of visually guided locomotion. Coord. Neural Behav. Soc. Dyn. 17, 45–75 (2008)CrossRef Warren, W., Fajen, B., Fuchs, A., Jirsa, V.: Behavioral dynamics of visually guided locomotion. Coord. Neural Behav. Soc. Dyn. 17, 45–75 (2008)CrossRef
21.
Zurück zum Zitat Oullier, O., de Guzman, G., Jantzen, K.J., Lagarde, J., Scott Kelso, J.A.: Social coordination dynamics: measuring human bonding. Soc. Neurosci. 3, 178–192 (2008)CrossRef Oullier, O., de Guzman, G., Jantzen, K.J., Lagarde, J., Scott Kelso, J.A.: Social coordination dynamics: measuring human bonding. Soc. Neurosci. 3, 178–192 (2008)CrossRef
22.
Zurück zum Zitat Lamb, M., Kallen, R.W., Harrison, S.J., Di Bernardo, M., Minai, A., Richardson, M.J.: To pass or not to pass: modeling the movement and affordance dynamics of a pick and place task. Front. Psychol. 8, 1061 (2017)CrossRef Lamb, M., Kallen, R.W., Harrison, S.J., Di Bernardo, M., Minai, A., Richardson, M.J.: To pass or not to pass: modeling the movement and affordance dynamics of a pick and place task. Front. Psychol. 8, 1061 (2017)CrossRef
23.
Zurück zum Zitat Warren, W.H.: Collective motion in human crowds. Curr. Dir. Psychol. Sci. 27, 232–240 (2018)CrossRef Warren, W.H.: Collective motion in human crowds. Curr. Dir. Psychol. Sci. 27, 232–240 (2018)CrossRef
24.
Zurück zum Zitat Haken, H., Kelso, J.A.S., Bunz, H.: A theoretical model of phase transitions in human hand movements. Biol. Cybern. 51, 347–356 (1985)MathSciNetCrossRef Haken, H., Kelso, J.A.S., Bunz, H.: A theoretical model of phase transitions in human hand movements. Biol. Cybern. 51, 347–356 (1985)MathSciNetCrossRef
25.
Zurück zum Zitat Strömbom, D., et al.: Solving the shepherding problem: heuristics for herding autonomous, interacting agents. J. R. Soc. Interface 11, 20140719 (2014)CrossRef Strömbom, D., et al.: Solving the shepherding problem: heuristics for herding autonomous, interacting agents. J. R. Soc. Interface 11, 20140719 (2014)CrossRef
26.
Zurück zum Zitat Nalepka, P., et al.: Emergence of efficient, coordinated solutions despite differences in agent ability during human-machine interaction. In: Proceedings of the 18th International Conference on Intelligent Virtual Agents - IVA 2018, pp. 337–338. ACM Press, New York (2019) Nalepka, P., et al.: Emergence of efficient, coordinated solutions despite differences in agent ability during human-machine interaction. In: Proceedings of the 18th International Conference on Intelligent Virtual Agents - IVA 2018, pp. 337–338. ACM Press, New York (2019)
27.
Zurück zum Zitat Muro, C., Escobedo, R., Spector, L., Coppinger, R.P.: Wolf-pack (Canis lupus) hunting strategies emerge from simple rules in computational simulations. Behav. Processes. 88, 192–197 (2011)CrossRef Muro, C., Escobedo, R., Spector, L., Coppinger, R.P.: Wolf-pack (Canis lupus) hunting strategies emerge from simple rules in computational simulations. Behav. Processes. 88, 192–197 (2011)CrossRef
28.
Zurück zum Zitat D’Vincent, C.G., Nilson, R.M., Hanna, R.E.: Vocalization and coordinated feeding behavior of the humpback whale in Southeastern Alaska. Sci. Reports Whales Res. Inst. 36, 41–47 (1985) D’Vincent, C.G., Nilson, R.M., Hanna, R.E.: Vocalization and coordinated feeding behavior of the humpback whale in Southeastern Alaska. Sci. Reports Whales Res. Inst. 36, 41–47 (1985)
29.
Zurück zum Zitat Ijspeert, A.J., Nakanishi, J., Schaal, S.: Movement imitation with nonlinear dynamical systems in humanoid robots. In: Proceedings 2002 IEEE International Conference on Robotics and Automation, pp. 1398–1403. IEEE, Piscataway (2002) Ijspeert, A.J., Nakanishi, J., Schaal, S.: Movement imitation with nonlinear dynamical systems in humanoid robots. In: Proceedings 2002 IEEE International Conference on Robotics and Automation, pp. 1398–1403. IEEE, Piscataway (2002)
30.
Zurück zum Zitat Dumas, G., de Guzman, G.C., Tognoli, E., Kelso, J.A.S.: The human dynamic clamp as a paradigm for social interaction. Proc. Natl. Acad. Sci. 111, E3726–E3734 (2014)CrossRef Dumas, G., de Guzman, G.C., Tognoli, E., Kelso, J.A.S.: The human dynamic clamp as a paradigm for social interaction. Proc. Natl. Acad. Sci. 111, E3726–E3734 (2014)CrossRef
31.
Zurück zum Zitat Kostrubiec, V., Dumas, G., Zanone, P.G., Scott Kelso, J.A.: The virtual teacher (VT) paradigm: learning new patterns of interpersonal coordination using the human dynamic clamp. PLoS ONE 10, 1–24 (2015)CrossRef Kostrubiec, V., Dumas, G., Zanone, P.G., Scott Kelso, J.A.: The virtual teacher (VT) paradigm: learning new patterns of interpersonal coordination using the human dynamic clamp. PLoS ONE 10, 1–24 (2015)CrossRef
32.
Zurück zum Zitat Kelso, J.A.S., de Guzman, G.C., Reveley, C., Tognoli, E.: Virtual partner interaction (VPI): exploring novel behaviors via coordination dynamics. PLoS One 4 (2009)CrossRef Kelso, J.A.S., de Guzman, G.C., Reveley, C., Tognoli, E.: Virtual partner interaction (VPI): exploring novel behaviors via coordination dynamics. PLoS One 4 (2009)CrossRef
33.
Zurück zum Zitat Kay, B.A., Kelso, J.A.S., Saltzman, E.L., Schöner, G.: Space-time behavior of single and bimanual rhythmical movements: data and limit cycle model. J. Exp. Psychol. Hum. Percept. Perform. 13, 178–192 (1987)CrossRef Kay, B.A., Kelso, J.A.S., Saltzman, E.L., Schöner, G.: Space-time behavior of single and bimanual rhythmical movements: data and limit cycle model. J. Exp. Psychol. Hum. Percept. Perform. 13, 178–192 (1987)CrossRef
34.
Zurück zum Zitat Richardson, M.J., Kallen, R.W.: Symmetry-breaking and the contextual emergence of human multiagent coordination and social activity. In: Dzhafarov, E., Jordan, S., Zhang, R., Cervantes, V. (eds.) World Scientific Review, pp. 1–57. World Scientific Publishing Co. (2015) Richardson, M.J., Kallen, R.W.: Symmetry-breaking and the contextual emergence of human multiagent coordination and social activity. In: Dzhafarov, E., Jordan, S., Zhang, R., Cervantes, V. (eds.) World Scientific Review, pp. 1–57. World Scientific Publishing Co. (2015)
35.
Zurück zum Zitat Sternad, D., Marino, H., Charles, S.K., Duarte, M., Dipietro, L., Hogan, N.: Transitions between discrete and rhythmic primitives in a unimanual task. Front. Comput. Neurosci. 7, 1–13 (2013)CrossRef Sternad, D., Marino, H., Charles, S.K., Duarte, M., Dipietro, L., Hogan, N.: Transitions between discrete and rhythmic primitives in a unimanual task. Front. Comput. Neurosci. 7, 1–13 (2013)CrossRef
37.
Zurück zum Zitat Selinger, J.C., O’Connor, S.M., Wong, J.D., Donelan, J.M.: Humans can continuously optimize energetic cost during walking. Curr. Biol. 25, 2452–2456 (2015)CrossRef Selinger, J.C., O’Connor, S.M., Wong, J.D., Donelan, J.M.: Humans can continuously optimize energetic cost during walking. Curr. Biol. 25, 2452–2456 (2015)CrossRef
38.
Zurück zum Zitat Maurice, P., Hogan, N., Sternad, D.: Predictability, force, and (anti)resonance in complex object control. J. Neurophysiol. 120, 765–780 (2018)CrossRef Maurice, P., Hogan, N., Sternad, D.: Predictability, force, and (anti)resonance in complex object control. J. Neurophysiol. 120, 765–780 (2018)CrossRef
39.
Zurück zum Zitat Vygotsky, L.S.: Mind and Society: The Development of Higher Psychological Processes. Harvard University Press, Cambridge (1978) Vygotsky, L.S.: Mind and Society: The Development of Higher Psychological Processes. Harvard University Press, Cambridge (1978)
40.
Zurück zum Zitat Johnston, J., Sottilare, R., Sinatra, A.M., Shawn Burke, C. (eds.): Building Intelligent Tutoring Systems for Teams. Emerald Publishing Limited (2018) Johnston, J., Sottilare, R., Sinatra, A.M., Shawn Burke, C. (eds.): Building Intelligent Tutoring Systems for Teams. Emerald Publishing Limited (2018)
41.
Zurück zum Zitat Gorman, J.C., Cooke, N.J., Amazeen, P.G.: Training adaptive teams. Hum. Factors 52, 295–307 (2010)CrossRef Gorman, J.C., Cooke, N.J., Amazeen, P.G.: Training adaptive teams. Hum. Factors 52, 295–307 (2010)CrossRef
42.
Zurück zum Zitat Mörtl, A., Lorenz, T., Hirche, S.: Rhythm patterns interaction - synchronization behavior for human-robot joint action. PLoS ONE 9, e95195 (2014)CrossRef Mörtl, A., Lorenz, T., Hirche, S.: Rhythm patterns interaction - synchronization behavior for human-robot joint action. PLoS ONE 9, e95195 (2014)CrossRef
43.
Zurück zum Zitat Lorenz, T., Weiss, A., Hirche, S.: Synchrony and reciprocity: key mechanisms for social companion robots in therapy and care. Int. J. Soc. Robot. 8, 125–143 (2016)CrossRef Lorenz, T., Weiss, A., Hirche, S.: Synchrony and reciprocity: key mechanisms for social companion robots in therapy and care. Int. J. Soc. Robot. 8, 125–143 (2016)CrossRef
44.
Zurück zum Zitat Słowiński, P., et al.: Dynamic similarity promotes interpersonal coordination in joint action. J. R. Soc. Interface 13, 20151093 (2016)CrossRef Słowiński, P., et al.: Dynamic similarity promotes interpersonal coordination in joint action. J. R. Soc. Interface 13, 20151093 (2016)CrossRef
45.
Zurück zum Zitat Iqbal, T., Riek, L.D.: Human-robot teaming: approaches from joint action and dynamical systems. In: Goswami, A., Vadakkepat, P. (eds.) Humanoid Robotics: A Reference, pp. 2293–2312. Springer, Dordrecht (2019)CrossRef Iqbal, T., Riek, L.D.: Human-robot teaming: approaches from joint action and dynamical systems. In: Goswami, A., Vadakkepat, P. (eds.) Humanoid Robotics: A Reference, pp. 2293–2312. Springer, Dordrecht (2019)CrossRef
46.
Zurück zum Zitat Słowiński, P., et al.: Unravelling socio-motor biomarkers in schizophrenia. NPJ Schizophr 3, 8 (2017)CrossRef Słowiński, P., et al.: Unravelling socio-motor biomarkers in schizophrenia. NPJ Schizophr 3, 8 (2017)CrossRef
Metadaten
Titel
Practical Applications of Multiagent Shepherding for Human-Machine Interaction
verfasst von
Patrick Nalepka
Rachel W. Kallen
Anthony Chemero
Elliot Saltzman
Michael J. Richardson
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-24209-1_14

Premium Partner