Skip to main content

2019 | OriginalPaper | Buchkapitel

Towards Fully Probabilistic Cooperative Decision Making

verfasst von : Miroslav Kárný, Zohreh Alizadeh

Erschienen in: Multi-Agent Systems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Modern prescriptive decision theories try to support the dynamic decision making (DM) in incompletely-known, stochastic, and complex environments. Distributed solutions single out as the only universal and scalable way to cope with DM complexity and with limited DM resources. They require a solid cooperation scheme, which harmonises disparate aims and abilities of involved agents (human decision makers, DM realising devices and their mixed groups). The paper outlines a distributed fully probabilistic DM. Its flat structuring enables a fully-scalable cooperative DM of adaptive and wise selfish agents. The paper elaborates the cooperation based on sharing and processing agents’ aims in the way, which negligibly increases agents’ deliberation effort, while preserving advantages of distributed DM. Simulation results indicate the strength of the approach and confirm the possibility of using an agent-specific feedback for controlling its cooperation.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
The axiomatisation [19] also shows that any Bayesian DM formulation can be approximated by an FPD formulation to an arbitrary precision.
 
Literatur
1.
Zurück zum Zitat Aknine, S., Caillou, P., Pinson, S.: Searching Pareto optimal solutions for the problem of forming and restructuring coalitions in multi-agent systems. Group Decis. Negot. 19, 7–37 (2010)CrossRef Aknine, S., Caillou, P., Pinson, S.: Searching Pareto optimal solutions for the problem of forming and restructuring coalitions in multi-agent systems. Group Decis. Negot. 19, 7–37 (2010)CrossRef
3.
Zurück zum Zitat Barndorff-Nielsen, O.: Information and Exponential Families in Statistical Theory. Wiley, Hoboken (1978)MATH Barndorff-Nielsen, O.: Information and Exponential Families in Statistical Theory. Wiley, Hoboken (1978)MATH
4.
Zurück zum Zitat Bond, A., Gasser, L.: Readings in Distributed Artificial Intelligence. Morgan Kaufmann, Burlington (2014) Bond, A., Gasser, L.: Readings in Distributed Artificial Intelligence. Morgan Kaufmann, Burlington (2014)
5.
Zurück zum Zitat Chen, L., Pu, P.: Survey of preference elicitation methods. Technical report IC/2004/67, HCI Group Ecole Politechnique Federale de Lausanne, Switzerland (2004) Chen, L., Pu, P.: Survey of preference elicitation methods. Technical report IC/2004/67, HCI Group Ecole Politechnique Federale de Lausanne, Switzerland (2004)
6.
Zurück zum Zitat Daee, P., Peltola, T., Soare, M., Kaski, S.: Knowledge elicitation via sequential probabilistic inference for high-dimensional prediction. Mach. Learn. 106(9), 1599–1620 (2017)MathSciNetCrossRef Daee, P., Peltola, T., Soare, M., Kaski, S.: Knowledge elicitation via sequential probabilistic inference for high-dimensional prediction. Mach. Learn. 106(9), 1599–1620 (2017)MathSciNetCrossRef
7.
Zurück zum Zitat DeGroot, M.: Optimal Statistical Decisions. McGraw-Hill, New York City (1970)MATH DeGroot, M.: Optimal Statistical Decisions. McGraw-Hill, New York City (1970)MATH
8.
Zurück zum Zitat Genest, C., Zidek, J.: Combining probability distributions: a critique and annotated bibliography. Stat. Sci. 1(1), 114–148 (1986)MathSciNetCrossRef Genest, C., Zidek, J.: Combining probability distributions: a critique and annotated bibliography. Stat. Sci. 1(1), 114–148 (1986)MathSciNetCrossRef
9.
Zurück zum Zitat Guan, P., Raginsky, M., Willett, R.: Online Markov decision processes with Kullback Leibler control cost. IEEE Trans. Autom. Control 59(6), 1423–1438 (2014)MathSciNetCrossRef Guan, P., Raginsky, M., Willett, R.: Online Markov decision processes with Kullback Leibler control cost. IEEE Trans. Autom. Control 59(6), 1423–1438 (2014)MathSciNetCrossRef
10.
Zurück zum Zitat Harsanyi, J.: Games with incomplete information played by Bayesian players. I-III. Management Science 50(Suppl. 12), 1763–1893 (2004) Harsanyi, J.: Games with incomplete information played by Bayesian players. I-III. Management Science 50(Suppl. 12), 1763–1893 (2004)
11.
Zurück zum Zitat Kárný, M.: Adaptive systems: local approximators? In: Workshop on Adaptive Systems in Control and Signal Processing, pp. 129–134. IFAC, Glasgow (1998) Kárný, M.: Adaptive systems: local approximators? In: Workshop on Adaptive Systems in Control and Signal Processing, pp. 129–134. IFAC, Glasgow (1998)
12.
Zurück zum Zitat Kárný, M.: Recursive estimation of high-order Markov chains: approximation by finite mixtures. Inf. Sci. 326, 188–201 (2016)CrossRef Kárný, M.: Recursive estimation of high-order Markov chains: approximation by finite mixtures. Inf. Sci. 326, 188–201 (2016)CrossRef
13.
Zurück zum Zitat Kárný, M.: Implementable prescriptive decision making. In: Guy, T., Kárný, M., D., D.R.I., Wolpert, D. (eds.) Proceedings of the NIPS 2016 Workshop on Imperfect Decision Makers, vol. 58, pp. 19–30. JMLR (2017) Kárný, M.: Implementable prescriptive decision making. In: Guy, T., Kárný, M., D., D.R.I., Wolpert, D. (eds.) Proceedings of the NIPS 2016 Workshop on Imperfect Decision Makers, vol. 58, pp. 19–30. JMLR (2017)
14.
Zurück zum Zitat Kárný, M., et al.: Optimized Bayesian Dynamic Advising: Theory and Algorithms. Springer, London (2006) Kárný, M., et al.: Optimized Bayesian Dynamic Advising: Theory and Algorithms. Springer, London (2006)
15.
16.
Zurück zum Zitat Kárný, M., Guy, T.V., Bodini, A., Ruggeri, F.: Cooperation via sharing of probabilistic information. Int. J. Comput. Intell. Stud. 1, 139–162 (2009)CrossRef Kárný, M., Guy, T.V., Bodini, A., Ruggeri, F.: Cooperation via sharing of probabilistic information. Int. J. Comput. Intell. Stud. 1, 139–162 (2009)CrossRef
18.
Zurück zum Zitat Kárný, M., Herzallah, R.: Scalable harmonization of complex networks with local adaptive controllers. IEEE Trans. SMC: Syst. 47(3), 394–404 (2017) Kárný, M., Herzallah, R.: Scalable harmonization of complex networks with local adaptive controllers. IEEE Trans. SMC: Syst. 47(3), 394–404 (2017)
19.
20.
22.
Zurück zum Zitat Lewicki, R., Weiss, S., Lewin, D.: Models of conflict, negotiation and 3rd party intervention - a review and synthesis. J. Organ. Behav. 13(3), 209–252 (1992)CrossRef Lewicki, R., Weiss, S., Lewin, D.: Models of conflict, negotiation and 3rd party intervention - a review and synthesis. J. Organ. Behav. 13(3), 209–252 (1992)CrossRef
23.
24.
Zurück zum Zitat Mayne, D.: Model predictive control: recent developments and future promise. Automatica 50, 2967–2986 (2014)MathSciNetCrossRef Mayne, D.: Model predictive control: recent developments and future promise. Automatica 50, 2967–2986 (2014)MathSciNetCrossRef
25.
Zurück zum Zitat Mine, H., Osaki, S.: Markovian Decision Processes. Elsevier, New York (1970)MATH Mine, H., Osaki, S.: Markovian Decision Processes. Elsevier, New York (1970)MATH
27.
Zurück zum Zitat Nurmi, H.: Resolving group choice paradoxes using probabilistic and fuzzy concepts. Group Decis. Negot. 10, 177–198 (2001)CrossRef Nurmi, H.: Resolving group choice paradoxes using probabilistic and fuzzy concepts. Group Decis. Negot. 10, 177–198 (2001)CrossRef
28.
Zurück zum Zitat Peterka, V.: Bayesian system identification. In: Eykhoff, P. (ed.) Trends and Progress in System Identification, pp. 239–304. Pergamon Press, Oxford (1981)CrossRef Peterka, V.: Bayesian system identification. In: Eykhoff, P. (ed.) Trends and Progress in System Identification, pp. 239–304. Pergamon Press, Oxford (1981)CrossRef
29.
Zurück zum Zitat Savage, L.: Foundations of Statistics. Wiley, Hoboken (1954)MATH Savage, L.: Foundations of Statistics. Wiley, Hoboken (1954)MATH
30.
Zurück zum Zitat Sečkárová, V.: Cross-entropy based combination of discrete probability distributions for distributed decision making. Ph.D. thesis, Charles University in Prague, Faculty of Mathematics and Physics, Department of Probability and Mathematical Statistics., Prague (2015). Submitted in May 2015. Successfully defended on 14 September 2015 Sečkárová, V.: Cross-entropy based combination of discrete probability distributions for distributed decision making. Ph.D. thesis, Charles University in Prague, Faculty of Mathematics and Physics, Department of Probability and Mathematical Statistics., Prague (2015). Submitted in May 2015. Successfully defended on 14 September 2015
32.
Zurück zum Zitat Sečkárová, V.: On supra-Bayesian weighted combination of available data determined by Kerridge inaccuracy and entropy. Pliska Stud. Math. Bulgar. 22, 159–168 (2013)MathSciNetMATH Sečkárová, V.: On supra-Bayesian weighted combination of available data determined by Kerridge inaccuracy and entropy. Pliska Stud. Math. Bulgar. 22, 159–168 (2013)MathSciNetMATH
33.
Zurück zum Zitat Shore, J., Johnson, R.: Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy. IEEE Trans. Inf. Theory 26(1), 26–37 (1980)MathSciNetCrossRef Shore, J., Johnson, R.: Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy. IEEE Trans. Inf. Theory 26(1), 26–37 (1980)MathSciNetCrossRef
34.
Zurück zum Zitat Simpson, E.: Combined decision making with multiple agents. Ph.D. thesis, Hertford College, Department of Engineering Science, University of Oxford (2014) Simpson, E.: Combined decision making with multiple agents. Ph.D. thesis, Hertford College, Department of Engineering Science, University of Oxford (2014)
35.
Zurück zum Zitat Simpson, E., Roberts, S., Psorakis, I., Smith, A.: Dynamic Bayesian combination of multiple imperfect classifiers. In: Guy, T., Kárný, M., Wolpert, D. (eds.) Decision Making and Imperfection. Studies in Computation Intelligence, vol. 474, pp. 1–35. Springer, Berlin (2013). https://doi.org/10.1007/978-3-642-36406-8_1CrossRef Simpson, E., Roberts, S., Psorakis, I., Smith, A.: Dynamic Bayesian combination of multiple imperfect classifiers. In: Guy, T., Kárný, M., Wolpert, D. (eds.) Decision Making and Imperfection. Studies in Computation Intelligence, vol. 474, pp. 1–35. Springer, Berlin (2013). https://​doi.​org/​10.​1007/​978-3-642-36406-8_​1CrossRef
36.
Zurück zum Zitat Todorov, E.: Linearly-solvable Markov decision problems. In: Schölkopf, B., et al. (eds.) Advances in Neural Information Processing, pp. 1369–1376. MIT Press, NY (2006) Todorov, E.: Linearly-solvable Markov decision problems. In: Schölkopf, B., et al. (eds.) Advances in Neural Information Processing, pp. 1369–1376. MIT Press, NY (2006)
37.
Zurück zum Zitat Šindelář, J., Vajda, I., Kárný, M.: Stochastic control optimal in the Kullback sense. Kybernetika 44(1), 53–60 (2008)MathSciNetMATH Šindelář, J., Vajda, I., Kárný, M.: Stochastic control optimal in the Kullback sense. Kybernetika 44(1), 53–60 (2008)MathSciNetMATH
38.
Zurück zum Zitat Wald, A.: Statistical Decision Functions. Wiley, London (1950)MATH Wald, A.: Statistical Decision Functions. Wiley, London (1950)MATH
39.
Zurück zum Zitat Wallenius, J., Dyer, J., Fishburn, P., Steuer, R., Zionts, S., Deb, K.: Multiple criteria decision making, multiattribute utility theory: recent accomplishments and what lies ahead. Manag. Sci. 54(7), 1336–1349 (2008)CrossRef Wallenius, J., Dyer, J., Fishburn, P., Steuer, R., Zionts, S., Deb, K.: Multiple criteria decision making, multiattribute utility theory: recent accomplishments and what lies ahead. Manag. Sci. 54(7), 1336–1349 (2008)CrossRef
40.
Zurück zum Zitat Zlotkin, G., Rosenschein, J.: Mechanism design for automated negotiation and its applicatin to task oriented domains. Artif. Intell. 86, 195–244 (1996)CrossRef Zlotkin, G., Rosenschein, J.: Mechanism design for automated negotiation and its applicatin to task oriented domains. Artif. Intell. 86, 195–244 (1996)CrossRef
Metadaten
Titel
Towards Fully Probabilistic Cooperative Decision Making
verfasst von
Miroslav Kárný
Zohreh Alizadeh
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-14174-5_11