Skip to main content

2015 | OriginalPaper | Buchkapitel

The Emergence of Norms via Contextual Agreements in Open Societies

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper explores the emergence of norms in agents’ societies when agents play multiple - even incompatible - roles in their social contexts simultaneously, and have limited interaction ranges. Specifically, this article proposes two reinforcement learning methods for agents to compute agreements on strategies for using common resources to perform joint tasks. The computation of norms by considering agents’ playing multiple roles in their social contexts has not been studied before. To make the problem even more realistic for open societies, we do not assume that agents share knowledge on their common resources. So, they have to compute semantic agreements towards performing their joint actions.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Of course agents may specify periods using different time granularities, different forms of representing time, etc. In this paper we assume that there is a specific granularity for specifying periods and thus agents just have to align their specifications: Otherwise, further agreements are necessary.
 
2
It must be pointed out that since the neighborhood of any agent includes itself, and its social context includes its own roles, it may also hold that \(i=j\).
 
3
the notation (\(\cdot \textit{:m}\)) means “any agent playing the role \(R_m\)”.
 
Literatur
1.
Zurück zum Zitat Epstein, J.: Learning to be thoughtless: social norms and individual computation. Comput. Econ. 18(1), 9–24 (2001)CrossRefMATH Epstein, J.: Learning to be thoughtless: social norms and individual computation. Comput. Econ. 18(1), 9–24 (2001)CrossRefMATH
2.
Zurück zum Zitat Mukherjee, P., Sen, S., Airiau, S.: Norm emergence under constrained interactions in diverse societies. In: Padgham, L., Parkes, D.C., Müller, J.P., Parsons, S. (eds.) AAMAS (2), pp. 779–786. IFAAMAS (2008) Mukherjee, P., Sen, S., Airiau, S.: Norm emergence under constrained interactions in diverse societies. In: Padgham, L., Parkes, D.C., Müller, J.P., Parsons, S. (eds.) AAMAS (2), pp. 779–786. IFAAMAS (2008)
3.
Zurück zum Zitat Sen, S., Airiau, S.: Emergence of norms through social learning. In: Proceedings of the 20th International Joint Conference on Artifical Intelligence, IJCAI 2007, pp. 1507–1512. Morgan Kaufmann Publishers Inc., San Francisco (2007) Sen, S., Airiau, S.: Emergence of norms through social learning. In: Proceedings of the 20th International Joint Conference on Artifical Intelligence, IJCAI 2007, pp. 1507–1512. Morgan Kaufmann Publishers Inc., San Francisco (2007)
4.
Zurück zum Zitat Yu, C., Zhang, M., Ren, F., Luo, X.: Emergence of social norms through collective learning in networked agent societies. In: Proceedings of the 2013 International Conference on Autonomous Agents and Multi-agent Systems, AAMAS 2013, pp. 475–482. International Foundation for Autonomous Agents and Multiagent Systems, Richland (2013) Yu, C., Zhang, M., Ren, F., Luo, X.: Emergence of social norms through collective learning in networked agent societies. In: Proceedings of the 2013 International Conference on Autonomous Agents and Multi-agent Systems, AAMAS 2013, pp. 475–482. International Foundation for Autonomous Agents and Multiagent Systems, Richland (2013)
5.
Zurück zum Zitat Vouros, G.: Decentralized semantic coordination via belief propagation. In: Proceedings of the 2013 International Conference on Autonomous Agents and Multi-agent Systems, AAMAS 2013, pp. 1207–1208. International Foundation for Autonomous Agents and Multiagent Systems, Richland (2013) Vouros, G.: Decentralized semantic coordination via belief propagation. In: Proceedings of the 2013 International Conference on Autonomous Agents and Multi-agent Systems, AAMAS 2013, pp. 1207–1208. International Foundation for Autonomous Agents and Multiagent Systems, Richland (2013)
6.
Zurück zum Zitat Puterman, M.L.: Markov Decision Processes: Discrete Stochastic Dynamic Programming, 1st edn. Wiley, New York (1994) CrossRefMATH Puterman, M.L.: Markov Decision Processes: Discrete Stochastic Dynamic Programming, 1st edn. Wiley, New York (1994) CrossRefMATH
7.
Zurück zum Zitat Guestrin, C.E.: Planning under uncertainty in complex structured environments. Ph.D. thesis, Stanford, CA, USA (2003) AAI3104233 Guestrin, C.E.: Planning under uncertainty in complex structured environments. Ph.D. thesis, Stanford, CA, USA (2003) AAI3104233
8.
Zurück zum Zitat Guestrin, C.G., Lagoudakis, M., Parr, R.: Coordinated reinforcement learning. In: Proceedings of the ICML-2002 The Nineteenth International Conference on Machine Learning, pp. 227–234 (2002) Guestrin, C.G., Lagoudakis, M., Parr, R.: Coordinated reinforcement learning. In: Proceedings of the ICML-2002 The Nineteenth International Conference on Machine Learning, pp. 227–234 (2002)
9.
Zurück zum Zitat Kok, J.R., Vlassis, N.: Collaborative multiagent reinforcement learning by payoff propagation. J. Mach. Learn. Res. 7, 1789–1828 (2006)MathSciNetMATH Kok, J.R., Vlassis, N.: Collaborative multiagent reinforcement learning by payoff propagation. J. Mach. Learn. Res. 7, 1789–1828 (2006)MathSciNetMATH
10.
Zurück zum Zitat Watts, D.J., Strogatz, S.H.: Collective dynamics of ‘small-world’ networks. Nature 393(6684), 440–442 (1998)CrossRef Watts, D.J., Strogatz, S.H.: Collective dynamics of ‘small-world’ networks. Nature 393(6684), 440–442 (1998)CrossRef
13.
Zurück zum Zitat Shoham, Y., Tennenholtz, M.: On the emergence of social conventions: modeling, analysis, and simulations. Artif. Intell. 94(1–2), 139–166 (1997)CrossRefMATH Shoham, Y., Tennenholtz, M.: On the emergence of social conventions: modeling, analysis, and simulations. Artif. Intell. 94(1–2), 139–166 (1997)CrossRefMATH
14.
Zurück zum Zitat Villatoro, D., Sabater-Mir, J., Sen, S.: Social instruments for robust convention emergence. In: Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, IJCAI 2011, vol. 1, pp. 420–425. AAAI Press (2011) Villatoro, D., Sabater-Mir, J., Sen, S.: Social instruments for robust convention emergence. In: Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, IJCAI 2011, vol. 1, pp. 420–425. AAAI Press (2011)
15.
Zurück zum Zitat Villatoro, D., Sen, S., Sabater-Mir, J.: Topology and memory effect on convention emergence. In: Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2009, vol. 02, pp. 233–240. IEEE Computer Society, Washington, DC (2009) Villatoro, D., Sen, S., Sabater-Mir, J.: Topology and memory effect on convention emergence. In: Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2009, vol. 02, pp. 233–240. IEEE Computer Society, Washington, DC (2009)
16.
Zurück zum Zitat Sen, O., Sen, S.: Effects of social network topology and options on norm emergence. In: Padget, J., Artikis, A., Vasconcelos, W., Stathis, K., da Silva, V.T., Matson, E., Polleres, A. (eds.) COIN@AAMAS 2009. LNCS, vol. 6069, pp. 211–222. Springer, Heidelberg (2010) CrossRef Sen, O., Sen, S.: Effects of social network topology and options on norm emergence. In: Padget, J., Artikis, A., Vasconcelos, W., Stathis, K., da Silva, V.T., Matson, E., Polleres, A. (eds.) COIN@AAMAS 2009. LNCS, vol. 6069, pp. 211–222. Springer, Heidelberg (2010) CrossRef
17.
18.
Zurück zum Zitat Fudenberg, D., Levine, D.: The Theory in Learning in Games. The MIT Press, Cambridge (1998)MATH Fudenberg, D., Levine, D.: The Theory in Learning in Games. The MIT Press, Cambridge (1998)MATH
19.
Zurück zum Zitat Barto, A.G., Mahadevan, S.: Recent advances in hierarchical reinforcement learning. Discrete Event Dyn. Syst. 13(1–2), 41–77 (2003)MathSciNetCrossRefMATH Barto, A.G., Mahadevan, S.: Recent advances in hierarchical reinforcement learning. Discrete Event Dyn. Syst. 13(1–2), 41–77 (2003)MathSciNetCrossRefMATH
Metadaten
Titel
The Emergence of Norms via Contextual Agreements in Open Societies
verfasst von
George A. Vouros
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-24804-2_12