Skip to main content
Erschienen in: Autonomous Agents and Multi-Agent Systems 5/2015

01.09.2015

\(\hbox {NB}^{3}\): a multilateral negotiation algorithm for large, non-linear agreement spaces with limited time

verfasst von: Dave de Jonge, Carles Sierra

Erschienen in: Autonomous Agents and Multi-Agent Systems | Ausgabe 5/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Existing work on automated negotiations has mainly focused on bilateral negotiations with linear utility functions. It is often assumed that all possible agreements and their utility values are given beforehand. Most real-world negotiations however are much more complex. We introduce a new family of negotiation algorithms that is applicable to domains with many agents, an intractably large space of possible agreements, non-linear utility functions and limited time so an exhaustive search for the best proposals is not feasible. We assume that agents are selfish and cannot be blindly trusted, so the algorithm does not rely on any mediator. This family of algorithms is called \(\hbox {NB}^{3}\) and applies heuristic Branch & Bound search to find good proposals. Search and negotiation happen simultaneously and therefore strongly influence each other. It applies a new time-based negotiation strategy that considers two utility aspiration levels: one for the agent itself and one for its opponents. Also, we introduce a negotiation protocol that imposes almost no restrictions and is therefore better applicable to negotiations with humans. We present the Negotiating Salesmen Problem (NSP): a variant of the Traveling Salesman Problem with multiple negotiating agents, as a test case. We describe an implementation of \(\hbox {NB}^{3}\) designed for the NSP and present the results of experiments with this implementation. We conclude that the algorithm is able to decrease the costs of the agents significantly, that the heuristic search is efficient and that the algorithm scales well with increasing complexity of the problem.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
In this paper we use Greek letters to indicate specific elements of the set \(A\) (i.e. they are the names of the agents), while we use Latin letters as variables over the set \(A\). The letter \(\epsilon \) however is used to refer to world states, so it is not the name of any agent.
 
2
As mentioned before, to keep the discussion simple we assume that the order in which actions are taken is irrelevant for the outcome of the state of the world, even though our algorithm would work just as well without this restriction. Therefore, we see a plan as a set of actions, rather than a sequence of actions. So a set of plans is a set of sets of actions.
 
3
We will not discuss how it could obtain such a model, because there are many ways to do this and depends on the domain. In the case of NSP this is simple, because it is known that each agent wants to minimize its path.
 
Literatur
1.
Zurück zum Zitat An, B., Gatti, N., & Lesser, V. (2009). Extending alternating-offers bargaining in one-to-many and many-to-many settings. In Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT ’09 (Vol. 02, pp. 423–426). Washington, DC: IEEE Computer Society. doi:10.1109/WI-IAT.2009.188. An, B., Gatti, N., & Lesser, V. (2009). Extending alternating-offers bargaining in one-to-many and many-to-many settings. In Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT ’09 (Vol. 02, pp. 423–426). Washington, DC: IEEE Computer Society. doi:10.​1109/​WI-IAT.​2009.​188.
3.
Zurück zum Zitat An, B., Sim, K. M., Tang, L., Li, S., & Cheng, D. (2006). Continuous time negotiation mechanism for software agents. IEEE Transactions on Systems, Man and Cybernetics, Part B: Cybernetics, 36(6), 1261–1272.CrossRef An, B., Sim, K. M., Tang, L., Li, S., & Cheng, D. (2006). Continuous time negotiation mechanism for software agents. IEEE Transactions on Systems, Man and Cybernetics, Part B: Cybernetics, 36(6), 1261–1272.CrossRef
5.
Zurück zum Zitat Arcos, J. L., Esteva, M., Noriega, P., Rodríguez-Aguilar, J. A., & Sierra, C. (2005). Engineering open environments with electronic institutions. Engineering Applications of Artificial Intelligence, 18(2), 191–204.CrossRef Arcos, J. L., Esteva, M., Noriega, P., Rodríguez-Aguilar, J. A., & Sierra, C. (2005). Engineering open environments with electronic institutions. Engineering Applications of Artificial Intelligence, 18(2), 191–204.CrossRef
6.
Zurück zum Zitat Baarslag, T., Hindriks, K., Jonker, C. M., Kraus, S., & Lin, R. (2010). The first automated negotiating agents competition (ANAC 2010). In T. Ito, M. Zhang, V. Robu, S. Fatima, & T. Matsuo (Eds.), New trends in agent-based complex automated negotiations, series of studies in computational intelligence. Berlin: Springer-Verlag. Baarslag, T., Hindriks, K., Jonker, C. M., Kraus, S., & Lin, R. (2010). The first automated negotiating agents competition (ANAC 2010). In T. Ito, M. Zhang, V. Robu, S. Fatima, & T. Matsuo (Eds.), New trends in agent-based complex automated negotiations, series of studies in computational intelligence. Berlin: Springer-Verlag.
7.
Zurück zum Zitat Bektas, T. (2006). The multiple traveling salesman problem: An overview of formulations and solution procedures. Omega, 34(3), 209–219.CrossRef Bektas, T. (2006). The multiple traveling salesman problem: An overview of formulations and solution procedures. Omega, 34(3), 209–219.CrossRef
9.
Zurück zum Zitat Endriss, U. (2006). Monotonic concession protocols for multilateral negotiation. In Proceedings of the Fifth International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS ’06 (pp. 392–399). New York, NY: ACM. doi:10.1145/1160633.1160702. Endriss, U. (2006). Monotonic concession protocols for multilateral negotiation. In Proceedings of the Fifth International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS ’06 (pp. 392–399). New York, NY: ACM. doi:10.​1145/​1160633.​1160702.
10.
Zurück zum Zitat Fabregues, A., & Sierra, C. (2010). An agent architecture for simultaneous bilateral negotiations. In Proceedings of the 13è Congrés Internacional de l’Associació Catalana d’Intel \(\cdot \) ligència Artificial (CCIA 2010) (pp. 29–38). Tarragona: Espluga de Francolí. Fabregues, A., & Sierra, C. (2010). An agent architecture for simultaneous bilateral negotiations. In Proceedings of the 13è Congrés Internacional de l’Associació Catalana d’Intel \(\cdot \) ligència Artificial (CCIA 2010) (pp. 29–38). Tarragona: Espluga de Francolí.
11.
Zurück zum Zitat Fabregues, A., & Sierra, C. (2011). Dipgame: A challenging negotiation testbed. Engineering Applications of Artificial Intelligence, 24, 1137–1146.CrossRef Fabregues, A., & Sierra, C. (2011). Dipgame: A challenging negotiation testbed. Engineering Applications of Artificial Intelligence, 24, 1137–1146.CrossRef
13.
Zurück zum Zitat Faratin, P., Sierra, C., & Jennings, N. R. (2000). Using similarity criteria to make negotiation trade-offs. In Proceedings of the 4th International Conference on Multi-Agent Systems (ICMAS 2000), Boston (pp. 119–126). Faratin, P., Sierra, C., & Jennings, N. R. (2000). Using similarity criteria to make negotiation trade-offs. In Proceedings of the 4th International Conference on Multi-Agent Systems (ICMAS 2000), Boston (pp. 119–126).
14.
Zurück zum Zitat Fatima, S., Wooldridge, M., & Jennings, N. R. (2009). An analysis of feasible solutions for multi-issue negotiation involving nonlinear utility functions. In Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems, AAMAS ’09 (Vol. 2, pp. 1041–1048). Richland, SC: International Foundation for Autonomous Agents and Multiagent Systems. http://dl.acm.org/citation.cfm?id=1558109.1558158. Accessed 18 Aug 2014. Fatima, S., Wooldridge, M., & Jennings, N. R. (2009). An analysis of feasible solutions for multi-issue negotiation involving nonlinear utility functions. In Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems, AAMAS ’09 (Vol. 2, pp. 1041–1048). Richland, SC: International Foundation for Autonomous Agents and Multiagent Systems. http://​dl.​acm.​org/​citation.​cfm?​id=​1558109.​1558158. Accessed 18 Aug 2014.
16.
Zurück zum Zitat Gendron, B., & Crainic, T. G. (1994). Parallel branch-and-bound algorithms: Survey and synthesis. Operations Research, 42, 1042–1066.MathSciNetCrossRefMATH Gendron, B., & Crainic, T. G. (1994). Parallel branch-and-bound algorithms: Survey and synthesis. Operations Research, 42, 1042–1066.MathSciNetCrossRefMATH
17.
Zurück zum Zitat Hemaissia, M., El Fallah Seghrouchni, A., Labreuche, C., & Mattioli, J. (2007). A multilateral multi-issue negotiation protocol. In Proceedings of the 6th International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS ’07 (pp. 155:1–155:8). New York, NY: ACM. doi:10.1145/1329125.1329314. Hemaissia, M., El Fallah Seghrouchni, A., Labreuche, C., & Mattioli, J. (2007). A multilateral multi-issue negotiation protocol. In Proceedings of the 6th International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS ’07 (pp. 155:1–155:8). New York, NY: ACM. doi:10.​1145/​1329125.​1329314.
18.
Zurück zum Zitat Hindriks, K., & Tykhonov, D. (2008). Opponent modelling in automated multi-issue negotiation using bayesian learning. In Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS ’08 (Vol. 1, pp. 331–338). Richland, SC: International Foundation for Autonomous Agents and Multiagent Systems. http://dl.acm.org/citation.cfm?id=1402383.1402433. Accessed 18 Aug 2014. Hindriks, K., & Tykhonov, D. (2008). Opponent modelling in automated multi-issue negotiation using bayesian learning. In Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS ’08 (Vol. 1, pp. 331–338). Richland, SC: International Foundation for Autonomous Agents and Multiagent Systems. http://​dl.​acm.​org/​citation.​cfm?​id=​1402383.​1402433. Accessed 18 Aug 2014.
22.
Zurück zum Zitat Koenig, S., Tovey, C., Lagoudakis, M., Markakis, V., Kempe, D., Keskinocak, P., Kleywegt, A., Meyerson, A., & Jain, S. (2006). The power of sequential single-item auctions for agent coordination. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI) (pp. 1625–1629). Koenig, S., Tovey, C., Lagoudakis, M., Markakis, V., Kempe, D., Keskinocak, P., Kleywegt, A., Meyerson, A., & Jain, S. (2006). The power of sequential single-item auctions for agent coordination. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI) (pp. 1625–1629).
27.
Zurück zum Zitat Marsa-Maestre, I., Lopez-Carmona, M. A., Velasco, J. R., & de la Hoz, E. (2009). Effective bidding and deal identification for negotiations in highly nonlinear scenarios. In Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems, AAMAS ’09 (Vol. 2, pp. 1057–1064). Richland, SC: International Foundation for Autonomous Agents and Multiagent Systems. http://dl.acm.org/citation.cfm?id=1558109.1558160. Accessed 18 Aug 2014. Marsa-Maestre, I., Lopez-Carmona, M. A., Velasco, J. R., & de la Hoz, E. (2009). Effective bidding and deal identification for negotiations in highly nonlinear scenarios. In Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems, AAMAS ’09 (Vol. 2, pp. 1057–1064). Richland, SC: International Foundation for Autonomous Agents and Multiagent Systems. http://​dl.​acm.​org/​citation.​cfm?​id=​1558109.​1558160. Accessed 18 Aug 2014.
28.
Zurück zum Zitat Marsa-Maestre, I., Lopez-Carmona, M. A., Velasco, J. R., Ito, T., Klein, M., & Fujita, K. (2009). Balancing utility and deal probability for auction-based negotiations in highly nonlinear utility spaces. In Proceedings of the 21st International Jont Conference on Artifical Intelligence, IJCAI’09 (pp. 214–219). San Francisco, CA: Morgan Kaufmann Publishers Inc. http://dl.acm.org/citation.cfm?id=1661445.1661480. Marsa-Maestre, I., Lopez-Carmona, M. A., Velasco, J. R., Ito, T., Klein, M., & Fujita, K. (2009). Balancing utility and deal probability for auction-based negotiations in highly nonlinear utility spaces. In Proceedings of the 21st International Jont Conference on Artifical Intelligence, IJCAI’09 (pp. 214–219). San Francisco, CA: Morgan Kaufmann Publishers Inc. http://​dl.​acm.​org/​citation.​cfm?​id=​1661445.​1661480.
33.
Zurück zum Zitat Nguyen, T. D., & Jennings, N. R. (2004). Coordinating multiple concurrent negotiations. In Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS ’04 (Vol. 3, pp. 1064–1071). Washington, DC: IEEE Computer Society. doi:10.1109/AAMAS.2004.94. Nguyen, T. D., & Jennings, N. R. (2004). Coordinating multiple concurrent negotiations. In Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS ’04 (Vol. 3, pp. 1064–1071). Washington, DC: IEEE Computer Society. doi:10.​1109/​AAMAS.​2004.​94.
36.
Zurück zum Zitat Osborne, M., & Rubinstein, A. (1994). A course in game theory. Cambridge: MIT Press.MATH Osborne, M., & Rubinstein, A. (1994). A course in game theory. Cambridge: MIT Press.MATH
37.
Zurück zum Zitat Papadimitriou, C. H. (1994). Computational complexity. Reading: Addison-Wesley.MATH Papadimitriou, C. H. (1994). Computational complexity. Reading: Addison-Wesley.MATH
38.
Zurück zum Zitat Poundstone, W. (1993). Prisoner’s dilemma (1st ed.). New York, NY: Doubleday. Poundstone, W. (1993). Prisoner’s dilemma (1st ed.). New York, NY: Doubleday.
39.
Zurück zum Zitat Robu, V., Somefun, D. J. A., & Poutré, J. A. L. (2005). Modeling complex multi-issue negotiations using utility graphs. In Proceedings of AAMAS’05 (pp. 280–287) Robu, V., Somefun, D. J. A., & Poutré, J. A. L. (2005). Modeling complex multi-issue negotiations using utility graphs. In Proceedings of AAMAS’05 (pp. 280–287)
40.
Zurück zum Zitat Rosenschein, J. S., & Zlotkin, G. (1994). Rules of encounter. Cambridge: MIT Press. Rosenschein, J. S., & Zlotkin, G. (1994). Rules of encounter. Cambridge: MIT Press.
42.
Zurück zum Zitat Serrano, R. (2008). Bargaining. In S. N. Durlauf & L. E. Blume (Eds.), The new palgrave dictionary of economics. Basingstoke: Palgrave Macmillan. Serrano, R. (2008). Bargaining. In S. N. Durlauf & L. E. Blume (Eds.), The new palgrave dictionary of economics. Basingstoke: Palgrave Macmillan.
43.
Zurück zum Zitat Sierra, C., & Debenham, J. (2007). The logic negotiation model. In Sixth International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS ’07 (pp. 1026–1033). New York: ACM. Sierra, C., & Debenham, J. (2007). The logic negotiation model. In Sixth International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS ’07 (pp. 1026–1033). New York: ACM.
44.
Zurück zum Zitat Stahl, I. (1972). Bargaining theory. Stockholm: EFI. Stahl, I. (1972). Bargaining theory. Stockholm: EFI.
45.
Zurück zum Zitat Vieira Moura, A., & Augusto Scaraficci, R. (2010). A grasp strategy for a more constrained school timetabling problem. International Journal of Operational Research, 7(2/2010), 152–170.CrossRefMATH Vieira Moura, A., & Augusto Scaraficci, R. (2010). A grasp strategy for a more constrained school timetabling problem. International Journal of Operational Research, 7(2/2010), 152–170.CrossRefMATH
47.
Zurück zum Zitat Williams, C. R., Robu, V., Gerding, E. H., & Jennings, N. R. (2011). Using gaussian processes to optimise concession in complex negotiations against unknown opponents. In Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, IJCAI’11 (Vol. 1, pp. 432–438). AAAI Press. doi:10.5591/978-1-57735-516-8/IJCAI11-080. Williams, C. R., Robu, V., Gerding, E. H., & Jennings, N. R. (2011). Using gaussian processes to optimise concession in complex negotiations against unknown opponents. In Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, IJCAI’11 (Vol. 1, pp. 432–438). AAAI Press. doi:10.​5591/​978-1-57735-516-8/​IJCAI11-080.
48.
Zurück zum Zitat Yokoo, M., Durfee, E. H., Ishida, T., & Kuwabara, K. (1998). The distributed constraint satisfaction problem: Formalization and algorithms. IEEE Transactions on Knowledge and Data Engineering, 10, 673–685.CrossRef Yokoo, M., Durfee, E. H., Ishida, T., & Kuwabara, K. (1998). The distributed constraint satisfaction problem: Formalization and algorithms. IEEE Transactions on Knowledge and Data Engineering, 10, 673–685.CrossRef
Metadaten
Titel
: a multilateral negotiation algorithm for large, non-linear agreement spaces with limited time
verfasst von
Dave de Jonge
Carles Sierra
Publikationsdatum
01.09.2015
Verlag
Springer US
Erschienen in
Autonomous Agents and Multi-Agent Systems / Ausgabe 5/2015
Print ISSN: 1387-2532
Elektronische ISSN: 1573-7454
DOI
https://doi.org/10.1007/s10458-014-9271-3

Weitere Artikel der Ausgabe 5/2015

Autonomous Agents and Multi-Agent Systems 5/2015 Zur Ausgabe