Skip to main content

2017 | OriginalPaper | Buchkapitel

Rethinking Frequency Opponent Modeling in Automated Negotiation

verfasst von : Okan Tunalı, Reyhan Aydoğan, Victor Sanchez-Anguix

Erschienen in: PRIMA 2017: Principles and Practice of Multi-Agent Systems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Frequency opponent modeling is one of the most widely used opponent modeling techniques in automated negotiation, due to its simplicity and its good performance. In fact, it outperforms even more complex mechanisms like Bayesian models. Nevertheless, the classical frequency model does not come without its own assumptions, some of which may not always hold in many realistic settings. This paper advances the state of the art in opponent modeling in automated negotiation by introducing a novel frequency opponent modeling mechanism, which soothes some of the assumptions introduced by classical frequency approaches. The experiments show that our proposed approach outperforms the classic frequency model in terms of evaluation of the outcome space, estimation of the Pareto frontier, and accuracy of both issue value evaluation estimation and issue weight estimation.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Please note that windows are not overlapping and not sliding.
 
2
2 models \(\times \) 5 opponents \(\times \) 8 domains \(\times \) 2 profiles \(\times \) 20 repetitions.
 
Literatur
1.
Zurück zum Zitat Afiouni, E.N., Øvrelid, L.J.: Negotiation for strategic video games. Master’s thesis, NTNU (2013) Afiouni, E.N., Øvrelid, L.J.: Negotiation for strategic video games. Master’s thesis, NTNU (2013)
2.
Zurück zum Zitat Alsrheed, F., El Rhalibi, A., Randles, M., Merabti, M.: Intelligent agents for automated cloud computing negotiation. In: IEEE International Conference on Multimedia Computing and Systems, pp. 1169–1174. IEEE (2014) Alsrheed, F., El Rhalibi, A., Randles, M., Merabti, M.: Intelligent agents for automated cloud computing negotiation. In: IEEE International Conference on Multimedia Computing and Systems, pp. 1169–1174. IEEE (2014)
3.
Zurück zum Zitat An, B., Gatti, N., Lesser, V.: Extending alternating-offers bargaining in one-to-many and many-to-many settings. In: Proceedings of the 2009 IEEE/WIC/ACM International Conference on Intelligent Agent Technology, vol. 2, pp. 423–426 (2009) An, B., Gatti, N., Lesser, V.: Extending alternating-offers bargaining in one-to-many and many-to-many settings. In: Proceedings of the 2009 IEEE/WIC/ACM International Conference on Intelligent Agent Technology, vol. 2, pp. 423–426 (2009)
4.
Zurück zum Zitat Aydoğan, R., Baarslag, T., Hindriks, K.V., Jonker, C.M., Yolum, P.: Heuristics for using cp-nets in utility-based negotiation without knowing utilities. Knowl. Inf. Syst. 45(2), 357–388 (2015)CrossRef Aydoğan, R., Baarslag, T., Hindriks, K.V., Jonker, C.M., Yolum, P.: Heuristics for using cp-nets in utility-based negotiation without knowing utilities. Knowl. Inf. Syst. 45(2), 357–388 (2015)CrossRef
5.
Zurück zum Zitat Aydoğan, R., Festen, D., Hindriks, K.V., Jonker, C.M.: Alternating offers protocols for multilateral negotiation. In: Fujita, K., Bai, Q., Ito, T., Zhang, M., Ren, F., Aydoğan, R., Hadfi, R. (eds.) Modern Approaches to Agent-based Complex Automated Negotiation. SCI, vol. 674, pp. 153–167. Springer, Cham (2017). doi:10.1007/978-3-319-51563-2_10 CrossRef Aydoğan, R., Festen, D., Hindriks, K.V., Jonker, C.M.: Alternating offers protocols for multilateral negotiation. In: Fujita, K., Bai, Q., Ito, T., Zhang, M., Ren, F., Aydoğan, R., Hadfi, R. (eds.) Modern Approaches to Agent-based Complex Automated Negotiation. SCI, vol. 674, pp. 153–167. Springer, Cham (2017). doi:10.​1007/​978-3-319-51563-2_​10 CrossRef
6.
Zurück zum Zitat Aydoğan, R., Yolum, P.: Ontology-based learning for negotiation. In: IEEE/WIC/ACM International Conference on Intelligent Agent Technology, pp. 177–184 (2009) Aydoğan, R., Yolum, P.: Ontology-based learning for negotiation. In: IEEE/WIC/ACM International Conference on Intelligent Agent Technology, pp. 177–184 (2009)
7.
Zurück zum Zitat Baarslag, T.: Measuring the performance of online opponent models. In: Exploring the Strategy Space of Negotiating Agents. ST, pp. 111–127. Springer, Cham (2016). doi:10.1007/978-3-319-28243-5_6 Baarslag, T.: Measuring the performance of online opponent models. In: Exploring the Strategy Space of Negotiating Agents. ST, pp. 111–127. Springer, Cham (2016). doi:10.​1007/​978-3-319-28243-5_​6
8.
Zurück zum Zitat Baarslag, T., Hendrikx, M., Hindriks, K., Jonker, C.: Predicting the performance of opponent models in automated negotiation. In: International Joint Conference on Web Intelligence and Intelligent Agent Technologies, vol. 2, pp. 59–66. IEEE (2013) Baarslag, T., Hendrikx, M., Hindriks, K., Jonker, C.: Predicting the performance of opponent models in automated negotiation. In: International Joint Conference on Web Intelligence and Intelligent Agent Technologies, vol. 2, pp. 59–66. IEEE (2013)
9.
Zurück zum Zitat Baarslag, T., Hendrikx, M.J., Hindriks, K.V., Jonker, C.M.: Learning about the opponent in automated bilateral negotiation: a comprehensive survey of opponent modeling techniques. Auton. Agent Multi Agent Syst. 30, 849–898 (2016)CrossRef Baarslag, T., Hendrikx, M.J., Hindriks, K.V., Jonker, C.M.: Learning about the opponent in automated bilateral negotiation: a comprehensive survey of opponent modeling techniques. Auton. Agent Multi Agent Syst. 30, 849–898 (2016)CrossRef
10.
Zurück zum Zitat Buffett, S., Spencer, B.: Learning opponents’ preferences in multi-object automated negotiation. In: Proceedings of the 7th International Conference on Electronic Commerce, pp. 300–305 (2005) Buffett, S., Spencer, B.: Learning opponents’ preferences in multi-object automated negotiation. In: Proceedings of the 7th International Conference on Electronic Commerce, pp. 300–305 (2005)
11.
Zurück zum Zitat Bui, H.H., Kieronska, D., Venkatesh, S.: Learning other agents’ preferences in multiagent negotiation. In: Proceedings of the National Conference on Artificial Intelligence, pp. 114–119 (1996) Bui, H.H., Kieronska, D., Venkatesh, S.: Learning other agents’ preferences in multiagent negotiation. In: Proceedings of the National Conference on Artificial Intelligence, pp. 114–119 (1996)
12.
Zurück zum Zitat Coehoorn, R.M., Jennings, N.R.: Learning an opponent’s preferences to make effective multi-issue negotiation tradeoffs. In: The 6th International Conference on E-Commerce, pp. 59–68 (2004) Coehoorn, R.M., Jennings, N.R.: Learning an opponent’s preferences to make effective multi-issue negotiation tradeoffs. In: The 6th International Conference on E-Commerce, pp. 59–68 (2004)
13.
Zurück zum Zitat Dirkzwager, A., Hendrikx, M.: An adaptive negotiation strategy for real-time bilateral negotiations. In: Marsa-Maestre, I., Lopez-Carmona, M.A., Ito, T., Zhang, M., Bai, Q., Fujita, K. (eds.) Novel Insights in Agent-based Complex Automated Negotiation. SCI, vol. 535, pp. 163–170. Springer, Tokyo (2014). doi:10.1007/978-4-431-54758-7_10 CrossRef Dirkzwager, A., Hendrikx, M.: An adaptive negotiation strategy for real-time bilateral negotiations. In: Marsa-Maestre, I., Lopez-Carmona, M.A., Ito, T., Zhang, M., Bai, Q., Fujita, K. (eds.) Novel Insights in Agent-based Complex Automated Negotiation. SCI, vol. 535, pp. 163–170. Springer, Tokyo (2014). doi:10.​1007/​978-4-431-54758-7_​10 CrossRef
14.
Zurück zum Zitat Faratin, P., Sierra, C., Jennings, N.R.: Using similarity criteria to make issue trade-offs in automated negotiations. Artif. Intell. 142(2), 205–237 (2002)MathSciNetCrossRef Faratin, P., Sierra, C., Jennings, N.R.: Using similarity criteria to make issue trade-offs in automated negotiations. Artif. Intell. 142(2), 205–237 (2002)MathSciNetCrossRef
15.
Zurück zum Zitat Faratin, P., Sierra, C., Jennings, N.R.: Negotiation decision functions for autonomous agents. Robot. Auton. Syst. 24(3–4), 159–182 (1998)CrossRef Faratin, P., Sierra, C., Jennings, N.R.: Negotiation decision functions for autonomous agents. Robot. Auton. Syst. 24(3–4), 159–182 (1998)CrossRef
16.
Zurück zum Zitat Fatima, S., Kraus, S., Wooldridge, M.: Principles of Automated Negotiation. Cambridge University Press, Cambridge (2014)CrossRef Fatima, S., Kraus, S., Wooldridge, M.: Principles of Automated Negotiation. Cambridge University Press, Cambridge (2014)CrossRef
17.
Zurück zum Zitat Fatima, S.S., Wooldridge, M., Jennings, N.R.: An agenda-based framework for multi-issue negotiation. Artif. Intell. 152(1), 1–45 (2004)MathSciNetCrossRefMATH Fatima, S.S., Wooldridge, M., Jennings, N.R.: An agenda-based framework for multi-issue negotiation. Artif. Intell. 152(1), 1–45 (2004)MathSciNetCrossRefMATH
18.
Zurück zum Zitat van Galen, L.N.: Agent smith: opponent model estimation in bilateral multi-issue negotiation. In: Ito, T., Zhang, M., Robu, V., Fatima, S., Matsuo, T. (eds.) New Trends in Agent-Based Complex Automated Negotiations. SCI, vol. 383, pp. 167–174. Springer, Heidelberg (2012). doi:10.1007/978-3-642-24696-8_12 CrossRef van Galen, L.N.: Agent smith: opponent model estimation in bilateral multi-issue negotiation. In: Ito, T., Zhang, M., Robu, V., Fatima, S., Matsuo, T. (eds.) New Trends in Agent-Based Complex Automated Negotiations. SCI, vol. 383, pp. 167–174. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-24696-8_​12 CrossRef
19.
Zurück zum Zitat Gerla, M., Lee, E.K., Pau, G., Lee, U.: Internet of vehicles: from intelligent grid to autonomous cars and vehicular clouds. In: IEEE World Forum on Internet of Things, pp. 241–246 (2014) Gerla, M., Lee, E.K., Pau, G., Lee, U.: Internet of vehicles: from intelligent grid to autonomous cars and vehicular clouds. In: IEEE World Forum on Internet of Things, pp. 241–246 (2014)
20.
Zurück zum Zitat Hindriks, K., Jonker, C.M., Kraus, S., Lin, R., Tykhonov, D.: Genius: negotiation environment for heterogeneous agents. In: Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems. pp. 1397–1398 (2009) Hindriks, K., Jonker, C.M., Kraus, S., Lin, R., Tykhonov, D.: Genius: negotiation environment for heterogeneous agents. In: Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems. pp. 1397–1398 (2009)
21.
Zurück zum Zitat Hindriks, K., Tykhonov, D.: Opponent modelling in automated multi-issue negotiation using bayesian learning. In: 7th International Joint Conference on Autonomous Agents and Multiagent Systems, pp. 331–338 (2008) Hindriks, K., Tykhonov, D.: Opponent modelling in automated multi-issue negotiation using bayesian learning. In: 7th International Joint Conference on Autonomous Agents and Multiagent Systems, pp. 331–338 (2008)
22.
Zurück zum Zitat Ikarashi, M., Fujita, K.: Compromising strategy using weighted counting in multi-times negotiations. In: Proceedings of the 3rd International Conference on Advanced Applied Informatics, pp. 453–458 (2014) Ikarashi, M., Fujita, K.: Compromising strategy using weighted counting in multi-times negotiations. In: Proceedings of the 3rd International Conference on Advanced Applied Informatics, pp. 453–458 (2014)
23.
Zurück zum Zitat Jennings, N.R., Faratin, P., Lomuscio, A.R., Parsons, S., Wooldridge, M.J., Sierra, C.: Automated negotiation: prospects, methods and challenges. Group Decis. Negot. 10, 199–215 (2001)CrossRef Jennings, N.R., Faratin, P., Lomuscio, A.R., Parsons, S., Wooldridge, M.J., Sierra, C.: Automated negotiation: prospects, methods and challenges. Group Decis. Negot. 10, 199–215 (2001)CrossRef
24.
Zurück zum Zitat Kawaguchi, S., Fujita, K., Ito, T.: AgentK: Compromising strategy based on estimated maximum utility for automated negotiating agents. In: Ito, T., Zhang, M., Robu, V., Fatima, S., Matsuo, T. (eds.) New Trends in Agent-Based Complex Automated Negotiations. SCI, vol. 383, pp. 137–144. Springer, Heidelberg (2012). doi:10.1007/978-3-642-24696-8_8 CrossRef Kawaguchi, S., Fujita, K., Ito, T.: AgentK: Compromising strategy based on estimated maximum utility for automated negotiating agents. In: Ito, T., Zhang, M., Robu, V., Fatima, S., Matsuo, T. (eds.) New Trends in Agent-Based Complex Automated Negotiations. SCI, vol. 383, pp. 137–144. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-24696-8_​8 CrossRef
25.
Zurück zum Zitat van Krimpen, T., Looije, D., Hajizadeh, S.: HardHeaded. In: Ito, T., Zhang, M., Robu, V., Matsuo, T. (eds.) Complex Automated Negotiations: Theories, Models, and Software Competitions. SCI, vol. 435, pp. 223–227. Springer, Heidelberg (2013). doi:10.1007/978-3-642-30737-9_17 CrossRef van Krimpen, T., Looije, D., Hajizadeh, S.: HardHeaded. In: Ito, T., Zhang, M., Robu, V., Matsuo, T. (eds.) Complex Automated Negotiations: Theories, Models, and Software Competitions. SCI, vol. 435, pp. 223–227. Springer, Heidelberg (2013). doi:10.​1007/​978-3-642-30737-9_​17 CrossRef
26.
Zurück zum Zitat Luo, X., Jennings, N.R., Shadbolt, N., Leung, H.F., Lee, J.H.M.: A fuzzy constraint based model for bilateral, multi-issue negotiations in semi-competitive environments. Artif. Intell. 148(1), 53–102 (2003)CrossRefMATH Luo, X., Jennings, N.R., Shadbolt, N., Leung, H.F., Lee, J.H.M.: A fuzzy constraint based model for bilateral, multi-issue negotiations in semi-competitive environments. Artif. Intell. 148(1), 53–102 (2003)CrossRefMATH
27.
28.
Zurück zum Zitat Sanchez-Anguix, V., Aydogan, R., Julian, V., Jonker, C.: Unanimously acceptable agreements for negotiation teams in unpredictable domains. Electron. Commer. Res. Appl. 13(4), 243–265 (2014)CrossRef Sanchez-Anguix, V., Aydogan, R., Julian, V., Jonker, C.: Unanimously acceptable agreements for negotiation teams in unpredictable domains. Electron. Commer. Res. Appl. 13(4), 243–265 (2014)CrossRef
29.
Zurück zum Zitat Sanchez-Anguix, V., Julian, V., Botti, V., García-Fornes, A.: Tasks for agent-based negotiation teams: analysis, review, and challenges. Eng. Appl. Artif. Intel. 26(10), 2480–2494 (2013)CrossRefMATH Sanchez-Anguix, V., Julian, V., Botti, V., García-Fornes, A.: Tasks for agent-based negotiation teams: analysis, review, and challenges. Eng. Appl. Artif. Intel. 26(10), 2480–2494 (2013)CrossRefMATH
30.
Zurück zum Zitat Williams, C.R., Robu, V., Gerding, E.H., Jennings, N.R.: IAMhaggler2011: a gaussian process regression based negotiation agent. In: Ito, T., Zhang, M., Robu, V., Matsuo, T. (eds.) Complex Automated Negotiations: Theories, Models, and Software Competitions. SCI, vol. 435, pp. 209–212. Springer, Heidelberg (2013). doi:10.1007/978-3-642-30737-9_14 CrossRef Williams, C.R., Robu, V., Gerding, E.H., Jennings, N.R.: IAMhaggler2011: a gaussian process regression based negotiation agent. In: Ito, T., Zhang, M., Robu, V., Matsuo, T. (eds.) Complex Automated Negotiations: Theories, Models, and Software Competitions. SCI, vol. 435, pp. 209–212. Springer, Heidelberg (2013). doi:10.​1007/​978-3-642-30737-9_​14 CrossRef
Metadaten
Titel
Rethinking Frequency Opponent Modeling in Automated Negotiation
verfasst von
Okan Tunalı
Reyhan Aydoğan
Victor Sanchez-Anguix
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-69131-2_16