Skip to main content
Erschienen in: KI - Künstliche Intelligenz 1/2014

01.02.2014 | Technical Contribution

Transfer for Automated Negotiation

verfasst von: Siqi Chen, Haitham Bou Ammar, Karl Tuyls, Gerhard Weiss

Erschienen in: KI - Künstliche Intelligenz | Ausgabe 1/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Learning in automated negotiation is a difficult problem because the target function is hidden and the available experience for learning is rather limited. Transfer learning is a branch of machine learning research concerned with the reuse of previously acquired knowledge in new learning tasks, for example, in order to reduce the amount of learning experience required to attain a certain level of performance. This paper proposes a novel strategy based on a variation of TrAdaBoost—a classic instance transfer technique—that can be used in a multi-issue negotiation setting. The experimental results show that the proposed method is effective in a variety of application domains against the state-of-the-art negotiating agents.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

KI - Künstliche Intelligenz

The Scientific journal "KI – Künstliche Intelligenz" is the official journal of the division for artificial intelligence within the "Gesellschaft für Informatik e.V." (GI) – the German Informatics Society - with constributions from troughout the field of artificial intelligence.

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Fußnoten
1
Adopting the same notation as in the original TrAdaBoost paper, the index s stands for "same distribution instance space" and the index D for "different distribution instance space".
 
2
Extending TrAdaBoost to multi-class classification problems is fairly straight forward.
 
3
Please note, that the formalization using the KL measure assesses that the two distributions should be having the same domain. This is reasonable in our framework as we operate within the same negotiation domain. If the two distributions are structurally different both could be approximated using one bigger distribution such as Gaussian mixture models.
 
4
In this work we split the negotiation session in intervals of 3 s.
 
5
Competitiveness refers to the minimum distance of possible outcomes in a domain to the point where both parties are both fully satisfied. To put it differently, agents tend to achieve better performance in a domain with lower competitiveness.
 
Literatur
1.
Zurück zum Zitat Ammar HB, Tuyls K, Taylor ME, Driessens K, Weiss G (2012) Reinforcement learning transfer via sparse coding. In: Proceedings of the 11th Int. Joint Conf. on Automomous Agents and Multi-Agent Systems. ACM, Valencia, p 383–390 Ammar HB, Tuyls K, Taylor ME, Driessens K, Weiss G (2012) Reinforcement learning transfer via sparse coding. In: Proceedings of the 11th Int. Joint Conf. on Automomous Agents and Multi-Agent Systems. ACM, Valencia, p 383–390
3.
Zurück zum Zitat Chen S, Ammar HB, Tuyls K, Weiss G (2013) Optimizing complex automated negotiation using sparse pseudo-input Gaussian processes. In: Proceedings of the 12th Int. Joint Conf. on Automomous Agents and Multi-Agent Systems. ACM, Saint Paul, p 707–714 Chen S, Ammar HB, Tuyls K, Weiss G (2013) Optimizing complex automated negotiation using sparse pseudo-input Gaussian processes. In: Proceedings of the 12th Int. Joint Conf. on Automomous Agents and Multi-Agent Systems. ACM, Saint Paul, p 707–714
4.
Zurück zum Zitat Chen S, Weiss G (2012) An efficient and adaptive approach to negotiation in complex environments. In: Proceedings of the 20th European Conference on Artificial Intelligence. IOS Press, Montpellier, France, p 228–233 Chen S, Weiss G (2012) An efficient and adaptive approach to negotiation in complex environments. In: Proceedings of the 20th European Conference on Artificial Intelligence. IOS Press, Montpellier, France, p 228–233
5.
Zurück zum Zitat Chen S, Weiss G (2013) An efficient automated negotiation strategy for complex environments. Eng Appl Artif Intell 26(10):2613–2623CrossRef Chen S, Weiss G (2013) An efficient automated negotiation strategy for complex environments. Eng Appl Artif Intell 26(10):2613–2623CrossRef
6.
Zurück zum Zitat Coehoorn RM, Jennings NR (2004) Learning on opponent’s preferences to make effective multi-issue negotiation trade-offs. In: Proceedings of the 6th Int. conf. on Electronic commerce, ICEC ’04. ACM, New York p 59–68 Coehoorn RM, Jennings NR (2004) Learning on opponent’s preferences to make effective multi-issue negotiation trade-offs. In: Proceedings of the 6th Int. conf. on Electronic commerce, ICEC ’04. ACM, New York p 59–68
7.
Zurück zum Zitat Dai W, Yang Q, Xue GR, Yu Y (2007) Boosting for transfer learning. In: Proceedings of the 24th international conference on Machine learning. ACM, New York, pages 193–200. Dai W, Yang Q, Xue GR, Yu Y (2007) Boosting for transfer learning. In: Proceedings of the 24th international conference on Machine learning. ACM, New York, pages 193–200.
8.
Zurück zum Zitat Hao J, Leung H (2012) ABiNeS: an adaptive bilateral negotiating strategy over multiple items. In: Proceedings of the 2012 IEEE/WIC/ACM International Conference on Intelligent Agent Technology (IAT 2012), Macau, China Hao J, Leung H (2012) ABiNeS: an adaptive bilateral negotiating strategy over multiple items. In: Proceedings of the 2012 IEEE/WIC/ACM International Conference on Intelligent Agent Technology (IAT 2012), Macau, China
9.
Zurück zum Zitat Hindriks K, Jonker C, Kraus S, Lin R, Tykhonov D (2009) Genius: negotiation environment for heterogeneous agents. In: Proceedings of the 8th Int. Joint Conf. on Automomous Agents and Multi-Agent Systems, p 1397–1398 Hindriks K, Jonker C, Kraus S, Lin R, Tykhonov D (2009) Genius: negotiation environment for heterogeneous agents. In: Proceedings of the 8th Int. Joint Conf. on Automomous Agents and Multi-Agent Systems, p 1397–1398
10.
Zurück zum Zitat Jennings NR, Faratin P, Lomuscio AR, Parsons S, Sierra C, Wooldridge M (2001) Automated negotiation: prospects, methods and challenges. Int J Group Decis Negot 10(2):199–215CrossRef Jennings NR, Faratin P, Lomuscio AR, Parsons S, Sierra C, Wooldridge M (2001) Automated negotiation: prospects, methods and challenges. Int J Group Decis Negot 10(2):199–215CrossRef
11.
Zurück zum Zitat Lau RY, Li Y, Song D, Kwok RCW (2008) Knowledge discovery for adaptive negotiation agents in e-marketplaces. Decis Support Syst 45(2):310–323CrossRef Lau RY, Li Y, Song D, Kwok RCW (2008) Knowledge discovery for adaptive negotiation agents in e-marketplaces. Decis Support Syst 45(2):310–323CrossRef
12.
Zurück zum Zitat Pan SJ, Yang Q (1010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359CrossRef Pan SJ, Yang Q (1010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359CrossRef
13.
Zurück zum Zitat Park S, Yang S (2008) An efficient multilateral negotiation system for pervasive computing environments. Eng Appl Artif Intell 21(4):633–643CrossRef Park S, Yang S (2008) An efficient multilateral negotiation system for pervasive computing environments. Eng Appl Artif Intell 21(4):633–643CrossRef
14.
Zurück zum Zitat Ponka I (2009) Commitment models and concurrent bilateral negotiation strategies in dynamic service markets. PhD thesis, University of Southampton, School of Electronics and Computer Science Ponka I (2009) Commitment models and concurrent bilateral negotiation strategies in dynamic service markets. PhD thesis, University of Southampton, School of Electronics and Computer Science
15.
Zurück zum Zitat Raiffa H (1982) The art and science of negotiation. Harvard University Press Cambridge, Cambridge Raiffa H (1982) The art and science of negotiation. Harvard University Press Cambridge, Cambridge
16.
Zurück zum Zitat Rasmussen CE (2006) Gaussian Processes for Machine Learning. MIT Press, CambridgeMATH Rasmussen CE (2006) Gaussian Processes for Machine Learning. MIT Press, CambridgeMATH
18.
Zurück zum Zitat Taylor ME, Stone P (2009) Transfer learning for reinforcement learning domains. A survey J Mach Learn Res 10:1633–1685MATHMathSciNet Taylor ME, Stone P (2009) Transfer learning for reinforcement learning domains. A survey J Mach Learn Res 10:1633–1685MATHMathSciNet
19.
Zurück zum Zitat Wang M, Wang H, Vogel D, Kumar K, and Chiu DK (2009) Agent-based negotiation and decision making for dynamic supply chain formation. Eng Appl Artif Intell 22(7):1046–1055CrossRef Wang M, Wang H, Vogel D, Kumar K, and Chiu DK (2009) Agent-based negotiation and decision making for dynamic supply chain formation. Eng Appl Artif Intell 22(7):1046–1055CrossRef
Metadaten
Titel
Transfer for Automated Negotiation
verfasst von
Siqi Chen
Haitham Bou Ammar
Karl Tuyls
Gerhard Weiss
Publikationsdatum
01.02.2014
Verlag
Springer Berlin Heidelberg
Erschienen in
KI - Künstliche Intelligenz / Ausgabe 1/2014
Print ISSN: 0933-1875
Elektronische ISSN: 1610-1987
DOI
https://doi.org/10.1007/s13218-013-0284-x

Weitere Artikel der Ausgabe 1/2014

KI - Künstliche Intelligenz 1/2014 Zur Ausgabe

Community

News

Premium Partner