Skip to main content
Erschienen in: Journal on Multimodal User Interfaces 2/2021

03.03.2021 | Original Paper

An expert-model and machine learning hybrid approach to predicting human-agent negotiation outcomes in varied data

verfasst von: Johnathan Mell, Markus Beissinger, Jonathan Gratch

Erschienen in: Journal on Multimodal User Interfaces | Ausgabe 2/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We present the results of a machine-learning approach to the analysis of several human-agent negotiation studies. By combining expert knowledge of negotiating behavior compiled over a series of empirical studies with neural networks, we show that a hybrid approach to parameter selection yields promise for designing more effective and socially intelligent agents. Specifically, we show that a deep feedforward neural network using a theory-driven three-parameter model can be effective in predicting negotiation outcomes. Furthermore, it outperforms other expert-designed models that use more parameters, as well as those using other techniques (such as linear regression models or boosted decision trees). In a follow-up study, we show that the most successful models change as the dataset size increases and the prediction targets change, and show that boosted decision trees may not be suitable for the negotiation domain. We anticipate these results will have impact for those seeking to combine extensive domain knowledge with more automated approaches in human-computer negotiation. Further, we show that this approach can be a stepping stone from purely exploratory research to targeted human-behavioral experimentation. Through our approach, areas of social artificial intelligence that have historically benefited from expert knowledge and traditional AI approaches can be combined with more recent proven-effective machine learning algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
“Wide” datasets have numerous measurable variables, while “deep” ones have many entries. Social dataset often have lots of variables to track but relatively few participants.
 
2
Since not all experiments contained the same inputs, statistical differences in the retention rate of data after cleaning (289/485 = 60% vs. 654/769 = 85%) are to be expected.
 
5
A sigmoid serves our purposes to force 0–1 range to form a percentage. A different approach, such as softmax, would force a percentage across all outputs so they must sum to 1. We are looking to get a percentage for each output individually, so we chose the sigmoid.
 
Literatur
1.
Zurück zum Zitat Alto KM, McCullough KM, Levant RF (2018) Who is on craigslist? a novel approach to participant recruitment for masculinities scholarship. Psychol Men Masc 19(2):319CrossRef Alto KM, McCullough KM, Levant RF (2018) Who is on craigslist? a novel approach to participant recruitment for masculinities scholarship. Psychol Men Masc 19(2):319CrossRef
2.
Zurück zum Zitat Anthony P, Jennings NR (2003) Developing a bidding agent for multiple heterogeneous auctions. ACM Trans Internet Technol (TOIT) 3(3):185–217CrossRef Anthony P, Jennings NR (2003) Developing a bidding agent for multiple heterogeneous auctions. ACM Trans Internet Technol (TOIT) 3(3):185–217CrossRef
3.
Zurück zum Zitat Baarslag T, Kaisers M, Gerding E, Jonker CM, Gratch J (2017) When will negotiation agents be able to represent us? The challenges and opportunities for autonomous negotiators. Sierra, Carles (ed.) In Proceedings of the twenty-sixth international joint conference on artificial intelligence. International joint conferences on artificial intelligence. pp. 4684–4690. Baarslag T, Kaisers M, Gerding E, Jonker CM, Gratch J (2017) When will negotiation agents be able to represent us? The challenges and opportunities for autonomous negotiators. Sierra, Carles (ed.) In Proceedings of the twenty-sixth international joint conference on artificial intelligence. International joint conferences on artificial intelligence. pp. 4684–4690.
4.
Zurück zum Zitat Bengio Y (2013) Deep learning of representations: looking forward. In international conference on statistical language and speech processing (pp. 1–37). Springer, Berlin Bengio Y (2013) Deep learning of representations: looking forward. In international conference on statistical language and speech processing (pp. 1–37). Springer, Berlin
5.
Zurück zum Zitat Bonnefon JF, Shariff A, Rahwan I (2016) The social dilemma of autonomous vehicles. Science 352(6293):1573–1576CrossRef Bonnefon JF, Shariff A, Rahwan I (2016) The social dilemma of autonomous vehicles. Science 352(6293):1573–1576CrossRef
6.
Zurück zum Zitat Bordone RC (2000) Teaching interpersonal skills for negotiation and for life. Negot J 16(4):377–385CrossRef Bordone RC (2000) Teaching interpersonal skills for negotiation and for life. Negot J 16(4):377–385CrossRef
7.
Zurück zum Zitat Castelfranchi C, Falcone R, (1998) Principles of trust for MAS: Cognitive anatomy, social importance, and quantification. In Multi Agent Systems, 1998. Proceedings. International conference on (pp. 72–79). IEEE Castelfranchi C, Falcone R, (1998) Principles of trust for MAS: Cognitive anatomy, social importance, and quantification. In Multi Agent Systems, 1998. Proceedings. International conference on (pp. 72–79). IEEE
8.
Zurück zum Zitat Caruana R, Lou Y, Gehrke J, Koch P, Sturm M, Elhadad N (2015) Intelligible models for healthcare: predicting pneumonia risk and hospital 30-day readmission. In proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining (pp. 1721–1730). ACM Caruana R, Lou Y, Gehrke J, Koch P, Sturm M, Elhadad N (2015) Intelligible models for healthcare: predicting pneumonia risk and hospital 30-day readmission. In proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining (pp. 1721–1730). ACM
9.
Zurück zum Zitat Chen T, Guestrin C (2016) Xgboost: a scalable tree boosting system. In proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining (pp. 785–794). ACM Chen T, Guestrin C (2016) Xgboost: a scalable tree boosting system. In proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining (pp. 785–794). ACM
10.
Zurück zum Zitat Cohen J (2013) Statistical power analysis for the behavioral sciences. Academic press, CambridgeCrossRef Cohen J (2013) Statistical power analysis for the behavioral sciences. Academic press, CambridgeCrossRef
11.
Zurück zum Zitat De Dreu CK, Koole SL, Steinel W (2000) Unfixing the fixed pie: a motivated information-processing approach to integrative negotiation. J Pers Soc Psychol 79(6):975CrossRef De Dreu CK, Koole SL, Steinel W (2000) Unfixing the fixed pie: a motivated information-processing approach to integrative negotiation. J Pers Soc Psychol 79(6):975CrossRef
12.
Zurück zum Zitat de Melo CM, Carnevale P, Gratch J, (2011) The effect of expression of anger and happiness in computer agents on negotiations with humans. In the 10th international conference on autonomous agents and multiagent systems-vol. 3 (pp. 937–944). International foundation for autonomous agents and multiagent systems. de Melo CM, Carnevale P, Gratch J, (2011) The effect of expression of anger and happiness in computer agents on negotiations with humans. In the 10th international conference on autonomous agents and multiagent systems-vol. 3 (pp. 937–944). International foundation for autonomous agents and multiagent systems.
13.
Zurück zum Zitat Fox J, Ahn SJ, Janssen JH, Yeykelis L, Segovia KY, Bailenson JN (2015) Avatars versus agents: a meta-analysis quantifying the effect of agency on social influence. Human Comput Interact 30(5):401–432CrossRef Fox J, Ahn SJ, Janssen JH, Yeykelis L, Segovia KY, Bailenson JN (2015) Avatars versus agents: a meta-analysis quantifying the effect of agency on social influence. Human Comput Interact 30(5):401–432CrossRef
14.
Zurück zum Zitat Gerhart B, Rynes S (1991) Determinants and consequences of salary negotiations by male and female MBA graduates. J Appl Psychol 76(2):256CrossRef Gerhart B, Rynes S (1991) Determinants and consequences of salary negotiations by male and female MBA graduates. J Appl Psychol 76(2):256CrossRef
15.
Zurück zum Zitat Goodman B, Flaxman S (2017) European Union regulations on algorithmic decision-making and a “right to explanation.” AI Magazine 38(3):50–57CrossRef Goodman B, Flaxman S (2017) European Union regulations on algorithmic decision-making and a “right to explanation.” AI Magazine 38(3):50–57CrossRef
17.
Zurück zum Zitat Hubbard R, Ryan PA (2000) The historical growth of statistical significance testing in psychology—And its future prospects. Educ Psychol Measur 60(5):661–681 Hubbard R, Ryan PA (2000) The historical growth of statistical significance testing in psychology—And its future prospects. Educ Psychol Measur 60(5):661–681
18.
Zurück zum Zitat Johnson E, Gratch J, DeVault D (2017) Towards an autonomous agent that provides automated feedback on students' negotiation skills. In proceedings of the 16th conference on autonomous agents and multiagent systems (pp. 410–418). International foundation for autonomous agents and multiagent systems Johnson E, Gratch J, DeVault D (2017) Towards an autonomous agent that provides automated feedback on students' negotiation skills. In proceedings of the 16th conference on autonomous agents and multiagent systems (pp. 410–418). International foundation for autonomous agents and multiagent systems
19.
Zurück zum Zitat Klambauer G, Unterthiner T, Mayr A, Hochreiter S (2017) Self-normalizing neural networks. In: Proceedings of the 31st international conference on neural information processing systems, pp 972–981 Klambauer G, Unterthiner T, Mayr A, Hochreiter S (2017) Self-normalizing neural networks. In: Proceedings of the 31st international conference on neural information processing systems, pp 972–981
20.
Zurück zum Zitat Lapuschkin S, Binder A, Montavon G, Muller KR Samek W (2016) Analyzing classifiers: fisher vectors and deep neural networks. In proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2912–2920) Lapuschkin S, Binder A, Montavon G, Muller KR Samek W (2016) Analyzing classifiers: fisher vectors and deep neural networks. In proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2912–2920)
21.
Zurück zum Zitat Lucas G, Stratou G, Lieblich S, Gratch J (2016) Trust me: multimodal signals of trustworthiness. In Proceedings of the 18th ACM international conference on multimodal interaction (pp. 5–12). ACM Lucas G, Stratou G, Lieblich S, Gratch J (2016) Trust me: multimodal signals of trustworthiness. In Proceedings of the 18th ACM international conference on multimodal interaction (pp. 5–12). ACM
22.
Zurück zum Zitat Mell J, Gratch J (2016) IAGO: interactive arbitration guide online. In AAMAS (pp. 1510–1512) Mell J, Gratch J (2016) IAGO: interactive arbitration guide online. In AAMAS (pp. 1510–1512)
23.
Zurück zum Zitat Mell J, Gratch J (2017) Grumpy and Pinocchio: answering human-agent negotiation questions through realistic agent design. In Proceedings of the 16th conference on autonomous agents and multiagent systems (pp. 401–409). International foundation for autonomous agents and multiagent systems Mell J, Gratch J (2017) Grumpy and Pinocchio: answering human-agent negotiation questions through realistic agent design. In Proceedings of the 16th conference on autonomous agents and multiagent systems (pp. 401–409). International foundation for autonomous agents and multiagent systems
24.
Zurück zum Zitat Mell J, Lucas GM, Gratch J (2018) Welcome to the real world: how agent strategy increases human willingness to deceive. In Proceedings of the 17th international conference on autonomous agents and multi agent systems (pp. 1250–1257). International foundation for autonomous agents and multi agent systems Mell J, Lucas GM, Gratch J (2018) Welcome to the real world: how agent strategy increases human willingness to deceive. In Proceedings of the 17th international conference on autonomous agents and multi agent systems (pp. 1250–1257). International foundation for autonomous agents and multi agent systems
25.
Zurück zum Zitat Mell J, Lucas G, Mozgai S, Boberg J, Artstein R, Gratch J (2018) Towards a repeated negotiating agent that treats people individually: cooperation, social value orientation, & machiavellianism. In Proceedings of the 18th international conference on intelligent virtual agents (pp. 125–132). ACM Mell J, Lucas G, Mozgai S, Boberg J, Artstein R, Gratch J (2018) Towards a repeated negotiating agent that treats people individually: cooperation, social value orientation, & machiavellianism. In Proceedings of the 18th international conference on intelligent virtual agents (pp. 125–132). ACM
27.
Zurück zum Zitat Pennacchiotti M, Popescu AM (2011) A machine learning approach to twitter user classification. In Fifth international AAAI conference on weblogs and social media Pennacchiotti M, Popescu AM (2011) A machine learning approach to twitter user classification. In Fifth international AAAI conference on weblogs and social media
28.
Zurück zum Zitat Perlich C, Dalessandro B, Raeder T, Stitelman O, Provost F (2014) Machine learning for targeted display advertising: transfer learning in action. Mach Learn 95(1):103–127MathSciNetCrossRef Perlich C, Dalessandro B, Raeder T, Stitelman O, Provost F (2014) Machine learning for targeted display advertising: transfer learning in action. Mach Learn 95(1):103–127MathSciNetCrossRef
29.
Zurück zum Zitat Samek W, Wiegand T, Müller KR (2017) Explainable artificial intelligence: understanding, visualizing and interpreting deep learning models. arXiv:1708.08296 Samek W, Wiegand T, Müller KR (2017) Explainable artificial intelligence: understanding, visualizing and interpreting deep learning models. arXiv:​1708.​08296
30.
Zurück zum Zitat Thompson LL (1991) Information exchange in negotiation. J Exp Soc Psychol 27(2):161–179CrossRef Thompson LL (1991) Information exchange in negotiation. J Exp Soc Psychol 27(2):161–179CrossRef
31.
Zurück zum Zitat Yu B, Kaufmann S, Diermeier D (2008) Classifying party affiliation from political speech. J Inf Technol Politics 5(1):33–48CrossRef Yu B, Kaufmann S, Diermeier D (2008) Classifying party affiliation from political speech. J Inf Technol Politics 5(1):33–48CrossRef
Metadaten
Titel
An expert-model and machine learning hybrid approach to predicting human-agent negotiation outcomes in varied data
verfasst von
Johnathan Mell
Markus Beissinger
Jonathan Gratch
Publikationsdatum
03.03.2021
Verlag
Springer International Publishing
Erschienen in
Journal on Multimodal User Interfaces / Ausgabe 2/2021
Print ISSN: 1783-7677
Elektronische ISSN: 1783-8738
DOI
https://doi.org/10.1007/s12193-021-00368-w

Weitere Artikel der Ausgabe 2/2021

Journal on Multimodal User Interfaces 2/2021 Zur Ausgabe

Premium Partner