Skip to main content
Top

2017 | OriginalPaper | Chapter

Investigation of Learning Strategies for the SPOT Broker in Power TAC

Authors : Moinul Morshed Porag Chowdhury, Russell Y. Folk, Ferdinando Fioretto, Christopher Kiekintveld, William Yeoh

Published in: Agent-Mediated Electronic Commerce. Designing Trading Strategies and Mechanisms for Electronic Markets

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The Power TAC simulation emphasizes the strategic problems that broker agents face in managing the economics of a smart grid. The brokers must make trades in multiple markets and, to be successful, brokers must make many good predictions about future supply, demand, and prices in the wholesale and tariff markets. In this paper, we investigate the feasibility of using learning strategies to improve the performance of our broker, SPOT. Specifically, we investigate the use of decision trees and neural networks to predict the clearing price in the wholesale market and the use of reinforcement learning to learn good strategies for pricing our tariffs in the tariff market. Our preliminary results show that our learning strategies are promising ways to improve the performance of the agent for future competitions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ketter, W., Peters, M., Collins, J.: Autonomous agents in future energy markets: the 2012 power trading agent competition. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 1298–1304 (2013) Ketter, W., Peters, M., Collins, J.: Autonomous agents in future energy markets: the 2012 power trading agent competition. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 1298–1304 (2013)
2.
go back to reference Ketter, W., Collins, J., Reddy, P.: Power TAC: a competitive economic simulation of the smart grid. Energy Econ. 39, 262–270 (2013)CrossRef Ketter, W., Collins, J., Reddy, P.: Power TAC: a competitive economic simulation of the smart grid. Energy Econ. 39, 262–270 (2013)CrossRef
3.
go back to reference Wellman, M.P., Greenwald, A., Stone, P., Wurman, P.R.: The 2001 trading agent competition. Electron. Markets 13(1), 4–12 (2003)CrossRef Wellman, M.P., Greenwald, A., Stone, P., Wurman, P.R.: The 2001 trading agent competition. Electron. Markets 13(1), 4–12 (2003)CrossRef
4.
go back to reference Ketter, W., Collins, J., Reddy, P.P., Weerdt, M.D.: The 2015 power trading agent competition. ERIM Report Series Reference No. ERS-2015-001-LIS (2015) Ketter, W., Collins, J., Reddy, P.P., Weerdt, M.D.: The 2015 power trading agent competition. ERIM Report Series Reference No. ERS-2015-001-LIS (2015)
5.
go back to reference Ketter, W., Collins, J., Reddy, P.: The 2012 power trading agent competition. ERIM Report Series Research in Management (No. ERS-2012-010-LIS) (2012) Ketter, W., Collins, J., Reddy, P.: The 2012 power trading agent competition. ERIM Report Series Research in Management (No. ERS-2012-010-LIS) (2012)
6.
go back to reference Kuate, R.T., He, M., Chli, M., Wang, H.H.: An intelligent broker agent for energy trading: an MDP approach. In: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), pp. 234–240 (2013) Kuate, R.T., He, M., Chli, M., Wang, H.H.: An intelligent broker agent for energy trading: an MDP approach. In: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), pp. 234–240 (2013)
7.
go back to reference Urieli, D., Stone, P.: TacTex13: a champion adaptive power trading agent. In: Proceedings of the International Conference on Autonomous Agents and Multiagent Systems (AAMAS), pp. 1447–1448 (2014) Urieli, D., Stone, P.: TacTex13: a champion adaptive power trading agent. In: Proceedings of the International Conference on Autonomous Agents and Multiagent Systems (AAMAS), pp. 1447–1448 (2014)
8.
go back to reference Kiekintveld, C., Miller, J., Jordan, P.R., Wellman, M.P.: Controlling a supply chain agent using value-based decomposition. In: Proceedings of the ACM Conference on Electronic Commerce (EC), pp. 208–217 (2006) Kiekintveld, C., Miller, J., Jordan, P.R., Wellman, M.P.: Controlling a supply chain agent using value-based decomposition. In: Proceedings of the ACM Conference on Electronic Commerce (EC), pp. 208–217 (2006)
9.
go back to reference Mausam, Kolobov, A.: Planning with Markov Decision Processes: An AI Perspective. Morgan & Claypool, San Rafael (2012)MATH Mausam, Kolobov, A.: Planning with Markov Decision Processes: An AI Perspective. Morgan & Claypool, San Rafael (2012)MATH
10.
go back to reference Abounadi, D.B., Borkar, V.S.: Learning algorithms for Markov decision processes with average cost. SIAM J. Control Optim. 40(3), 681–698 (2001)MathSciNetCrossRefMATH Abounadi, D.B., Borkar, V.S.: Learning algorithms for Markov decision processes with average cost. SIAM J. Control Optim. 40(3), 681–698 (2001)MathSciNetCrossRefMATH
11.
go back to reference Elomaa, T., Kaariainen, M.: An analysis of reduced error pruning. J. Artif. Intell. Res. 15, 163–187 (2001)MathSciNetMATH Elomaa, T., Kaariainen, M.: An analysis of reduced error pruning. J. Artif. Intell. Res. 15, 163–187 (2001)MathSciNetMATH
13.
go back to reference Robnik-Sikonja, M., Kononenko, I.: An adaptation of relief for attribute estimation in regression. In: Proceedings of the International Conference on Machine Learning (ICML), pp. 296–304 (1997) Robnik-Sikonja, M., Kononenko, I.: An adaptation of relief for attribute estimation in regression. In: Proceedings of the International Conference on Machine Learning (ICML), pp. 296–304 (1997)
14.
go back to reference Lauer, M., Riedmiller, M.A.: An algorithm for distributed reinforcement learning in cooperative multi-agent systems. In: Proceedings of the International Conference on Machine Learning (ICML), pp. 535–542 (2000) Lauer, M., Riedmiller, M.A.: An algorithm for distributed reinforcement learning in cooperative multi-agent systems. In: Proceedings of the International Conference on Machine Learning (ICML), pp. 535–542 (2000)
Metadata
Title
Investigation of Learning Strategies for the SPOT Broker in Power TAC
Authors
Moinul Morshed Porag Chowdhury
Russell Y. Folk
Ferdinando Fioretto
Christopher Kiekintveld
William Yeoh
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-54229-4_7

Premium Partner