Skip to main content
Erschienen in: Formal Methods in System Design 1/2013

01.08.2013

Automatic verification of competitive stochastic systems

verfasst von: Taolue Chen, Vojtěch Forejt, Marta Kwiatkowska, David Parker, Aistis Simaitis

Erschienen in: Formal Methods in System Design | Ausgabe 1/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We present automatic verification techniques for the modelling and analysis of probabilistic systems that incorporate competitive behaviour. These systems are modelled as turn-based stochastic multi-player games, in which the players can either collaborate or compete in order to achieve a particular goal. We define a temporal logic called rPATL for expressing quantitative properties of stochastic multi-player games. This logic allows us to reason about the collective ability of a set of players to achieve a goal relating to the probability of an event’s occurrence or the expected amount of cost/reward accumulated. We give an algorithm for verifying properties expressed in this logic and implement the techniques in a probabilistic model checker, as an extension of the PRISM tool. We demonstrate the applicability and efficiency of our methods by deploying them to analyse and detect potential weaknesses in a variety of large case studies, including algorithms for energy management in Microgrids and collective decision making for autonomous systems.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
Rational values can be handled by re-scaling all rewards by the lowest common multiple of the denominators of rewards appearing in the game. Note that re-scaling does not increase the size of the model, so the stated complexity results are not affected.
 
2
The tool is currently available from: http://​www.​prismmodelchecke​r.​org/​games/​.
 
Literatur
1.
Zurück zum Zitat Aizatulin M, Schnoor H, Wilke T (2009) Computationally sound analysis of a probabilistic contract signing protocol. In: Proc of the 14th European symposium on research in computer security (ESORICS’09). LNCS, vol 5789. Springer, Berlin, pp 571–586 Aizatulin M, Schnoor H, Wilke T (2009) Computationally sound analysis of a probabilistic contract signing protocol. In: Proc of the 14th European symposium on research in computer security (ESORICS’09). LNCS, vol 5789. Springer, Berlin, pp 571–586
3.
Zurück zum Zitat Alur R, Henzinger T, Mang F, Qadeer S, Rajamani S, MOCHA ST (1998) Modularity in model checking. In: Proc of the 10th international conference on computer aided verification (CAV’98), Vancouver. LNCS, vol 1427. Springer, Berlin, pp 521–525 CrossRef Alur R, Henzinger T, Mang F, Qadeer S, Rajamani S, MOCHA ST (1998) Modularity in model checking. In: Proc of the 10th international conference on computer aided verification (CAV’98), Vancouver. LNCS, vol 1427. Springer, Berlin, pp 521–525 CrossRef
4.
Zurück zum Zitat Andova S, Hermanns H, Katoen J-P (2003) Discrete-time rewards model-checked. In: Proc of the formal modeling and analysis of timed systems (FORMATS’03). LNCS, vol 2791. Springer, Berlin, pp 88–104 CrossRef Andova S, Hermanns H, Katoen J-P (2003) Discrete-time rewards model-checked. In: Proc of the formal modeling and analysis of timed systems (FORMATS’03). LNCS, vol 2791. Springer, Berlin, pp 88–104 CrossRef
5.
Zurück zum Zitat Baier C, Brázdil T, Größer M, Kucera A (2007) Stochastic game logic. In: Proc of the 4th international conference on quantitative evaluation of systems (QEST’07). IEEE Press, New York, pp 227–236 CrossRef Baier C, Brázdil T, Größer M, Kucera A (2007) Stochastic game logic. In: Proc of the 4th international conference on quantitative evaluation of systems (QEST’07). IEEE Press, New York, pp 227–236 CrossRef
6.
Zurück zum Zitat Baier C, Katoen J-P (2008) Principles of model checking. MIT Press, Cambridge MATH Baier C, Katoen J-P (2008) Principles of model checking. MIT Press, Cambridge MATH
7.
Zurück zum Zitat Ballarini P, Fisher M, Wooldridge M (2006) Uncertain agent verification through probabilistic model-checking. In: Proc of the 3rd international workshop on safety and security in multi-agent systems (SASEMAS’06) Ballarini P, Fisher M, Wooldridge M (2006) Uncertain agent verification through probabilistic model-checking. In: Proc of the 3rd international workshop on safety and security in multi-agent systems (SASEMAS’06)
8.
Zurück zum Zitat Bianco A, de Alfaro L (1995) Model checking of probabilistic and nondeterministic systems. In: Thiagarajan P (ed) Proc of the 15th conference on foundations of software technology and theoretical computer science (FSTTCS’95). LNCS, vol 1026. Springer, Berlin, pp 499–513 CrossRef Bianco A, de Alfaro L (1995) Model checking of probabilistic and nondeterministic systems. In: Thiagarajan P (ed) Proc of the 15th conference on foundations of software technology and theoretical computer science (FSTTCS’95). LNCS, vol 1026. Springer, Berlin, pp 499–513 CrossRef
9.
Zurück zum Zitat Brihaye T, Markey N, Ghannem M, Rieg L (2008) Good friends are hard to find! In: Demri S, Jensen C (eds) Proc of the 15th international symposium on temporal representation and reasoning (TIME’08). IEEE Press, New York, pp 32–40 Brihaye T, Markey N, Ghannem M, Rieg L (2008) Good friends are hard to find! In: Demri S, Jensen C (eds) Proc of the 15th international symposium on temporal representation and reasoning (TIME’08). IEEE Press, New York, pp 32–40
10.
Zurück zum Zitat Bulling N, Jamroga W (2009) What agents can probably enforce. Fundam Inform 93(1–3):81–96 MathSciNetMATH Bulling N, Jamroga W (2009) What agents can probably enforce. Fundam Inform 93(1–3):81–96 MathSciNetMATH
11.
Zurück zum Zitat Cerný P, Chatterjee K, Henzinger T, Radhakrishna A, Singh R (2011) Quantitative synthesis for concurrent programs. In: Gopalakrishnan G, Qadeer S (eds) Proc of the 23rd international conference on computer aided verification (CAV’11). LNCS, vol 6806. Springer, Berlin, pp 243–259 CrossRef Cerný P, Chatterjee K, Henzinger T, Radhakrishna A, Singh R (2011) Quantitative synthesis for concurrent programs. In: Gopalakrishnan G, Qadeer S (eds) Proc of the 23rd international conference on computer aided verification (CAV’11). LNCS, vol 6806. Springer, Berlin, pp 243–259 CrossRef
12.
Zurück zum Zitat Chatterjee K (2007) Stochastic ω-regular games. PhD thesis, University of California at Berkeley Chatterjee K (2007) Stochastic ω-regular games. PhD thesis, University of California at Berkeley
13.
Zurück zum Zitat Chatterjee K, Henzinger T (2008) Value iteration. In: 25 years of model checking, pp 107–138 CrossRef Chatterjee K, Henzinger T (2008) Value iteration. In: 25 years of model checking, pp 107–138 CrossRef
14.
Zurück zum Zitat Chatterjee K, Henzinger T, Jobstmann B, Gist AR (2010) A solver for probabilistic games. In: Proc of the 22nd international conference on computer aided verification (CAV’10). LNCS. Springer, Berlin, pp 665–669 CrossRef Chatterjee K, Henzinger T, Jobstmann B, Gist AR (2010) A solver for probabilistic games. In: Proc of the 22nd international conference on computer aided verification (CAV’10). LNCS. Springer, Berlin, pp 665–669 CrossRef
15.
Zurück zum Zitat Chatterjee K, Jurdzinski M, Henzinger T (2004) Quantitative stochastic parity games. In: Munro JI (ed) Proc of the 15th annual ACM-SIAM symposium on discrete algorithms (SODA’04). SIAM, Philadelphia, pp 121–130 Chatterjee K, Jurdzinski M, Henzinger T (2004) Quantitative stochastic parity games. In: Munro JI (ed) Proc of the 15th annual ACM-SIAM symposium on discrete algorithms (SODA’04). SIAM, Philadelphia, pp 121–130
16.
Zurück zum Zitat Chen T, Forejt V, Kwiatkowska M, Parker D, Simaitis A (2012) Automatic verification of competitive stochastic systems. In: Flanagan C, König B (eds) Proc of the 18th international conference on tools and algorithms for the construction and analysis of systems (TACAS’12). LNCS, vol 7214. Springer, Berlin, pp 315–330 CrossRef Chen T, Forejt V, Kwiatkowska M, Parker D, Simaitis A (2012) Automatic verification of competitive stochastic systems. In: Flanagan C, König B (eds) Proc of the 18th international conference on tools and algorithms for the construction and analysis of systems (TACAS’12). LNCS, vol 7214. Springer, Berlin, pp 315–330 CrossRef
17.
Zurück zum Zitat Chen T, Kwiatkowska M, Parker D, Simaitis A (2011) Verifying team formation protocols with probabilistic model checking. In: Proc of the 12th international workshop on computational logic in multi-agent systems (CLIMA XII 2011). LNCS, vol 6814. Springer, Berlin, pp 190–297 CrossRef Chen T, Kwiatkowska M, Parker D, Simaitis A (2011) Verifying team formation protocols with probabilistic model checking. In: Proc of the 12th international workshop on computational logic in multi-agent systems (CLIMA XII 2011). LNCS, vol 6814. Springer, Berlin, pp 190–297 CrossRef
18.
Zurück zum Zitat Chen T, Lu J (2007) Probabilistic alternating-time temporal logic and model checking algorithm. In: Proc of the 4th international conference on fuzzy systems and knowledge discovery (FSKD’07). IEEE Press, New York, pp 35–39 CrossRef Chen T, Lu J (2007) Probabilistic alternating-time temporal logic and model checking algorithm. In: Proc of the 4th international conference on fuzzy systems and knowledge discovery (FSKD’07). IEEE Press, New York, pp 35–39 CrossRef
19.
Zurück zum Zitat Condon A (1993) On algorithms for simple stochastic games. In: Advances in computational complexity theory. DIMACS series in discrete mathematics and theoretical computer science, vol 13, pp 51–73 Condon A (1993) On algorithms for simple stochastic games. In: Advances in computational complexity theory. DIMACS series in discrete mathematics and theoretical computer science, vol 13, pp 51–73
21.
Zurück zum Zitat de Alfaro L (1999) Computing minimum and maximum reachability times in probabilistic systems. In: Baeten J, Mauw S (eds) Proc of the 10th international conference on concurrency theory (CONCUR’99). LNCS, vol 1664. Springer, Berlin, pp 66–81 CrossRef de Alfaro L (1999) Computing minimum and maximum reachability times in probabilistic systems. In: Baeten J, Mauw S (eds) Proc of the 10th international conference on concurrency theory (CONCUR’99). LNCS, vol 1664. Springer, Berlin, pp 66–81 CrossRef
22.
Zurück zum Zitat de Alfaro L, Henzinger T (2000) Concurrent omega-regular games. In: Proc of the 15th annual IEEE symposium on logic in computer science. IEEE Comput Soc, Los Alamitos, pp 141–154 de Alfaro L, Henzinger T (2000) Concurrent omega-regular games. In: Proc of the 15th annual IEEE symposium on logic in computer science. IEEE Comput Soc, Los Alamitos, pp 141–154
23.
Zurück zum Zitat Filar J, Vrieze K (1997) Competitive Markov decision processes. Springer, Berlin MATH Filar J, Vrieze K (1997) Competitive Markov decision processes. Springer, Berlin MATH
24.
Zurück zum Zitat Forejt V, Kwiatkowska M, Norman G, Parker D (2011) Automated verification techniques for probabilistic systems. In: Bernardo M, Issarny V (eds) Formal methods for eternal networked software systems (SFM’11). LNCS, vol 6659. Springer, Berlin, pp 53–113 CrossRef Forejt V, Kwiatkowska M, Norman G, Parker D (2011) Automated verification techniques for probabilistic systems. In: Bernardo M, Issarny V (eds) Formal methods for eternal networked software systems (SFM’11). LNCS, vol 6659. Springer, Berlin, pp 53–113 CrossRef
25.
Zurück zum Zitat Hansson H, Jonsson B (1994) A logic for reasoning about time and reliability. Form Asp Comput 6(5):512–535 MATHCrossRef Hansson H, Jonsson B (1994) A logic for reasoning about time and reliability. Form Asp Comput 6(5):512–535 MATHCrossRef
26.
Zurück zum Zitat Hildmann H, Saffre F (2011) Influence of variable supply and load flexibility on demand-side management. In: Proc of the 8th international conference on the European energy market (EEM’11), pp 63–68 Hildmann H, Saffre F (2011) Influence of variable supply and load flexibility on demand-side management. In: Proc of the 8th international conference on the European energy market (EEM’11), pp 63–68
27.
Zurück zum Zitat Kremer S, Raskin J-F (2003) A game-based verification of non-repudiation and fair exchange protocols. J Comput Secur 11(3):399–430 Kremer S, Raskin J-F (2003) A game-based verification of non-repudiation and fair exchange protocols. J Comput Secur 11(3):399–430
28.
Zurück zum Zitat Kwiatkowska M, Norman G, Parker D (2011) PRISM 4.0: verification of probabilistic real-time systems. In: Gopalakrishnan G, Qadeer S (eds) Proc of the 23rd international conference on computer aided verification (CAV’11). LNCS, vol 6806. Springer, Berlin, pp 585–591 CrossRef Kwiatkowska M, Norman G, Parker D (2011) PRISM 4.0: verification of probabilistic real-time systems. In: Gopalakrishnan G, Qadeer S (eds) Proc of the 23rd international conference on computer aided verification (CAV’11). LNCS, vol 6806. Springer, Berlin, pp 585–591 CrossRef
29.
Zurück zum Zitat Laroussinie F, Markey N, Oreiby G (2007) On the expressiveness and complexity of ATL. In: Seidl H (ed) Proc of the 10th international conference on foundations of software science and computational structures (FOSSACS’07). LNCS, vol 4423. Springer, Berlin, pp 243–257 Laroussinie F, Markey N, Oreiby G (2007) On the expressiveness and complexity of ATL. In: Seidl H (ed) Proc of the 10th international conference on foundations of software science and computational structures (FOSSACS’07). LNCS, vol 4423. Springer, Berlin, pp 243–257
30.
Zurück zum Zitat Lomuscio A, Qu H, Raimondi F (2009) MCMAS: a model checker for the verification of multi-agent systems. In: Proc of the 21st international conference on computer aided verification (CAV’09). LNCS, vol 5643. Springer, Berlin, pp 682–688 CrossRef Lomuscio A, Qu H, Raimondi F (2009) MCMAS: a model checker for the verification of multi-agent systems. In: Proc of the 21st international conference on computer aided verification (CAV’09). LNCS, vol 5643. Springer, Berlin, pp 682–688 CrossRef
31.
34.
Zurück zum Zitat Schnoor H (2010) Strategic planning for probabilistic games with incomplete information. In: Proc of the 9th international conference on autonomous agents and multiagent systems (AAMAS’10), pp 1057–1064 Schnoor H (2010) Strategic planning for probabilistic games with incomplete information. In: Proc of the 9th international conference on autonomous agents and multiagent systems (AAMAS’10), pp 1057–1064
35.
Zurück zum Zitat Ummels M (2010) Stochastic multiplayer games: theory and algorithms. PhD thesis, RWTH Aachen University Ummels M (2010) Stochastic multiplayer games: theory and algorithms. PhD thesis, RWTH Aachen University
36.
Zurück zum Zitat van der Hoek W, Wooldridge M (2003) Model checking cooperation, knowledge, and time—a case study. Res Econ 57(3):235–265 CrossRef van der Hoek W, Wooldridge M (2003) Model checking cooperation, knowledge, and time—a case study. Res Econ 57(3):235–265 CrossRef
37.
Zurück zum Zitat Zhang C, Pang J (2010) On probabilistic alternating simulations. In: Calude C, Sassone V (eds) Proc of the 6th IFIP conference on theoretical computer science (TCS’10). IFIP, vol 323. Springer, Berlin, pp 71–85 CrossRef Zhang C, Pang J (2010) On probabilistic alternating simulations. In: Calude C, Sassone V (eds) Proc of the 6th IFIP conference on theoretical computer science (TCS’10). IFIP, vol 323. Springer, Berlin, pp 71–85 CrossRef
38.
Zurück zum Zitat Zhang C, Pang J (2012) An algorithm for probabilistic alternating simulation. In: Bieliková M, Friedrich G, Gottlob G, Katzenbeisser S, Turán G (eds) Proc of the 38th conference on current trends in theory and practice of computer science (SOFSEM’12). LNCS, vol 7147. Springer, Berlin, pp 431–442 Zhang C, Pang J (2012) An algorithm for probabilistic alternating simulation. In: Bieliková M, Friedrich G, Gottlob G, Katzenbeisser S, Turán G (eds) Proc of the 38th conference on current trends in theory and practice of computer science (SOFSEM’12). LNCS, vol 7147. Springer, Berlin, pp 431–442
Metadaten
Titel
Automatic verification of competitive stochastic systems
verfasst von
Taolue Chen
Vojtěch Forejt
Marta Kwiatkowska
David Parker
Aistis Simaitis
Publikationsdatum
01.08.2013
Verlag
Springer US
Erschienen in
Formal Methods in System Design / Ausgabe 1/2013
Print ISSN: 0925-9856
Elektronische ISSN: 1572-8102
DOI
https://doi.org/10.1007/s10703-013-0183-7