Skip to main content

2020 | OriginalPaper | Buchkapitel

Probabilistic Timed Automata with One Clock and Initialised Clock-Dependent Probabilities

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Clock-dependent probabilistic timed automata extend classical timed automata with discrete probabilistic choice, where the probabilities are allowed to depend on the exact values of the clocks. Previous work has shown that the quantitative reachability problem for clock-dependent probabilistic timed automata with at least three clocks is undecidable. In this paper, we consider the subclass of clock-dependent probabilistic timed automata that have one clock, that have clock dependencies described by affine functions, and that satisfy an initialisation condition requiring that, at some point between taking edges with non-trivial clock dependencies, the clock must have an integer value. We present an approach for solving in polynomial time quantitative and qualitative reachability problems of such one-clock initialised clock-dependent probabilistic timed automata. Our results are obtained by a transformation to interval Markov decision processes.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
From [18, Lemma 4.10], without loss of generality we can assume henceforth that schedulers map to distributions assigning positive probability to finite sets of actions, i.e., schedulers \(\sigma \) for which \(|\mathsf {support}(\sigma (r))|\) is finite for all \(r\in Paths ^{\mathcal {M}}_*\).
 
2
Given that there is only one action available from states such as \(((1,3),p_\mathrm {W},\mathsf {lb})\) and \(((1,3),p_\mathrm {W},\mathsf {rb})\), we omit both the action and the usual black box from the figure.
 
3
Note that \(\mathfrak {A}_{\mathfrak {M}[{\mathcal {P}}]}({l,B}) \ne \emptyset \) for each \((l,B) \in S_{\mathfrak {M}[{\mathcal {P}}]}^\mathsf {reg}\), by the assumptions that we made on 1c-cdPTA in Sect. 3 (namely, that it is always possible to take a probabilistic edge, either immediately or after letting time elapse).
 
4
We recall that \(\mathfrak {D}_{\mathfrak {M}[{\mathcal {P}}]}(s,\mathfrak {a}) = \bot \) for \(s\in S_{\mathfrak {M}[{\mathcal {P}}]}\) and \(\mathfrak {a}\in \mathfrak {A}_{\mathfrak {M}[{\mathcal {P}}]} \setminus \mathfrak {A}_{\mathfrak {M}[{\mathcal {P}}]}({s})\).
 
Literatur
1.
Zurück zum Zitat Akshay, S., Bouyer, P., Krishna, S.N., Manasa, L., Trivedi, A.: Stochastic timed games revisited. In: Faliszewski, P., Muscholl, A., Niedermeier, R., (eds.) Proceedings of MFCS 2016 LIPIcs, vol. 58, pp. 8:1–8:14. Leibniz-Zentrum für Informatik (2016) Akshay, S., Bouyer, P., Krishna, S.N., Manasa, L., Trivedi, A.: Stochastic timed games revisited. In: Faliszewski, P., Muscholl, A., Niedermeier, R., (eds.) Proceedings of MFCS 2016 LIPIcs, vol. 58, pp. 8:1–8:14. Leibniz-Zentrum für Informatik (2016)
3.
Zurück zum Zitat Baier, C., Katoen, J.-P.: Principles of Model Checking. MIT Press, Cambridge (2008)MATH Baier, C., Katoen, J.-P.: Principles of Model Checking. MIT Press, Cambridge (2008)MATH
4.
Zurück zum Zitat Bertrand, N., Bordais, B., Hélouët, L., Mari, T., Parreaux, J., Sankur, O.: Performance evaluation of metro regulations using probabilistic model-checking. In: Collart-Dutilleul, S., Lecomte, T., Romanovsky, A. (eds.) RSSRail 2019. LNCS, vol. 11495, pp. 59–76. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-18744-6_4CrossRef Bertrand, N., Bordais, B., Hélouët, L., Mari, T., Parreaux, J., Sankur, O.: Performance evaluation of metro regulations using probabilistic model-checking. In: Collart-Dutilleul, S., Lecomte, T., Romanovsky, A. (eds.) RSSRail 2019. LNCS, vol. 11495, pp. 59–76. Springer, Cham (2019). https://​doi.​org/​10.​1007/​978-3-030-18744-6_​4CrossRef
8.
Zurück zum Zitat Bouyer, P., Larsen, K.G., Markey, N.: Model checking one-clock priced timed automata. Log. Methods Comput. Sci. 4(2), 1–28 (2008)MathSciNetCrossRef Bouyer, P., Larsen, K.G., Markey, N.: Model checking one-clock priced timed automata. Log. Methods Comput. Sci. 4(2), 1–28 (2008)MathSciNetCrossRef
11.
Zurück zum Zitat Chen, T., Han, T., Kwiatkowska, M.: On the complexity of model checking interval-valued discrete time Markov chains. Inf. Process. Lett. 113(7), 210–216 (2013)MathSciNetCrossRef Chen, T., Han, T., Kwiatkowska, M.: On the complexity of model checking interval-valued discrete time Markov chains. Inf. Process. Lett. 113(7), 210–216 (2013)MathSciNetCrossRef
12.
Zurück zum Zitat Clarke, E.M., Grumberg, O., Peled, D.A.: Model Checking. MIT Press, Cambridge (2001)CrossRef Clarke, E.M., Grumberg, O., Peled, D.A.: Model Checking. MIT Press, Cambridge (2001)CrossRef
13.
Zurück zum Zitat Feng, L., Wiltsche, C., Humphrey, L.R., Topcu, U.: Synthesis of human-in-the-loop control protocols for autonomous systems. IEEE Trans. Autom. Sci. Eng. 13(2), 450–462 (2016)CrossRef Feng, L., Wiltsche, C., Humphrey, L.R., Topcu, U.: Synthesis of human-in-the-loop control protocols for autonomous systems. IEEE Trans. Autom. Sci. Eng. 13(2), 450–462 (2016)CrossRef
15.
Zurück zum Zitat Givan, R., Leach, S.M., Dean, T.L.: Bounded-parameter Markov decision processes. Artif. Intell. 122(1–2), 71–109 (2000)MathSciNetCrossRef Givan, R., Leach, S.M., Dean, T.L.: Bounded-parameter Markov decision processes. Artif. Intell. 122(1–2), 71–109 (2000)MathSciNetCrossRef
16.
Zurück zum Zitat Gregersen, H., Jensen, H.E.: Formal design of reliable real time systems. Master’s thesis, Department of Mathematics and Computer Science, Aalborg University (1995) Gregersen, H., Jensen, H.E.: Formal design of reliable real time systems. Master’s thesis, Department of Mathematics and Computer Science, Aalborg University (1995)
17.
Zurück zum Zitat Haddad, S., Monmege, B.: Interval iteration algorithm for MDPs and IMDPs. Theor. Comput. Sci. 735, 111–131 (2018)MathSciNetCrossRef Haddad, S., Monmege, B.: Interval iteration algorithm for MDPs and IMDPs. Theor. Comput. Sci. 735, 111–131 (2018)MathSciNetCrossRef
18.
Zurück zum Zitat Hahn, E.M.: Model checking stochastic hybrid systems. Ph.D., thesis, Universität des Saarlandes (2013) Hahn, E.M.: Model checking stochastic hybrid systems. Ph.D., thesis, Universität des Saarlandes (2013)
20.
Zurück zum Zitat Hashemi, V., Hatefi, H., Krcál, J.: Probabilistic bisimulations for PCTL model checking of interval MDPs. In: André, É., Frehse, G., (eds.) Proceedings of SynCoP 2014 EPTCS, vol. 145, pp. 19–33 (2014) Hashemi, V., Hatefi, H., Krcál, J.: Probabilistic bisimulations for PCTL model checking of interval MDPs. In: André, É., Frehse, G., (eds.) Proceedings of SynCoP 2014 EPTCS, vol. 145, pp. 19–33 (2014)
21.
Zurück zum Zitat Henzinger, T.A., Kopke, P.W., Puri, A., Varaiya, P.: What’s decidable about hybrid automata? J. Comput. Syst. Sci. 57(1), 94–124 (1998)MathSciNetCrossRef Henzinger, T.A., Kopke, P.W., Puri, A., Varaiya, P.: What’s decidable about hybrid automata? J. Comput. Syst. Sci. 57(1), 94–124 (1998)MathSciNetCrossRef
22.
Zurück zum Zitat Jonsson, B., Larsen, K.G.: Specification and refinement of probabilistic processes. In: Proceedings of LICS 1991, pp. 266–277. IEEE Computer Society (1991) Jonsson, B., Larsen, K.G.: Specification and refinement of probabilistic processes. In: Proceedings of LICS 1991, pp. 266–277. IEEE Computer Society (1991)
23.
Zurück zum Zitat Jurdziński, M., Laroussinie, F., Sproston, J.: Model checking probabilistic timed automata with one or two clocks. Log. Methods Comput. Sci. 4(3), 1–28 (2008)MathSciNetCrossRef Jurdziński, M., Laroussinie, F., Sproston, J.: Model checking probabilistic timed automata with one or two clocks. Log. Methods Comput. Sci. 4(3), 1–28 (2008)MathSciNetCrossRef
24.
25.
Zurück zum Zitat Kwiatkowska, M., Norman, G., Segala, R., Sproston, J.: Automatic verification of real-time systems with discrete probability distributions. Theor. Comput. Sci. 286, 101–150 (2002)MathSciNetCrossRef Kwiatkowska, M., Norman, G., Segala, R., Sproston, J.: Automatic verification of real-time systems with discrete probability distributions. Theor. Comput. Sci. 286, 101–150 (2002)MathSciNetCrossRef
27.
Zurück zum Zitat Nilim, A., El Ghaoui, L.: Robust control of Markov decision processes with uncertain transition matrices. Oper. Res. 53(5), 780–798 (2005)MathSciNetCrossRef Nilim, A., El Ghaoui, L.: Robust control of Markov decision processes with uncertain transition matrices. Oper. Res. 53(5), 780–798 (2005)MathSciNetCrossRef
28.
Zurück zum Zitat Norman, G., Parker, D., Sproston, J.: Model checking for probabilistic timed automata. Form. Methods Syst. Des. 43(2), 164–190 (2013)CrossRef Norman, G., Parker, D., Sproston, J.: Model checking for probabilistic timed automata. Form. Methods Syst. Des. 43(2), 164–190 (2013)CrossRef
29.
Zurück zum Zitat Papadimitriou, C.H., Tsitsiklis, J.N.: The complexity of Markov decision processes. Math. Oper. Res. 12(3), 441–450 (1987)MathSciNetCrossRef Papadimitriou, C.H., Tsitsiklis, J.N.: The complexity of Markov decision processes. Math. Oper. Res. 12(3), 441–450 (1987)MathSciNetCrossRef
34.
Zurück zum Zitat Sproston, J.: Probabilistic timed automata with one clock and initialised clock-dependent probabilities. CoRR (2020) Sproston, J.: Probabilistic timed automata with one clock and initialised clock-dependent probabilities. CoRR (2020)
35.
Zurück zum Zitat Winkler, T., Junges, S., Pérez, G.A., Katoen, J.: On the complexity of reachability in parametric Markov decision processes. In: Fokkink, W., van Glabbeek, R. (eds.) Proceedings of CONCUR 2019 LIPIcs, vol. 140, pp. 14:1–14:17. Leibniz-Zentrum für Informatik (2019) Winkler, T., Junges, S., Pérez, G.A., Katoen, J.: On the complexity of reachability in parametric Markov decision processes. In: Fokkink, W., van Glabbeek, R. (eds.) Proceedings of CONCUR 2019 LIPIcs, vol. 140, pp. 14:1–14:17. Leibniz-Zentrum für Informatik (2019)
36.
Zurück zum Zitat Wu, D., Koutsoukos, X.D.: Reachability analysis of uncertain systems using bounded-parameter Markov decision processes. Artif. Intell. 172(8–9), 945–954 (2008)MathSciNetCrossRef Wu, D., Koutsoukos, X.D.: Reachability analysis of uncertain systems using bounded-parameter Markov decision processes. Artif. Intell. 172(8–9), 945–954 (2008)MathSciNetCrossRef
Metadaten
Titel
Probabilistic Timed Automata with One Clock and Initialised Clock-Dependent Probabilities
verfasst von
Jeremy Sproston
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-50086-3_9