Skip to main content
SpringerLink
Log in

Third International Competition on Runtime Verification

CRV 2016

  • Conference paper
  • First Online:
Runtime Verification (RV 2016)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 10012))

Included in the following conference series:

Abstract

We report on the Third International Competition on Runtime Verification (CRV-2016). The competition was held as a satellite event of the 16th International Conference on Runtime Verification (RV’16). The competition consisted of two tracks: offline monitoring of traces and online monitoring of Java programs. The intention was to also include a track on online monitoring of C programs but there were too few participants to proceed with this track. This report describes the format of the competition, the participating teams, the submitted benchmarks and the results. We also describe our experiences with transforming trace formats from other tools into the standard format required by the competition and report on feedback gathered from current and past participants and use this to make suggestions for the future of the competition.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://crv.liflab.ca/CRV2016.pdf.

  2. 2.

    http://crv.liflab.ca/wiki.

  3. 3.

    http://chroniclerecognitionlibrary.github.io/crl/o.html.

  4. 4.

    https://liflab.github.io/beepbeep-3.

  5. 5.

    http://www.cs.um.edu.mt/svrg/Tools/LARVA/.

  6. 6.

    https://github.com/selig/qea.

  7. 7.

    http://www.isp.uni-luebeck.de/mufin.

  8. 8.

    https://bitbucket.org/sylvainhalle/pingu-generator.

References

  1. Barringer, H., Falcone, Y., Havelund, K., Reger, G., Rydeheard, D.: Quantified event automata: towards expressive and efficient runtime monitors. In: Giannakopoulou, D., Méry, D. (eds.) FM 2012. LNCS, vol. 7436, pp. 68–84. Springer, Heidelberg (2012). doi:10.1007/978-3-642-32759-9_9

    Chapter  Google Scholar 

  2. Bartocci, E., Bonakdarpour, B., Falcone, Y.: First international competition on software for runtime verification. In: Bonakdarpour, B., Smolka, S.A. (eds.) RV 2014. LNCS, vol. 8734, pp. 1–9. Springer, Heidelberg (2014). doi:10.1007/978-3-319-11164-3_1

    Google Scholar 

  3. Bartocci, E., Bonakdarpour, B., Falcone, Y., Colombo, C., Decker, N., Klaedtke, F., Havelund, K., Joshi, Y., Milewicz, R., Reger, G., Rosu, G., Signoles, J., Thoma, D., Zalinescu, E., Zhang, Y.: First international competition on runtime verification. Int. J. Softw. Tools Technol. Trans. (STTT) (submitted)

    Google Scholar 

  4. Colombo, C., Pace, G.J., Schneider, G.: Dynamic event-based runtime monitoring of real-time and contextual properties. In: Cofer, D., Fantechi, A. (eds.) FMICS 2008. LNCS, vol. 5596, pp. 135–149. Springer, Heidelberg (2009). doi:10.1007/978-3-642-03240-0_13

    Chapter  Google Scholar 

  5. Colombo, C., Pace, G.J., Schneider, G.: LARVA - safer monitoring of real-time Java programs (tool paper). In: Proceedings of the 2009 Seventh IEEE International Conference on Software Engineering and Formal Methods, SEFM 2009, pp. 33–37, 2009. IEEE Computer Society, Washington (2009)

    Google Scholar 

  6. Decker, N., Harder, J., Scheffel, T., Schmitz, M., Thoma, D.: Runtime monitoring with union-find structures. In: Chechik, M., Raskin, J.-F. (eds.) TACAS 2016. LNCS, vol. 9636, pp. 868–884. Springer, Heidelberg (2016). doi:10.1007/978-3-662-49674-9_54

    Chapter  Google Scholar 

  7. Delahaye, M., Kosmatov, N., Signoles, J.: Common specification language for static, dynamic analysis of cprograms. In: Proceedings of SAC 2013: The 28th Annual ACM Symposium on Applied Computing, pp. 1230–1235. ACM (2013)

    Google Scholar 

  8. Falcone, Y., Havelund, K., Reger, G.: A tutorial on runtimeverification. In: Broy, M., Peled, D. (eds.) SummerSchool Marktoberdorf 2012 - Engineering Dependable Software Systems. IOS Press (2013) (to appear)

    Google Scholar 

  9. Falcone, Y., Ničković, D., Reger, G., Thoma, D.: Second international competition on runtime verification. In: Bartocci, E., Majumdar, R. (eds.) Runtime Verification. LNCS, vol. 9333, pp. 405–422. Springer, Cham (2015)

    Chapter  Google Scholar 

  10. Hallé, S.: When RV meets CEP. In: Falcone, Y., Sanchez, C. (eds.) RV 2016. LNCS, vol. 10012, pp. 68–91. Springer, Heidelberg (2016)

    Google Scholar 

  11. Havelund, K., Reger, G.: Specification of parametric monitors. In: Drechsler, R., Kühne, U. (eds.) Formal Modeling, Verification of Cyber-Physical Systems, pp. 151–189. Springer, Heidelberg (2015)

    Chapter  Google Scholar 

  12. Havelund, K., Reger, G.: What is a trace? a run time verification perspective. In: 7th International Symposium on Leveraging Applications of Formal Methods, Verification and Validation (ISoLA 2016) (accepted)

    Google Scholar 

  13. Leucker, M., Schallhart, C.: A brief account of run time verification. J. Logic Algebr. Programm. 78(5), 293–303 (2008)

    Article  MATH  Google Scholar 

  14. Piel, A.: Reconnaissance de comportements complexes partraitement en ligne de flux d’événements. (Online event flowprocessing for complex behaviour recognition). Ph.D. thesis, Paris 13 University, Villetaneuse, Saint-Denis, Bobigny, France (2014)

    Google Scholar 

  15. Reger, G.: Automata based monitoring and mining of execution traces. Ph.D. thesis, University of Manchester (2014)

    Google Scholar 

  16. Reger, G., Cruz, H.C., Rydeheard, D.: MarQ: monitoring at runtime with QEA. In: Baier, C., Tinelli, C. (eds.) TACAS 2015. LNCS, vol. 9035, pp. 596–610. Springer, Heidelberg (2015). doi:10.1007/978-3-662-46681-0_55

    Google Scholar 

  17. Reger, G., Rydeheard, D.: From first-order temporal logic to parametric trace slicing. In: Bartocci, E., Majumdar, R. (eds.) RV 2015. LNCS, vol. 9333, pp. 216–232. Springer, Heidelberg (2015). doi:10.1007/978-3-319-23820-3_14

    Chapter  Google Scholar 

  18. Varvaressos, S., Lavoie, K., Massé, A.B., Gaboury, S.,Hallé, S.: Automated bug finding in video games: a case study for runtime monitoring. In: Proceedings of the 2014 IEEE International Conference on Software Testing, Verification, and Validation, ICST 2014, pp. 143–152. IEEE Computer Society, Washington (2014)

    Google Scholar 

Download references

Acknowledgment

Thanks to Klaus Havelund, Julien Signoles, Torben Scheffel, Domenico Bianculli, Daniel Thoma and Felix Klaedtke for providing the feedback discussed in Sect. 7. The Laboratoire d’informatique formelle from Université du Québec à Chicoutimi lent the server for hosting the wiki and running the benchmarks. This article is based upon work from COST Action ARVI IC1402, supported by COST (European Cooperation in Science and Technology).

Author information

Authors and Affiliations

  1. University of Manchester, Manchester, UK

    Giles Reger

  2. Université du Québec à Chicoutimi, Saguenay, Canada

    Sylvain Hallé

  3. Univ. Grenoble Alpes, Inria, LIG, 38000, Grenoble, France

    Yliès Falcone

Authors
  1. Giles Reger
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sylvain Hallé
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yliès Falcone
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Giles Reger .

Editor information

Editors and Affiliations

  1. Université Grenoble Alpes, Inria, Grenoble, France

    Yliès Falcone

  2. IMDEA Software Institute, Madrid, Spain

    César Sánchez

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Reger, G., Hallé, S., Falcone, Y. (2016). Third International Competition on Runtime Verification. In: Falcone, Y., Sánchez, C. (eds) Runtime Verification. RV 2016. Lecture Notes in Computer Science(), vol 10012. Springer, Cham. https://doi.org/10.1007/978-3-319-46982-9_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-46982-9_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-46981-2

  • Online ISBN: 978-3-319-46982-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation