Marcelo R.N. Mendes
ABSTRACT
There has been an increasing interest both in academia and industry for systematic methods for evaluating the performance and scalability of event processing systems. A number of performance results have been disclosed over the last years, but there is still a lack of standardized benchmarks that allow an objective comparison of the different systems. In this paper, we present our work in progress: the BiCEP benchmark suite, a set of workloads, datasets and tools for evaluating different performance aspects of event processing platforms. In particular, we introduce 'Pairs', the first of the BiCEP benchmarks, aimed at assessing the ability of CEP engines in processing progressively larger volumes of events and simultaneous queries while providing quick answers.
- Aldridge, Irene, High-frequency trading: a practical guide to algorithmic strategies and trading. Wiley trading series. ISBN 978-0-470-56376-2.Google Scholar
- BiCEP project web site: http://bicep.dei.uc.ptGoogle Scholar
- Dekkers, P. Master Thesis Computer Science. Complex Event Processing. Radboud University Nijmegen, Thesis number 574, October 2007.Google Scholar
- FINCoS Framework: https://code.google.com/p/fincos/Google Scholar
- Hinze, A., Sachs, K., Buchmann, A.P. Event-based applications and enabling technologies. In Proceedings of DEBS 2009. Google ScholarDigital Library
- Mendes, M.R.N., Bizarro, P., Marques, P. 2009. A Performance Study of Event Processing Systems. In Proceedings of the 1st TPC Technology Conference (Lyon, France, August 2009), 221--236. Google ScholarDigital Library
- SPECjsm2007 benchmark: http://www.spec.org/jms2007/Google Scholar
- STAC Report: Aleri Order Book Consolidation on Intel Tigertown and Solaris 10. Available at: http://www.stacresearch.com/node/3844Google Scholar
- White, S., Alves, A., Rorke, D. 2008. WebLogic event server: a lightweight, modular application server for event processing. In Proceedings of DEBS 2008, 193--200. Google ScholarDigital Library
Index Terms
- Towards a standard event processing benchmark
Recommendations
SPEC MPI2007—an application benchmark suite for parallel systems using MPI
International Supercomputing Conference (ISC07)The SPEC High-Performance Group has developed the benchmark suite SPEC MPI2007 and its run rules over the last few years. The purpose of the SPEC MPI2007 benchmark and its run rules is to further the cause of fair and objective benchmarking of high-...
A scalable complex event processing system and evaluations of its performance
DEBS '12: Proceedings of the 6th ACM International Conference on Distributed Event-Based SystemsThis paper describes a scalable context delivery platform (SCTXPF) and our evaluations of it. The SCTXPF receives a large number of events from various event sources and a large number of complex event processing (CEP) rules from various services/...
A complex event processing for large-scale M2M services and its performance evaluations
DEBS '15: Proceedings of the 9th ACM International Conference on Distributed Event-Based SystemsThis paper describes a scalable complex event processing (CEP) system and rule allocation algorithm for large-scale M2M services and presents the results of its performance evaluations. Platforms providing M2M services deal with various data from ...
Comments