Irina Botan
Laura Haas
Nesime Tatbul
Abstract
There are many academic and commercial stream processing engines (SPEs) today, each of them with its own execution semantics. This variation may lead to seemingly inexplicable differences in query results. In this paper, we present SECRET, a model of the behavior of SPEs. SECRET is a descriptive model that allows users to analyze the behavior of systems and understand the results of window-based queries for a broad range of heterogeneous SPEs. The model is the result of extensive analysis and experimentation with several commercial and academic engines. In the paper, we describe the types of heterogeneity found in existing engines, and show with experiments on real systems that our model can explain the key differences in windowing behavior.
- Coral8, Inc. http://www.coral8.com/.Google Scholar
- IBM System S. http://www.ibm.com/.Google Scholar
- Microsoft SQL Server StreamInsight Technology. http://www.microsoft.com/sqlserver/2008/en/us/R2-complex-event.aspx.Google Scholar
- Oracle CEP. http://www.oracle.com/technologies/soa/complex-event-processing.html.Google Scholar
- Stanford Stream Data Manager. http://infolab.stanford.edu/stream/.Google Scholar
- StreamBase Systems, Inc. http://www.streambase.com/.Google Scholar
- Truviso, Inc. http://www.truviso.com/.Google Scholar
- D. Abadi and et al. Aurora: A New Model and Architecture for Data Stream Management. VLDB Journal, 12(2), 2003. Google ScholarDigital Library
- A. Arasu and et al. The CQL Continuous Query Language: Semantic Foundations and Query Execution. VLDB Journal, 15(2), 2006. Google ScholarDigital Library
- I. Botan and et al. Design and Implementation of the MaxStream Federated Stream Processing Architecture. Technical Report TR-632, ETH Zurich Department of Computer Science, June 2009.Google Scholar
- S. Chandrasekaran and et al. TelegraphCQ: Continuous Dataflow Processing for an Uncertain World. In CIDR Conference, 2003.Google Scholar
- B. Gedik and et al. SPADE: The System S Declarative Stream Processing Engine. In ACM SIGMOD Conference, 2008. Google ScholarDigital Library
- N. Jain and et al. Towards a Streaming SQL Standard. In VLDB Conference, 2008. Google ScholarDigital Library
- J. Kramer and B. Seeger. Semantics and Implementation of Continuous Sliding Window Queries over Data Streams. ACM TODS, 34(1), 2009. Google ScholarDigital Library
- L. Li and et al. Semantics and Evaluation Techniques for Window Aggregates in Data Streams. In ACM SIGMOD Conference, 2005. Google ScholarDigital Library
- D. Maier and et al. Semantics of Data Streams and Operators. In ICDT Conference, 2005. Google ScholarDigital Library
- R. Motwani and et al. Query Processing, Approximation, and Resource Management in a Data Stream Management System. In CIDR Conference, 2003.Google Scholar
- K. Patroumpas and T. Sellis. Window Specification over Data Streams. In EDBT Workshops, 2006. Google ScholarDigital Library
- U. Srivastava and J. Widom. Flexible Time Management in Data Stream Systems. In ACM PODS Conference, 2004. Google ScholarDigital Library
- M. Tsimelzon. On Streaming SQL Standards. http://www.coral8.com/blogs/blog-entry/streaming-sql-standards, September 2008.Google Scholar
Index Terms
- SECRET: a model for analysis of the execution semantics of stream processing systems
Recommendations
Modeling the execution semantics of stream processing engines with SECRET
There are many academic and commercial stream processing engines (SPEs) today, each of them with its own execution semantics. This variation may lead to seemingly inexplicable differences in query results. In this paper, we present SECRET, a model of ...
Comments