skip to main content
article

No pane, no gain: efficient evaluation of sliding-window aggregates over data streams

Published:01 March 2005Publication History
Skip Abstract Section

Abstract

Windows queries are proving essential to data-stream processing. In this paper, we present an approach for evaluating sliding-window aggregate queries that reduces both space and computation time for query execution. Our approach divides overlapping windows into disjoint panes, computes sub-aggregates over each pane, and "rolls up" the pane-aggregates to computer window-aggregates. Our experimental study shows that using panes has significant performance benefits.

References

  1. A. Arasu, S. Babu, and J. Widom. The CQL Continuous Query Language: Semantic Foundations and Query Execution. Stanford University Technical Report, October 2003.Google ScholarGoogle Scholar
  2. A. Arasu, J. Widom. Resource Sharing in Continuous Sliding-Window Aggregates. In Proceedings of the 30th International Conference on Very Large Databases (VLDB 2004). Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. B. Babcock et al. Models and Issues in Data Stream Systems. In Proc. of the 2002 ACM Symp. on Principles of Database Systems (PODS 2002). Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. D. Carney et al. Monitoring Streams - A New Class of Data Management Applications. In Proceedings of the 28th International Conference on Very Large Databases (VLDB 2002). Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. G. Cormode el al. Holistic UDAFs at streaming speeds. In Proceedings of the 2004 ACM SIGMOD International Conference on the Management of Data (SIGMOD 2004). Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. C. Cranor, T. Johnson, O. Spatashek. Gigascope: A Stream Database for Network Applications. In Proceedings of the 2003 ACM SIGMOD International Conference on the Management of Data (SIGMOD 2003). Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. S. Chandrasekaran et al. TelegraphCQ: Continuous Dataflow Processing for an Uncertain World. In Proceedings of the 2003 Conference on Innovative Data Systems Research.Google ScholarGoogle Scholar
  8. J. Gray et al. Data Cube: A Relational Aggregation Operator generalizing Group-by, Cross-Tab, and Sub Totals. Data Mining and Knowledge Discovery 1(1), 1997, 29--53. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. J. Li et al. Evaluating window aggregate queries over streams. Technical Report, May 2004, OGI/OHSU. http://www.cse.ogi.edu/~jinli/papers/WinAggrQ.pdfGoogle ScholarGoogle Scholar
  10. J. Naughton et al. The Niagara Internet Query System. IEEE Data Engineering Bulletin, 24(2), 27--33, (June 2001).Google ScholarGoogle Scholar
  11. U. Srivastava, J. Widom. Flexible Time Management in Data Stream Systems. Technical Report 2003-40, Stanford University, Stanford, CA (July 2003).Google ScholarGoogle Scholar
  12. The STREAM Group. STREAM: The Stanford STREAM Data Manager. IEEE Data Engineering Bulletin, 26(1), (March 2003).Google ScholarGoogle Scholar
  13. XMark Benchmark. http://www.xml-benchmark.org.Google ScholarGoogle Scholar

Index Terms

  1. No pane, no gain: efficient evaluation of sliding-window aggregates over data streams

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM SIGMOD Record
        ACM SIGMOD Record  Volume 34, Issue 1
        March 2005
        86 pages
        ISSN:0163-5808
        DOI:10.1145/1058150
        Issue’s Table of Contents

        Copyright © 2005 Authors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 1 March 2005

        Check for updates

        Qualifiers

        • article

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader