skip to main content
research-article

Faster visual analytics through pixel-perfect aggregation

Published:01 August 2014Publication History
Skip Abstract Section

Abstract

State-of-the-art visual data analysis tools ignore bandwidth limitations. They fetch millions of records of high-volume time series data from an underlying RDBMS to eventually draw only a few thousand pixels on the screen.

In this work, we demonstrate a pixel-aware big data visualization system that dynamically adapts the number of data points transmitted and thus the data rate, while preserving pixel-perfect visualizations. We show how to carefully select the data points to fetch for each pixel of a visualization, using a visualization-driven data aggregation that models the visualization process. Defining all required data reduction operators at the query level, our system trades off a few milliseconds of query execution time for dozens of seconds of data transfer time. The results are significantly reduced response times and a near real-time visualization of millions of data points.

Using our pixel-aware system, the audience will be able to enjoy the speed and ease of big data visualizations and learn about the scientific background of our system through an interactive evaluation component, allowing the visitor to measure, visualize, and compare competing visualization-related data reduction techniques.

References

  1. G. Burtini, S. Fazackerley, and R. Lawrence. Time series compression for adaptive chart generation. In CCECE, pages 1--6. IEEE, 2013.Google ScholarGoogle Scholar
  2. S. G. Eick and A. F. Karr. Visual scalability. Journal of Computational and Graphical Statistics, 11(1):22--43, 2002.Google ScholarGoogle ScholarCross RefCross Ref
  3. T. Fu. A review on time series data mining. EAAI Journal, 24(1):164--181, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. J. Heer and B. Shneiderman. Interactive dynamics for visual analysis. ACM Queue, 10(2):30, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. J. Hershberger and J. Snoeyink. Speeding up the Douglas-Peucker line-simplification algorithm. University of British Columbia, Department of Computer Science, 1992.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Z. Jerzak, T. Heinze, M. Fehr, D. Gröber, R. Hartung, and N. Stojanovic. The DEBS 2012 Grand Challenge. In DEBS, pages 393--398. ACM, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. U. Jugel, Z. Jerzak, G. Hackenbroich, and V. Markl. M4: A visualization-oriented time series data aggregation. In VLDB. VLDB Endowment, 2014. (submitted, review pending). Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. C. Mutschler, H. Ziekow, and Z. Jerzak. The DEBS 2013 Grand Challenge. In DEBS, pages 289--294. ACM, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. W. Shi and C. Cheung. Performance evaluation of line simplification algorithms for vector generalization. The Cartographic Journal, 43(1):27--44, 2006.Google ScholarGoogle ScholarCross RefCross Ref
  10. B. Shneiderman. Extreme visualization: squeezing a billion records into a million pixels. In SIGMOD, pages 3--12. ACM, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. M. Visvalingam and J. Whyatt. Line generalisation by repeated elimination of points. The Cartographic Journal, 30(1):46--51, 1993.Google ScholarGoogle ScholarCross RefCross Ref
  12. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli. Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4):600--612, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in

Full Access

  • Published in

    cover image Proceedings of the VLDB Endowment
    Proceedings of the VLDB Endowment  Volume 7, Issue 13
    August 2014
    466 pages
    ISSN:2150-8097
    Issue’s Table of Contents

    Publisher

    VLDB Endowment

    Publication History

    • Published: 1 August 2014
    Published in pvldb Volume 7, Issue 13

    Qualifiers

    • research-article

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader