Skip to main content
Top

2017 | OriginalPaper | Chapter

Sparse Prefix Sums

Authors : Michael Shekelyan, Anton Dignös, Johann Gamper

Published in: Advances in Databases and Information Systems

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The prefix sum approach is a powerful technique to answer range-sum queries over multi-dimensional arrays in constant time by requiring only a few look-ups in an array of precomputed prefix sums. In this paper, we propose the sparse prefix sum approach that is based on relative prefix sums and exploits sparsity in the data to vastly reduce the storage costs for the prefix sums. The proposed approach has desirable theoretical properties and works well in practice. It is the first approach achieving constant query time with sub-linear update costs and storage costs for range-sum queries over sparse low-dimensional arrays. Experiments on real-world data sets show that the approach reduces storage costs by an order of magnitude with only a small overhead in query time, thus preserving microsecond-fast query answering.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
www.openstreetmap.org.
 
Literature
1.
3.
4.
go back to reference Chan, C.Y., Ioannidis, Y.E.: Hierarchical prefix cubes for range-sum queries. In: VLDB, pp. 675–686 (1999) Chan, C.Y., Ioannidis, Y.E.: Hierarchical prefix cubes for range-sum queries. In: VLDB, pp. 675–686 (1999)
6.
go back to reference Chazelle, B.: A functional approach to data structures and its use in multidimensional searching. SIAM J. Comput. 17(3), 427–462 (1988)MathSciNetCrossRefMATH Chazelle, B.: A functional approach to data structures and its use in multidimensional searching. SIAM J. Comput. 17(3), 427–462 (1988)MathSciNetCrossRefMATH
7.
go back to reference Chun, S., Chung, C., Lee, S.: Space-efficient cubes for OLAP range-sum queries. Decis. Support Syst. 37(1), 83–102 (2004)CrossRef Chun, S., Chung, C., Lee, S.: Space-efficient cubes for OLAP range-sum queries. Decis. Support Syst. 37(1), 83–102 (2004)CrossRef
9.
go back to reference Geffner, S., Agrawal, D., Abbadi, A.: The dynamic data cube. In: Zaniolo, C., Lockemann, P.C., Scholl, M.H., Grust, T. (eds.) EDBT 2000. LNCS, vol. 1777, pp. 237–253. Springer, Heidelberg (2000). doi:10.1007/3-540-46439-5_17 CrossRef Geffner, S., Agrawal, D., Abbadi, A.: The dynamic data cube. In: Zaniolo, C., Lockemann, P.C., Scholl, M.H., Grust, T. (eds.) EDBT 2000. LNCS, vol. 1777, pp. 237–253. Springer, Heidelberg (2000). doi:10.​1007/​3-540-46439-5_​17 CrossRef
10.
go back to reference Geffner, S., Agrawal, D., El Abbadi, A., Smith, T.R.: Relative prefix sums: an efficient approach for querying dynamic OLAP data cubes. In: ICDE, pp. 328–335 (1999) Geffner, S., Agrawal, D., El Abbadi, A., Smith, T.R.: Relative prefix sums: an efficient approach for querying dynamic OLAP data cubes. In: ICDE, pp. 328–335 (1999)
11.
go back to reference Ho, C., Agrawal, R., Megiddo, N., Srikant, R.: Range queries in OLAP data cubes. In: SIGMOD Conference, pp. 73–88 (1997) Ho, C., Agrawal, R., Megiddo, N., Srikant, R.: Range queries in OLAP data cubes. In: SIGMOD Conference, pp. 73–88 (1997)
12.
go back to reference Kang, H., Min, J., Chun, S., Chung, C.: A compression method for prefix-sum cubes. Inf. Process. Lett. 92(2), 99–105 (2004)CrossRefMATH Kang, H., Min, J., Chun, S., Chung, C.: A compression method for prefix-sum cubes. Inf. Process. Lett. 92(2), 99–105 (2004)CrossRefMATH
13.
go back to reference Liang, W., Wang, H., Orlowska, M.E.: Range queries in dynamic OLAP data cubes. Data Knowl. Eng. 34(1), 21–38 (2000)CrossRefMATH Liang, W., Wang, H., Orlowska, M.E.: Range queries in dynamic OLAP data cubes. Data Knowl. Eng. 34(1), 21–38 (2000)CrossRefMATH
14.
go back to reference Riedewald, M., Agrawal, D., El Abbadi, A.: pCUBE: update-efficient online aggregation with progressive feedback and error bounds. In: SSDBM, pp. 95–108 (2000) Riedewald, M., Agrawal, D., El Abbadi, A.: pCUBE: update-efficient online aggregation with progressive feedback and error bounds. In: SSDBM, pp. 95–108 (2000)
15.
go back to reference Riedewald, M., Agrawal, D., El Abbadi, A.: Dynamic multidimensional data cubes. In: Multidimensional Databases, pp. 200–221 (2003) Riedewald, M., Agrawal, D., El Abbadi, A.: Dynamic multidimensional data cubes. In: Multidimensional Databases, pp. 200–221 (2003)
16.
go back to reference Riedewald, M., Agrawal, D., Abbadi, A.E., Pajarola, R.: Space-efficient data cubes for dynamic environments. In: Kambayashi, Y., Mohania, M., Tjoa, A.M. (eds.) DaWaK 2000. LNCS, vol. 1874, pp. 24–33. Springer, Heidelberg (2000). doi:10.1007/3-540-44466-1_3 CrossRef Riedewald, M., Agrawal, D., Abbadi, A.E., Pajarola, R.: Space-efficient data cubes for dynamic environments. In: Kambayashi, Y., Mohania, M., Tjoa, A.M. (eds.) DaWaK 2000. LNCS, vol. 1874, pp. 24–33. Springer, Heidelberg (2000). doi:10.​1007/​3-540-44466-1_​3 CrossRef
17.
go back to reference Takaoka, T.: Efficient algorithms for the maximum subarray problem by distance matrix multiplication. Electr. Notes Theor. Comput. Sci. 61, 191–200 (2002)CrossRefMATH Takaoka, T.: Efficient algorithms for the maximum subarray problem by distance matrix multiplication. Electr. Notes Theor. Comput. Sci. 61, 191–200 (2002)CrossRefMATH
18.
go back to reference Viola, P.A., Jones, M.J.: Rapid object detection using a boosted cascade of simple features. In: CVPR (1), pp. 511–518 (2001) Viola, P.A., Jones, M.J.: Rapid object detection using a boosted cascade of simple features. In: CVPR (1), pp. 511–518 (2001)
Metadata
Title
Sparse Prefix Sums
Authors
Michael Shekelyan
Anton Dignös
Johann Gamper
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-66917-5_9

Premium Partner