Skip to main content
Top
Published in: The VLDB Journal 1/2019

17-09-2018 | Regular Paper

A scalable spatial skyline evaluation system utilizing parallel independent region groups

Authors: Wenlu Wang, Ji Zhang, Min-Te Sun, Wei-Shinn Ku

Published in: The VLDB Journal | Issue 1/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This research presents two parallel solutions to efficiently address spatial skyline queries. First, we propose a novel concept called independent regions for parallelizing the process of spatial skyline evaluation. Spatial skyline candidates in an independent region do not depend on any data point in other independent regions. Then, we propose a GPU-based solution. We use multi-level independent region group-based parallel filter to support efficient multi-threading spatial skyline non-candidate elimination. Beyond that, we propose comparable region to accelerate non-candidate elimination in each independent region. Secondly, we propose a MapReduce-based solution. We generate the convex hull of query points in the first MapReduce phase. In the second phase, we calculate independent regions based on the input data points and the convex hull of the query points. With the independent regions, spatial skylines are evaluated in parallel in the third phase, in which data points are partitioned by their associated independent regions in map functions, and spatial skyline candidates are calculated by reduce functions. The results of the spatial skyline queries are the union of outputs from the reduce functions. Our experimental results show that GPU multi-threading scheme is very efficient on small-scale input datasets. On the contrary, MapReduce scheme performs very well on large-scale input datasets.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Börzsönyi, S., Kossmann, D., Stocker, K.: The skyline operator. In: ICDE, pp. 421–430 (2001) Börzsönyi, S., Kossmann, D., Stocker, K.: The skyline operator. In: ICDE, pp. 421–430 (2001)
2.
go back to reference Tan, K-L., Eng, P.-K., Ooi, B.C.: Efficient progressive skyline computation. In: VLDB, pp. 301–310 (2001) Tan, K-L., Eng, P.-K., Ooi, B.C.: Efficient progressive skyline computation. In: VLDB, pp. 301–310 (2001)
3.
go back to reference Kossmann, D., Ramsak, F., Rost, S.: Shooting stars in the sky: an online algorithm for skyline queries. In: VLDB, pp. 275–286 (2002) Kossmann, D., Ramsak, F., Rost, S.: Shooting stars in the sky: an online algorithm for skyline queries. In: VLDB, pp. 275–286 (2002)
4.
go back to reference Papadias, D., Tao, Y., Fu, G., Seeger, B.: Progressive skyline computation in database systems. ACM Trans. Database Syst. 30(1), 41–82 (2005)CrossRef Papadias, D., Tao, Y., Fu, G., Seeger, B.: Progressive skyline computation in database systems. ACM Trans. Database Syst. 30(1), 41–82 (2005)CrossRef
5.
go back to reference Chomicki, J., Godfrey, P., Gryz, J., Liang, D.: Skyline with presorting. In: ICDE, pp. 717–719 (2003) Chomicki, J., Godfrey, P., Gryz, J., Liang, D.: Skyline with presorting. In: ICDE, pp. 717–719 (2003)
6.
go back to reference Zhang, S., Mamoulis, N., Cheung, D.W.: Scalable skyline computation using object-based space partitioning. In: SIGMOD Conference, pp. 483–494 (2009) Zhang, S., Mamoulis, N., Cheung, D.W.: Scalable skyline computation using object-based space partitioning. In: SIGMOD Conference, pp. 483–494 (2009)
7.
go back to reference Sarma, A.D., Lall, A., Nanongkai, D., Xu, J.: Randomized multi-pass streaming skyline algorithms. PVLDB 2(1), 85–96 (2009) Sarma, A.D., Lall, A., Nanongkai, D., Xu, J.: Randomized multi-pass streaming skyline algorithms. PVLDB 2(1), 85–96 (2009)
8.
go back to reference Huang, Z., Jensen, C.S., Lu, H., Ooi, B.C.: Skyline queries against mobile lightweight devices in MANETs. In: ICDE, p. 66 (2006) Huang, Z., Jensen, C.S., Lu, H., Ooi, B.C.: Skyline queries against mobile lightweight devices in MANETs. In: ICDE, p. 66 (2006)
9.
go back to reference Sharifzadeh, M., Shahabi, C.: The spatial skyline queries. In: VLDB, pp. 751–762 (2006) Sharifzadeh, M., Shahabi, C.: The spatial skyline queries. In: VLDB, pp. 751–762 (2006)
10.
go back to reference Son, W., Lee, M.-W., Ahn, H.-K., Hwang, S.-W.: Spatial skyline queries: an efficient geometric algorithm. In: SSTD, pp. 247–264 (2009) Son, W., Lee, M.-W., Ahn, H.-K., Hwang, S.-W.: Spatial skyline queries: an efficient geometric algorithm. In: SSTD, pp. 247–264 (2009)
11.
go back to reference Hose, K., Vlachou, A.: A survey of skyline processing in highly distributed environments. VLDB J. 21(3), 359–384 (2012)CrossRef Hose, K., Vlachou, A.: A survey of skyline processing in highly distributed environments. VLDB J. 21(3), 359–384 (2012)CrossRef
12.
go back to reference Choi, W., Liu, L., Yu, B.: Multi-criteria decision making with skyline computation. In: Information Reuse and Integration (IRI), 2012 IEEE 13th International Conference, pp. 316–323. IEEE (2012) Choi, W., Liu, L., Yu, B.: Multi-criteria decision making with skyline computation. In: Information Reuse and Integration (IRI), 2012 IEEE 13th International Conference, pp. 316–323. IEEE (2012)
13.
go back to reference Bøgh, K.S.. Assent, I., Magnani, M.: Efficient GPU-based skyline computation. In: Proceedings of the Ninth International Workshop on Data Management on New Hardware, p. 5. ACM (2013) Bøgh, K.S.. Assent, I., Magnani, M.: Efficient GPU-based skyline computation. In: Proceedings of the Ninth International Workshop on Data Management on New Hardware, p. 5. ACM (2013)
14.
go back to reference Lee, J., Hwang, S.-W.: Scalable skyline computation using a balanced pivot selection technique. Inf. Syst. 39, 1–21 (2014)CrossRef Lee, J., Hwang, S.-W.: Scalable skyline computation using a balanced pivot selection technique. Inf. Syst. 39, 1–21 (2014)CrossRef
15.
go back to reference Mullesgaard, K., Pedersen, J.L., Lu, H., Zhou, Y.: Efficient skyline computation in MapReduce. In: EDBT (2014) Mullesgaard, K., Pedersen, J.L., Lu, H., Zhou, Y.: Efficient skyline computation in MapReduce. In: EDBT (2014)
16.
go back to reference Park, Y., Min, J.-K., Shim, K.: Parallel computation of skyline and reverse skyline queries using mapreduce. PVLDB 6(14), 2002–2013 (2013) Park, Y., Min, J.-K., Shim, K.: Parallel computation of skyline and reverse skyline queries using mapreduce. PVLDB 6(14), 2002–2013 (2013)
17.
go back to reference Zhang, J., Jiang, X., Ku, W.-S., Qin, X.: Efficient parallel skyline evaluation using MapReduce. IEEE Trans. Parallel Distrib. Syst. 27(7), 1996–2009 (2016)CrossRef Zhang, J., Jiang, X., Ku, W.-S., Qin, X.: Efficient parallel skyline evaluation using MapReduce. IEEE Trans. Parallel Distrib. Syst. 27(7), 1996–2009 (2016)CrossRef
18.
go back to reference Zhang, C., Li, F., Jestes, J.: Efficient parallel kNN joins for large data in MapReduce. In: EDBT, pp. 38–49 (2012) Zhang, C., Li, F., Jestes, J.: Efficient parallel kNN joins for large data in MapReduce. In: EDBT, pp. 38–49 (2012)
19.
go back to reference Vernica, R., Carey, M.J., Li, C.: Efficient parallel set-similarity joins using MapReduce. In: SIGMOD Conference, pp. 495–506 (2010) Vernica, R., Carey, M.J., Li, C.: Efficient parallel set-similarity joins using MapReduce. In: SIGMOD Conference, pp. 495–506 (2010)
20.
go back to reference Okcan, A., Riedewald, M.: Processing theta-joins using MapReduce. In: SIGMOD Conference, pp. 949–960 (2011) Okcan, A., Riedewald, M.: Processing theta-joins using MapReduce. In: SIGMOD Conference, pp. 949–960 (2011)
21.
go back to reference Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. Commun. ACM 51(1), 107–113 (2008)CrossRef Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. Commun. ACM 51(1), 107–113 (2008)CrossRef
22.
go back to reference Bøgh, K.S., Chester, S., Assent, I.: Work-efficient parallel skyline computation for the GPU. Proc. VLDB Endow. 8(9), 962–973 (2015)CrossRef Bøgh, K.S., Chester, S., Assent, I.: Work-efficient parallel skyline computation for the GPU. Proc. VLDB Endow. 8(9), 962–973 (2015)CrossRef
24.
go back to reference Eldawy, A., Li, Y., Mokbel, M.F., Janardan, R.: CG\_Hadoop: Computational geometry in MapReduce. In: SIGSPATIAL, pp. 294–303 (2013) Eldawy, A., Li, Y., Mokbel, M.F., Janardan, R.: CG\_Hadoop: Computational geometry in MapReduce. In: SIGSPATIAL, pp. 294–303 (2013)
25.
go back to reference de Berg, M., Cheong, O., van Kreveld, M., Overmars, M.: Computational Geometry: Algorithms and Applications, 3rd edn. Springer, New York (2008)CrossRefMATH de Berg, M., Cheong, O., van Kreveld, M., Overmars, M.: Computational Geometry: Algorithms and Applications, 3rd edn. Springer, New York (2008)CrossRefMATH
27.
go back to reference Chester, S., Šidlauskas, D., Assent, I., Bøgh, K.S: Scalable parallelization of skyline computation for multi-core processors. In: 2015 IEEE 31st International Conference on Data Engineering, pp. 1083–1094. IEEE (2015) Chester, S., Šidlauskas, D., Assent, I., Bøgh, K.S: Scalable parallelization of skyline computation for multi-core processors. In: 2015 IEEE 31st International Conference on Data Engineering, pp. 1083–1094. IEEE (2015)
28.
go back to reference Lee, S.-Y., Wu, C.-J.: Characterizing the latency hiding ability of GPUS. In: Performance Analysis of Systems and Software (ISPASS), 2014 IEEE International Symposium, pp. 145–146. IEEE (2014) Lee, S.-Y., Wu, C.-J.: Characterizing the latency hiding ability of GPUS. In: Performance Analysis of Systems and Software (ISPASS), 2014 IEEE International Symposium, pp. 145–146. IEEE (2014)
29.
go back to reference Balke, W.-T., Güntzer, U., Zheng, J. X.: Efficient distributed skylining for web information systems. In: EDBT, pp. 256–273 (2004) Balke, W.-T., Güntzer, U., Zheng, J. X.: Efficient distributed skylining for web information systems. In: EDBT, pp. 256–273 (2004)
30.
go back to reference Wu, P., Zhang, C., Feng, Y., Zhao, B.Y., Agrawal, D., El Abbadi, A.: Parallelizing skyline queries for scalable distribution. In: EDBT, pp. 112–130 (2006) Wu, P., Zhang, C., Feng, Y., Zhao, B.Y., Agrawal, D., El Abbadi, A.: Parallelizing skyline queries for scalable distribution. In: EDBT, pp. 112–130 (2006)
31.
go back to reference Cosgaya-Lozano, A., Rau-Chaplin, A., Zeh, N.: Parallel computation of skyline queries. In: HPCS, p. 12 (2007) Cosgaya-Lozano, A., Rau-Chaplin, A., Zeh, N.: Parallel computation of skyline queries. In: HPCS, p. 12 (2007)
32.
go back to reference Afrati, F.N., Koutris, P., Suciu, D., Ullman, J.D.: Parallel skyline queries. In: ICDT, pp. 274–284 (2012) Afrati, F.N., Koutris, P., Suciu, D., Ullman, J.D.: Parallel skyline queries. In: ICDT, pp. 274–284 (2012)
33.
go back to reference Rocha-Junior, J.B., Vlachou, A., Doulkeridis, C., Nørvåg, K.: AGiDS: a grid-based strategy for distributed skyline query processing. In: Globe, pp. 12–23 (2009) Rocha-Junior, J.B., Vlachou, A., Doulkeridis, C., Nørvåg, K.: AGiDS: a grid-based strategy for distributed skyline query processing. In: Globe, pp. 12–23 (2009)
34.
go back to reference Vlachou, A., Doulkeridis, C., Kotidis, Y.: Angle-based space partitioning for efficient parallel skyline computation. In: SIGMOD Conference, pp. 227–238 (2008) Vlachou, A., Doulkeridis, C., Kotidis, Y.: Angle-based space partitioning for efficient parallel skyline computation. In: SIGMOD Conference, pp. 227–238 (2008)
35.
go back to reference Köhler, H., Yang, J., Zhou, X.: Efficient parallel skyline processing using hyperplane projections. In: SIGMOD Conference, pp. 85–96 (2011) Köhler, H., Yang, J., Zhou, X.: Efficient parallel skyline processing using hyperplane projections. In: SIGMOD Conference, pp. 85–96 (2011)
36.
go back to reference Han, X., Li, J., Yang, D., Wang, J.: Efficient skyline computation on big data. IEEE Trans. Knowl. Data Eng. 25(11), 2521–2535 (2013)CrossRef Han, X., Li, J., Yang, D., Wang, J.: Efficient skyline computation on big data. IEEE Trans. Knowl. Data Eng. 25(11), 2521–2535 (2013)CrossRef
37.
go back to reference Zhang, B., Zhou, S., Guan, J.: Adapting skyline computation to the Mapreduce framework: algorithms and experiments. In: DASFAA Workshops, pp. 403–414 (2011) Zhang, B., Zhou, S., Guan, J.: Adapting skyline computation to the Mapreduce framework: algorithms and experiments. In: DASFAA Workshops, pp. 403–414 (2011)
38.
go back to reference Chen, L., Hwang, K., Wu, J.: Mapreduce skyline query processing with a new angular partitioning approach. In: IPDPS Workshops, pp. 2262–2270 (2012) Chen, L., Hwang, K., Wu, J.: Mapreduce skyline query processing with a new angular partitioning approach. In: IPDPS Workshops, pp. 2262–2270 (2012)
39.
go back to reference Yoon, S., Shahabi, C.: Distributed spatial skyline query processing in wireless sensor networks. In: Proceedings of the IPSN, San Francisco, CA, USA, pp. 13–16 (2009) Yoon, S., Shahabi, C.: Distributed spatial skyline query processing in wireless sensor networks. In: Proceedings of the IPSN, San Francisco, CA, USA, pp. 13–16 (2009)
40.
go back to reference Wang, Y., Song, B., Wang, J., Zhang, L., Wang, L.: Geometry-based distributed spatial skyline queries in wireless sensor networks. Sensors 16(4), 454 (2016)CrossRef Wang, Y., Song, B., Wang, J., Zhang, L., Wang, L.: Geometry-based distributed spatial skyline queries in wireless sensor networks. Sensors 16(4), 454 (2016)CrossRef
Metadata
Title
A scalable spatial skyline evaluation system utilizing parallel independent region groups
Authors
Wenlu Wang
Ji Zhang
Min-Te Sun
Wei-Shinn Ku
Publication date
17-09-2018
Publisher
Springer Berlin Heidelberg
Published in
The VLDB Journal / Issue 1/2019
Print ISSN: 1066-8888
Electronic ISSN: 0949-877X
DOI
https://doi.org/10.1007/s00778-018-0519-4

Other articles of this Issue 1/2019

The VLDB Journal 1/2019 Go to the issue

Premium Partner