Skip to main content
Top
Published in: World Wide Web 4/2016

01-07-2016

Efficient processing of top-k dominating queries in distributed environments

Authors: Daichi Amagata, Yuya Sasaki, Takahiro Hara, Shojiro Nishio

Published in: World Wide Web | Issue 4/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Due to the recent massive data generation, preference queries are becoming an increasingly important for users because such queries retrieve only a small number of preferable data objects from a huge multi-dimensional dataset. A top-k dominating query, which retrieves the k data objects dominating the highest number of data objects in a given dataset, is particularly important in supporting multi-criteria decision making because this query can find interesting data objects in an intuitive way exploiting the advantages of top-k and skyline queries. Although efficient algorithms for top-k dominating queries have been studied over centralized databases, there are no studies which deal with top-k dominating queries in distributed environments. The recent data management is becoming increasingly distributed, so it is necessary to support processing of top-k dominating queries in distributed environments. In this paper, we address, for the first time, the challenging problem of processing top-k dominating queries in distributed networks and propose a method for efficient top-k dominating data retrieval, which avoids redundant communication cost and latency. Furthermore, we also propose an approximate version of our proposed method, which further reduces communication cost. Extensive experiments on both synthetic and real data have demonstrated the efficiency and effectiveness of our proposed methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Akbarinia, R., Pacitti, E., Valduriez, P.: Reducing network traffic in unstructured p2p systems using top-k queries. Distributed and Parallel Databases 19(2), 67–86 (2006)CrossRef Akbarinia, R., Pacitti, E., Valduriez, P.: Reducing network traffic in unstructured p2p systems using top-k queries. Distributed and Parallel Databases 19(2), 67–86 (2006)CrossRef
2.
go back to reference Akbarinia, R., Pacitti, E., Valduriez, P.: Best position algorithms for top-k queries VLDB, pp. 495–506 (2007) Akbarinia, R., Pacitti, E., Valduriez, P.: Best position algorithms for top-k queries VLDB, pp. 495–506 (2007)
3.
go back to reference Balke, W.T., Kießling, W.: Optimizing multi-feature queries for image databases VLDB, pp. 10–14 (2000) Balke, W.T., Kießling, W.: Optimizing multi-feature queries for image databases VLDB, pp. 10–14 (2000)
4.
go back to reference Börzsönyi, S., Kossmann, D., Stocker, K.: The skyline operator, ICDE, pp. 421–430 (2001) Börzsönyi, S., Kossmann, D., Stocker, K.: The skyline operator, ICDE, pp. 421–430 (2001)
5.
go back to reference Buckley, C., Voorhees, E.M.: Evaluating evaluation measure stability SIGIR, pp. 33–40 (2000) Buckley, C., Voorhees, E.M.: Evaluating evaluation measure stability SIGIR, pp. 33–40 (2000)
6.
go back to reference Chan, C.Y., Jagadish, H., Tan, K.L., Tung, A.K., Zhang, Z.: Finding k-dominant skylines in high dimensional space SIGMOD, pp. 503–514 (2006) Chan, C.Y., Jagadish, H., Tan, K.L., Tung, A.K., Zhang, Z.: Finding k-dominant skylines in high dimensional space SIGMOD, pp. 503–514 (2006)
7.
go back to reference Chan, C.Y., Jagadish, H., Tan, K.L., Tung, A.K., Zhang, Z.: On high dimensional skylines EDBT, pp. 478–495 (2006) Chan, C.Y., Jagadish, H., Tan, K.L., Tung, A.K., Zhang, Z.: On high dimensional skylines EDBT, pp. 478–495 (2006)
8.
go back to reference Chen, L., Cui, B., Lu, H.: Constrained skyline query processing against distributed data sites. IEEE TKDE 23(2), 204–217 (2011) Chen, L., Cui, B., Lu, H.: Constrained skyline query processing against distributed data sites. IEEE TKDE 23(2), 204–217 (2011)
9.
go back to reference Han, X., Li, J., Gao, H.: Tdep: efficiently processing top-k dominating query on massive data. Knowledge and Information Systems Springer (2014) Han, X., Li, J., Gao, H.: Tdep: efficiently processing top-k dominating query on massive data. Knowledge and Information Systems Springer (2014)
10.
go back to reference He, Z., Lo, E.: Answering why-not questions on top-k queries ICDE, pp. 750–761 (2012) He, Z., Lo, E.: Answering why-not questions on top-k queries ICDE, pp. 750–761 (2012)
11.
go back to reference Hose, K., Vlachou, A.: A survey of skyline processing in highly distributed environments. The VLDB J. 21(3), 359–384 (2012)CrossRef Hose, K., Vlachou, A.: A survey of skyline processing in highly distributed environments. The VLDB J. 21(3), 359–384 (2012)CrossRef
12.
go back to reference Huang, Z., Jensen, C.S., Lu, H., Ooi, B.C.: Skyline queries against mobile lightweight devices in manets ICDE, p. 66 (2006) Huang, Z., Jensen, C.S., Lu, H., Ooi, B.C.: Skyline queries against mobile lightweight devices in manets ICDE, p. 66 (2006)
13.
go back to reference Ilyas, I.F., Beskales, G., Soliman, M.A.: A survey of top-k query processing techniques in relational database systems. ACM Comput. Surveys (CSUR) 40(4), 11 (2008)CrossRef Ilyas, I.F., Beskales, G., Soliman, M.A.: A survey of top-k query processing techniques in relational database systems. ACM Comput. Surveys (CSUR) 40(4), 11 (2008)CrossRef
14.
go back to reference Kießling, W.: Foundations of preferences in database systems, VLDB, pp. 311–322 (2002) Kießling, W.: Foundations of preferences in database systems, VLDB, pp. 311–322 (2002)
15.
go back to reference Kontaki, M., Papadopoulos, A.N., Manolopoulos, Y.: Continuous top-k dominating queries in subspaces, Panhellenic Conference on Informatics, pp. 31–35 (2008) Kontaki, M., Papadopoulos, A.N., Manolopoulos, Y.: Continuous top-k dominating queries in subspaces, Panhellenic Conference on Informatics, pp. 31–35 (2008)
16.
go back to reference Kontaki, M., Papadopoulos, A.N., Manolopoulos, Y.: Continuous top-k dominating queries. IEEE TKDE 24(5), 840–853 (2012) Kontaki, M., Papadopoulos, A.N., Manolopoulos, Y.: Continuous top-k dominating queries. IEEE TKDE 24(5), 840–853 (2012)
17.
go back to reference Kosmatopoulos, A., Papadopoulos, A., Tsichlas, K.: Dynamic processing of dominating queries with performance guarantees ICDT, pp. 225–234 (2014) Kosmatopoulos, A., Papadopoulos, A., Tsichlas, K.: Dynamic processing of dominating queries with performance guarantees ICDT, pp. 225–234 (2014)
18.
go back to reference Lee, J., You, G.W., Hwang, S.W.: Personalized top-k skyline queries in high-dimensional space. Inf. Syst. 34(1), 45–61 (2009)CrossRef Lee, J., You, G.W., Hwang, S.W.: Personalized top-k skyline queries in high-dimensional space. Inf. Syst. 34(1), 45–61 (2009)CrossRef
19.
go back to reference Lian, X., Chen, L.: Top-k dominating queries in uncertain databases EDBT, pp. 660–671 (2009) Lian, X., Chen, L.: Top-k dominating queries in uncertain databases EDBT, pp. 660–671 (2009)
21.
go back to reference Lin, X., Yuan, Y., Zhang, Q., Zhang, Y.: Selecting stars: The k most representative skyline operator, SIGMOD, pp. 86–95 (2007) Lin, X., Yuan, Y., Zhang, Q., Zhang, Y.: Selecting stars: The k most representative skyline operator, SIGMOD, pp. 86–95 (2007)
22.
go back to reference Papadias, D., Tao, Y., Fu, G., Seeger, B.: Progressive skyline computation in database systems. ACM Trans. Database Syst. 30(1), 41–82 (2005)CrossRef Papadias, D., Tao, Y., Fu, G., Seeger, B.: Progressive skyline computation in database systems. ACM Trans. Database Syst. 30(1), 41–82 (2005)CrossRef
23.
go back to reference Santoso, B., Chiu, G.: Close dominance graph: An efficient framework for answering continuous top-k dominating queries IEEE TKDE (2013) Santoso, B., Chiu, G.: Close dominance graph: An efficient framework for answering continuous top-k dominating queries IEEE TKDE (2013)
24.
go back to reference Sarma, A.D., Lall, A., Nanongkai, D., Lipton, R.J., Xu, J.: Representative skylines using threshold-based preference distributions ICDE, pp. 387–398 (2011) Sarma, A.D., Lall, A., Nanongkai, D., Lipton, R.J., Xu, J.: Representative skylines using threshold-based preference distributions ICDE, pp. 387–398 (2011)
25.
go back to reference Skoutas, D., Sacharidis, D., Simitsis, A., Kantere, V., Sellis, T.: Top-k dominant web services under multi-criteria matching EDBT, pp. 898–909 (2009) Skoutas, D., Sacharidis, D., Simitsis, A., Kantere, V., Sellis, T.: Top-k dominant web services under multi-criteria matching EDBT, pp. 898–909 (2009)
26.
go back to reference Tao, Y., Ding, L., Lin, X., Pei, J.: Distance-based representative skyline ICDE, pp. 892–903 (2009) Tao, Y., Ding, L., Lin, X., Pei, J.: Distance-based representative skyline ICDE, pp. 892–903 (2009)
27.
go back to reference Tao, Y., Xiao, X., Pei, J.: Subsky: Efficient computation of skylines in subspaces ICDE, pp. 65–76 (2006) Tao, Y., Xiao, X., Pei, J.: Subsky: Efficient computation of skylines in subspaces ICDE, pp. 65–76 (2006)
28.
go back to reference Tiakas, E., Valkans, G., Papadopoulos, A.N., Manolopoulos, Y.D.G.: Metric-based top-k dominating queries EDBT, pp. 415–426 (2014) Tiakas, E., Valkans, G., Papadopoulos, A.N., Manolopoulos, Y.D.G.: Metric-based top-k dominating queries EDBT, pp. 415–426 (2014)
29.
go back to reference Vlachou, A., Doulkeridis, C., Halkidi, M.: Discovering representative skyline points over distributed data Scientific and Statistical Database Management, pp. 141–158. Springer (2012) Vlachou, A., Doulkeridis, C., Halkidi, M.: Discovering representative skyline points over distributed data Scientific and Statistical Database Management, pp. 141–158. Springer (2012)
30.
go back to reference Vlachou, A., Doulkeridis, C., Kotidis, Y., Vazirgiannis, M.: Skypeer: Efficient subspace skyline computation over distributed data ICDE, pp. 416–425 (2007) Vlachou, A., Doulkeridis, C., Kotidis, Y., Vazirgiannis, M.: Skypeer: Efficient subspace skyline computation over distributed data ICDE, pp. 416–425 (2007)
31.
go back to reference Vlachou, A., Doulkeridis, C., Nørvåg, K.: Distributed top-k query processing by exploiting skyline summaries. Distributed and Parallel Databases 30(3-4), 239–271 (2012)CrossRef Vlachou, A., Doulkeridis, C., Nørvåg, K.: Distributed top-k query processing by exploiting skyline summaries. Distributed and Parallel Databases 30(3-4), 239–271 (2012)CrossRef
32.
go back to reference Vlachou, A., Doulkeridis, C., Nørvåg, K., Vazirgiannis, M.: On efficient top-k query processing in highly distributed environments, SIGMOD, pp. 753–764 (2008) Vlachou, A., Doulkeridis, C., Nørvåg, K., Vazirgiannis, M.: On efficient top-k query processing in highly distributed environments, SIGMOD, pp. 753–764 (2008)
33.
go back to reference Xie, X., Lu, H., Chen, J., Shang, S.: Top-k neighborhood dominating query DASFAA, pp. 131–145 (2013) Xie, X., Lu, H., Chen, J., Shang, S.: Top-k neighborhood dominating query DASFAA, pp. 131–145 (2013)
34.
go back to reference Yiu, M.L., Mamoulis, N.: Efficient processing of top-k dominating queries on multi-dimensional data VLDB, pp. 483–494 (2007) Yiu, M.L., Mamoulis, N.: Efficient processing of top-k dominating queries on multi-dimensional data VLDB, pp. 483–494 (2007)
35.
go back to reference Yiu, M.L., Mamoulis, N.: Multi-dimensional top-k dominating queries. The VLDB J. 18(3), 695–718 (2009)CrossRef Yiu, M.L., Mamoulis, N.: Multi-dimensional top-k dominating queries. The VLDB J. 18(3), 695–718 (2009)CrossRef
36.
go back to reference Zhan, L., Zhang, Y., Zhang, W., Lin, X.: Identifying top k dominating objects over uncertain data DASFAA, pp. 388–405 (2014) Zhan, L., Zhang, Y., Zhang, W., Lin, X.: Identifying top k dominating objects over uncertain data DASFAA, pp. 388–405 (2014)
37.
go back to reference Zhang, W., Lin, X., Zhang, Y., Pei, J., Wang, W.: Threshold-based probabilistic top-k dominating queries. The VLDB J. 19(2), 283–305 (2010)CrossRef Zhang, W., Lin, X., Zhang, Y., Pei, J., Wang, W.: Threshold-based probabilistic top-k dominating queries. The VLDB J. 19(2), 283–305 (2010)CrossRef
38.
go back to reference Zhang, W., Lin, X., Zhang, Y., Pei, J., Wang, W.: Progressive processing of subspace dominating queries. The VLDB J. 20(6), 921–948 (2011)CrossRef Zhang, W., Lin, X., Zhang, Y., Pei, J., Wang, W.: Progressive processing of subspace dominating queries. The VLDB J. 20(6), 921–948 (2011)CrossRef
39.
go back to reference Zhu, L., Tao, Y., Zhou, S.: Distributed skyline retrieval with low bandwidth consumption. IEEE TKDE 21(3), 384–400 (2009) Zhu, L., Tao, Y., Zhou, S.: Distributed skyline retrieval with low bandwidth consumption. IEEE TKDE 21(3), 384–400 (2009)
Metadata
Title
Efficient processing of top-k dominating queries in distributed environments
Authors
Daichi Amagata
Yuya Sasaki
Takahiro Hara
Shojiro Nishio
Publication date
01-07-2016
Publisher
Springer US
Published in
World Wide Web / Issue 4/2016
Print ISSN: 1386-145X
Electronic ISSN: 1573-1413
DOI
https://doi.org/10.1007/s11280-015-0340-6

Other articles of this Issue 4/2016

World Wide Web 4/2016 Go to the issue

Premium Partner