Skip to main content
Top

2019 | OriginalPaper | Chapter

Skyline Computation for Big Data

Authors : R. D. Kulkarni, B. F. Momin

Published in: Data Science and Big Data Analytics

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

From a multidimensional dataset, a skyline query extracts the data which satisfy the multiple preferences given by the user. The real challenge in skyline computation is to retrieve such data, in the optimum time. When the datasets are huge, the challenge becomes critical. In this paper, we address exactly this issue focusing on the big data. For this, we aim at utilizing the correlations observed in the user queries. These correlations and the results of historical skyline queries, executed on the same dataset, are very much helpful in optimizing the response time of further skyline computation. For the same purpose, we have earlier proposed a novel structure namely Query Profiler (QP). In this paper, we present a technique namely SkyQP to assert the effectiveness of this concept against the big data. We have also presented the time and space analysis of the proposed technique. The experimental results obtained assert the efficacy of the SkyQP technique.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Kulkarni RD, Momin BF (2016) Skyline computation for frequent queries in update intensive environment. J King Saud Univ Comput Inf Sci 28(4):447–456 Kulkarni RD, Momin BF (2016) Skyline computation for frequent queries in update intensive environment. J King Saud Univ Comput Inf Sci 28(4):447–456
2.
go back to reference Borzsonyi S, Kossmann D, Stocker K (2001) The skyline operator. In: Proceedings IEEE international conference on data engineering, pp 421–430 Borzsonyi S, Kossmann D, Stocker K (2001) The skyline operator. In: Proceedings IEEE international conference on data engineering, pp 421–430
3.
go back to reference Chomicki J, Godfrey P, Gryz J, Liang D (2003) Skyline with presorting. In: Proceedings IEEE international conference on data engineering, pp 717–719 Chomicki J, Godfrey P, Gryz J, Liang D (2003) Skyline with presorting. In: Proceedings IEEE international conference on data engineering, pp 717–719
4.
go back to reference Godfrey P, Shipley R, Gryz J (2005) Maximal vector computation in large data sets. In: Proceedings IEEE international conference on very large databases, pp 229–240 Godfrey P, Shipley R, Gryz J (2005) Maximal vector computation in large data sets. In: Proceedings IEEE international conference on very large databases, pp 229–240
5.
go back to reference Bartolini I, Ciaccia P, Patella M (2006) SaLSa: computing the skyline without scanning the whole sky. In: Proceedings IEEE international conference on information and knowledge management, pp 405–411 Bartolini I, Ciaccia P, Patella M (2006) SaLSa: computing the skyline without scanning the whole sky. In: Proceedings IEEE international conference on information and knowledge management, pp 405–411
6.
go back to reference Kossmann D, Ramsak F, Rost S (2002) Shooting stars in the sky: an online algorithm for skyline queries. In: Proceedings IEEE international conference on very large databases, pp 275–286 Kossmann D, Ramsak F, Rost S (2002) Shooting stars in the sky: an online algorithm for skyline queries. In: Proceedings IEEE international conference on very large databases, pp 275–286
7.
go back to reference Papadias D, Tao Y, Fu G, Seeger B (2005) Progressive skyline computation in database systems. ACM Trans Database Syst 30(1):41–82CrossRef Papadias D, Tao Y, Fu G, Seeger B (2005) Progressive skyline computation in database systems. ACM Trans Database Syst 30(1):41–82CrossRef
8.
go back to reference Xia T, Zhang D (2005) Refreshing the sky: the compressed skycube with efficient support for frequent updates. In: Proceedings ACM SIGMOD International Conference on Management of Data, pp 493–501 Xia T, Zhang D (2005) Refreshing the sky: the compressed skycube with efficient support for frequent updates. In: Proceedings ACM SIGMOD International Conference on Management of Data, pp 493–501
9.
go back to reference Yuan Y, Lin X, Liu Q, Wang W, Yu JX, Zhang Q (2005) Efficient computation of the skyline cube. In: Proceedings IEEE international conference on very large databases, pp 241–252 Yuan Y, Lin X, Liu Q, Wang W, Yu JX, Zhang Q (2005) Efficient computation of the skyline cube. In: Proceedings IEEE international conference on very large databases, pp 241–252
10.
go back to reference Zhang N, Li C, Hassan N, Rajasekaran S, Das G (2014) On skyline groups. IEEE Trans Knowl Data Eng 26(4):942–956 Zhang N, Li C, Hassan N, Rajasekaran S, Das G (2014) On skyline groups. IEEE Trans Knowl Data Eng 26(4):942–956
11.
go back to reference Zheng W, Zou L, Lian X, Hong L, Zhao D (2014) Efficient subgraph skyline search over large graphs. In: Proceedings ACM international conference on conference on information and knowledge management, pp 1529–1538 Zheng W, Zou L, Lian X, Hong L, Zhao D (2014) Efficient subgraph skyline search over large graphs. In: Proceedings ACM international conference on conference on information and knowledge management, pp 1529–1538
12.
go back to reference Lin J, Wei J (2008) Constrained skyline computing over data streams. In: Proceedings IEEE international conference on e-business, engineering, pp 155–161 Lin J, Wei J (2008) Constrained skyline computing over data streams. In: Proceedings IEEE international conference on e-business, engineering, pp 155–161
13.
go back to reference Wu P, Zhang C, Feng Y, Zhao B, Agrawal D, Abbadi A (2006) Parallelizing skyline queries for scalable distribution. In: Proceedings IEEE international conference on extending database technology, pp 112–130 Wu P, Zhang C, Feng Y, Zhao B, Agrawal D, Abbadi A (2006) Parallelizing skyline queries for scalable distribution. In: Proceedings IEEE international conference on extending database technology, pp 112–130
14.
go back to reference Wang S, Ooi B, Tung A, Xu L (2007) Efficient skyline query processing on peer-to-peer net-works. In: Proceedings IEEE international conference on data engineering, pp 1126–1135 Wang S, Ooi B, Tung A, Xu L (2007) Efficient skyline query processing on peer-to-peer net-works. In: Proceedings IEEE international conference on data engineering, pp 1126–1135
15.
go back to reference Chen L, Cui B, Lu H, Xu L, Xu Q (2008) iSky: efficient and progressive skyline computing in a structured P2P network. In: Proceedings IEEE international conference on distributed computing systems, pp 160–167 Chen L, Cui B, Lu H, Xu L, Xu Q (2008) iSky: efficient and progressive skyline computing in a structured P2P network. In: Proceedings IEEE international conference on distributed computing systems, pp 160–167
16.
go back to reference Wang S, Vu Q, Ooi B, Tung A, Xu L (2009) Skyframe: a framework for skyline query processing in peer-to-peer systems. VLDB J 18(1):345–362CrossRef Wang S, Vu Q, Ooi B, Tung A, Xu L (2009) Skyframe: a framework for skyline query processing in peer-to-peer systems. VLDB J 18(1):345–362CrossRef
17.
go back to reference Jensen HC, Lu H, Ooi HB (2006) Skyline queries against mobile lightweight devices in MANETs. In: Proceedings IEEE international conference on data engineering, pp 66–72 Jensen HC, Lu H, Ooi HB (2006) Skyline queries against mobile lightweight devices in MANETs. In: Proceedings IEEE international conference on data engineering, pp 66–72
18.
go back to reference Hose K, Lemke C, Sattler K (2006) Processing relaxed skylines in PDMS using distributed data summaries. In: Proceedings IEEE international conference on information and knowledge management, pp 425–434 Hose K, Lemke C, Sattler K (2006) Processing relaxed skylines in PDMS using distributed data summaries. In: Proceedings IEEE international conference on information and knowledge management, pp 425–434
19.
go back to reference Hose K, Lemke C, Sattler K, Zinn D (2007) A relaxed but not necessarily constrained way from the top to the sky. In: Proceedings international conference on cooperative information systems, pp 339–407 Hose K, Lemke C, Sattler K, Zinn D (2007) A relaxed but not necessarily constrained way from the top to the sky. In: Proceedings international conference on cooperative information systems, pp 339–407
20.
go back to reference Zhang B, Zhou S, Guan J (2011) Adapting skyline computation to the MapReduce framework: algorithms and experiments. In: Proceedings international conference on database systems for advanced applications, pp 403–414 Zhang B, Zhou S, Guan J (2011) Adapting skyline computation to the MapReduce framework: algorithms and experiments. In: Proceedings international conference on database systems for advanced applications, pp 403–414
21.
go back to reference Park Y, Min J-K, Shim K (2013) Parallel computation of skyline and reverse skyline queries using MapReduce. J VLDB Endow 6(14):2002–2013CrossRef Park Y, Min J-K, Shim K (2013) Parallel computation of skyline and reverse skyline queries using MapReduce. J VLDB Endow 6(14):2002–2013CrossRef
22.
go back to reference Mullesgaard K, Pederseny JL, Lu H, Zhou Y (2014) Efficient skyline computation in MapReduce. In: Proceedings international conference on extending database technology, pp 37–48 Mullesgaard K, Pederseny JL, Lu H, Zhou Y (2014) Efficient skyline computation in MapReduce. In: Proceedings international conference on extending database technology, pp 37–48
23.
go back to reference Chen L, Hwang K, Wu J (2012) MapReduce skyline query processing with a new angular partitioning approach. In: Proceedings international conference on parallel and distributed processing symposium, pp 403–414 Chen L, Hwang K, Wu J (2012) MapReduce skyline query processing with a new angular partitioning approach. In: Proceedings international conference on parallel and distributed processing symposium, pp 403–414
24.
go back to reference Bgh K, Aasent I, Maghni M (2013) Efficient GPU-based skyline computation. In: Proceedings international workshop on data management on new hardware, Article no. 5 Bgh K, Aasent I, Maghni M (2013) Efficient GPU-based skyline computation. In: Proceedings international workshop on data management on new hardware, Article no. 5
25.
go back to reference Bgh K, Chester S, Assent I (2015) Work-efficient parallel skyline computation for the GPU. J Very Large Data Bases Endow 962–973 Bgh K, Chester S, Assent I (2015) Work-efficient parallel skyline computation for the GPU. J Very Large Data Bases Endow 962–973
26.
go back to reference Choi W, Liu L, Yu B (2012) Multi-criteria decision making with skyline computation. In: Proceedings IEEE international conference on information reuse and integration, pp 316–323 Choi W, Liu L, Yu B (2012) Multi-criteria decision making with skyline computation. In: Proceedings IEEE international conference on information reuse and integration, pp 316–323
27.
go back to reference Woods L, Alonso G, Teubner J (2013) Parallel computation of skyline queries. In: Proceedings IEEE international conference on field-programmable custom computing machines, pp 1–8 Woods L, Alonso G, Teubner J (2013) Parallel computation of skyline queries. In: Proceedings IEEE international conference on field-programmable custom computing machines, pp 1–8
28.
go back to reference Woods L, Alonso G, Teubner J (2015) Parallelizing data processing on FPGAs with shifter lists. J ACM Trans Reconfig Technol Syst 8(2) Woods L, Alonso G, Teubner J (2015) Parallelizing data processing on FPGAs with shifter lists. J ACM Trans Reconfig Technol Syst 8(2)
29.
go back to reference Bhattacharya A, Teja P, Dutta S (2011) Caching stars in the sky: a semantic caching approach to accelerate skyline queries. In: Proceedings international conference on database and expert systems applications, pp 493–501 Bhattacharya A, Teja P, Dutta S (2011) Caching stars in the sky: a semantic caching approach to accelerate skyline queries. In: Proceedings international conference on database and expert systems applications, pp 493–501
Metadata
Title
Skyline Computation for Big Data
Authors
R. D. Kulkarni
B. F. Momin
Copyright Year
2019
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-7641-1_23

Premium Partner