nach oben

The Journal of Supercomputing

Erschienen in:

23.03.2023

An evaluation of relational and NoSQL distributed databases on a low-power cluster

verfasst von: Lucas Ferreira da Silva, João V. F. Lima

Erschienen in: The Journal of Supercomputing | Ausgabe 12/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

The constant growth of social media, unconventional web technologies, mobile applications, and Internet of Things (IoT) devices create challenges for cloud data systems in order to support huge datasets and very high request rates. NoSQL databases, such as Cassandra and HBase, and relational SQL databases with replication, such as Citus/PostgreSQL, have been used to increase horizontal scalability and high availability of data store systems. In this paper, we evaluated three distributed databases on a low-power low-cost cluster of commodity Single-Board Computers (SBC): relational Citus/PostgreSQL and NoSQL databases Cassandra and HBase. The cluster has 15 Raspberry Pi 3 nodes with Docker Swarm orchestration tool for service deployment and ingress load balancing over SBCs. We believe that a low-cost SBC cluster can support cloud serving goals such as scale-out, elasticity, and high availability. Experimental results clearly demonstrated that there is a trade-off between performance and replication, which provides availability and partition tolerance. Besides, both properties are essential in the context of distributed systems with low-power boards. Cassandra attained better results with its consistency levels specified by the client. Both Citus and HBase enable consistency but it penalizes performance as the number of replicas increases.

Vorheriger Artikel Efficient GPU implementation of a Boltzmann-Schrödinger-Poisson solver for the simulation of nanoscale DG MOSFETs

Nächster Artikel QGA–QGCNN: a model of quantum gate circuit neural network optimized by quantum genetic algorithm

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

HypriotOS, https://blog.hypriot.com/.

Prometheus, https://prometheus.io/.

Node Exporter, https://github.com/prometheus/node_exporter.

David Reinsel JR, Gantz J (2018) The digitization of the world from edge to core. https://www.seagate.com/files/www-content/our-story/trends/files/idc-seagate-dataage-whitepaper.pdf

Johnston SJ, Basford PJ, Perkins CS, Herry H, Tso FP, Pezaros D, Mullins RD, Yoneki E, Cox SJ, Singer J (2018) Commodity single board computer clusters and their applications. Future Gener Comput Syst 89:201–212. https://doi.org/10.1016/j.future.2018.06.048CrossRef

Wolf W, Jerraya AA, Martin G (2008) Multiprocessor system-on-chip (MPSoC) technology. Trans Comput Aided Des Integr Circuits Syst 27(10):1701–1713. https://doi.org/10.1109/TCAD.2008.923415CrossRef

Kim H-J, Ko E-J, Jeon Y-H, Lee K-H (2020) Techniques and guidelines for effective migration from RDBMS to NoSQL. J Supercomput 76(10):7936–7950. https://doi.org/10.1007/s11227-018-2361-2CrossRef

Davoudian A, Chen L, Liu M (2018) A survey on NoSQL stores. ACM Comput Surv. https://doi.org/10.1145/3158661CrossRef

Hendawi A, Gupta J, Liu J, Teredesai A, Ramakrishnan N, Shah M, El-Sappagh S, Kwak K-S, Ali M (2019) Benchmarking large-scale data management for Internet of Things. J Supercomput 75(12):8207–8230. https://doi.org/10.1007/s11227-019-02984-6CrossRef

Yao X, Wang C-L (2020) Probabilistic consistency guarantee in partial quorum-based data store. IEEE Trans Parallel Distrib Syst 31(8):1815–1827. https://doi.org/10.1109/TPDS.2020.2973619CrossRef

Antas J, Rocha Silva R, Bernardino J (2022) Assessment of SQL and NoSQL systems to store and mine Covid-19 data. Computers. https://doi.org/10.3390/computers11020029CrossRef

Cooper BF, Silberstein A, Tam E, Ramakrishnan R, Sears R (2010) Benchmarking cloud serving systems with YCSB. In: Proceedings of the 1st ACM Symposium on Cloud Computing. SoCC ’10. ACM, New York, pp 143–154. https://doi.org/10.1145/1807128.1807152

10.

Abramova V, Bernardino J, Furtado P (2014) Evaluating cassandra scalability with YCSB. In: Decker H, Lhotská L, Link S, Spies M, Wagner RR (eds) Database and expert systems applications. Springer, Cham, pp 199–207

11.

Swaminathan SN, Elmasri R (2016) Quantitative analysis of scalable NoSQL databases. In: 2016 IEEE International Congress on Big Data (BigData Congress), pp 323–326. https://doi.org/10.1109/BigDataCongress.2016.49

12.

Abramova V, Bernardino J (2013) NoSQL databases: Mongodb vs cassandra. In: Proceedings of the International C* Conference on Computer Science and Software Engineering. C3S2E ’13. ACM, New York, pp 14–22. https://doi.org/10.1145/2494444.2494447

13.

Papapanagiotou I, Chella V (2018) NDBench: benchmarking microservices at scale

14.

Ashari A, Riasetiawan M (2015) High performance computing on cluster and multicore architecture. Telkomnika (Telecommun Comput Electron Control) 13(4):1408–1413CrossRef

15.

Priyambodo TK, Lisan AW, Riasetiawan M (2018) Inexpensive green mini supercomputer based on single board computer cluster. J Telecommun Electron Comput Eng 10(1–6):141–145

16.

Sande Veiga V, Simon M, Azab A, Fernandez C, Muscianisi G, Fiameni G, Marocchi S (2019) Evaluation and benchmarking of singularity MPI containers on EU research e-infrastructure. In: 2019 IEEE/ACM International Workshop on Containers and New Orchestration Paradigms for Isolated Environments in HPC (CANOPIE-HPC), pp 1–10. https://doi.org/10.1109/CANOPIE-HPC49598.2019.00006

17.

Beserra D, Moreno ED, Endo PT, Barreto J, Sadok D, Fernandes S (2015) Performance analysis of LXC for HPC environments. In: 2015 Ninth International Conference on Complex, Intelligent, and Software Intensive Systems, pp 358–363. https://doi.org/10.1109/CISIS.2015.53

18.

Zhang J, Lu X, Panda DK (2016) High performance MPI library for container-based HPC cloud on InfiniBand clusters. In: 2016 45th International Conference on Parallel Processing (ICPP), pp 268–277. https://doi.org/10.1109/ICPP.2016.38

19.

Steffenel LA, Charão AS, da Silva Alves B (2019) A containerized tool to deploy scientific applications over SoC-based systems: the case of meteorological forecasting with WRF. In: Proceedings of the 9th International Conference on Cloud Computing and Services Science (CLOSER). SciTePress, Heraklion, Crete, pp 561–568. https://doi.org/10.5220/0007799705610568. INSTICC

20.

Steffenel LA, Charão AS, Alves B, de Araujo LR, da Silva LF (2020) MPI to go: container clusters for MPI applications. In: Ferguson D, Méndez Muñoz V, Pahl C, Helfert M (eds) Cloud computing and service science. Springer, Cham, pp 199–222CrossRef

21.

Fayos-Jordan R, Felici-Castell S, Segura-Garcia J, Pastor-Aparicio A, Lopez-Ballester J (2019) Elastic computing in the fog on Internet of Things to improve the performance of low cost nodes. Electronics 8(12):1489CrossRef

22.

Shirinbab S, Lundberg L, Casalicchio E (2020) Performance evaluation of containers and virtual machines when running cassandra workload concurrently. Concurr Comput Pract Exp 32(17):5693. https://doi.org/10.1002/cpe.5693CrossRef

23.

Richardson DP, Lin AC, Pecarina JM (2017) Hosting distributed databases on internet of things-scale devices. In: 2017 IEEE Conference on Dependable and Secure Computing, pp 352–357

24.

Da Silva LF, Lima JVF (2021) An evaluation of cassandra nosql database on a low-power cluster. In: 2021 International Symposium on Computer Architecture and High Performance Computing Workshops (SBAC-PADW), pp 9–14. https://doi.org/10.1109/SBAC-PADW53941.2021.00012

25.

Brewer EA (2000) Towards robust distributed systems (abstract). In: Proceedings of the Nineteenth Annual ACM Symposium on Principles of Distributed Computing. PODC ’00. ACM, New York, p 7. https://doi.org/10.1145/343477.343502

26.

Gilbert S, Lynch N (2002) Brewer’s conjecture and the feasibility of consistent, available, partition-tolerant web services. SIGACT News 33(2):51–59. https://doi.org/10.1145/564585.564601CrossRef

27.

Hadoop A (2022) Apache Hadoop. http://hadoop.apache.org/

28.

Redis Ltd (2022) Redis. https://redis.io/

29.

Brewer E (2012) Cap twelve years later: how the rules have changed. Computer 45(2):23–29. https://doi.org/10.1109/MC.2012.37CrossRef

30.

Lakshman A, Malik P (2010) Cassandra: a decentralized structured storage system. SIGOPS Oper Syst Rev 44(2):35–40. https://doi.org/10.1145/1773912.1773922CrossRef

31.

DeCandia G, Hastorun D, Jampani M, Kakulapati G, Lakshman A, Pilchin A, Sivasubramanian S, Vosshall P, Vogels W (2007) Dynamo: Amazon’s highly available key-value store. In: Proceedings of Twenty-First ACM SIGOPS Symposium on Operating Systems Principles. SOSP ’07. ACM, New York, pp 205–220. https://doi.org/10.1145/1294261.1294281

32.

Stonebraker M, Rowe LA, Hirohama M (1990) The implementation of postgres. IEEE Trans Knowl Data Eng 2(1):125–142. https://doi.org/10.1109/69.50912CrossRef

33.

Oracle Corporation: MySQL (2022). https://www.mysql.com/

34.

Cubukcu U, Erdogan O, Pathak S, Sannakkayala S, Slot M (2021) Citus: distributed postgresql for data-intensive applications. In: Proceedings of the 2021 International Conference on Management of Data. SIGMOD ’21. ACM, New York, pp 2490–2502. https://doi.org/10.1145/3448016.3457551

35.

Chang F, Dean J, Ghemawat S, Hsieh WC, Wallach DA, Burrows M, Chandra T, Fikes A, Gruber RE (2008) Bigtable: a distributed storage system for structured data. ACM Trans Comput Syst. https://doi.org/10.1145/1365815.1365816CrossRef

36.

Shvachko K, Kuang H, Radia S, Chansler R (2010) The hadoop distributed file system. In: MSST ’10. IEEE Computer Society, pp 1–10 (2010). https://doi.org/10.1109/MSST.2010.5496972

37.

Cassandra A (2020) Dynamo. https://cassandra.apache.org/doc/latest/architecture

38.

Docker: what is a Container? (2020). https://www.docker.com/resources/what-container

39.

Docker: Swarm mode overview (2020). https://docs.docker.com/engine/swarm/

40.

Docker: Swarm mode key concepts (2020). https://docs.docker.com/engine/swarm/key-concepts/

41.

Witte RS, Witte JS (2017) Statistics, 11th edn. Wiley, HobokenMATH

42.

Tang E, Fan Y (2016) Performance comparison between five NoSQL databases. In: 2016 7th International Conference on Cloud Computing and Big Data (CCBD), pp 105–109. https://doi.org/10.1109/CCBD.2016.030

43.

Datastax (2015) Benchmarking top NoSQL databases. Technical report, End Point Corporation

44.

Kuhlenkamp J, Klems M, Röss O (2014) Benchmarking scalability and elasticity of distributed database systems. Proc VLDB Endow 7(12):1219–1230. https://doi.org/10.14778/2732977.2732995CrossRef

45.

Huang X, Wang J, Zhong Y, Song S, Yu PS (2015) Optimizing data partition for scaling out NoSQL cluster. Concurr Comput Pract Exp 27(18):5793–5809. https://doi.org/10.1002/cpe.3643CrossRef

Titel: An evaluation of relational and NoSQL distributed databases on a low-power cluster
verfasst von: Lucas Ferreira da Silva
João V. F. Lima
Publikationsdatum: 23.03.2023
Verlag: Springer US
Erschienen in: The Journal of Supercomputing / Ausgabe 12/2023
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI: https://doi.org/10.1007/s11227-023-05166-7

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Springer Professional "Wirtschaft+Technik"

Weitere Artikel der Ausgabe 12/2023

Statistically aided Binary Multi-Objective Grey Wolf Optimizer: a new feature selection approach for classification

Model-based and model-free deep features fusion for high performed human gait recognition

GPU performance analysis for viscoacoustic wave equations using fast stencil computation from the symbolic specification

A secure lightweight mutual authentication scheme in Social Industrial IoT environment

Cooperative computation offloading combined with data compression in mobile edge computing system

Small unmanned helicopter modeling method based on a hybrid kernel function PSO-LSSVM

Premium Partner