Top

Information Systems Frontiers

Published in:

14-04-2018

Quantitative Analysis of Apache Storm Applications: The NewsAsset Case Study

Authors: José I. Requeno, José Merseguer, Simona Bernardi, Diego Perez-Palacin, Giorgos Giotis, Vasilis Papanikolaou

Published in: Information Systems Frontiers | Issue 1/2019

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

The development of Information Systems today faces the era of Big Data. Large volumes of information need to be processed in real-time, for example, for Facebook or Twitter analysis. This paper addresses the redesign of NewsAsset, a commercial product that helps journalists by providing services, which analyzes millions of media items from the social network in real-time. Technologies like Apache Storm can help enormously in this context. We have quantitatively analyzed the new design of NewsAsset to assess whether the introduction of Apache Storm can meet the demanding performance requirements of this media product. Our assessment approach, guided by the Unified Modeling Language (UML), takes advantage, for performance analysis, of the software designs already used for development. In addition, we converted UML into a domain-specific modeling language (DSML) for Apache Storm, thus creating a profile for Storm. Later, we transformed said DSML into an appropriate language for performance evaluation, specifically, stochastic Petri nets. The assessment ended with a successful software design that certainly met the scalability requirements of NewsAsset.

previous article Verification of Model Transformations Using Isabelle/HOL and Scala

next article Integrated Synthesis and Execution of Optimal Plans for Multi-Robot Systems in Logistics

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Available only for authorised users

Domain Specific Modeling Language.

Small and medium-sized enterprise.

Modelling and Analysis of Real Time and Embedded Systems (OMG 2011a).

Dependability Modelling and Analysis (Bernardi et al. 2011).

The Student t-distribution with \(N-1 = 21\) degrees of freedom has been used.

Figure 7 does not show the utilizations of the bolts that are below \(5\%\).

Apache. (2017a). Apache Storm Website. http://storm.apache.org/.

Apache. (2017b). Apache Zookeeper Website. https://zookeeper.apache.org/.

Ardagna, D., & et al. (2016). Modeling performance of Hadoop applications: a journey from queueing networks to stochastic well formed nets. In Carretero, J., & et al. (Eds.) Proceedings of the 16th Int. Conf. on algorithms and architectures for parallel processing. ISBN 978-3-319-49583-5 (pp. 599–613). Cham: Springer.

ATC. (2018). Athens technology center Website. https://www.atc.gr/default.aspx?page=home.

Avizienis, A., Laprie, J.-C., Randell, B., Landwehr, C.E. (2004). Basic concepts and taxonomy of dependable and secure computing. IEEE Transactions on Dependable and Secure Computing, 1(1), 11–33. https://doi.org/10.1109/TDSC.2004.2.CrossRef

Bernardi, S., Merseguer, J., Petriu, D.C. (2011). A dependability profile within MARTE. Software &, Systems Modeling, 10(3), 313–336.CrossRef

Chiola, G., Marsan, M.A., Balbo, G., Conte, G. (1993). Generalized stochastic Petri nets: a definition at the net level and its implications. IEEE Transactions on Software Engineering, 19(2), 89–107.CrossRef

DICE Consortium. (2016). Requirement Specification. Technical report, European Union’s Horizon 2020 research and innovation program. http://wp.doc.ic.ac.uk/dice-h2020/wp-content/uploads/sites/75/2015/08/D1.2_Requirement-specification.pdf.

DICE Consortium. (2016). Storm profile. https://github.com/dice-project/DICE-Profiles.

DICE Consortium. (2017). DICE Simulation tool. https://github.com/dice-project/DICE-Simulation/.

Dipartimento di informatica, Università di Torino. (2015). GRaphical Editor and Analyzer for Timed and Stochastic Petri Nets. http://www.di.unito.it/greatspn/index.html.

Diplaris, S., & et al. (2012). SocialSensor: sensing user generated input for improved media discovery and experience. In Proceedings of the 21st international conference on World Wide Web (pp. 243–246). ACM.

Flexiant. (2017). Flexiant cloud orchestator Website. https://www.flexiant.com/.

Gianniti, E., & et al. (2017). Fluid Petri nets for the performance evaluation of MapReduce and Spark applications. ACM SIGMETRICS Performance Evaluation Review, 44(4), 23–36.CrossRef

ISO. (2008). Systems and software engineering – High-level Petri nets – Part 2: Transfer format. ISO/IEC 159092:2011. Geneva: International Organization for Standardization.

Kroß, J., Brunnert, A., Krcmar, H. (2015). Modeling big data systems by extending the Palladio component model. Softwaretechnik-Trends, 35(3), 1–3.

Kroß, J., & Krcmar, H. (2016). Modeling and simulating Apache Spark streaming applications. Softwaretechnik-Trends, 36(4), 1–3.

Lagarde, F., Espinoza, H., Terrier, F., Gérard, S. (2007). Improving UML profile design practices by leveraging conceptual domain models. In Kurt Stirewalt, RE, Egyed, A., Fischer, B. (Eds.) Proceeedins of the 22nd IEEE/ACM international conference on automated software engineering (ASE 2007) (pp. 445–448). Atlanta : ACM.

Law Averill, M. (2015). Simulation modeling and analysis. McGraw-Hill.

Marsan, M.A., Balbo, G., Conte, G., Donatelli, S., Franceschinis, G. (1994). Modelling with generalized stochastic Petri nets, 1st edn. New York: John Wiley & Sons, Inc.

Nalepa, F., Batko, M., Zezula, P. (2015a). Model for performance analysis of distributed stream processing applications. In Proceedings of the 20th international conference on database and expert systems applications (pp. 520–533). Springer.

Nalepa, F., Batko, M., Zezula, P. (2015b). Performance analysis of distributed stream processing applications through colored Petri nets. In Proceedings of the 10th international doctoral workshop on mathematical and engineering methods in computer science (pp. 93–106). Springer.

OMG. (2011a). UML Profile for MARTE: Modeling and Analysis of Real-time Embedded Systems, Version 1.1. http://www.omg.org/spec/MARTE/1.1/.

OMG. (2011b). Meta object facility (MOF) 2.0 Query/View/ Transformation specification, version 1.1. http://www.omg.org/spec/QVT/1.1/.

Rak, T. (2015). Response time analysis of distributed web systems using QPNs. Mathematical Problems in Engineering, 2015, Article ID 490835, 10. https://doi.org/10.1155/2015/490835.

Ranjan, R. (2014). Modeling and simulation in performance optimization of big data processing frameworks. IEEE Cloud Computing, 1(4), 14–19.CrossRef

Requeno, J.I., Merseguer, J., Bernardi, S. (2017). Performance analysis of Apache Storm applications using stochastic Petri nets. In Proceedings of the 5th international workshop on formal methods integration.

Samolej, S., & Rak, T. (2009). Simulation and performance analysis of distributed internet systems using TCPNs. Informatica, 33(4), 405–415.

Selic, B. (2007). A systematic approach to domain-specific language design using UML. In Proceedings of the 10th IEEE international symposium on object-oriented real-time distributed computing (pp. 2–9). IEEE Computer Society.

Singhal, R., & Verma, A. (2016). Predicting job completion time in heterogeneous MapReduce environments. In Proceedings of the 30th IEEE international parallel and distributed processing symposium workshops (pp. 17–27). IEEE.

Wang, K., & Khan, M.M.H. (2015). Performance prediction for Apache Spark platform. In 2015 IEEE 17th international conference on high performance computing and communications (HPCC), 2015 IEEE 7th international symposium on cyberspace safety and security (CSS), and 2015 IEEE 12th international conferen on embedded software and systems (ICESS) (pp. 166–173). IEEE.

Zimmermann, A. (2017). Modelling and performance evaluation with TimeNET 4.4 (pp. 300–303). Cham: Springer International Publishing.

Title: Quantitative Analysis of Apache Storm Applications: The NewsAsset Case Study
Authors: José I. Requeno
José Merseguer
Simona Bernardi
Diego Perez-Palacin
Giorgos Giotis
Vasilis Papanikolaou
Publication date: 14-04-2018
Publisher: Springer US
Published in: Information Systems Frontiers / Issue 1/2019
Print ISSN: 1387-3326
Electronic ISSN: 1572-9419
DOI: https://doi.org/10.1007/s10796-018-9851-x

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Other articles of this Issue 1/2019

Discovering composable web services using functional semantics and service dependencies based on natural language requests

Extracting Knowledge from Technical Reports for the Valuation of West Texas Intermediate Crude Oil Futures

Schema Extraction for Deep Web Query Interfaces Using Heuristics Rules

Generalized Feature Embedding for Supervised, Unsupervised, and Online Learning Tasks

An information integration and transmission model of multi-source data for product quality and safety

Towards a Reuse Strategic Decision Pattern Framework – from Theories to Practices

Premium Partner