Kieran Evans
Zhiming Zhao
ABSTRACT
Cloud-based applications that depend on time-critical data processing or network throughput require the capability of reconfiguring their infrastructure on demand as and when conditions change. Although the ability to apply quality of service constraints on the current Cloud offering is limited, there are ongoing efforts to change this. One such effort is the European funded SWITCH project that aims to provide a programming model and toolkit to help programmers specify quality of service and quality of experience metrics of their distributed application and to provide the means to specify the reconfiguration actions which can be taken to maintain these requirements. In this paper, we present an approach to application reconfiguration by applying a workflow methodology to implement a prototype involving multiple reconfiguration scenarios of a distributed real-time social media analysis application, called Sentinel. We show that by using a lightweight RPC-based workflow approach, we can monitor a live application in real time and spawn dependency-based workflows to reconfigure the underlying Docker containers that implement the distributed components of the application. We propose to use this prototype as the basis for part of the SWITCH workbench, which will support more advanced programmable infrastructures.
- E. Deelman, D. Gannon, M. Shields, and I. Taylor, "Workflows and e-Science: An overview of workflow system features and capabilities," Future Generation Computer Systems, vol. 25, pp. 528--540, 2009. Google Scholar
Digital Library
- S. Gesing, M. Atkinson, R. Filgueira, I. Taylor, A. Jones, V. Stankovski, et al., "Workflows in a dashboard: a new generation of usability," in Workflows in Support of Large-Scale Science (WORKS), 2014 9th Workshop on, 2014, pp. 82--93. Google ScholarDigital Library
- C. Roberts, M. Innes, A. Preece, and I. Spasic, "Soft facts and spontaneous community mobilisation: the role of rumour after major crime events," Data for Good: How big and open data can be used for the common good, P. Baeck, ed, pp. 37--43, 2015.Google Scholar
- Z. Zhao, C. Dumitru, P. Grosso, and C. De Laat, "Network resource control for data intensive applications in heterogeneous infrastructures," in Parallel and Distributed Processing Symposium Workshops & PhD Forum (IPDPSW), 2012 IEEE 26th International, 2012, pp. 2069--2076. Google ScholarDigital Library
- K. Wolstencroft, R. Haines, D. Fellows, A. Williams, D. Withers, S. Owen, et al., "The Taverna workflow suite: designing and executing workflows of Web Services on the desktop, web or in the cloud," Nucleic acids research, p. gkt328, 2013.Google Scholar
- I. Taylor, M. Shields, I. Wang, and A. Harrison, "The triana workflow environment: Architecture and applications," in Workflows for e-Science, ed: Springer, 2007, pp. 320--339.Google Scholar
- E. Deelman, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, S. Patil, et al., "Pegasus: Mapping scientific workflows onto the grid," in Grid Computing, 2004, pp. 11--20.Google ScholarCross Ref
- M. Wieczorek, R. Prodan, and T. Fahringer, "Scheduling of scientific workflows in the ASKALON grid environment," ACM SIGMOD Record, vol. 34, pp. 56--62, 2005. Google ScholarDigital Library
- T. Glatard, J. Montagnat, D. Lingrand, and X. Pennec, "Flexible and efficient workflow deployment of data-intensive applications on grids with MOTEUR," International Journal of High Performance Computing Applications, vol. 22, pp. 347--360, 2008. Google ScholarDigital Library
- D. Meyer, "The software-defined-networking research group," Internet Computing, IEEE, vol. 17, pp. 84--87, 2013. Google ScholarDigital Library
- M. Ghijsen, J. Van Der Ham, P. Grosso, C. Dumitru, H. Zhu, Z. Zhao, et al., "A semantic-web approach for modeling computing infrastructures," Computers & Electrical Engineering, vol. 39, pp. 2553--2565, 2013. Google ScholarDigital Library
- W. Dong, Y. Liu, C. Chen, J. Bu, C. Huang, and Z. Zhao, "R2: Incremental reprogramming using relocatable code in networked embedded systems," Computers, IEEE Transactions on, vol. 62, pp. 1837--1849, 2013. Google ScholarDigital Library
- H. Jin, D. Pan, J. Liu, and N. Pissinou, "OpenFlow-Based Flow-Level Bandwidth Provisioning for CICQ Switches," Computers, IEEE Transactions on, vol. 62, pp. 1799--1812, 2013. Google ScholarDigital Library
- C. Muller, M. Oriol, X. Franch, J. Marco, M. Resinas, A. Ruiz-Cortés, et al., "Comprehensive explanation of SLA violations at runtime," Services Computing, IEEE Transactions on, vol. 7, pp. 168--183, 2014.Google ScholarCross Ref
- A.-F. Antonescu, A.-M. Oprescu, Y. Demchenko, C. De Laat, and T. Braun, "Dynamic optimization of SLA-based services scaling rules," in Cloud Computing Technology and Science (CloudCom), 2013 IEEE 5th International Conference on, 2013, pp. 282--289. Google ScholarDigital Library
- I. Spasić, M. Greenwood, A. Preece, N. Francis, and G. Elwyn, "FlexiTerm: a flexible term recognition method," Journal of biomedical semantics, vol. 4, p. 27, 2013.Google ScholarCross Ref
- A. Ochian, G. Suciu, O. Fratu, and V. Suciu, "Big data search for environmental telemetry," in Communications and Networking (BlackSeaCom), 2014 IEEE International Black Sea Conference on, 2014, pp. 182--184.Google Scholar
Index Terms
- Dynamically reconfigurable workflows for time-critical applications
Recommendations
Constructing distributed time-critical applications using cognitive enabled services
AbstractTime-critical analytics applications are increasingly making use of distributed service interfaces (e.g., micro-services) that support the rapid construction of new applications by dynamically linking the services into different ...
Highlights- An Architecture for decentralized construction and control of time critical applications.
Pipeline Reconfigurable DSP for Dynamically Reconfigurable Architectures
Dynamically reconfigurable architectures, such as NATURE, achieve high logic density and low reconfiguration latency compared to traditional field-programmable gate arrays. Unlike fine-grained NATURE, reconfigurable DSP block incorporated NATURE ...
HW/SW codesign techniques for dynamically reconfigurable architectures
Hardward/software (HW/SW) codesign and reconfigurable computing are commonly used methodologies for digital-systems design. However, no previous work has been carried out in order to define a HW/SW codesign methodology with dynamic scheduling for run-...
Comments