ABSTRACT
This paper presents a scheme to optimize the mapping of HPC applications to a set of hybrid dedicated and cloud resources. First, we characterize application performance on dedicated clusters and cloud to obtain application signatures. Then, we propose an algorithm to match these signatures to resources such that performance is maximized and cost is minimized. Finally, we show simulation results revealing that in a concrete scenario our proposed scheme reduces the cost by 60% at only 10-15% performance penalty vs. a non optimized configuration. We also find that the execution overhead in cloud can be minimized to a negligible level using thin hypervisors or OS-level containers.
- NPB. http://www.nas.nasa.gov/Resources/Software/npb.html.Google Scholar
- Magellan Final Report. Technical report, U.S. Department of Energy (DOE), 2011.Google Scholar
- Exploring the Performance and Mapping of HPC Applications to Platforms in the Cloud. Technical report, HP Labs, 2012.Google Scholar
- A. Bhatele et al. Overcoming scaling challenges in biomolecular simulations across multiple platforms. In IPDPS 2008.Google Scholar
- A. Gupta and D. Milojicic. Evaluation of HPC Applications on Cloud. In Best Student Paper, Open Cirrus Summit, 2011. Google ScholarDigital Library
- E. Walker. Benchmarking Amazon EC2 for high-performance scientific computing. LOGIN, 2008.Google Scholar
Index Terms
- Exploring the performance and mapping of HPC applications to platforms in the cloud
Recommendations
Optimizing VM placement for HPC in the cloud
FederatedClouds '12: Proceedings of the 2012 workshop on Cloud services, federation, and the 8th open cirrus summitComputing as a service model in cloud has encouraged High Performance Computing to reach out to wider scientific and industrial community. Many small and medium scale HPC users are exploring Infrastructure cloud as a possible platform to run their ...
Towards Efficient Mapping, Scheduling, and Execution of HPC Applications on Platforms in Cloud
IPDPSW '13: Proceedings of the 2013 IEEE 27th International Symposium on Parallel and Distributed Processing Workshops and PhD ForumThe advantages of pay-as-you-go model, elasticity, and the flexibility and customization offered by virtualization make cloud computing an attractive option for meeting the needs of some High Performance Computing (HPC) users. However, there is a ...
Improving HPC application performance in cloud through dynamic load balancing
CCGRID '13: Proceedings of the 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid ComputingDriven by the benefits of elasticity and pay-as-you-go model, cloud computing is emerging as an attractive alternative and addition to in-house clusters and supercomputers for some High Performance Computing (HPC) applications. However, poor ...
Comments