Omer Khalid
ABSTRACT
The primary motivation for uptake of virtualization have been resource isolation, capacity management and resource customization: isolation and capacity management allow providers to isolate users from the site and control their resources usage while customization allows end-users to easily project the required environment onto a variety of sites. Various approaches have been taken to integrate virtualization with Grid technologies. In this paper, we propose an approach that combines virtualization on the existing software infrastructure such as Pilot Jobs with minimum change on the part of resource providers. We also present a standard API to enable a wider set of applications including Batch systems to deploy virtual machines on-demand as isolated job sandboxes. To illustrate the usefulness of this approach, we also evaluate the impact of Xen virtualization on memory and compute intensive tasks, and present our results that how memory and scheduling parameters could be tweaked to optimize job performance.
- Xen Source, Virtualization Hypervisor, http://www.xensource.com.Google Scholar
- Foster, I., Kesselman, C. The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann, San Francisco. 1999. Google ScholarDigital Library
- Braham P., Dragovic B., Fraser K., Hand S., Haris T., Ho A., Neugebauer R., Pratt I., and Warfield A. Xen and the art of virtualization, Proceedings of the nineteenth ACM symposium on Operating systems principles, SOSP, pages 164--177, ACM Press. 2003. Google ScholarDigital Library
- Steinder, M. Whalley, I.; Carrera, D. Gaweda, I. Chess, D. Server virtualization in autonomic management of heterogeneous workloads. Integrated Network Management, 2007. IM '07. 10th IFIP/IEEE International Symposium, vol., no., pp.139--148, May 21 2007-Yearly 25.Google ScholarCross Ref
- Emeneker W., Stanzione D. Dynamic Virtual Clustering. IEEE International Conference on Cluster Computing 2007. Google ScholarDigital Library
- Santhanam S., Elango P., Arpaci-Dusseau A., and Livny M. Deploying Virtual Machines as Sandboxes for the Grid. WORLDS 2005, San Francisco, CA, December, 2004. Google ScholarDigital Library
- Emeneker W., Stanzione D. Efficient Virtual Machine Caching in Dynamic Virtual Clusters. IEEE Cluster, 2007. Google ScholarDigital Library
- Uhlig R. et al, Intel Virtualization Technology, IEEE Computer Society Journal, 2005. Google ScholarDigital Library
- Rosenblum M. and Garfinkel T. Virtual Machine Monitors: Current Technology and Future Trends. IEEE Computer Society Journal, 2005. Google ScholarDigital Library
- Denemark J., Ruda M., Matyska L. Virtualizing Meta Centre Resources Using Magrathea, IEEE, 2007.Google Scholar
- Khalid O., Koeckerbauer T., Shiyachki D., Unterkircher A., Schulz M. The VGrid Project. EGEE'07 Conference Poster, 2007.Google Scholar
- Khalid O., Nilsson P., Schulz M., Keahey K. Enabling Virtual PanDa Pilot for ATLAS. EGEE'08 Conference Poster, 2008.Google Scholar
- Rubio-Montero A.J., Huedo E., Montero R.S., Llorente I.M. Management of Virtual Machines on Globus Grids Using GridWay. Parallel and Distributed Processing Symposium, IPDPS, 2007.Google Scholar
- Fontán J., Vázquez T., Gonzalez L., Montero R. S. and Llorente I. M. OpenNEbula: The Open Source Virtual Machine Manager for Cluster Computing. Open Source Grid and Cluster Software Conference, May 2008, San Francisco, U.S.A. 2008.Google Scholar
- Keahey K., Freeman T., Lauret J., Olson D. Virtual Workspaces for Scientific Applications. SciDAC 2007 Conference, Boston, MA, 2007.Google Scholar
- Freeman, T., Keahey K. Flying Low: Simple Leases with Workspace Pilot. ACM/IEEE Euro--Par 2008, Las Palmas de Gran Canaria, Spain, 2008. Google ScholarDigital Library
- Fraser K., Hand S., Harris T., Leslie I. M., and Pratt I. The Xenoserver Computing Infrastructure: a Project Overview. Technical Report, 2002.Google Scholar
- Kiyanclar N., Koenig G. A., and Yurcik W. Maestro-VC: On-Demand Secure Cluster Computing Using Virtualization. In 7th LCI International Conference on Linux Clusters, 2006.Google Scholar
- Xu J., Adabala S., Fortes, J.A.B. Towards Autonomic Virtual Applications in the In--VIGO System. Autonomic Computing, 2005. ICAC 2005. Proceedings. Second International Conference on Autonomous Computing, vol., no., pp.15--26, 13-16 June, 2005. Google ScholarDigital Library
- Tadashi M., ATLAS Collaboration, PanDA: Distributed production and distributed analysis system for ATLAS. 2008. 4pp. Published in J. Phys. Conf. Ser. 119: 062036, 2008.Google Scholar
- G. Aad et al, ATLAS Collaboration. The ATLAS Experiment at the CERN Large Hadron Collider. 437 pp. Published in JINST 3: S08003, 2008.Google ScholarCross Ref
- Nilsson P, ATLAS Collaboration. Experience from a pilot based system for ATLAS. 6pp. Published in J. Phys. Conf. Ser. 119: 062038, 2008.Google ScholarCross Ref
- Figueiredo, R., P. Dinda, and J. Fortes. A Case for Grid Computing on Virtual Machines. In 23rd International Conference on Distributed Computing Systems. 2003. Google ScholarDigital Library
- Keahey, K., K. Doering, and I. Foster. From Sandbox to Playground: Dynamic Virtual Environments in the Grid. In 5th International Workshop in Grid Computing. 2004. Google ScholarDigital Library
- Platform Computing, http://www.platform.com/Google Scholar
- Torque, http://www.clusterresources.com/Google Scholar
- Condor, http://www.cs. wisc.edu/condor/Google Scholar
- gLite Middleware, http://www.glite.orgGoogle Scholar
- Globus Grid Alliance, http://www.globus.org/Google Scholar
Index Terms
- Enabling and optimizing pilot jobs using xen based virtual machines for the HPC grid applications
Recommendations
Dynamic scheduling of virtual machines running HPC workloads in scientific grids
NTMS'09: Proceedings of the 3rd international conference on New technologies, mobility and securityThe primary motivation for uptake of virtualization has been resource isolation, capacity management and resource customization allowing resource providers to consolidate their resources in virtual machines. Various approaches have been taken to ...
Enabling Instantaneous Relocation of Virtual Machines with a Lightweight VMM Extension
CCGRID '10: Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid ComputingWe are developing an efficient resource management system with aggressive virtual machine (VM) relocation among physical nodes in a data center. Existing live migration technology, however, requires a long time to change the execution host of a VM, it ...
Deadline Aware Virtual Machine Scheduler for Grid and Cloud Computing
WAINA '10: Proceedings of the 2010 IEEE 24th International Conference on Advanced Information Networking and Applications WorkshopsVirtualization technology has enabled applications to be decoupled from the underlying hardware providing the benefits of portability, better control over execution environment and isolation. It has been widely adopted in scientific grids and commercial ...
Comments