skip to main content
10.1145/1375527.1375554acmconferencesArticle/Chapter ViewAbstractPublication PagesicsConference Proceedingsconference-collections
research-article

Evaluating the effect of replacing CNK with linux on the compute-nodes of blue gene/l

Authors Info & Claims
Published:07 June 2008Publication History

ABSTRACT

The Blue Gene machines in production today run a small single-user, single-process kernel (CNK) having a limited functionality. Motivated by the desire to provide applications with a much richer operating environment, we evaluate the effect of replacing CNK with a standard Linux kernel on the compute nodes of Blue Gene/L. We show that with a relatively small amount of effort we were able to improve benchmark performance under Linux up to a level that is comparable to CNK.

References

  1. The MPICH and MPICH2 homepage. http://www-unix.mcs.anl.gov/mpi/mpich.Google ScholarGoogle Scholar
  2. N. R. Adiga et al. An overview of the BlueGene/L supercomputer. In SC2002 -- High Performance Networking and Computing, Baltimore, MD, November 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. G. Alm--asi, R. Bellofatto, J. Brunheroto, C. Cascaval, J. G. Castanos, L. Ceze, P. Crumley, C. Erway, J. Gagliano, D. Lieber, X. Martorell, J. E. Moreira, A. Sanomiya, and K. Strauss. An overview of the BlueGene/L system software organization. In Proceedings of Euro-Par 2003 Conference, Lecture Notes in Computer Science, Klagenfurt, Austria, August 2003. Springer-Verlag.Google ScholarGoogle Scholar
  4. G. Alm--asi et al. The Design and Implementation of Message Passing Services for the BlueGene/L Supercomputer. IBM System Journal, 2004.Google ScholarGoogle Scholar
  5. Astron project homepage. http://astron.nl/.Google ScholarGoogle Scholar
  6. P. Beckman, K. Iskra, K. Yoshii, and S. Coghlan. The influence of operating systems on the performance of collective operations at extreme scale. In Proceedings of the 8th IEEE International Conference on Cluster Computing, Barcelona, Spain, Sept. 2006.Google ScholarGoogle ScholarCross RefCross Ref
  7. P. Beckman, K. Iskra, K. Yoshii, and S. Coghlan. Operating system issues for petascale systems. ACM SIGOPS Operating Systems Review, 40(2):29--33, Apr. 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Blue brain project homepage. http://bluebrain.epfl.ch/.Google ScholarGoogle Scholar
  9. R. Brightwell, L. A. Fisk, D. S. Greenberg, T. Hudson, M. Levenhagen, A. B. MacCabe, and R. Riesen. Massively parallel computing using commodity components. Parallel Comput., 26(2-3):243--266, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. R. Brightwell, A. B. Maccabe, and R. Riesen. On the appropriateness of commodity operating systems for large-scale, balanced computing systems. ipdps, 00:68a, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. R. Brightwell, R. Riesen, K. D. Underwood, T. Hudson, P. G. Bridges, and A. B. Maccabe. A performance comparison of linux and a lightweight kernel. In CLUSTER, pages 251--258, 2003.Google ScholarGoogle ScholarCross RefCross Ref
  12. S. Chakravorty, C. L. Mendes, L. V. Kal--e, T. Jones, A. Tauferner, T. Inglett, and J. Moreira. Hpc-colony: services and interfaces for very large systems. SIGOPS Oper. Syst. Rev., 40(2):43--49, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. J. Dongarra, H.-W. Meuer, and E. Strohmaier. TOP500 Supercomputer Sites. Available in Web page at: http://www.netlib.org/benchmark/top500.html.Google ScholarGoogle Scholar
  14. Francois Gygi et al. Large-scale electronic structure calculations of high-z metals on the bluegene/l platform. Gordon Bell prize winner at Supercomputing 2006, Tampa FL. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. FUSE Homepage. http://fuse.sourceforge.net/.Google ScholarGoogle Scholar
  16. T. G. Mattson, D. Scott, and S. R. Wheat. A tera flop supercomputer in 1996: The ASCI t flop system. In IPPS '96: Proceedings of the 10th International Parallel Processing Symposium, pages 84--93, Washington, DC, USA, 1996. IEEE Computer Society. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. J. Navarro, S. Iyer, P. Druschel, and A. Cox. Practical, transparent operating system support for superpages. SIGOPS Oper. Syst. Rev., 36(SI):89--104, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. NAS Parallel Benchmarks. http://www.nas.nasa.gov/Software/NPB.Google ScholarGoogle Scholar
  19. F. Petrini, D. J. Kerbyson, and S. Pakin. The case of the missing supercomputer performance: Achieving optimal performance on the 8,192 processors of ASCI Q. In SC '03: Proceedings of the 2003 ACM/IEEE conference on Supercomputing, page 55, Washington, DC, USA, 2003. IEEE Computer Society. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Evaluating the effect of replacing CNK with linux on the compute-nodes of blue gene/l

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        ICS '08: Proceedings of the 22nd annual international conference on Supercomputing
        June 2008
        390 pages
        ISBN:9781605581583
        DOI:10.1145/1375527

        Copyright © 2008 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 7 June 2008

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        Overall Acceptance Rate584of2,055submissions,28%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader