ABSTRACT
LOFAR is the first of a new generation of radio telescopes, that combines the signals from many thousands of simple, fixed antennas, rather than from expensive dishes. Its revolutionary design and unprecedented size enables observations in a frequency range that could hardly be observed before, and allows the study of a vast amount of new science cases.In this paper, we describe a novel approach to process realtime, streaming telescope data in software, using a supercomputer. The desire for a flexible and reconfigurable instrument demands a software solution, where traditionally customized hardware was used. This, and LOFAR's exceptional real-time, streaming signalprocessing requirements compel the use of a supercomputer. We focus on the LOFAR CEntral Processing facility (CEP), that combines the signals of all LOFAR stations. CEP consists of a 12,288-core IBM Blue Gene/L supercomputer, embedded in several conventional clusters.We describe a highly optimized implementation that will do the bulk of the central signal processing on the Blue Gene/L, namely PolyPhase Filtering, Delay Compensation, and Correlation. Measurements show that we reach exceptionally high computational performance (up to 98% of the theoretical floating-point peak performance). We also discuss how we handle external I/O performance limitations into and out of the Blue Gene/L, to obtain sufficient bandwidth for LOFAR.
- H.R. Butcher. LOFAR: First of a New Generation of Radio Telescopes. Proceedings of the SPIE, 5489:537--544, October 2004.Google ScholarCross Ref
- A.G. de Bruyn, R.P. Fender, J.M.E. Kuijpers, G.K. Miley, R. Ramachandran, H.J.A. Röttgering, B.W. Stappers, M.A.M. van de Weygaert, and M.P. van Haarlem. Exploring the Universe with the Low Frequency Array, A Scientific Case, September 2002. http://www.lofar.org/PDF/NL-CASE-1.0.pdf.Google Scholar
- J. Lorenz, S. Kral, F. Franchetti, and C.W. Ueberhuber. Vectorization Techniques for the Blue Gene/L Double FPU. IBM Journal of Research and Development, 49(2/3):437--446, March 2005. Google ScholarDigital Library
- C. Phillips, T. Tzioumis, A. Deller, S. Tingay, C. Harris, and K. Haines. Electronic Transmission and Computation of Very Long Baseline Interferometry and Its Application to Next Generation Radio Telescopes. Poster in the first IEEE International Conference on e-Science and Grid Computing, December 2005.Google Scholar
- J.J. Ritsko, I. Ames, S.I. Raider, and J.H. Robinson, editors. Blue Gene, volume 49, number 2/3 of IBM Journal of Research and Development. IBM Corporation, March/May 2005.Google Scholar
- K. van der Schaaf, C. Broekema, G. van Diepen, and E. van Meijeren. The LOFAR Central Processing Facility Architecture. Experimental Astronomy, 17:43--58, 2005.Google Scholar
- C.M. de Vos, K. van der Schaaf, and J.D. Bregman. Cluster Computers and Grid Processing in the First Radio-Telescope of a New Generation. In IEEE International Symposium on Cluster Computing and the Grid (CCGRID), pages 156--160, May 2001. Google ScholarDigital Library
- Private discussions with people from the Joint Institute for VLBI in Europe, March 2006.Google Scholar
Index Terms
- Astronomical real-time streaming signal processing on a Blue Gene/L supercomputer
Recommendations
The LOFAR correlator: implementation and performance analysis
PPoPP '10LOFAR is the first of a new generation of radio telescopes.Rather than using expensive dishes, it forms a distributed sensor network that combines the signals from many thousands of simple antennas. Its revolutionary design allows observations in a ...
The LOFAR correlator: implementation and performance analysis
PPoPP '10: Proceedings of the 15th ACM SIGPLAN Symposium on Principles and Practice of Parallel ProgrammingLOFAR is the first of a new generation of radio telescopes.Rather than using expensive dishes, it forms a distributed sensor network that combines the signals from many thousands of simple antennas. Its revolutionary design allows observations in a ...
(Near-)real-time orbit determination for GNSS radio occultation processing
The processing of GPS radio occultation measurements for use in numerical weather predictions requires a precise orbit determination (POD) of the host satellite in near-real-time. Making use of data from the GRAS instrument on Metop-A, the performance ...
Comments