The LOFAR long-term archive: e-infrastructure on petabyte scale

Hanno Holties; Adriaan Renting; Yan Grange

doi:10.1117/12.927147

24 September 2012 The LOFAR long-term archive: e-infrastructure on petabyte scale

Hanno Holties, Adriaan Renting, Yan Grange

Proceedings Volume 8451, Software and Cyberinfrastructure for Astronomy II; 845117 (2012) https://doi.org/10.1117/12.927147
Event: SPIE Astronomical Telescopes + Instrumentation, 2012, Amsterdam, Netherlands

Abstract

The Low Frequency Array (LOFAR) is a large distributed radio telescope that observes at frequencies from 10 MHz to 240 MHz. LOFAR combines phased array antenna stations in Germany, the UK, France, and Sweden with forty stations in the Netherlands. The archive of science data products is expected to grow by five petabyte per year. The LOFAR long-term archive (LTA) provides an e-Infrastructure for the storage, distribution, and analysis of the science data produced by LOFAR. It builds on national and international e-Infrastructure on a European scale pioneering the international cyber-infrastructures of the future such as needed for e.g. the Square Kilometer Array. For astronomers, the LOFAR LTA is the principal interface not only to LOFAR data retrieval and data mining but also to processing facilities for this data. Each site involved in the LTA provides storage capacity and optionally processing capabilities. To allow collaboration with a variety of institutes and projects, the LOFAR LTA merges different technologies (EGI, global file systems, Astro-WISE dataservers). For its connectivity it utilizes the national research networks and explores new technologies for high bandwidth on demand and long distance data streaming. A centrally operated catalogue provides a searchable database for scientific products stored in the LTA from raw visibilities to calibrated images and derived source lists. The user administration synchronizes accounts across the LTA and is designed to connect to federated infrastructures. For its data analysis capabilities it builds on the data processing frameworks provided by EGI and Astro-WISE.

Citation Download Citation

Hanno Holties, Adriaan Renting, and Yan Grange "The LOFAR long-term archive: e-infrastructure on petabyte scale", Proc. SPIE 8451, Software and Cyberinfrastructure for Astronomy II, 845117 (24 September 2012); https://doi.org/10.1117/12.927147

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available