Optimising NGAS for the MWA Archive

Chen Wu; Andreas Wicenec; D. Pallot; Alessio Checcucci

doi:10.1007/s10686-013-9354-1

Optimising NGAS for the MWA Archive

Chen Wu, Andreas Wicenec, D. Pallot, Alessio Checcucci

Research output: Contribution to journal › Article › peer-review

16 Citations (Web of Science)

Abstract

The Murchison Widefield Array (MWA) is a next-generation radio telescope, generating visibility data products continuously at about 400 MB/s. Efficiently managing and archiving this data is a challenge. The MWA Archive consists of dataflows and storage sub-systems distributed across three tiers. At its core is the open source software-the Next-Generation Archive System (NGAS)-that was initially developed in ESO. However, to meet the MWA data challenge, we have tailored and optimised NGAS to achieve high-throughput data ingestion, efficient data flow management, multi-tiered data storage and processing-aware data staging. © 2013 Springer Science+Business Media Dordrecht.

Original language	English
Pages (from-to)	679-694
Journal	EXPERIMENTAL ASTRONOMY: AN INTERNATIONAL JOURNAL ON ASTRONOMICAL INSTRUMENTATION & DATA ANALYSIS
Volume	36
Issue number	3
DOIs	https://doi.org/10.1007/s10686-013-9354-1
Publication status	Published - 2013

Access to Document

10.1007/s10686-013-9354-1

Cite this

@article{4b01ec9960ba4b6599679492011118e0,

title = "Optimising NGAS for the MWA Archive",

abstract = "The Murchison Widefield Array (MWA) is a next-generation radio telescope, generating visibility data products continuously at about 400 MB/s. Efficiently managing and archiving this data is a challenge. The MWA Archive consists of dataflows and storage sub-systems distributed across three tiers. At its core is the open source software-the Next-Generation Archive System (NGAS)-that was initially developed in ESO. However, to meet the MWA data challenge, we have tailored and optimised NGAS to achieve high-throughput data ingestion, efficient data flow management, multi-tiered data storage and processing-aware data staging. {\textcopyright} 2013 Springer Science+Business Media Dordrecht.",

author = "Chen Wu and Andreas Wicenec and D. Pallot and Alessio Checcucci",

year = "2013",

doi = "10.1007/s10686-013-9354-1",

language = "English",

volume = "36",

pages = "679--694",

journal = "Experimental Astronomy",

issn = "0922-6435",

publisher = "Springer",

number = "3",

}

TY - JOUR

T1 - Optimising NGAS for the MWA Archive

AU - Wu, Chen

AU - Wicenec, Andreas

AU - Pallot, D.

AU - Checcucci, Alessio

PY - 2013

Y1 - 2013

N2 - The Murchison Widefield Array (MWA) is a next-generation radio telescope, generating visibility data products continuously at about 400 MB/s. Efficiently managing and archiving this data is a challenge. The MWA Archive consists of dataflows and storage sub-systems distributed across three tiers. At its core is the open source software-the Next-Generation Archive System (NGAS)-that was initially developed in ESO. However, to meet the MWA data challenge, we have tailored and optimised NGAS to achieve high-throughput data ingestion, efficient data flow management, multi-tiered data storage and processing-aware data staging. © 2013 Springer Science+Business Media Dordrecht.

AB - The Murchison Widefield Array (MWA) is a next-generation radio telescope, generating visibility data products continuously at about 400 MB/s. Efficiently managing and archiving this data is a challenge. The MWA Archive consists of dataflows and storage sub-systems distributed across three tiers. At its core is the open source software-the Next-Generation Archive System (NGAS)-that was initially developed in ESO. However, to meet the MWA data challenge, we have tailored and optimised NGAS to achieve high-throughput data ingestion, efficient data flow management, multi-tiered data storage and processing-aware data staging. © 2013 Springer Science+Business Media Dordrecht.

U2 - 10.1007/s10686-013-9354-1

DO - 10.1007/s10686-013-9354-1

M3 - Article

VL - 36

SP - 679

EP - 694

JO - Experimental Astronomy

JF - Experimental Astronomy

SN - 0922-6435

IS - 3

ER -

Optimising NGAS for the MWA Archive

Abstract

Access to Document

Fingerprint

Cite this