TY - JOUR
T1 - Sofia 2 - An automated, parallel H i source finding pipeline for the WALLABY survey
AU - Westmeier, T.
AU - Kitaeff, S.
AU - Pallot, D.
AU - Serra, P.
AU - Van Der Hulst, J. M.
AU - Jurek, R. J.
AU - Elagali, A.
AU - For, B. Q.
AU - Kleiner, D.
AU - Koribalski, B. S.
AU - Lee-Waddell, K.
AU - Mould, J. R.
AU - Reynolds, T. N.
AU - Rhee, J.
AU - Staveley-Smith, L.
PY - 2021/9/1
Y1 - 2021/9/1
N2 - We present sofia 2, the fully automated 3D source finding pipeline for the WALLABY extragalactic H i survey with the Australian SKA Pathfinder (ASKAP). sofia 2 is a reimplementation of parts of the original sofia pipeline in the c programming language and makes use of OpenMP for multithreading of the most time-critical algorithms. In addition, we have developed a parallel framework called sofia-X that allows the processing of large data cubes to be split across multiple computing nodes. As a result of these efforts, sofia 2 is substantially faster and comes with a much reduced memory footprint compared to its predecessor, thus allowing the large WALLABY data volumes of hundreds of gigabytes of imaging data per epoch to be processed in real time. The source code has been made publicly available to the entire community under an open-source licence. Performance tests using mock galaxies injected into genuine ASKAP data suggest that in the absence of significant imaging artefacts sofia 2 is capable of achieving near-100 per cent completeness and reliability above an integrated signal-to-noise ratio (SNR) of about 5-6. We also demonstrate that sofia 2 generally recovers the location, integrated flux, and w20 line width of galaxies with high accuracy. Other parameters, including the peak flux density and w50 line width, are more strongly biased due to the influence of the noise on the measurement. In addition, very faint galaxies below an integrated SNR of about 10 may get broken up into multiple components, thus requiring a strategy to identify fragmented sources and ensure that they do not affect the integrity of any scientific analysis based on the sofia 2 output.
AB - We present sofia 2, the fully automated 3D source finding pipeline for the WALLABY extragalactic H i survey with the Australian SKA Pathfinder (ASKAP). sofia 2 is a reimplementation of parts of the original sofia pipeline in the c programming language and makes use of OpenMP for multithreading of the most time-critical algorithms. In addition, we have developed a parallel framework called sofia-X that allows the processing of large data cubes to be split across multiple computing nodes. As a result of these efforts, sofia 2 is substantially faster and comes with a much reduced memory footprint compared to its predecessor, thus allowing the large WALLABY data volumes of hundreds of gigabytes of imaging data per epoch to be processed in real time. The source code has been made publicly available to the entire community under an open-source licence. Performance tests using mock galaxies injected into genuine ASKAP data suggest that in the absence of significant imaging artefacts sofia 2 is capable of achieving near-100 per cent completeness and reliability above an integrated signal-to-noise ratio (SNR) of about 5-6. We also demonstrate that sofia 2 generally recovers the location, integrated flux, and w20 line width of galaxies with high accuracy. Other parameters, including the peak flux density and w50 line width, are more strongly biased due to the influence of the noise on the measurement. In addition, very faint galaxies below an integrated SNR of about 10 may get broken up into multiple components, thus requiring a strategy to identify fragmented sources and ensure that they do not affect the integrity of any scientific analysis based on the sofia 2 output.
KW - Methods: data analysis
KW - Software: data analysis
UR - http://www.scopus.com/inward/record.url?scp=85112158547&partnerID=8YFLogxK
U2 - 10.1093/mnras/stab1881
DO - 10.1093/mnras/stab1881
M3 - Review article
AN - SCOPUS:85112158547
SN - 0035-8711
VL - 506
SP - 3962
EP - 3976
JO - Monthly Notices of the Royal Astronomical Society
JF - Monthly Notices of the Royal Astronomical Society
IS - 3
ER -