-
Spatial Temporal Approach for High-Resolution Gridded Wind Forecasting across Southwest Western Australia
Authors:
Fuling Chen,
Kevin Vinsen,
Arthur Filoche
Abstract:
Accurate wind speed and direction forecasting is paramount across many sectors, spanning agriculture, renewable energy generation, and bushfire management. However, conventional forecasting models encounter significant challenges in precisely predicting wind conditions at high spatial resolutions for individual locations or small geographical areas (< 20 km2) and capturing medium to long-range tem…
▽ More
Accurate wind speed and direction forecasting is paramount across many sectors, spanning agriculture, renewable energy generation, and bushfire management. However, conventional forecasting models encounter significant challenges in precisely predicting wind conditions at high spatial resolutions for individual locations or small geographical areas (< 20 km2) and capturing medium to long-range temporal trends and comprehensive spatio-temporal patterns. This study focuses on a spatial temporal approach for high-resolution gridded wind forecasting at the height of 3 and 10 metres across large areas of the Southwest of Western Australia to overcome these challenges. The model utilises the data that covers a broad geographic area and harnesses a diverse array of meteorological factors, including terrain characteristics, air pressure, 10-metre wind forecasts from the European Centre for Medium-Range Weather Forecasts, and limited observation data from sparsely distributed weather stations (such as 3-metre wind profiles, humidity, and temperature), the model demonstrates promising advancements in wind forecasting accuracy and reliability across the entire region of interest. This paper shows the potential of our machine learning model for wind forecasts across various prediction horizons and spatial coverage. It can help facilitate more informed decision-making and enhance resilience across critical sectors.
△ Less
Submitted 26 July, 2024;
originally announced July 2024.
-
Rapid localization of gravitational wave sources from compact binary coalescences using deep learning
Authors:
Chayan Chatterjee,
Manoj Kovalam,
Linqing Wen,
Damon Beveridge,
Foivos Diakogiannis,
Kevin Vinsen
Abstract:
The mergers of neutron star-neutron star and neutron star-black hole binaries are the most promising gravitational wave events with electromagnetic counterparts. The rapid detection, localization and simultaneous multi-messenger follow-up of these sources is of primary importance in the upcoming science runs of the LIGO-Virgo-KAGRA Collaboration. While prompt electromagnetic counterparts during bi…
▽ More
The mergers of neutron star-neutron star and neutron star-black hole binaries are the most promising gravitational wave events with electromagnetic counterparts. The rapid detection, localization and simultaneous multi-messenger follow-up of these sources is of primary importance in the upcoming science runs of the LIGO-Virgo-KAGRA Collaboration. While prompt electromagnetic counterparts during binary mergers can last less than two seconds, the time scales of existing localization methods that use Bayesian techniques, varies from seconds to days. In this paper, we propose the first deep learning-based approach for rapid and accurate sky localization of all types of binary coalescences, including neutron star-neutron star and neutron star-black hole binaries for the first time. Specifically, we train and test a normalizing flow model on matched-filtering output from gravitational wave searches. Our model produces sky direction posteriors in milliseconds using a single P100 GPU, which is three to six orders of magnitude faster than Bayesian techniques.
△ Less
Submitted 5 December, 2023; v1 submitted 29 July, 2022;
originally announced July 2022.
-
CHILES VII: Deep Imaging for the CHILES project, a SKA prototype
Authors:
R. Dodson,
E. Momjian,
D. J. Pisano,
N. Luber,
J. Blue Bird,
K. Rozgonyi,
E. T. Smith,
J. H. van Gorkom,
D. Lucero,
K. M. Hess,
M. Yun,
J. Rhee,
J. M. van der Hulst,
K. Vinsen,
M. Meyer,
X. Fernandez,
H. B. Gim,
A. Popping,
E. Wilcots
Abstract:
Radio Astronomy is undergoing a renaissance, as the next-generation of instruments provides a massive leap forward in collecting area and therefore raw sensitivity. However, to achieve this theoretical level of sensitivity in the science data products we need to address the much more pernicious systematic effects, which are the true limitation. These become all the more significant when we conside…
▽ More
Radio Astronomy is undergoing a renaissance, as the next-generation of instruments provides a massive leap forward in collecting area and therefore raw sensitivity. However, to achieve this theoretical level of sensitivity in the science data products we need to address the much more pernicious systematic effects, which are the true limitation. These become all the more significant when we consider that much of the time used by survey instruments, such as the SKA, will be dedicated to deep surveys.
CHILES is a deep HI survey of the COSMOS field, with 1,000 hours of VLA time. We present our approach for creating the image cubes from the first Epoch, with discussions of the methods and quantification of the data quality from 946 to 1420MHz -- a redshift range of 0.5 to 0. We layout the problems we had to solve and describe how we tackled them. These are of importance as CHILES is the first deep wideband multi-epoch HI survey and it has relevance for ongoing and future surveys.
We focus on the accumulated systematic errors in the imaging, as the goal is to deliver a high-fidelity image that is only limited by the random thermal errors. To understand and correct these systematic effects we ideally manage them in the domain in which they arise, and that is predominately the visibility domain. CHILES is a perfect test bed for many of the issues we can expect for deep imaging with the SKA or ngVLA and we discuss the lessons we have learned.
△ Less
Submitted 13 December, 2021;
originally announced December 2021.
-
Extraction of Binary Black Hole Gravitational Wave Signals from Detector Data Using Deep Learning
Authors:
Chayan Chatterjee,
Linqing Wen,
Foivos Diakogiannis,
Kevin Vinsen
Abstract:
Accurate extractions of the detected gravitational wave (GW) signal waveforms are essential to validate a detection and to probe the astrophysics behind the sources producing the GWs. This however could be difficult in realistic scenarios where the signals detected by existing GW detectors could be contaminated with non-stationary and non-Gaussian noise. While the performance of existing waveform…
▽ More
Accurate extractions of the detected gravitational wave (GW) signal waveforms are essential to validate a detection and to probe the astrophysics behind the sources producing the GWs. This however could be difficult in realistic scenarios where the signals detected by existing GW detectors could be contaminated with non-stationary and non-Gaussian noise. While the performance of existing waveform extraction methods are optimal, they are not fast enough for online application, which is important for multi-messenger astronomy. In this paper, we demonstrate that a deep learning architecture consisting of Convolutional Neural Network and bidirectional Long Short-Term Memory components can be used to extract binary black hole (BBH) GW waveforms from realistic noise in a few milli-seconds. We have tested our network systematically on injected GW signals, with component masses uniformly distributed in the range of 10 to 80 solar masses, on Gaussian noise and LIGO detector noise. We find that our model can extract GW waveforms with overlaps of more than 0.95 with pure Numerical Relativity templates for signals with signal-to-noise ratio (SNR) greater than six, and is also robust against interfering glitches. We then apply our model to all ten detected BBH events from the first (O1) and second (O2) observation runs, obtaining greater than 0.97 overlaps for all ten extracted BBH waveforms with the corresponding pure templates. We discuss the implication of our result and its future applications to GW localization and mass estimation.
△ Less
Submitted 17 July, 2021; v1 submitted 7 May, 2021;
originally announced May 2021.
-
CHILES VI: HI and H$α$ Observations for z < 0.1 Galaxies; Probing HI Spin Alignment with Filaments in the Cosmic Web
Authors:
J. Blue Bird,
J. Davis,
N. Luber,
J. H. van Gorkom,
E. Wilcots,
D. J. Pisano,
H. B. Gim,
E. Momjian,
X. Fernandez,
K. M. Hess,
D. Lucero,
R. Dodson,
K. Vinsen,
A. Popping,
A. Chung,
K. Kreckel,
J. M. van der Hulst,
M. Yun
Abstract:
We present neutral hydrogen (HI) and ionized hydrogen (H$α$) observations of ten galaxies out to a redshift of 0.1. The HI observations are from the first epoch (178 hours) of the COSMOS HI Large Extragalactic Survey (CHILES). Our sample is HI biased and consists of ten late-type galaxies with HI masses that range from $1.8\times10^{7}$ M$_{\odot}$ to $1.1\times10^{10}$ M$_{\odot}$. We find that a…
▽ More
We present neutral hydrogen (HI) and ionized hydrogen (H$α$) observations of ten galaxies out to a redshift of 0.1. The HI observations are from the first epoch (178 hours) of the COSMOS HI Large Extragalactic Survey (CHILES). Our sample is HI biased and consists of ten late-type galaxies with HI masses that range from $1.8\times10^{7}$ M$_{\odot}$ to $1.1\times10^{10}$ M$_{\odot}$. We find that although the majority of galaxies show irregularities in the morphology and kinematics, they generally follow the scaling relations found in larger samples. We find that the HI and H$α$ velocities reach the flat part of the rotation curve. We identify the large-scale structure in the nearby CHILES volume using DisPerSE with the spectroscopic catalog from SDSS. We explore the gaseous properties of the galaxies as a function of location in the cosmic web. We also compare the angular momentum vector (spin) of the galaxies to the orientation of the nearest cosmic web filament. Our results show that galaxy spins tend to be aligned with cosmic web filaments and show a hint of a transition mass associated with the spin angle alignment.
△ Less
Submitted 2 December, 2019;
originally announced December 2019.
-
Using Deep Learning to Localize Gravitational Wave Sources
Authors:
Chayan Chatterjee,
Linqing Wen,
Kevin Vinsen,
Manoj Kovalam,
Amitava Datta
Abstract:
In this paper, we report on the construction of a deep Artificial Neural Network (ANN) to localize simulated gravitational wave signals in the sky with high accuracy. We have modelled the sky as a sphere and have considered cases where the sphere is divided into 18, 50, 128, 1024, 2048 and 4096 sectors. The sky direction of the gravitational wave source is estimated by classifying the signal into…
▽ More
In this paper, we report on the construction of a deep Artificial Neural Network (ANN) to localize simulated gravitational wave signals in the sky with high accuracy. We have modelled the sky as a sphere and have considered cases where the sphere is divided into 18, 50, 128, 1024, 2048 and 4096 sectors. The sky direction of the gravitational wave source is estimated by classifying the signal into one of these sectors based on it's right ascension and declination values for each of these cases. In order to do this, we have injected simulated binary black hole gravitational wave signals of component masses sampled uniformly between 30-80 solar mass into Gaussian noise and used the whitened strain values to obtain the input features for training our ANN. We input features such as the delays in arrival times, phase differences and amplitude ratios at each of the three detectors Hanford, Livingston and Virgo, from the raw time-domain strain values as well as from analytical versions of these signals, obtained through Hilbert transformation. We show that our model is able to classify gravitational wave samples, not used in the training process, into their correct sectors with very high accuracy (>90%) for coarse angular resolution using 18, 50 and 128 sectors. We also test our localization on test samples with injection parameters of the published LIGO binary black hole merger events GW150914, GW170818 and GW170823 for 1024, 2048 and 4096 sectors and compare the result with that from BAYESTAR and Parameter Estimation (PE). In addition, we report that the time taken by our model to localize one GW signal is around 0.018 secs on 14 Intel Xeon CPU cores.
△ Less
Submitted 20 October, 2019; v1 submitted 13 September, 2019;
originally announced September 2019.
-
CHILES: HI morphology and galaxy environment at z=0.12 and z=0.17
Authors:
Kelley M. Hess,
Nicholas M. Luber,
Ximena Fernández,
Hansung B. Gim,
J. H. van Gorkom,
Emmanuel Momjian,
Julia Gross,
Martin Meyer,
Attila Popping,
Luke J. M. Davies,
Lucas Hunt,
Kathryn Kreckel,
Danielle Lucero,
D. J. Pisano,
Monica Sanchez-Barrantes,
Min S. Yun,
Richard Dodson,
Kevin Vinsen,
Andreas Wicenec,
Chen Wu,
Matthew A. Bershady,
Aeree Chung,
Julie D. Davis,
Jennifer Donovan Meyer,
Patricia Henning
, et al. (5 additional authors not shown)
Abstract:
We present a study of 16 HI-detected galaxies found in 178 hours of observations from Epoch 1 of the COSMOS HI Large Extragalactic Survey (CHILES). We focus on two redshift ranges between 0.108 <= z <= 0.127 and 0.162 <= z <= 0.183 which are among the worst affected by radio frequency interference (RFI). While this represents only 10% of the total frequency coverage and 18% of the total expected t…
▽ More
We present a study of 16 HI-detected galaxies found in 178 hours of observations from Epoch 1 of the COSMOS HI Large Extragalactic Survey (CHILES). We focus on two redshift ranges between 0.108 <= z <= 0.127 and 0.162 <= z <= 0.183 which are among the worst affected by radio frequency interference (RFI). While this represents only 10% of the total frequency coverage and 18% of the total expected time on source compared to what will be the full CHILES survey, we demonstrate that our data reduction pipeline recovers high quality data even in regions severely impacted by RFI. We report on our in-depth testing of an automated spectral line source finder to produce HI total intensity maps which we present side-by-side with significance maps to evaluate the reliability of the morphology recovered by the source finder. We recommend that this become a common place manner of presenting data from upcoming HI surveys of resolved objects. We use the COSMOS 20k group catalogue, and we extract filamentary structure using the topological DisPerSE algorithm to evaluate the \hi\ morphology in the context of both local and large-scale environments and we discuss the shortcomings of both methods. Many of the detections show disturbed HI morphologies suggesting they have undergone a recent interaction which is not evident from deep optical imaging alone. Overall, the sample showcases the broad range of ways in which galaxies interact with their environment. This is a first look at the population of galaxies and their local and large-scale environments observed in HI by CHILES at redshifts beyond the z=0.1 Universe.
△ Less
Submitted 28 November, 2018;
originally announced November 2018.
-
GAMA/H-ATLAS: The Local Dust Mass Function and Cosmic Density as a Function of Galaxy Type - A Benchmark for Models of Galaxy Evolution
Authors:
R. A. Beeston,
A. H. Wright,
S. Maddox,
H. L. Gomez,
L. Dunne,
S. P. Driver,
A. Robotham,
C. J. R. Clark,
K. Vinsen,
T. T. Takeuchi,
G. Popping,
N. Bourne,
M. N. Bremer,
S. Phillipps,
A. J. Moffett,
M. Baes,
S. Brough,
P. De Vis,
S. A. Eales,
B. W. Holwerda,
J. Loveday,
M. W. L. Smith,
D. J. B. Smith,
C. Vlahakis,
L. Wang
Abstract:
We present the dust mass function (DMF) of 15,750 galaxies with redshift $z< 0.1$, drawn from the overlapping area of the GAMA and {\it H-}ATLAS surveys. The DMF is derived using the density corrected $V_{\rm max}$ method, where we estimate $V_{\rm max}$ using: (i) the normal photometric selection limit ($pV_{\rm max}$) and (ii) a bivariate brightness distribution (BBD) technique, which accounts f…
▽ More
We present the dust mass function (DMF) of 15,750 galaxies with redshift $z< 0.1$, drawn from the overlapping area of the GAMA and {\it H-}ATLAS surveys. The DMF is derived using the density corrected $V_{\rm max}$ method, where we estimate $V_{\rm max}$ using: (i) the normal photometric selection limit ($pV_{\rm max}$) and (ii) a bivariate brightness distribution (BBD) technique, which accounts for two selection effects. We fit the data with a Schechter function, and find $M^{*}=(4.65\pm0.18)\times 10^{7}\,h^2_{70}\, M_{\odot}$, $α=(1.22\pm 0.01)$, $φ^{*}=(6.26\pm 0.28)\times 10^{-3}\,h^3_{70}\,\rm Mpc^{-3}\,dex^{-1}$. The resulting dust mass density parameter integrated down to $10^4\,M_{\odot}$ is $Ω_{\rm d}=(1.11 \pm0.02)\times 10^{-6}$ which implies the mass fraction of baryons in dust is $f_{m_b}=(2.40\pm0.04)\times 10^{-5}$; cosmic variance adds an extra 7-17\,per\,cent uncertainty to the quoted statistical errors. Our measurements have fewer galaxies with high dust mass than predicted by semi-analytic models. This is because the models include too much dust in high stellar mass galaxies. Conversely, our measurements find more galaxies with high dust mass than predicted by hydrodynamical cosmological simulations. This is likely to be from the long timescales for grain growth assumed in the models. We calculate DMFs split by galaxy type and find dust mass densities of $Ω_{\rm d}=(0.88\pm0.03)\times 10^{-6}$ and $Ω_{\rm d}=(0.060\pm0.005)\times 10^{-6}$ for late-types and early-types respectively. Comparing to the equivalent galaxy stellar mass functions (GSMF) we find that the DMF for late-types is well matched by the GMSF scaled by $(8.07\pm0.35) \times 10^{-4}$.
△ Less
Submitted 1 June, 2018; v1 submitted 19 December, 2017;
originally announced December 2017.
-
GAMA/G10-COSMOS/3D-HST: The 0<z<5 cosmic star-formation history, stellar- and dust-mass densities
Authors:
Simon P. Driver,
Stephen K. Andrews,
Elisabete da Cunha,
Luke J. Davies,
Claudia Lagos,
Aaron S. G. Robotham,
Kevin Vinsen,
Angus H. Wright,
Mehmet Alpaslan,
Joss Bland-Hawthorn,
Nathan Bourne,
Sarah Brough,
Malcolm N. Bremer,
Michelle Cluver,
Matthew Colless,
Christopher J. Conselice,
Loretta Dunne,
Steve A. Eales,
Haley Gomez,
Benne Holwerda,
Andrew M. Hopkins,
Prajwal R. Kafle,
Lee S. Kelvin,
Jon Loveday,
Jochen Liske
, et al. (8 additional authors not shown)
Abstract:
We use the energy-balance code MAGPHYS to determine stellar and dust masses, and dust corrected star-formation rates for over 200,000 GAMA galaxies, 170,000 G10-COSMOS galaxies and 200,000 3D-HST galaxies. Our values agree well with previously reported measurements and constitute a representative and homogeneous dataset spanning a broad range in stellar mass (10^8---10^12 Msol), dust mass (10^6---…
▽ More
We use the energy-balance code MAGPHYS to determine stellar and dust masses, and dust corrected star-formation rates for over 200,000 GAMA galaxies, 170,000 G10-COSMOS galaxies and 200,000 3D-HST galaxies. Our values agree well with previously reported measurements and constitute a representative and homogeneous dataset spanning a broad range in stellar mass (10^8---10^12 Msol), dust mass (10^6---10^9 Msol), and star-formation rates (0.01---100 Msol per yr), and over a broad redshift range (0.0 < z < 5.0). We combine these data to measure the cosmic star-formation history (CSFH), the stellar-mass density (SMD), and the dust-mass density (DMD) over a 12 Gyr timeline. The data mostly agree with previous estimates, where they exist, and provide a quasi-homogeneous dataset using consistent mass and star-formation estimators with consistent underlying assumptions over the full time range. As a consequence our formal errors are significantly reduced when compared to the historic literature. Integrating our cosmic star-formation history we precisely reproduce the stellar-mass density with an ISM replenishment factor of 0.50 +/- 0.07, consistent with our choice of Chabrier IMF plus some modest amount of stripped stellar mass. Exploring the cosmic dust density evolution, we find a gradual increase in dust density with lookback time. We build a simple phenomenological model from the CSFH to account for the dust mass evolution, and infer two key conclusions: (1) For every unit of stellar mass which is formed 0.0065---0.004 units of dust mass is also formed; (2) Over the history of the Universe approximately 90 to 95 per cent of all dust formed has been destroyed and/or ejected.
△ Less
Submitted 19 October, 2017; v1 submitted 18 October, 2017;
originally announced October 2017.
-
Galaxy And Mass Assembly: the evolution of the cosmic spectral energy distribution from z = 1 to z = 0
Authors:
Stephen K. Andrews,
Simon P. Driver,
Luke J. M. Davies,
Prajwal R. Kafle,
Aaron S. G. Robotham,
Kevin Vinsen,
Angus H. Wright,
Joss Bland-Hawthorn,
Nathan Bourne,
Malcolm Bremer,
Elisabete da Cunha,
Michael Drinkwater,
Benne Holwerda,
Andrew M. Hopkins,
Lee S. Kelvin,
John Loveday,
Steven Phillipps,
Stephen Wilkins
Abstract:
We present the evolution of the Cosmic Spectral Energy Distribution (CSED) from $z = 1 - 0$. Our CSEDs originate from stacking individual spectral energy distribution fits based on panchromatic photometry from the Galaxy and Mass Assembly (GAMA) and COSMOS datasets in ten redshift intervals with completeness corrections applied. Below $z = 0.45$, we have credible SED fits from 100 nm to 1 mm. Due…
▽ More
We present the evolution of the Cosmic Spectral Energy Distribution (CSED) from $z = 1 - 0$. Our CSEDs originate from stacking individual spectral energy distribution fits based on panchromatic photometry from the Galaxy and Mass Assembly (GAMA) and COSMOS datasets in ten redshift intervals with completeness corrections applied. Below $z = 0.45$, we have credible SED fits from 100 nm to 1 mm. Due to the relatively low sensitivity of the far-infrared data, our far-infrared CSEDs contain a mix of predicted and measured fluxes above $z = 0.45$. Our results include appropriate errors to highlight the impact of these corrections. We show that the bolometric energy output of the Universe has declined by a factor of roughly four -- from $5.1 \pm 1.0$ at $z \sim 1$ to $1.3 \pm 0.3 \times 10^{35}~h_{70}$~W~Mpc$^{-3}$ at the current epoch. We show that this decrease is robust to cosmic variance, SED modelling and other various types of error. Our CSEDs are also consistent with an increase in the mean age of stellar populations. We also show that dust attenuation has decreased over the same period, with the photon escape fraction at 150~nm increasing from $16 \pm 3$ at $z \sim 1$ to $24 \pm 5$ per cent at the current epoch, equivalent to a decrease in $A_\mathrm{FUV}$ of 0.4~mag. Our CSEDs account for $68 \pm 12$ and $61 \pm 13$ per cent of the cosmic optical and infrared backgrounds respectively as defined from integrated galaxy counts and are consistent with previous estimates of the cosmic infrared background with redshift.
△ Less
Submitted 22 May, 2017;
originally announced May 2017.
-
DALiuGE: A Graph Execution Framework for Harnessing the Astronomical Data Deluge
Authors:
Chen Wu,
Rodrigo Tobar,
Kevin Vinsen,
Andreas Wicenec,
Dave Pallot,
Baoqiang Lao,
Ruonan Wang,
Tao An,
Mark Boulton,
Ian Cooper,
Richard Dodson,
Markus Dolensky,
Ying Mei,
Feng Wang
Abstract:
The Data Activated Liu Graph Engine - DALiuGE - is an execution framework for processing large astronomical datasets at a scale required by the Square Kilometre Array Phase 1 (SKA1). It includes an interface for expressing complex data reduction pipelines consisting of both data sets and algorithmic components and an implementation run-time to execute such pipelines on distributed resources. By ma…
▽ More
The Data Activated Liu Graph Engine - DALiuGE - is an execution framework for processing large astronomical datasets at a scale required by the Square Kilometre Array Phase 1 (SKA1). It includes an interface for expressing complex data reduction pipelines consisting of both data sets and algorithmic components and an implementation run-time to execute such pipelines on distributed resources. By mapping the logical view of a pipeline to its physical realisation, DALiuGE separates the concerns of multiple stakeholders, allowing them to collectively optimise large-scale data processing solutions in a coherent manner. The execution in DALiuGE is data-activated, where each individual data item autonomously triggers the processing on itself. Such decentralisation also makes the execution framework very scalable and flexible, supporting pipeline sizes ranging from less than ten tasks running on a laptop to tens of millions of concurrent tasks on the second fastest supercomputer in the world. DALiuGE has been used in production for reducing interferometry data sets from the Karl E. Jansky Very Large Array and the Mingantu Ultrawide Spectral Radioheliograph; and is being developed as the execution framework prototype for the Science Data Processor (SDP) consortium of the Square Kilometre Array (SKA) telescope. This paper presents a technical overview of DALiuGE and discusses case studies from the CHILES and MUSER projects that use DALiuGE to execute production pipelines. In a companion paper, we provide in-depth analysis of DALiuGE's scalability to very large numbers of tasks on two supercomputing facilities.
△ Less
Submitted 24 February, 2017;
originally announced February 2017.
-
Operations in the era of large distributed telescopes
Authors:
Yan Guillaume Grange,
Kevin Vinsen,
Juan Carlos Guzman,
José Alfredo Parra,
Jan David Mol,
Rosly Renil,
Christoper Schollar
Abstract:
The previous generation of astronomical instruments tended to consist of single receivers in the focal point of one or more physical reflectors. Because of this, most astronomical data sets were small enough that the raw data could easily be downloaded and processed on a single machine.
In the last decade, several large, complex Radio Astronomy instruments have been built and the SKA is currentl…
▽ More
The previous generation of astronomical instruments tended to consist of single receivers in the focal point of one or more physical reflectors. Because of this, most astronomical data sets were small enough that the raw data could easily be downloaded and processed on a single machine.
In the last decade, several large, complex Radio Astronomy instruments have been built and the SKA is currently being designed. Many of these instruments have been designed by international teams, and, in the case of LOFAR span an area larger than a single country. Such systems are ICT telescopes and consist mainly of complex software. This causes the main operational issues to be related to the ICT systems and not the telescope hardware. However, it is important that the operations of the ICT systems are coordinated with the traditional operational work. Managing the operations of such telescopes therefore requires an approach that significantly differs from classical telescope operations.
The goal of this session is to bring together members of operational teams responsible for such large-scale ICT telescopes. This gathering will be used to exchange experiences and knowledge between those teams. Also, we consider such a meeting as very valuable input for future instrumentation, especially the SKA and its regional centres.
△ Less
Submitted 1 December, 2016;
originally announced December 2016.
-
Imaging SKA-Scale data in three different computing environments
Authors:
Richard Dodson,
Kevin Vinsen,
Chen Wu,
Attila Popping,
Martin Meyer,
Andreas Wicenec,
Peter Quinn,
Jacqueline van Gorkom,
Emmanuel Momjian
Abstract:
We present the results of our investigations into options for the computing platform for the imaging pipeline in the CHILES project, an ultra-deep HI pathfinder for the era of the Square Kilometre Array. CHILES pushes the current computing infrastructure to its limits and understanding how to deliver the images from this project is clarifying the Science Data Processing requirements for the SKA. W…
▽ More
We present the results of our investigations into options for the computing platform for the imaging pipeline in the CHILES project, an ultra-deep HI pathfinder for the era of the Square Kilometre Array. CHILES pushes the current computing infrastructure to its limits and understanding how to deliver the images from this project is clarifying the Science Data Processing requirements for the SKA. We have tested three platforms: a moderately sized cluster, a massive High Performance Computing (HPC) system, and the Amazon Web Services (AWS) cloud computing platform. We have used well-established tools for data reduction and performance measurement to investigate the behaviour of these platforms for the complicated access patterns of real-life Radio Astronomy data reduction. All of these platforms have strengths and weaknesses and the system tools allow us to identify and evaluate them in a quantitative manner. With the insights from these tests we are able to complete the imaging pipeline processing on both the HPC platform and also on the cloud computing platform, which paves the way for meeting big data challenges in the era of SKA in the field of Radio Astronomy. We discuss the implications that all similar projects will have to consider, in both performance and costs, to make recommendations for the planning of Radio Astronomy imaging workflows.
△ Less
Submitted 2 November, 2015;
originally announced November 2015.
-
Galaxy And Mass Assembly (GAMA): Panchromatic Data Release (far-UV --- far-IR) and the low-z energy budget
Authors:
Simon P. Driver,
Angus H. Wright,
Stephen K. Andrews,
Luke J. Davies,
Prajwal R. Kafle,
Rebecca Lange,
Amanda J. Moffett,
Elizabeth Mannering,
Aaron S. G. Robotham,
Kevin Vinsen,
Mehmet Alpaslan,
Ellen Andrae,
Ivan K. Baldry,
Amanda E. Bauer,
Steven P. Bamford,
Joss Bland-Hawthorn,
Nathan Bourne,
Sarah Brough,
Michael J. I. Brown,
Michelle E. Cluver,
Scott Croom,
Matthew Colless,
Christopher J. Conselice,
Elisabete da Cunha,
Roberto De Propris
, et al. (38 additional authors not shown)
Abstract:
We present the GAMA Panchromatic Data Release (PDR) constituting over 230deg$^2$ of imaging with photometry in 21 bands extending from the far-UV to the far-IR. These data complement our spectroscopic campaign of over 300k galaxies, and are compiled from observations with a variety of facilities including: GALEX, SDSS, VISTA, WISE, and Herschel, with the GAMA regions currently being surveyed by VS…
▽ More
We present the GAMA Panchromatic Data Release (PDR) constituting over 230deg$^2$ of imaging with photometry in 21 bands extending from the far-UV to the far-IR. These data complement our spectroscopic campaign of over 300k galaxies, and are compiled from observations with a variety of facilities including: GALEX, SDSS, VISTA, WISE, and Herschel, with the GAMA regions currently being surveyed by VST and scheduled for observations by ASKAP. These data are processed to a common astrometric solution, from which photometry is derived for 221,373 galaxies with r<19.8 mag. Online tools are provided to access and download data cutouts, or the full mosaics of the GAMA regions in each band.
We focus, in particular, on the reduction and analysis of the VISTA VIKING data, and compare to earlier datasets (i.e., 2MASS and UKIDSS) before combining the data and examining its integrity. Having derived the 21-band photometric catalogue we proceed to fit the data using the energy balance code MAGPHYS. These measurements are then used to obtain the first fully empirical measurement of the 0.1-500$μ$m energy output of the Universe. Exploring the Cosmic Spectral Energy Distribution (CSED) across three time-intervals (0.3-1.1Gyr, 1.1-1.8~Gyr and 1.8---2.4~Gyr), we find that the Universe is currently generating $(1.5 \pm 0.3) \times 10^{35}$ h$_{70}$ W Mpc$^{-3}$, down from $(2.5 \pm 0.2) \times 10^{35}$ h$_{70}$ W Mpc$^{-3}$ 2.3~Gyr ago. More importantly, we identify significant and smooth evolution in the integrated photon escape fraction at all wavelengths, with the UV escape fraction increasing from 27(18)% at z=0.18 in NUV(FUV) to 34(23)% at z=0.06.
The GAMA PDR will allow for detailed studies of the energy production and outputs of individual systems, sub-populations, and representative galaxy samples at $z<0.5$. The GAMA PDR can be found at: http://gama-psi.icrar.org/
△ Less
Submitted 20 November, 2015; v1 submitted 9 August, 2015;
originally announced August 2015.
-
A BOINC based, citizen-science project for pixel Spectral Energy Distribution fitting of resolved galaxies in multi-wavelength surveys
Authors:
Kevin Vinsen,
David Thilker
Abstract:
In this work we present our experience from the first year of theSkyNet Pan-STARRS1 Optical Galaxy Survey (POGS) project. This citizen-scientist driven research project uses the Berkeley Open Infrastructure for Network Computing (BOINC) middleware and thousands of Internet-connected computers to measure the resolved galactic structural properties of ~100,000 low redshift galaxies. We are combining…
▽ More
In this work we present our experience from the first year of theSkyNet Pan-STARRS1 Optical Galaxy Survey (POGS) project. This citizen-scientist driven research project uses the Berkeley Open Infrastructure for Network Computing (BOINC) middleware and thousands of Internet-connected computers to measure the resolved galactic structural properties of ~100,000 low redshift galaxies. We are combining the spectral coverage of GALEX, Pan-STARRS1, SDSS, and WISE to generate a value-added, multi-wavelength UV-optical-NIR galaxy atlas for the nearby Universe. Specifically, we are measuring physical parameters (such as local stellar mass, star formation rate, and first-order star formation history) on a resolved pixel-by-pixel basis using spectral energy distribution (SED) fitting techniques in a distributed computing mode.
△ Less
Submitted 2 October, 2013; v1 submitted 7 June, 2013;
originally announced June 2013.
-
SkuareView: Client-Server Framework for Accessing Extremely Large Radio Astronomy Image Data
Authors:
Vyacheslav V. Kitaeff,
Chen Wu,
Andreas Wicenec,
Andrew D. Cannon,
Kevin Vinsen
Abstract:
The new wide-field radio telescopes, such as: ASKAP, MWA, and SKA; will produce spectral-imaging data-cubes (SIDC) of unprecedented volume. This requires new approaches to managing and servicing the data to the end-user. We present a new integrated framework based on the JPEG2000/ISO/IEC 15444 standard to address the challenges of working with extremely large SIDC. We also present the developed j2…
▽ More
The new wide-field radio telescopes, such as: ASKAP, MWA, and SKA; will produce spectral-imaging data-cubes (SIDC) of unprecedented volume. This requires new approaches to managing and servicing the data to the end-user. We present a new integrated framework based on the JPEG2000/ISO/IEC 15444 standard to address the challenges of working with extremely large SIDC. We also present the developed j2k software, that converts and encodes FITS image cubes into JPEG2000 images, paving the way to implementing the pre- sented framework.
△ Less
Submitted 10 September, 2012;
originally announced September 2012.
