Showing 1–25 of 25 results for author: Wilensky, M

Mitigating calibration errors from mutual coupling with time-domain filtering of 21 cm cosmological radio observations

Authors: N. Charles, N. S. Kern, R. Pascua, G. Bernardi, L. Bester, O. Smirnov, E. d. L. Acedo, Z. Abdurashidova, T. Adams, J. E. Aguirre, R. Baartman, A. P. Beardsley, L. M. Berkhout, T. S. Billings, J. D. Bowman, P. Bull, J. Burba, R. Byrne, S. Carey, K. Chen, S. Choudhuri, T. Cox, D. R. DeBoer, M. Dexter, J. S. Dillon , et al. (58 additional authors not shown)

Abstract: The 21 cm transition from neutral Hydrogen promises to be the best observational probe of the Epoch of Reionisation (EoR). This has led to the construction of low-frequency radio interferometric arrays, such as the Hydrogen Epoch of Reionization Array (HERA), aimed at systematically mapping this emission for the first time. Precision calibration, however, is a requirement in 21 cm radio observatio… ▽ More The 21 cm transition from neutral Hydrogen promises to be the best observational probe of the Epoch of Reionisation (EoR). This has led to the construction of low-frequency radio interferometric arrays, such as the Hydrogen Epoch of Reionization Array (HERA), aimed at systematically mapping this emission for the first time. Precision calibration, however, is a requirement in 21 cm radio observations. Due to the spatial compactness of HERA, the array is prone to the effects of mutual coupling, which inevitably lead to non-smooth calibration errors that contaminate the data. When unsmooth gains are used in calibration, intrinsically spectrally-smooth foreground emission begins to contaminate the data in a way that can prohibit a clean detection of the cosmological EoR signal. In this paper, we show that the effects of mutual coupling on calibration quality can be reduced by applying custom time-domain filters to the data prior to calibration. We find that more robust calibration solutions are derived when filtering in this way, which reduces the observed foreground power leakage. Specifically, we find a reduction of foreground power leakage by 2 orders of magnitude at k=0.5. △ Less

Submitted 30 July, 2024; originally announced July 2024.

Investigating Mutual Coupling in the Hydrogen Epoch of Reionization Array and Mitigating its Effects on the 21-cm Power Spectrum

Authors: E. Rath, R. Pascua, A. T. Josaitis, A. Ewall-Wice, N. Fagnoni, E. de Lera Acedo, Z. E. Martinot, Z. Abdurashidova, T. Adams, J. E. Aguirre, R. Baartman, A. P. Beardsley, L. M. Berkhout, G. Bernardi, T. S. Billings, J. D. Bowman, P. Bull, J. Burba, R. Byrne, S. Carey, K. -F. Chen, S. Choudhuri, T. Cox, D. R. DeBoer, M. Dexter , et al. (56 additional authors not shown)

Abstract: Interferometric experiments designed to detect the highly redshifted 21-cm signal from neutral hydrogen are producing increasingly stringent constraints on the 21-cm power spectrum, but some k-modes remain systematics-dominated. Mutual coupling is a major systematic that must be overcome in order to detect the 21-cm signal, and simulations that reproduce effects seen in the data can guide strategi… ▽ More Interferometric experiments designed to detect the highly redshifted 21-cm signal from neutral hydrogen are producing increasingly stringent constraints on the 21-cm power spectrum, but some k-modes remain systematics-dominated. Mutual coupling is a major systematic that must be overcome in order to detect the 21-cm signal, and simulations that reproduce effects seen in the data can guide strategies for mitigating mutual coupling. In this paper, we analyse 12 nights of data from the Hydrogen Epoch of Reionization Array and compare the data against simulations that include a computationally efficient and physically motivated semi-analytic treatment of mutual coupling. We find that simulated coupling features qualitatively agree with coupling features in the data; however, coupling features in the data are brighter than the simulated features, indicating the presence of additional coupling mechanisms not captured by our model. We explore the use of fringe-rate filters as mutual coupling mitigation tools and use our simulations to investigate the effects of mutual coupling on a simulated cosmological 21-cm power spectrum in a "worst case" scenario where the foregrounds are particularly bright. We find that mutual coupling contaminates a large portion of the "EoR Window", and the contamination is several orders-of-magnitude larger than our simulated cosmic signal across a wide range of cosmological Fourier modes. While our fiducial fringe-rate filtering strategy reduces mutual coupling by roughly a factor of 100 in power, a non-negligible amount of coupling cannot be excised with fringe-rate filters, so more sophisticated mitigation strategies are required. △ Less

Submitted 12 June, 2024; originally announced June 2024.

Comments: 19 pages, 12 figures, submitted to MNRAS

High-dimensional inference of radio interferometer beam patterns I: Parametric model of the HERA beams

Authors: Michael J. Wilensky, Jacob Burba, Philip Bull, Hugh Garsden, Katrine A. Glasscock, Nicolas Fagnoni, Eloy de Lera Acedo, David R. DeBoer, Nima Razavi-Ghods

Abstract: Accurate modelling of the primary beam is an important but difficult task in radio astronomy. For high dynamic range problems such as 21cm intensity mapping, small modelling errors in the sidelobes and spectral structure of the beams can translate into significant systematic errors. Realistic beams exhibit complex spatial and spectral structure, presenting a major challenge for beam measurement an… ▽ More Accurate modelling of the primary beam is an important but difficult task in radio astronomy. For high dynamic range problems such as 21cm intensity mapping, small modelling errors in the sidelobes and spectral structure of the beams can translate into significant systematic errors. Realistic beams exhibit complex spatial and spectral structure, presenting a major challenge for beam measurement and calibration methods. In this paper series, we present a Bayesian framework to infer per-element beam patterns from the interferometric visibilities for large arrays with complex beam structure, assuming a particular (but potentially uncertain) sky model and calibration solution. In this first paper, we develop a compact basis for the beam so that the Bayesian computation is tractable with high-dimensional sampling methods. We use the Hydrogen Epoch of Reionization Array (HERA) as an example, verifying that the basis is capable of describing its single-element E-field beam (i.e. without considering array effects like mutual coupling) with a relatively small number of coefficients. We find that 32 coefficients per feed, incident polarization, and frequency, are sufficient to give percent-level and $\sim$10\% errors in the mainlobe and sidelobes respectively for the current HERA Vivaldi feeds, improving to $\sim 0.1\%$ and $\sim 1\%$ for 128 coefficients. △ Less

Submitted 24 July, 2024; v1 submitted 20 March, 2024; originally announced March 2024.

Sensitivity of Bayesian 21 cm power spectrum estimation to foreground model errors

Authors: Jacob Burba, Philip Bull, Michael J. Wilensky, Fraser Kennedy, Hugh Garsden, Katrine A. Glasscock

Abstract: Power spectrum estimators are an important tool in efforts to detect the 21 cm brightness temperature fluctuations from neutral hydrogen at early times. An initial detection will likely be statistical in nature, meaning that it will not be possible to make a coherent map of the brightness temperature fluctuations; instead, only their variance will be measured against a background of noise and resi… ▽ More Power spectrum estimators are an important tool in efforts to detect the 21 cm brightness temperature fluctuations from neutral hydrogen at early times. An initial detection will likely be statistical in nature, meaning that it will not be possible to make a coherent map of the brightness temperature fluctuations; instead, only their variance will be measured against a background of noise and residual systematic effects. Optimal Quadratic Estimator (OQE)-based methods often apply an inverse covariance weighting to the data. However, inaccurate covariance modelling can lead to reduced sensitivity and, in some cases, severe signal loss. We recently proposed a Bayesian method to jointly estimate the 21 cm fluctuations, their power spectrum, and foreground emission. Instead of requiring a fixed a priori estimate of the covariance, we estimate the covariance as part of the inference. Choices of parametrization, particularly of the foregrounds, are subject to model errors and could lead to biases and other ill effects if not properly controlled. In this paper, we investigate the effects of inaccurate foreground models on 21 cm power spectrum recovery. Using simulated visibilities, we find that, even in the most extreme scenarios tested, our approach is capable of recovering 21 cm delay power spectrum estimates consistent with a known input signal for delays $\gtrsim300$ ns ($\sim$88\% of the available Fourier modes). This is true even when using foreground models derived from modified foreground catalogs containing spatial and spectral perturbations at the quoted level of uncertainty on our foreground catalogs. △ Less

Submitted 20 March, 2024; originally announced March 2024.

Comments: 13 pages, 9 figures

Statistical estimation of full-sky radio maps from 21cm array visibility data using Gaussian Constrained Realisations

Authors: Katrine A. Glasscock, Philip Bull, Jacob Burba, Hugh Garsden, Michael J. Wilensky

Abstract: An important application of next-generation wide-field radio interferometers is making high dynamic range maps of radio emission. Traditional deconvolution methods like CLEAN can give poor recovery of diffuse structure, prompting the development of wide-field alternatives like Direct Optimal Mapping and $m$-mode analysis. In this paper, we propose an alternative Bayesian method to infer the coeffi… ▽ More An important application of next-generation wide-field radio interferometers is making high dynamic range maps of radio emission. Traditional deconvolution methods like CLEAN can give poor recovery of diffuse structure, prompting the development of wide-field alternatives like Direct Optimal Mapping and $m$-mode analysis. In this paper, we propose an alternative Bayesian method to infer the coefficients of a full-sky spherical harmonic basis for a drift-scan telescope with potentially thousands of baselines. The can precisely encode the uncertainties and correlations between the parameters used to build the recovered image. We use Gaussian Constrained Realisations (GCR) to efficiently draw samples of the spherical harmonic coefficients, despite the very large parameter space and extensive sky-regions of missing data. Each GCR solution provides a complete, statistically-consistent gap-free realisation of a full-sky map conditioned on the available data, even when the interferometer's field of view is small. Many realisations can be generated and used for further analysis and robust propagation of statistical uncertainties. In this paper, we present the mathematical formalism of the spherical harmonic GCR-method for radio interferometers. We focus on the recovery of diffuse emission as a use case, along with validation of the method against simulations with a known diffuse emission component. △ Less

Submitted 20 March, 2024; originally announced March 2024.

Comments: 16 pages, 12 figures, submitted to RASTI

A demonstration of the effect of fringe-rate filtering in the Hydrogen Epoch of Reionization Array delay power spectrum pipeline

Authors: Hugh Garsden, Philip Bull, Mike Wilensky, Zuhra Abdurashidova, Tyrone Adams, James E. Aguirre, Paul Alexander, Zaki S. Ali, Rushelle Baartman, Yanga Balfour, Adam P. Beardsley, Lindsay M. Berkhout, Gianni Bernardi, Tashalee S. Billings, Judd D. Bowman, Richard F. Bradley, Jacob Burba, Steven Carey, Chris L. Carilli, Kai-Feng Chen, Carina Cheng, Samir Choudhuri, David R. DeBoer, Eloy de Lera Acedo, Matt Dexter , et al. (72 additional authors not shown)

Abstract: Radio interferometers targeting the 21cm brightness temperature fluctuations at high redshift are subject to systematic effects that operate over a range of different timescales. These can be isolated by designing appropriate Fourier filters that operate in fringe-rate (FR) space, the Fourier pair of local sidereal time (LST). Applications of FR filtering include separating effects that are correl… ▽ More Radio interferometers targeting the 21cm brightness temperature fluctuations at high redshift are subject to systematic effects that operate over a range of different timescales. These can be isolated by designing appropriate Fourier filters that operate in fringe-rate (FR) space, the Fourier pair of local sidereal time (LST). Applications of FR filtering include separating effects that are correlated with the rotating sky vs. those relative to the ground, down-weighting emission in the primary beam sidelobes, and suppressing noise. FR filtering causes the noise contributions to the visibility data to become correlated in time however, making interpretation of subsequent averaging and error estimation steps more subtle. In this paper, we describe fringe rate filters that are implemented using discrete prolate spheroidal sequences, and designed for two different purposes -- beam sidelobe/horizon suppression (the `mainlobe' filter), and ground-locked systematics removal (the `notch' filter). We apply these to simulated data, and study how their properties affect visibilities and power spectra generated from the simulations. Included is an introduction to fringe-rate filtering and a demonstration of fringe-rate filters applied to simple situations to aid understanding. △ Less

Submitted 13 February, 2024; originally announced February 2024.

Comments: 21 pages, 18 figures, submitted to Monthly Notices of the Royal Astronomical Society

Evidence of Ultra-faint Radio Frequency Interference in Deep 21~cm Epoch of Reionization Power Spectra with the Murchison Widefield Array

Authors: Michael J. Wilensky, Miguel F. Morales, Bryna J. Hazelton, Pyxie L. Star, Nichole Barry, Ruby Byrne, C. H. Jordan, Daniel C. Jacobs, Jonathan C. Pober, C. M. Trott

Abstract: We present deep upper limits from the 2014 Murchison Widefield Array (MWA) Phase I observing season, with a particular emphasis on identifying the spectral fingerprints of extremely faint radio frequency interference (RFI) contamination in the 21~cm power spectra (PS). After meticulous RFI excision involving a combination of the \textsc{SSINS} RFI flagger and a series of PS-based jackknife tests,… ▽ More We present deep upper limits from the 2014 Murchison Widefield Array (MWA) Phase I observing season, with a particular emphasis on identifying the spectral fingerprints of extremely faint radio frequency interference (RFI) contamination in the 21~cm power spectra (PS). After meticulous RFI excision involving a combination of the \textsc{SSINS} RFI flagger and a series of PS-based jackknife tests, our lowest upper limit on the Epoch of Reionization (EoR) 21~cm PS signal is $Δ^2 \leq 1.61\cdot10^4 \text{ mK}^2$ at $k=0.258\text{ h Mpc}^{-1}$ at a redshift of 7.1 using 14.7 hours of data. By leveraging our understanding of how even fainter RFI is likely to contaminate the EoR PS, we are able to identify ultra-faint RFI signals in the cylindrical PS. Surprisingly this signature is most obvious in PS formed with less than an hour of data, but is potentially subdominant to other systematics in multiple-hour integrations. Since the total RFI budget in a PS detection is quite strict, this nontrivial integration behavior suggests a need to more realistically model coherently integrated ultra-faint RFI in PS measurements so that its potential contribution to a future detection can be diagnosed. △ Less

Submitted 7 November, 2023; v1 submitted 5 October, 2023; originally announced October 2023.

Comments: Update acknowledgements, author metadata, and attach journal doi

Journal ref: The Astrophysical Journal, 2023, Volume 957, Number 2, p. 78

Why and When to Expect Gaussian Error Distributions in Epoch of Reionization 21-cm Power Spectrum Measurements

Authors: Michael J. Wilensky, Jordan Brown, Bryna J. Hazelton

Abstract: We explore error distributions in Epoch of Reionization 21-cm power spectrum estimators using a combination of mathematical analysis and numerical simulations. We provide closed form solutions for the error distributions of individual bins in 3d-power spectra for two estimators currently in use in the field, which we designate as ``straight-square" and ``cross-multiply" estimators. We then demonst… ▽ More We explore error distributions in Epoch of Reionization 21-cm power spectrum estimators using a combination of mathematical analysis and numerical simulations. We provide closed form solutions for the error distributions of individual bins in 3d-power spectra for two estimators currently in use in the field, which we designate as ``straight-square" and ``cross-multiply" estimators. We then demonstrate when the corresponding spherically binned power spectra should (and should not) have Gaussian error distributions, which requires appealing to nonstandard statements of the central limit theorem. This has important implications for how upper limits are reported, as well as how cosmological inferences are performed based on power spectrum measurements. Specifically, assuming a Gaussian error distribution can over or underestimate the upper limit depending on the type of estimator, and produces overly compact likelihood functions for the power spectrum. △ Less

Submitted 19 April, 2023; v1 submitted 24 November, 2022; originally announced November 2022.

Comments: Revisions from peer review

Statistical recovery of 21cm visibilities and their power spectra with Gaussian constrained realisations and Gibbs sampling

Authors: Fraser Kennedy, Philip Bull, Michael Wilensky, Jacob Burba, Samir Choudhuri

Abstract: Radio interferometers designed to probe the 21cm signal from Cosmic Dawn and the Epoch of Reionisation must contend with systematic effects that make it difficult to achieve sufficient dynamic range to separate the 21cm signal from foreground emission and other effects. For instance, the instrument's chromatic response modulates the otherwise spectrally smooth foregrounds, making them difficult to… ▽ More Radio interferometers designed to probe the 21cm signal from Cosmic Dawn and the Epoch of Reionisation must contend with systematic effects that make it difficult to achieve sufficient dynamic range to separate the 21cm signal from foreground emission and other effects. For instance, the instrument's chromatic response modulates the otherwise spectrally smooth foregrounds, making them difficult to model, while a significant fraction of the data must be excised due to the presence of radio frequency interference (RFI), leaving gaps in the data. Errors in modelling the (modulated and gappy) foregrounds can easily generate spurious contamination of what should otherwise be 21cm signal-dominated modes. Various approaches have been developed to mitigate these issues by (e.g.) using non-parametric reconstruction of the foregrounds, in-painting the gaps, and weighting the data to reduce the level of contamination. We present a Bayesian statistical method that combines these approaches, using the coupled techniques of Gaussian constrained realisations (GCR) and Gibbs sampling. This provides a way of drawing samples from the joint posterior distribution of the 21cm signal modes and their power spectrum in the presence of gappy data and an uncertain foreground model in a computationally scalable manner. The data are weighted by an inverse covariance matrix that is estimated as part of the inference, along with a foreground model that can then be marginalised over. We demonstrate the application of this technique on a simulated HERA-like delay spectrum analysis, comparing three different approaches for accounting for the foreground components. △ Less

Submitted 17 March, 2023; v1 submitted 9 November, 2022; originally announced November 2022.

Comments: Updated to match accepted version. Note minor changes to power spectrum plots due to a small bugfix

Bayesian jackknife tests with a small number of subsets: Application to HERA 21cm power spectrum upper limits

Authors: Michael J. Wilensky, Fraser Kennedy, Philip Bull, Joshua S. Dillon, The HERA Collaboration

Abstract: We present a Bayesian jackknife test for assessing the probability that a data set contains biased subsets, and, if so, which of the subsets are likely to be biased. The test can be used to assess the presence and likely source of statistical tension between different measurements of the same quantities in an automated manner. Under certain broadly applicable assumptions, the test is analytically… ▽ More We present a Bayesian jackknife test for assessing the probability that a data set contains biased subsets, and, if so, which of the subsets are likely to be biased. The test can be used to assess the presence and likely source of statistical tension between different measurements of the same quantities in an automated manner. Under certain broadly applicable assumptions, the test is analytically tractable. We also provide an open source code, CHIBORG, that performs both analytic and numerical computations of the test on general Gaussian-distributed data. After exploring the information theoretical aspects of the test and its performance with an array of simulations, we apply it to data from the Hydrogen Epoch of Reionization Array (HERA) to assess whether different sub-seasons of observing can justifiably be combined to produce a deeper 21cm power spectrum upper limit. We find that, with a handful of exceptions, the HERA data in question are statistically consistent and this decision is justified. We conclude by pointing out the wide applicability of this test, including to CMB experiments and the $H_0$ tension. △ Less

Submitted 31 October, 2022; originally announced October 2022.

Improved Constraints on the 21 cm EoR Power Spectrum and the X-Ray Heating of the IGM with HERA Phase I Observations

Authors: The HERA Collaboration, Zara Abdurashidova, Tyrone Adams, James E. Aguirre, Paul Alexander, Zaki S. Ali, Rushelle Baartman, Yanga Balfour, Rennan Barkana, Adam P. Beardsley, Gianni Bernardi, Tashalee S. Billings, Judd D. Bowman, Richard F. Bradley, Daniela Breitman, Philip Bull, Jacob Burba, Steve Carey, Chris L. Carilli, Carina Cheng, Samir Choudhuri, David R. DeBoer, Eloy de Lera Acedo, Matt Dexter, Joshua S. Dillon , et al. (70 additional authors not shown)

Abstract: We report the most sensitive upper limits to date on the 21 cm epoch of reionization power spectrum using 94 nights of observing with Phase I of the Hydrogen Epoch of Reionization Array (HERA). Using similar analysis techniques as in previously reported limits (HERA Collaboration 2022a), we find at 95% confidence that $Δ^2(k = 0.34$ $h$ Mpc$^{-1}$) $\leq 457$ mK$^2$ at $z = 7.9$ and that… ▽ More We report the most sensitive upper limits to date on the 21 cm epoch of reionization power spectrum using 94 nights of observing with Phase I of the Hydrogen Epoch of Reionization Array (HERA). Using similar analysis techniques as in previously reported limits (HERA Collaboration 2022a), we find at 95% confidence that $Δ^2(k = 0.34$ $h$ Mpc$^{-1}$) $\leq 457$ mK$^2$ at $z = 7.9$ and that $Δ^2 (k = 0.36$ $h$ Mpc$^{-1}) \leq 3,496$ mK$^2$ at $z = 10.4$, an improvement by a factor of 2.1 and 2.6 respectively. These limits are mostly consistent with thermal noise over a wide range of $k$ after our data quality cuts, despite performing a relatively conservative analysis designed to minimize signal loss. Our results are validated with both statistical tests on the data and end-to-end pipeline simulations. We also report updated constraints on the astrophysics of reionization and the cosmic dawn. Using multiple independent modeling and inference techniques previously employed by HERA Collaboration (2022b), we find that the intergalactic medium must have been heated above the adiabatic cooling limit at least as early as $z = 10.4$, ruling out a broad set of so-called "cold reionization" scenarios. If this heating is due to high-mass X-ray binaries during the cosmic dawn, as is generally believed, our result's 99% credible interval excludes the local relationship between soft X-ray luminosity and star formation and thus requires heating driven by evolved low-metallicity stars. △ Less

Submitted 19 January, 2023; v1 submitted 10 October, 2022; originally announced October 2022.

Comments: 57 pages, 37 figures. Updated to match the accepted ApJ version. Corresponding author: Joshua S. Dillon

Journal ref: 2023 ApJ 945 124

Exploring the consequences of chromatic data excision in 21-cm Epoch of Reionization power spectrum observations

Authors: Michael J. Wilensky, Bryna J. Hazelton, Miguel F. Morales

Abstract: We explore how chromatic RFI flags affect 21-cm power spectrum measurements. We particularly study flags that are coarser than the analysis resolution. We find that such RFI flags produce excess power in the EoR window in much the same way as residual RFI. We use Fast Holographic Deconvolution (FHD) simulations to explain this as a result of chromatic disruptions in the interferometric sampling fu… ▽ More We explore how chromatic RFI flags affect 21-cm power spectrum measurements. We particularly study flags that are coarser than the analysis resolution. We find that such RFI flags produce excess power in the EoR window in much the same way as residual RFI. We use Fast Holographic Deconvolution (FHD) simulations to explain this as a result of chromatic disruptions in the interferometric sampling function of the array. We also use these simulations in conjunction with Error Propagated Power Spectrum with InterLeaved Observed Noise ($\varepsilon$ppsilon) to show that without modifying current flagging strategies or implementing extremely accurate and complete foreground subtraction, 21-cm EoR experiments will fail to make a significant detection. As a mitigation strategy, we find that circumventing the chromatic structure altogether by flagging the entire analysis band when RFI is detected is simple to implement and highly successful. This demands a detection strategy with a low false positive rate in order to prevent excessive data loss. △ Less

Submitted 11 January, 2022; v1 submitted 15 October, 2021; originally announced October 2021.

Comments: Including revisions from peer review

Epoch of Reionization Power Spectrum Limits from Murchison Widefield Array Data Targeted at EoR1 Field

Authors: M. Rahimi, B. Pindor, J. L. B. Line, N. Barry, C. M. Trott, R. L. Webster, C. H. Jordan, M. Wilensky, S. Yoshiura, A. Beardsley, J. Bowman, R. Byrne, A. Chokshi, B. J. Hazelton, K. Hasegawa, E. Howard, B. Greig, D. Jacobs, R. Joseph, M. Kolopanis, C. Lynch, B. McKinley, D. A. Mitchell, S. Murray, M. F. Morales , et al. (6 additional authors not shown)

Abstract: Current attempts to measure the 21cm Power Spectrum of neutral hydrogen during the Epoch of Reionization are limited by systematics which produce measured upper limits above both the thermal noise and the expected cosmological signal. These systematics arise from a combination of observational, instrumental, and analysis effects. In order to further understand and mitigate these effects, it is ins… ▽ More Current attempts to measure the 21cm Power Spectrum of neutral hydrogen during the Epoch of Reionization are limited by systematics which produce measured upper limits above both the thermal noise and the expected cosmological signal. These systematics arise from a combination of observational, instrumental, and analysis effects. In order to further understand and mitigate these effects, it is instructive to explore different aspects of existing datasets. One such aspect is the choice of observing field. To date, MWA EoR observations have largely focused on the EoR0 field. In this work, we present a new detailed analysis of the EoR1 field. The EoR1 field is one of the coldest regions of the Southern radio sky, but contains the very bright radio galaxy Fornax-A. The presence of this bright extended source in the primary beam of the interferometer makes the calibration and analysis of EoR1 particularly challenging. We demonstrate the effectiveness of a recently developed shapelet model of Fornax-A in improving the results from this field. We also describe and apply a series of data quality metrics which identify and remove systematically contaminated data. With substantially improved source models, upgraded analysis algorithms and enhanced data quality metrics, we determine EoR power spectrum upper limits based on analysis of the best $\sim$14-hours data observed during 2015 and 2014 at redshifts 6.5, 6.8 and 7.1, with the lowest $2σ$ upper limit at z=6.5 of $Δ^2 \leq (73.78 ~\mathrm{mK)^2}$ at $k=0.13~\mathrm{h~ Mpc^{-1}}$, improving on previous EoR1 measurement results. △ Less

Submitted 7 October, 2021; originally announced October 2021.

Comments: 18 pages, 17 figures, Accepted for publication in MNRAS

Constraining the 21cm brightness temperature of the IGM at $z$=6.6 around LAEs with the Murchison Widefield Array

Authors: Cathryn M. Trott, C. H. Jordan, J. L. B. Line, C. R. Lynch, S. Yoshiura, B. McKinley, P. Dayal, B. Pindor, A. Hutter, K. Takahashi, R. B. Wayth, N. Barry, A. Beardsley, J. Bowman, R. Byrne, A. Chokshi, B. Greig, K. Hasegawa, B. J. Hazelton, E. Howard, D. Jacobs, M. Kolopanis, D. A. Mitchell, M. F. Morales, S. Murray , et al. (7 additional authors not shown)

Abstract: The locations of Ly-$α$ emitting galaxies (LAEs) at the end of the Epoch of Reionisation (EoR) are expected to correlate with regions of ionised hydrogen, traced by the redshifted 21~cm hyperfine line. Mapping the neutral hydrogen around regions with detected and localised LAEs offers an avenue to constrain the brightness temperature of the Universe within the EoR by providing an expectation for t… ▽ More The locations of Ly-$α$ emitting galaxies (LAEs) at the end of the Epoch of Reionisation (EoR) are expected to correlate with regions of ionised hydrogen, traced by the redshifted 21~cm hyperfine line. Mapping the neutral hydrogen around regions with detected and localised LAEs offers an avenue to constrain the brightness temperature of the Universe within the EoR by providing an expectation for the spatial distribution of the gas, thereby providing prior information unavailable to power spectrum measurements. We use a test set of 12 hours of observations from the Murchison Widefield Array (MWA) in extended array configuration, to constrain the neutral hydrogen signature of 58 LAEs, detected with the Subaru Hypersuprime Cam in the \textit{Silverrush} survey, centred on $z$=6.58. We assume that detectable emitters reside in the centre of ionised HII bubbles during the end of reionization, and predict the redshifted neutral hydrogen signal corresponding to the remaining neutral regions using a set of different ionised bubble radii. A prewhitening matched filter detector is introduced to assess detectability. We demonstrate the ability to detect, or place limits upon, the amplitude of brightness temperature fluctuations, and the characteristic HII bubble size. With our limited data, we constrain the brightness temperature of neutral hydrogen to $Δ{\rm T}_B<$30 mK ($<$200 mK) at 95% (99%) confidence for lognormally-distributed bubbles of radii, $R_B =$ 15$\pm$2$h^{-1}$cMpc. △ Less

Submitted 30 July, 2021; originally announced July 2021.

Comments: 9 pages, 6 figures, accepted for publication in MNRAS

A new MWA limit on the 21 cm Power Spectrum at Redshifts $\sim$ 13 $-$ 17

Authors: S. Yoshiura, B. Pindor, J. L. B. Line, N. Barry, C. M. Trott, A. Beardsley, J. Bowman, R. Byrne, A. Chokshi, B. J. Hazelton, K. Hasegawa, E. Howard, B. Greig, D. Jacobs, C. H. Jordan, R. Joseph, M. Kolopanis, C. Lynch, B. McKinley, D. A. Mitchell, M. F. Morales, S. G. Murray, J. C. Pober, M. Rahimi, K. Takahashi , et al. (7 additional authors not shown)

Abstract: Observations in the lowest MWA band between $75-100$ MHz have the potential to constrain the distribution of neutral hydrogen in the intergalactic medium at redshift $\sim 13-17$. Using 15 hours of MWA data, we analyse systematics in this band such as radio-frequency interference (RFI), ionospheric and wide field effects. By updating the position of point sources, we mitigate the direction indepen… ▽ More Observations in the lowest MWA band between $75-100$ MHz have the potential to constrain the distribution of neutral hydrogen in the intergalactic medium at redshift $\sim 13-17$. Using 15 hours of MWA data, we analyse systematics in this band such as radio-frequency interference (RFI), ionospheric and wide field effects. By updating the position of point sources, we mitigate the direction independent calibration error due to ionospheric offsets. Our calibration strategy is optimized for the lowest frequency bands by reducing the number of direction dependent calibrators and taking into account radio sources within a wider field of view. We remove data polluted by systematics based on the RFI occupancy and ionospheric conditions, finally selecting 5.5 hours of the cleanest data. Using these data, we obtain two sigma upper limits on the 21 cm power spectrum in the range of $0.1\lessapprox k \lessapprox 1 ~\rm ~h~Mpc^{-1}$ and at $z$=14.2, 15.2 and 16.5, with the lowest limit being $6.3\times 10^6 ~\rm mK^2$ at $\rm k=0.14 \rm ~h~Mpc^{-1}$ and at $z=15.2$ with a possibility of a few \% of signal loss due to direction independent calibration. △ Less

Submitted 26 May, 2021; originally announced May 2021.

Comments: 17 pages, 18 figures, accepted to MNRAS

A Real Time Processing System for Big Data in Astronomy: Applications to HERA

Authors: Paul La Plante, Peter K. G. Williams, Matthew Kolopanis, Joshua S. Dillon, Adam P. Beardsley, Nicholas S. Kern, Michael Wilensky, Zaki S. Ali, Zara Abdurashidova, James E. Aguirre, Paul Alexander, Yanga Balfour, Gianni Bernardi, Tashalee S. Billings, Judd D. Bowman, Richard F. Bradley, Phil Bull, Jacob Burba, Steve Carey, Chris L. Carilli, Carina Cheng, David R. DeBoer, Matt Dexter, Eloy de Lera Acedo, John Ely , et al. (50 additional authors not shown)

Abstract: As current- and next-generation astronomical instruments come online, they will generate an unprecedented deluge of data. Analyzing these data in real time presents unique conceptual and computational challenges, and their long-term storage and archiving is scientifically essential for generating reliable, reproducible results. We present here the real-time processing (RTP) system for the Hydrogen… ▽ More As current- and next-generation astronomical instruments come online, they will generate an unprecedented deluge of data. Analyzing these data in real time presents unique conceptual and computational challenges, and their long-term storage and archiving is scientifically essential for generating reliable, reproducible results. We present here the real-time processing (RTP) system for the Hydrogen Epoch of Reionization Array (HERA), a radio interferometer endeavoring to provide the first detection of the highly redshifted 21 cm signal from Cosmic Dawn and the Epoch of Reionization by an interferometer. The RTP system consists of analysis routines run on raw data shortly after they are acquired, such as calibration and detection of radio-frequency interference (RFI) events. RTP works closely with the Librarian, the HERA data storage and transfer manager which automatically ingests data and transfers copies to other clusters for post-processing analysis. Both the RTP system and the Librarian are public and open source software, which allows for them to be modified for use in other scientific collaborations. When fully constructed, HERA is projected to generate over 50 terabytes (TB) of data each night, and the RTP system enables the successful scientific analysis of these data. △ Less

Submitted 30 September, 2021; v1 submitted 8 April, 2021; originally announced April 2021.

Comments: 15 pages, 3 figures, published in Astronomy and Computing

Journal ref: Astronomy and Computing 36 (2021) 100489

The Impact of Tandem Redundant/Sky-Based Calibration in MWA Phase II Data Analysis

Authors: Zheng Zhang, Jonathan C. Pober, Wenyang Li, Bryna J. Hazelton, Miguel F. Morales, Cathryn M. Trott, Christopher H. Jordan, Ronniy C. Joseph, Adam Beardsley, Nichole Barry, Ruby Byrne, Steven J. Tingay, Aman Chokshi, Kenji Hasegawa, Daniel C. Jacobs, Adam Lanman, Jack L. B. Line, Christene Lynch, Benjamin McKinley, Daniel A. Mitchell, Steven Murray, Bart Pindor, Mahsa Rahimi, Keitaro Takahashi, Randall B. Wayth , et al. (4 additional authors not shown)

Abstract: Precise instrumental calibration is of crucial importance to 21-cm cosmology experiments. The Murchison Widefield Array's (MWA) Phase II compact configuration offers us opportunities for both redundant calibration and sky-based calibration algorithms; using the two in tandem is a potential approach to mitigate calibration errors caused by inaccurate sky models. The MWA Epoch of Reionization (EoR)… ▽ More Precise instrumental calibration is of crucial importance to 21-cm cosmology experiments. The Murchison Widefield Array's (MWA) Phase II compact configuration offers us opportunities for both redundant calibration and sky-based calibration algorithms; using the two in tandem is a potential approach to mitigate calibration errors caused by inaccurate sky models. The MWA Epoch of Reionization (EoR) experiment targets three patches of the sky (dubbed EoR0, EoR1, and EoR2) with deep observations. Previous work in \cite{Li_2018} and \cite{Wenyang_2019} studied the effect of tandem calibration on the EoR0 field and found that it yielded no significant improvement in the power spectrum over sky-based calibration alone. In this work, we apply similar techniques to the EoR1 field and find a distinct result: the improvements in the power spectrum from tandem calibration are significant. To understand this result, we analyze both the calibration solutions themselves and the effects on the power spectrum over three nights of EoR1 observations. We conclude that the presence of the bright radio galaxy Fornax A in EoR1 degrades the performance of sky-based calibration, which in turn enables redundant calibration to have a larger impact. These results suggest that redundant calibration can indeed mitigate some level of model-incompleteness error. △ Less

Submitted 19 September, 2020; originally announced September 2020.

Comments: 20 pages, 11 figures, accepted for publication in PASA

A Unified Calibration Framework for 21 cm Cosmology

Authors: Ruby Byrne, Miguel F. Morales, Bryna Hazelton, Michael Wilensky

Abstract: Calibration precision is currently a limiting systematic in 21 cm cosmology experiments. While there are innumerable calibration approaches, most can be categorized as either `sky-based,' relying on an extremely accurate model of astronomical foreground emission, or `redundant,' requiring a precisely regular array with near-identical antenna response patterns. Both of these classes of calibration… ▽ More Calibration precision is currently a limiting systematic in 21 cm cosmology experiments. While there are innumerable calibration approaches, most can be categorized as either `sky-based,' relying on an extremely accurate model of astronomical foreground emission, or `redundant,' requiring a precisely regular array with near-identical antenna response patterns. Both of these classes of calibration are inflexible to the realities of interferometric measurement. In practice, errors in the foreground model, antenna position offsets, and beam response inhomogeneities degrade calibration performance and contaminate the cosmological signal. Here we show that sky-based and redundant calibration can be unified into a highly general and physically motivated calibration framework based on a Bayesian statistical formalism. Our new framework includes sky and redundant calibration as special cases but can additionally support relaxing the rigid assumptions implicit in those approaches. Furthermore, we present novel calibration techniques such as redundant calibration for arrays with no redundant baselines, representing an alternative calibration method for imaging arrays such as the MWA Phase I. These new calibration approaches could mitigate systematics and reduce calibration error, thereby improving the precision of cosmological measurements. △ Less

Submitted 2 March, 2021; v1 submitted 17 April, 2020; originally announced April 2020.

Comments: Accepted for publication in MNRAS. This updated version has a section exploring the effects of the unified calibration framework on simulated data and comparing unified calibration to sky-based and redundant calibration. It also has an expanded discussion of calibration biases

Quantifying Excess Power from Radio Frequency Interference in Epoch of Reionization Measurements

Authors: Michael J. Wilensky, Nichole Barry, Miguel F. Morales, Bryna J. Hazelton, Ruby Byrne

Abstract: We quantify the effect of radio frequency interference (RFI) on measurements of the 21-cm power spectrum during the Epoch of Reionization (EoR). Specifically, we investigate how the frequency structure of RFI source emission generates contamination in higher-order wave modes that is much more problematic than smooth-spectrum foreground sources. Using a relatively optimistic EoR model, we find that… ▽ More We quantify the effect of radio frequency interference (RFI) on measurements of the 21-cm power spectrum during the Epoch of Reionization (EoR). Specifically, we investigate how the frequency structure of RFI source emission generates contamination in higher-order wave modes that is much more problematic than smooth-spectrum foreground sources. Using a relatively optimistic EoR model, we find that even a single relatively dim RFI source can overwhelm the EoR power spectrum signal of $\sim10\text{ mK}^2$ for modes $0.1 \text{ }h\text{ Mpc}^{-1} < k < 2 \text{ }h\text{ Mpc}^{-1}$. If total apparent RFI flux density in the final power spectrum integration is kept below 1 mJy, an EoR signal resembling this optimistic model should be detectable for modes $k < 0.9\text{ }h\text{ Mpc}^{-1}$, given no other systematic contaminants and an error tolerance as high as 10%. More pessimistic models will be more restrictive. These results emphasize the need for highly effective RFI mitigation strategies for telescopes used to search for the EoR. △ Less

Submitted 11 August, 2020; v1 submitted 15 April, 2020; originally announced April 2020.

Deep multi-redshift limits on Epoch of Reionisation 21cm Power Spectra from Four Seasons of Murchison Widefield Array Observations

Authors: Cathryn M. Trott, C. H. Jordan, S. Midgley, N. Barry, B. Greig, B. Pindor, J. H. Cook, G. Sleap, S. J. Tingay, D. Ung, P. Hancock, A. Williams, J. Bowman, R. Byrne, A. Chokshi, B. J. Hazelton, K. Hasegawa, D. Jacobs, R. C. Joseph, W. Li, J. L. B Line, C. Lynch, B. McKinley, D. A. Mitchell, M. F. Morales , et al. (11 additional authors not shown)

Abstract: We compute the spherically-averaged power spectrum from four seasons of data obtained for the Epoch of Reionisation (EoR) project observed with the Murchison Widefield Array (MWA). We measure the EoR power spectrum over $k= 0.07-3.0~h$Mpc$^{-1}$ at redshifts $z=6.5-8.7$. The largest aggregation of 110 hours on EoR0 high-band (3,340 observations), yields a lowest measurement of (43~mK)$^2$ = 1.8… ▽ More We compute the spherically-averaged power spectrum from four seasons of data obtained for the Epoch of Reionisation (EoR) project observed with the Murchison Widefield Array (MWA). We measure the EoR power spectrum over $k= 0.07-3.0~h$Mpc$^{-1}$ at redshifts $z=6.5-8.7$. The largest aggregation of 110 hours on EoR0 high-band (3,340 observations), yields a lowest measurement of (43~mK)$^2$ = 1.8$\times$10$^3$ mK$^2$ at $k$=0.14~$h$Mpc$^{-1}$ and $z=6.5$ (2$σ$ thermal noise plus sample variance). Using the Real-Time System to calibrate and the CHIPS pipeline to estimate power spectra, we select the best observations from the central five pointings within the 2013--2016 observing seasons, observing three independent fields and in two frequency bands. This yields 13,591 2-minute snapshots (453 hours), based on a quality assurance metric that measures ionospheric activity. We perform another cut to remove poorly-calibrated data, based on power in the foreground-dominated and EoR-dominated regions of the two-dimensional power spectrum, reducing the set to 12,569 observations (419 hours). These data are processed in groups of 20 observations, to retain the capacity to identify poor data, and used to analyse the evolution and structure of the data over field, frequency, and data quality. We subsequently choose the cleanest 8,935 observations (298 hours of data) to form integrated power spectra over the different fields, pointings and redshift ranges. △ Less

Submitted 6 February, 2020; originally announced February 2020.

Comments: 19 pages, 29 figures, accepted for publication in Monthly Notices of the Royal Astronomical Society

First Season MWA Phase II EoR Power Spectrum Results at Redshift 7

Authors: W. Li, J. C. Pober, N. Barry, B. J. Hazelton, M. F. Morales, C. M. Trott, A. Lanman, M. Wilensky, I. Sullivan, A. P. Beardsley, T. Booler, J. D. Bowman, R. Byrne, B. Crosse, D. Emrich, T. M. O. Franzen, K. Hasegawa, L. Horsley, M. Johnston-Hollitt, D. C. Jacobs, C. H. Jordan, R. C. Joseph, T. Kaneuji, D. L. Kaplan, D. Kenney , et al. (22 additional authors not shown)

Abstract: The compact configuration of Phase II of the Murchison Widefield Array (MWA) consists of both a redundant subarray and pseudo-random baselines, offering unique opportunities to perform sky-model and redundant interferometric calibration. The highly redundant hexagonal cores give improved power spectrum sensitivity. In this paper, we present the analysis of nearly 40 hours of data targeting one of… ▽ More The compact configuration of Phase II of the Murchison Widefield Array (MWA) consists of both a redundant subarray and pseudo-random baselines, offering unique opportunities to perform sky-model and redundant interferometric calibration. The highly redundant hexagonal cores give improved power spectrum sensitivity. In this paper, we present the analysis of nearly 40 hours of data targeting one of the MWA's EoR fields observed in 2016. We use both improved analysis techniques presented in Barry et al. (2019) as well as several additional techniques developed for this work, including data quality control methods and interferometric calibration approaches. We show the EoR power spectrum limits at redshift 6.5, 6.8 and 7.1 based on our deep analysis on this 40-hour data set. These limits span a range in $k$ space of $0.18$ $h$ $\mathrm{Mpc^{-1}}$ $<k<1.6$ $h$ $\mathrm{Mpc^{-1}}$, with a lowest measurement of $Δ^2\leqslant2.39\times 10^3$ $\mathrm{mK}^2$ at $k=0.59$ $h$ $\mathrm{Mpc^{-1}}$ and $z=6.5$. △ Less

Submitted 20 December, 2019; v1 submitted 22 November, 2019; originally announced November 2019.

Comments: 26 pages, 15 figures, 3 tables. Updated acknowledgements. Published in ApJ

Journal ref: ApJ (2019) 887 141

Improving the Epoch of Reionization Power Spectrum Results from Murchison Widefield Array Season 1 Observations

Authors: N. Barry, M. Wilensky, C. M. Trott, B. Pindor, A. P. Beardsley, B. J. Hazelton, I. S. Sullivan, M. F. Morales, J. C. Pober, J. Line, B. Greig, R. Byrne, A. Lanman, W. Li, C. H. Jordan, R. C. Joseph, B. McKinley, M. Rahimi, S. Yoshiura, J. D. Bowman, B. M. Gaensler, J. N. Hewitt, D. C. Jacobs, D. A. Mitchell, N. Udaya Shankar , et al. (5 additional authors not shown)

Abstract: Measurements of 21 cm Epoch of Reionization (EoR) structure are subject to systematics originating from both the analysis and the observation conditions. Using 2013 data from the Murchison Widefield Array (MWA), we show the importance of mitigating both sources of contamination. A direct comparison between results from Beardsley et al. 2016 and our updated analysis demonstrates new precision techn… ▽ More Measurements of 21 cm Epoch of Reionization (EoR) structure are subject to systematics originating from both the analysis and the observation conditions. Using 2013 data from the Murchison Widefield Array (MWA), we show the importance of mitigating both sources of contamination. A direct comparison between results from Beardsley et al. 2016 and our updated analysis demonstrates new precision techniques, lowering analysis systematics by a factor of 2.8 in power. We then further lower systematics by excising observations contaminated by ultra-faint RFI, reducing by an additional factor of 3.8 in power for the zenith pointing. With this enhanced analysis precision and newly developed RFI mitigation, we calculate a noise-dominated upper limit on the EoR structure of $Δ^2 \leq 3.9 \times 10^3$ mK$^2$ at $k=0.20$ $\textit{h}$ Mpc$^{-1}$ and $z=7$ using 21 hr of data, improving previous MWA limits by almost an order of magnitude. △ Less

Submitted 8 October, 2019; v1 submitted 2 September, 2019; originally announced September 2019.

Comments: 21 pages, 10 figures, published in ApJ, updated title and text

Absolving the SSINS of Precision Interferometric Radio Data: A New Technique for Mitigating Faint Radio Frequency Interference

Authors: Michael J. Wilensky, Miguel F. Morales, Bryna J. Hazelton, Nichole Barry, Ruby Byrne, Sumit Roy

Abstract: We introduce a new pipeline for analyzing and mitigating radio frequency interference (RFI), which we call Sky-Subtracted Incoherent Noise Spectra (SSINS). SSINS is designed to identify and remove faint RFI below the single baseline thermal noise by employing a frequency-matched detection algorithm on baseline-averaged amplitudes of time-differenced visibilities. We demonstrate the capabilities of… ▽ More We introduce a new pipeline for analyzing and mitigating radio frequency interference (RFI), which we call Sky-Subtracted Incoherent Noise Spectra (SSINS). SSINS is designed to identify and remove faint RFI below the single baseline thermal noise by employing a frequency-matched detection algorithm on baseline-averaged amplitudes of time-differenced visibilities. We demonstrate the capabilities of SSINS using the Murchison Widefield Array (MWA) in Western Australia. We successfully image aircraft flying over the array via digital television (DTV) reflection detected using SSINS and summarize an RFI occupancy survey of MWA Epoch of Reionization data. We describe how to use SSINS with new data using a documented, publicly available implementation with comprehensive usage tutorials. △ Less

Submitted 9 October, 2019; v1 submitted 3 June, 2019; originally announced June 2019.

Comments: Publication Draft

Gridded and direct Epoch of Reionisation bispectrum estimates using the Murchison Widefield Array

Authors: Cathryn M. Trott, Catherine A. Watkinson, Christopher H. Jordan, Shintaro Yoshiura, Suman Majumdar, N. Barry, R. Byrne, B. J. Hazelton, K. Hasegawa, R. Joseph, T. Kaneuji, K. Kubota, W. Li, J. Line, C. Lynch, B. McKinley, D. A. Mitchell, M. F. Morales, S. Murray, B. Pindor, J. C. Pober, M. Rahimi, J. Riding, K. Takahashi, S. J. Tingay , et al. (20 additional authors not shown)

Abstract: We apply two methods to estimate the 21~cm bispectrum from data taken within the Epoch of Reionisation (EoR) project of the Murchison Widefield Array (MWA). Using data acquired with the Phase II compact array allows a direct bispectrum estimate to be undertaken on the multiple redundantly-spaced triangles of antenna tiles, as well as an estimate based on data gridded to the $uv$-plane. The direct… ▽ More We apply two methods to estimate the 21~cm bispectrum from data taken within the Epoch of Reionisation (EoR) project of the Murchison Widefield Array (MWA). Using data acquired with the Phase II compact array allows a direct bispectrum estimate to be undertaken on the multiple redundantly-spaced triangles of antenna tiles, as well as an estimate based on data gridded to the $uv$-plane. The direct and gridded bispectrum estimators are applied to 21 hours of high-band (167--197~MHz; $z$=6.2--7.5) data from the 2016 and 2017 observing seasons. Analytic predictions for the bispectrum bias and variance for point source foregrounds are derived. We compare the output of these approaches, the foreground contribution to the signal, and future prospects for measuring the bispectra with redundant and non-redundant arrays. We find that some triangle configurations yield bispectrum estimates that are consistent with the expected noise level after 10 hours, while equilateral configurations are strongly foreground-dominated. Careful choice of triangle configurations may be made to reduce foreground bias that hinders power spectrum estimators, and the 21~cm bispectrum may be accessible in less time than the 21~cm power spectrum for some wave modes, with detections in hundreds of hours. △ Less

Submitted 17 May, 2019; originally announced May 2019.

Comments: 19 pages, 10 figures, accepted for publication in PASA

Robust statistics toward detection of the 21 cm signal from the Epoch of Reionisation

Authors: Cathryn M. Trott, Shih Ching Fu, Steven Murray, Christopher Jordan, Jack Line, N. Barry, R. Byrne, B. J. Hazelton, K. Hasegawa, R. Joseph, T. Kaneuji, K. Kubota, W. Li, C. Lynch, B. McKinley, D. A. Mitchell, M. F. Morales, B. Pindor, J. C. Pober, M. Rahimi, K. Takahashi, S. J. Tingay, R. B. Wayth, R. L. Webster, M. Wilensky , et al. (4 additional authors not shown)

Abstract: We explore methods for robust estimation of the 21 cm signal from the Epoch of Reionisation (EoR). A Kernel Density Estimator (KDE) is introduced for measuring the spatial temperature fluctuation power spectrum from the EoR. The KDE estimates the underlying probability distribution function of fluctuations as a function of spatial scale, and contains different systematic biases and errors to the t… ▽ More We explore methods for robust estimation of the 21 cm signal from the Epoch of Reionisation (EoR). A Kernel Density Estimator (KDE) is introduced for measuring the spatial temperature fluctuation power spectrum from the EoR. The KDE estimates the underlying probability distribution function of fluctuations as a function of spatial scale, and contains different systematic biases and errors to the typical approach to estimating the fluctuation power spectrum. Extraction of histograms of visibilities allows moments analysis to be used to discriminate foregrounds from 21 cm signal and thermal noise. We use the information available in the histograms, along with the statistical dis-similarity of foregrounds from two independent observing fields, to robustly separate foregrounds from cosmological signal, while making no assumptions about the Gaussianity of the signal. Using two independent observing fields to robustly discriminate signal from foregrounds is crucial for the analysis presented in this paper. We apply the techniques to 13 hours of Murchison Widefield Array (MWA) EoR data over two observing fields. We compare the output to that obtained with a comparative power spectrum estimation method, and demonstrate the reduced foreground contamination using this approach. Using the second moment obtained directly from the KDE distribution functions yields a factor of 2-3 improvement in power for k < 0.3hMpc^{-1} compared with a matched delay space power estimator, while weighting data by additional statistics does not offer significant improvement beyond that available for thermal noise-only weights. △ Less

Submitted 25 April, 2019; originally announced April 2019.

Comments: 19 pages, 18 figures, accepted for publication in MNRAS