Browsing by Author "Kittiwisit, Piyanat"

Now showing 1 - 5 of 5
  • Thumbnail Image
    Item
    Automated detection of antenna malfunctions in large-n interferometers: A case study with the hydrogen epoch of reionization array
    (2022) Storer, Dara; Dillon, Joshua S.; Kittiwisit, Piyanat
    We present a framework for identifying and flagging malfunctioning antennas in large radio interferometers. We outline two distinct categories of metrics designed to detect outliers along known failure modes of large arrays: cross-correlation metrics, based on all antenna pairs, and auto-correlation metrics, based solely on individual antennas. We define and motivate the statistical framework for all metrics used, and present tailored visualizations that aid us in clearly identifying new and existing systematics. We implement these techniques using data from 105 antennas in the Hydrogen Epoch of Reionization Array (HERA) as a case study. Finally, we provide a detailed algorithm for implementing these metrics as flagging tools on real data sets.
  • Thumbnail Image
    Item
    Matvis: a matrix-based visibility simulator for fast forward modelling of many-element 21 cm arrays
    (Oxford University Press, 2025) Kittiwisit, Piyanat; Bull, Philip; Murray, Steven
    Detection of the faint 21 cm line emission from the Cosmic Dawn and Epoch of Reionization will require not only exquisite control over instrumental calibration and systematics to achieve the necessary dynamic range of observations but also validation of analysis techniques to demonstrate their statistical properties and signal loss characteristics. A key ingredient in achieving this is the ability to perform high-fidelity simulations of the kinds of data that are produced by the large, many-element, radio interferometric arrays that have been purpose-built for these studies. The large scale of these arrays presents a computational challenge, as one must simulate a detailed sky and instrumental model across many hundreds of frequency channels, thousands of time samples, and tens of thousands of baselines for arrays with hundreds of antennas. In this paper, we present a fast matrix-based method for simulating radio interferometric measurements (visibilities) at the necessary scale. We achieve this through judicious use of primary beam interpolation, fast approximations for coordinate transforms, and a vectorized outer product to expand per-antenna quantities to per-baseline visibilities, coupled with standard parallelization techniques. We validate the results of this method, implemented in the publicly available matvis code, against a high-precision reference simulator, and explore its computational scaling on a variety of problems.
  • Thumbnail Image
    Item
    Measurements of one-point statistics in 21-cm intensity maps via foreground avoidance strategy
    (Oxford University Press, 2022) Kittiwisit, Piyanat; Bowman, Judd D.; Murray, Steven G.
    Measurements of the one-point probability distribution function and higher-order moments (variance, skewness, and kurtosis) of the high-redshift 21-cm fluctuations are among the most directstatistical probes of the non-Gaussian nature ofstructure formation and evolution during re-ionization. However, contamination from astrophysical foregrounds and instrument systematics pose significant challenges in measuring these statistics in real observations. In this work, we use forward modelling to investigate the feasibility of measuring 21-cm one-point statistics through a foreground avoidance strategy. Leveraging the characteristic wedge-shape of the foregrounds in k-space, we apply a wedge-cut filtre that removes the foreground contaminated modes from a mock data set based on the Hydrogen Epoch of Re-ionization Array (HERA) instrument, and measure the one-point statistics from the image-space representation of the remaining non-contaminated modes. We experiment with varying degrees of wedge-cutting over different frequency bandwidths and find that the centre of the band is the least susceptible to bias from wedge-cutting. Based on this finding, we introduce a rolling filtre method that allows reconstruction of an optimal wedge-cut 21-cm intensity map over the full bandwidth using outputs from wedge-cutting over multiple sub-bands. We perform Monte Carlo simulations to show that HERA should be able to measure the rise in skewness and kurtosis near the end of re-ionization with the rolling wedge-cut method if foreground leakage from the Fourier transform window function can be controlled.
  • Thumbnail Image
    Item
    A real time processing system for big data in astronomy: Applications to Hera
    (Elsevier, 2021) La Plante, Paul; Williams, Peter KG; Kittiwisit, Piyanat
    As current- and next-generation astronomical instruments come online, they will generate an unprecedented deluge of data. Analyzing these data in real time presents unique conceptual and computational challenges, and their long-term storage and archiving is scientifically essential for generating reliable, reproducible results. We present here the real-time processing (RTP) system for the Hydrogen Epoch of Reionization Array (HERA), a radio interferometer endeavoring to provide the first detection of the highly redshifted 21 cm signal from Cosmic Dawn and the Epoch of Reionization by an interferometer. The RTP system consists of analysis routines run on raw data shortly after they are acquired, such as calibration and detection of radio-frequency interference (RFI) events. RTP works closely with the Librarian, the HERA data storage and transfer manager which automatically ingests data and transfers copies to other clusters for post-processing analysis. Both the RTP system and the Librarian are public and open source software, which allows for them to be modified for use in other scientific collaborations. When fully constructed, HERA is projected to generate over 50 terabytes (TB) of data each night, and the RTP system enables the successful scientific analysis of these data.
  • Thumbnail Image
    Item
    Validation of the HERA Phase I Epoch of Reionization 21 cm Power Spectrum Software Pipeline
    (The American Astronomical Society., 2022) Aguirre, James E.; Murray, Steven G.; Kittiwisit, Piyanat
    We describe the validation of the HERA Phase I software pipeline by a series of modular tests, building up to an end-to-end simulation. The philosophy of this approach is to validate the software and algorithms used in the Phase I upper-limit analysis on wholly synthetic data satisfying the assumptions of that analysis, not addressing whether the actual data meet these assumptions. We discuss the organization of this validation approach, the specific modular tests performed, and the construction of the end-to-end simulations. We explicitly discuss the limitations in scope of the current simulation effort. With mock visibility data generated from a known analytic power spectrum and a wide range of realistic instrumental effects and foregrounds, we demonstrate that the current pipeline produces power spectrum estimates that are consistent with known analytic inputs to within thermal noise levels (at the 2σ level) for k > 0.2h Mpc−1 for both bands and fields considered. Our input spectrum is intentionally amplified to enable a strong “detection” at k ∼ 0.2 h Mpc−1 —at the level of ∼25σ—with foregrounds dominating on larger scales and thermal noise dominating at smaller scales. Our pipeline is able to detect this amplified input signal after suppressing foregrounds with a dynamic range (foreground to noise ratio) of 107. Our validation test suite uncovered several sources of scale-independent signal loss throughout the pipeline, whose amplitude is well characterized and accounted for in the final estimates. We conclude with a discussion of the steps required for the next round of data analysis.