This task performs a preliminary bandpass solution and applies it, then computes the flagging heuristics by calling hif_correctedampflag which looks for outlier visibility points by statistically examining the scalar difference of the corrected amplitude minus model amplitudes, flags those outliers, then derives a final bandpass solution (if any flags were generated). The philosophy is that only outlier data points that have remained outliers after calibration will be flagged. Note that the phase of the data is not assessed.

In further detail, the workflow is as follows: an a priori calibration is applied using pre-existing caltables in the calibration state, a preliminary bandpass solution and amplitude gaincal solution is solved and applied, the flagging heuristics are run and any outliers are flagged, a final bandpass solution is solved (if necessary) and the name "final" is appended to this caltable. Plots are generated at two points in this workflow: after bandpass calibration but before flagging heuristics are run, and after flagging heuristics have been run and applied. If no points were flagged, the "after" plots are not generated or displayed. The score for this stage is a simple combination (multiplication) of the standard data flagging score (depending on the fraction of data flagged) and the score for the bandpass solution.

Contents

Flagging

Report Files
Measurement Set Flagging Commands Number of Statements
uid___A002_Xe20b32_X84e7.ms uid___A002_Xe20b32_X84e7.ms-flag_commands.txt 0

Flagged data summary

Measurement Set: uid___A002_Xe20b32_X84e7.ms

Summary of flagged data. Each cell states the amount of data flagged as a fraction of the specified data selection.
Data Selection flagged before flagged after
TOTAL 35.9% 35.9%
BANDPASS 20.3% 20.3%
AMPLITUDE 20.3% 20.3%
PHASE 20.2% 20.2%
TARGET 20.2% 20.2%

Bandpass results

Phase-up on bandpass calibrator

Applied calibrations and parameters used for phase-up calibration
Measurement Set Phase-up Solution Parameters
Type Interval Min Baselines per Antenna Min SNR Phase-up Bandwidth
uid___A002_Xe20b32_X84e7.ms Phase only Per integration (10.08s) 4 3.0

Bandpass calibration

Parameters used for bandpass calibration
Measurement Set Solution Parameters Applied To Calibration Table
Type Interval Scan Intent Spectral Windows
uid___A002_Xe20b32_X84e7.ms Channel inf,7.812500MHz(16.0ch) ALL 16 uid___A002_Xe20b32_X84e7.ms.hifa_bandpassflag.s12_2.spw16_18_20_22.channel.solintinf.bcal.final.tbl
inf,3.906250MHz(8.0ch) 18
inf,7.812500MHz(64.0ch) 20
22

Plots

Plots show the bandpass correction applied to the target source. The first two plots show amplitude vs frequency; one for the reference antenna and one for a typical antenna, identified the antenna with mode score. The third plot shows phase vs frequency for the typical antenna.

Click the summary plots to enlarge them, or the plot title to see see detailed plots per spectral window and antenna.

uid___A002_Xe20b32_X84e7.ms

Amplitude vs frequency (show uid___A002_Xe20b32_X84e7.ms)

The plots below show amplitude vs frequency for the bandpass correction, overlayed for all spectral windows and correlations. Click on the link above to show show detailed plots for all antennas, or on the links below to show plots with specific antennas preselected.

Reference antenna (CM10) ( show CM10)

Amplitude vs frequency for the reference antenna (CM10). Click the link above to show detailed plots for CM10.

Typical antenna (CM01) ( show CM01 )

Amplitude vs frequency for a typical antenna (CM01). Click the link above to show detailed plots for CM01.

NB. random antenna until scores are working

Phase vs frequency (show uid___A002_Xe20b32_X84e7.ms)

The plot below shows phase vs frequency for the bandpass correction, overlayed for all spectral windows and correlations. Click on the link above to show show phase vs frequency plots for all antennas, or on the link for just the typical antenna.

Typical antenna (CM01) ( show CM01 )

Phase vs frequency for a typical antenna (CM01). Click the link above to show detailed plots for CM01.

Amplitude vs time

These plots show amplitude vs time for two cases: 1, the calibrated data before application of any flags; and 2, where flagging was applied, the calibrated data after application of flags.

Data are plotted for all antennas and correlations, with different correlations shown in different colours.

uid___A002_Xe20b32_X84e7.ms

Spectral Window 16

Intents: BANDPASS

Calibrated data before flagging.

Spectral Window 18

Intents: BANDPASS

Calibrated data before flagging.

Spectral Window 20

Intents: BANDPASS

Calibrated data before flagging.

Spectral Window 22

Intents: BANDPASS

Calibrated data before flagging.

Amplitude vs UV distance

These plots show amplitude vs UV distance for two cases: 1, the calibrated data before application of any flags; and 2, where flagging was applied, the calibrated data after application of flags.

Data are plotted for all antennas and correlations, with different correlations shown in different colours.

uid___A002_Xe20b32_X84e7.ms

Spectral Window 16

Intents: BANDPASS

Calibrated data before flagging.

Spectral Window 18

Intents: BANDPASS

Calibrated data before flagging.

Spectral Window 20

Intents: BANDPASS

Calibrated data before flagging.

Spectral Window 22

Intents: BANDPASS

Calibrated data before flagging.

Pipeline QA summary for this task.
Score Reason
1.00 Combined score for uid___A002_Xe20b32_X84e7.ms: multiplication of flagging score 1.00 and bandpass score 1.00.
1.00 Lowest score for amplitude SNR is 1.00 (uid___A002_Xe20b32_X84e7.ms unknown origin)
1.00 Lowest score for phase derivative is 1.00 (uid___A002_Xe20b32_X84e7.ms unknown origin)
1.00 0.00% of unflagged data with intent BANDPASS in uid___A002_Xe20b32_X84e7.ms was newly flagged.
opacity
 
bandtype
B
solint
inf
spw
16,18,20,22
vis
/opt/dared/opt/dared.2019AUG/mnt/dataproc/2019.1.00195.L_2019_10_13T21_07_41.359/SOUS_uid___A001_X146c_X95/GOUS_uid___A001_X146c_X9d/MOUS_uid___A001_X146c_Xa2/working/uid___A002_Xe20b32_X84e7.ms
evenbpints
True
antpossig
4.6
phaseupsolint
int
bpnsols
8
tmint
0.085
antenna
 
minbpsnr
20.0
field
J0538-4405
antblnegsig
3.4
combine
scan
output_dir
/opt/dared/opt/dared.2019AUG/mnt/dataproc/2019.1.00195.L_2019_10_13T21_07_41.359/SOUS_uid___A001_X146c_X95/GOUS_uid___A001_X146c_X9d/MOUS_uid___A001_X146c_Xa2/working
tmbl
0.175
solnorm
True
antnegsig
4.0
bpsnr
50.0
maxchannels
240
intent
BANDPASS
relaxed_factor
2.0
phaseupsnr
20.0
refant
CM10,CM03,CM02,CM12,CM05,CM08,CM07,CM01,CM11,CM04
hm_bandpass
snr
niter
2
antblpossig
3.2
minblperant
4
caltable
/opt/dared/opt/dared.2019AUG/mnt/dataproc/2019.1.00195.L_2019_10_13T21_07_41.359/SOUS_uid___A001_X146c_X95/GOUS_uid___A001_X146c_X9d/MOUS_uid___A001_X146c_Xa2/working/uid___A002_Xe20b32_X84e7.ms.s12_0.spw16_18_20_22.channel.solintinf.bcal.tbl
phaseupnsols
2
minsnr
3.0
mode
channel
tmantint
0.063
selectdata
False
hm_phaseup
snr
phaseupbw
 
Start time
2019-10-13 21:32:42.503
End
2019-10-13 21:35:39.129
Duration
0:02:56.626
Note, WebLog generation is not included in the time.

CASA logs for stage 12