NOTES: Some shadowing: most of 2nd Pri of Ant 16 (flagging the little bit there) & all of last 2 Secs in Ant 21 The galaxy is there, and it *is* rotating (channels ~76-136). There are also a few continuum sources. LITTLE THINGS AIPS Reduction of Haro29, C2 (AW) config.: VLA Obs. of 19apr08 ===================================================================== calibration recipe v. 2.0: mrupen 10oct08 calibration recipe v. 2.1: mrupen 13oct08 calibration recipe v. 2.1.update: Dana Ficut Vicas 29Oct08 (new adverbs in Aips) calibration recipe v. 2.2: Dana Ficut Vicas 11Dec08(tiny bits) calibration recipe v. 2.3: Dana Ficut Vicas 11 Feb 09(UVCOP ambiguities) calibration recipe v. 2.4: Dana Ficut Vicas 3 Mar 09(team raised issues) Latest update: 3rd March 2009 (Actually, this is a tiny bit different- all parameters are ordered as in AIPS) Data reduced by Kim Herrmann, Lowell 23jun09-23jun09 Suggestion: STARTING with D ARRAY and then working through C array and B array is recommended. D array data will allow you to have a look at the whole field (the strong continuum sources that might give problems will be obvious here), is more stable and will give you the best feel for the data. The recipe lists the B-array reduction, but obviously the same steps apply to all configurations. ^0. Basic stuff C2 configuration (AW) From observing log (available online at http://www.lowell.edu/users/dah/littleteam/haro29/vla/obs/logs_AH927_AW.html): Observing: 19Apr08 09:20:29-11:19:20 (19Apr08 02:20:29-04:19:20 local time) * Wind/API rms phase/clouds: 19Apr 09:19:40 SE at 0.6 m/s 2.4 API Sky clear. 19Apr 10:59:45 E at 1.5 m/s 1.1 API Sky clear. * ant. 2, 5 (do not have good baseline positions because recently moved) * EVLA antennas: 1, 4, 11, 13, 14, 16, 17, 18, 19, 21, 23, 24, 25, 26 (14 antennas) * ant. 5 LOST (EVLA: Antenna is undergoing EVLA testing.) (whole time) ^1. FILLM executed on 23jun09 ^a. Request archive data: requested AH927_AW_1 and saved temporarily as /Users/herrmann/Desktop/AH927_C_AW_1 ^b. FILLM -> Haro29-C2.CH 0.1, Haro29-C2.LINE.1 (1 & 2) default FILLM datain '/Users/herrmann/Desktop/AH927_C_AW_ nfiles 0 $ normally don't skip any files band 'L' qual 1 $ restricts FILLM to the galaxy+calibrators of interest vlaobs 'AH927' timerang 0 0 $ No other scans before or after Haro29 outna 'Haro29-C2 outseq 0; outdisk 1 douvcomp=-1 $ allow channel/IF-dependent weights doconcat=-1 $ Change this to DOCONCAT=1 to add data to an existing file ncount 1 $ read one file doweight 10 $ use memo 108 weights (i.e., put weights in 1/Jy^2) cparm 0 cparm(4)=25.1 $ one needs to explicitly flag shadowed antennas $ since the ModComps were retired on 27 June 2007 $ this requires FILLM in 31DEC08 after 18Nov08 MNJ cparm(7)= 0 $ assigns new FREQID if frequency changes by more than $ the max. Doppler shift between sources 180 degrees $ apart. Setting this to -1 forces all data to have same FREQID. bparm= -1,-1 $ avoid opacity & gain corrections doall -1 $ DOESN'T SEEM TO BE THERE ***N.B. FILLM's channel 0 will ONLY be used for initial flagging. We're quite paranoid here. tortue> FILLM1: ****************************************************** tortue> FILLM1: ** Times written by FILLM are now centered in ** tortue> FILLM1: ** the integration, before they were at the end ** tortue> FILLM1: ****************************************************** tortue> FILLM1: Shadow flag limit = 2.510E+01 meters. tortue> FILLM1: No opacity correction in CL table. tortue> FILLM1: No gain curve correction in CL table. tortue> FILLM1: Opening /Users/herrmann/Desktop/AH927_C_AW_1 tortue> FILLM1: tortue> FILLM1: *** ATTENTION - default: loading subarray 1 *** tortue> FILLM1: tortue> FILLM1: tape file # 1, start date/time = 20080419/09:20:30 tortue> FILLM1: MCINI: Processing Correlator Code '2AC ' with 26 antennas. tortue> FILLM1: MCINI - Mode 2AC compatible tortue> FILLM1: Program = AH927 ; Tape revision number = 33. tortue> FILLM1: Create Haro29-C2 .CH 0 . 1 (UV) on disk 1 cno 1 tortue> FILLM1: Ref. date = 20080419 A-C = 1.419004 B-D = 1.419004 GHz tortue> FILLM1: Create Haro29-C2 .LINE . 1 (UV) on disk 1 cno 2 tortue> FILLM1: Ref. date = 20080419 A-C = 1.419004 B-D = 1.419004 GHz tortue> FILLM1: FLMFQ: FQ entry tolerance = 1.609D+02 tortue> FILLM1: Found 1331+305 : 1 1.562 MHz at IAT 0/ 09:20:25.0 tortue> FILLM1: MCINI: Processing Correlator Code '2AC ' with 26 antennas. tortue> FILLM1: MCINI - Mode 2AC compatible tortue> FILLM1: Ref. date = 20080419 A-C = 1.419004 B-D = 1.419004 GHz tortue> FILLM1: Appending new data to: Haro29-C2 .CH 0 . 1 disk 1 tortue> FILLM1: Ref. date = 20080419 A-C = 1.419004 B-D = 1.419004 GHz tortue> FILLM1: Appending new data to: Haro29-C2 .LINE . 1 disk 1 tortue> FILLM1: Found 1331+305 : 1 1.562 MHz at IAT 0/ 09:20:35.0 tortue> FILLM1: Found 1331+305 : 1 1.562 MHz at IAT 0/ 09:27:55.0 tortue> FILLM1: Found 1227+365 : 1 1.562 MHz at IAT 0/ 09:32:25.0 tortue> FILLM1: Found HARO29 : 1 1.562 MHz at IAT 0/ 09:36:15.0 tortue> FILLM1: Found 1227+365 : 1 1.562 MHz at IAT 0/ 09:56:15.0 tortue> FILLM1: Found HARO29 : 1 1.562 MHz at IAT 0/ 10:00:15.0 tortue> FILLM1: Found 1227+365 : 1 1.562 MHz at IAT 0/ 10:20:05.0 tortue> FILLM1: Found HARO29 : 1 1.562 MHz at IAT 0/ 10:24:05.0 tortue> FILLM1: Found 1227+365 : 1 1.562 MHz at IAT 0/ 10:44:05.0 tortue> FILLM1: Found HARO29 : 1 1.562 MHz at IAT 0/ 10:48:05.0 tortue> FILLM1: Found 1227+365 : 1 1.562 MHz at IAT 0/ 11:08:05.0 tortue> FILLM1: Found 1331+305 : 1 1.562 MHz at IAT 0/ 11:11:55.0 tortue> FILLM1: Dropped 975 shadowed vis at limit 2.5100E+01 meter tortue> FILLM1: Read 202589 visibilities from 1 files tortue> FILLM1: Appears to have ended successfully ^2. TASAV -> LINSAV.1 executed on 23jun09 ***We TASAV right away, because VLANT changes the AN table. Did I mention we're paranoid? default TASAV outna 'Haro29C2BgTb outcla 'LINSAV' outdi 2 $ Ideally set this to a different disk from indisk, $ in case of disk crashes getn 2 $ *.LINE ^3. UVCOP -> LINCOP.1 executed on 23jun09 ***Discard the first and last channels: 1st and last 10 channels if 127 channels total 1st and last 20 channels if 255 channels total ***We discard these Evil Channels because (1) they're pretty much useless; (2) they seem to confuse BPASS (which takes the solution from channel N as the initial guess for channel N+1); (3) their noise characteristics are quite different from the rest of the channels, which can be confusing e.g. in clipping and imaging. default UVCOP outcla 'LINCOP' bchan 21; echan 235 $ Use bchan 21; echan 235 for 255 channels $ Use bchan 11; echan 117 for 127 channels uvcopprm 0 uvcopprm(4) 1 $ report progress getn 2 $ *.LINE ***From now on we operate on LINCOP data (34) unless otherwise specified. ^4. LISTR/SCAN --> Haro29-C2.listr ***We do this before VLANT because we need to know FREQIDs for VLANT default LISTR optype 'SCAN' docrt -1 outpr '/Users/herrmann/Desktop/Haro29-C2.listr getn 34 $ *.LINCOP --> *.listr tortue LISTR(31DEC08) 4 23-JUN-2009 11:33:53 Page 1 File = Haro29-C2 .LINCOP. 1 Vol = 1 Userid = 4 Freq = 1.419003570 GHz Ncor = 2 No. vis = 202589 Scan summary listing Scan Source Qual Calcode Sub Timerange FrqID START VIS END VIS 1 1331+305 : 0001 A 1 0/09:27:55 - 0/09:31:35 1 1 6061 2 1227+365 : 0001 A 1 0/09:32:25 - 0/09:35:35 1 6062 12561 3 HARO29 : 0001 1 0/09:36:15 - 0/09:55:35 1 12562 50492 4 1227+365 : 0001 A 1 0/09:56:15 - 0/09:59:35 1 50493 57292 5 HARO29 : 0001 1 0/10:00:15 - 0/10:19:25 1 57293 94967 6 1227+365 : 0001 A 1 0/10:20:05 - 0/10:23:25 1 94968 101792 7 HARO29 : 0001 1 0/10:24:05 - 0/10:43:25 1 101793 139568 8 1227+365 : 0001 A 1 0/10:44:05 - 0/10:47:25 1 139569 145868 9 HARO29 : 0001 1 0/10:48:05 - 0/11:07:25 1 145869 183893 10 1227+365 : 0001 A 1 0/11:08:05 - 0/11:11:15 1 183894 189293 11 1331+305 : 0001 A 1 0/11:11:55 - 0/11:19:15 1 189294 202589 Source summary Velocity type = ' ' Definition = ' ' ID Source Qual Calcode RA(2000.0) Dec(2000.0) IFlux QFlux UFlux VFlux No. vis 1 1331+305 : 0001 A 13:31:08.2879 30:30:32.958 0.000 0.000 0.000 0.000 19357 2 1227+365 : 0001 A 12:27:58.7254 36:35:11.827 0.000 0.000 0.000 0.000 31825 3 HARO29 : 0001 12:26:16.0000 48:29:37.000 0.000 0.000 0.000 0.000 151407 ID Source Freq(GHz) Velocity(Km/s) Rest freq (GHz) 1 All Sources 1.4190 0.0000 0.0000 Frequency Table summary FQID IF# Freq(GHz) BW(kHz) Ch.Sep(kHz) Sideband 1 1 1.41900357 1312.2560 6.1035 1 Primary: 3:50, 7:30-> 11:20 Secondary: 3:20, 3:30: 3:30, 3:30, 3:20 -> 17:10 Galaxy: 19:30, 19:20, 19:30, 19:30 -> 77:50 total However, subtract 10s out of 1 scans-> so 77:40 total (1.294 hrs = 01:17:40) ^5. VLANT -> AN/1, CL/2 executed on 23jun09 ***Note that VLANT can be run only for data observed from 1992 onwards. Data earlier than 1991 produce the following error message: VLANT1: Task VLANT (release of 31DEC07) begins VLANT1: ANT DATA UNAVAILABLE FOR YEAR 1991 DATA START WITH 1992 VLANT1: Purports to die of UNNATURAL causes For earlier data we skip baseline corrections entirely, and hope for the best. If there are clear and systematic phase gradients with time, consult the baseline corrections at http://www.vla.nrao.edu/astro/archive/baselines/ and apply corrections via CLCOR (which is basically what VLANT does). ***Note that if you get an error like the following: /tmp/baselines.vlais09 copied from the VLA web site, ZABORS: signal 11 received, ABORT! you can probably solve this by going to http://www.vla.nrao.edu/astro/archive/baselines/ and copying the list of baseline corrections from the current year (say, 2009) into aips/TEXT/STARS/VLA.ant.2009 (Make sure there are no empty lines at the start of the file) ***10oct08: Currently VLANT works on only one FREQID at a time. We therefore have to run VLANT multiple times for data with multiple FREQIDs. Unfortunately VLANT (1) produces a new CL table every time, and (2) updates the AN table positions every time as well. : CL tables: I'd like to maintain the convention that CL/1 is the original CL table and CL/2 has all the corrections that should have been applied on-line but weren't -- mainly, antenna position corrections. For multiple FREQIDs therefore this recipe calls for deleting the intermediate CL tables created by VLANT, using the rather clumsy mechanism of TASAVing to a temporary file, deleting the original CL tables, and copying the latest one back from the TASAV'd data set. Blah. : AN table: For now, this recipe resets to the original AN table just before running VLANT the last time. This means that only one run of VLANT updates the AN entries, leading to a correct AN table as needed for (e.g.) UVFIX. I've e-mailed DAIP to see about fixing all this, by allowing FREQID= -1 to mean "calculate corrections for all FREQIDs" (currently FREQID= -1 is reset to FREQID= 1). We'll see what Eric says. #####VLANT no longer has freqid as a parameter. ^5a. default VLANT getn 34 $ *.LINCOP tortue> VLANT1: WARNING: 2 ANTENNAS MAY STILL GET MORE CORRECTION tortue> VLANT1: Copied CL file from vol/cno/vers 1 34 1 to 1 34 2 tortue> VLANT1: CL version input 1 output 2 tortue> VLANT1: VLANT STNID(10) = 'E8 ' tortue> VLANT1: VLANT XCOR(10) = 0.0013 tortue> VLANT1: VLANT YCOR(10) = 0.0000 tortue> VLANT1: VLANT ZCOR(10) = 0.0004 tortue> VLANT1: VLANT STNID(16) = 'W6 ' tortue> VLANT1: VLANT XCOR(16) = 0.0013 tortue> VLANT1: VLANT YCOR(16) = 0.0008 tortue> VLANT1: VLANT ZCOR(16) = 0.0002 tortue> VLANT1: Appears to have ended successfully %%% Probably the warning is about antenna 2, 5, or 29 which aren't being used (from step 6 PRTAN) x5b. If VLANT does not create a new CL table (no antennas moved), or the data were taken before 1992: default TACOP getn 34 $ *.LINCOP getona 34 $ *.LINCOP inext 'CL' ; inver 1 ; ncount 1 ; outver 2 ***The goal here is to keep the recipe uniform for all data. ^6. PRTAN AN/1 default PRTAN docrt 132 getn 34 $ *.LINCOP Location Of VLA Antennas N18 ( 7) N16 (13)* N14 (27) N12 (18)* N8 ( 9) N6 (26)* N4 (12) N2 (25)* N1 (15) (22) W2 E2 (21)* *(19) W4 ( ) *(16) W6 E6 (28) ( 6) W8 E8 (10) *( 1) W10 E10 (11)* *(24) W12 E12 (20) *(17) W14 E14 ( 3) ( 8) W16 E16 (14)* *( 4) W18 E18 (23)* VLA:_OUT ( 2) VLA:_OUT ( 5) VPT:_OUT (29) * => EVLA ANTENNA ***To choose the reference antenna the following algorithm should be followed: 1. should be present throughout the run 2. should be on an "inner" pad, but NOT N1/E1/W1 (to avoid shadowing) 3. NOT on the master pad (since those are always weird) 4. NOT an EVLA antenna (since those are often weird) 5. try to avoid the north arm in the smaller configurations (to avoid shadowing) 6. NOT listed in any interesting way in the log file (to avoid problems with the reference antenna) 7. preferably consistent with other recent runs 8. should be a fairly stable antenna (can't tell until TVFLG/CALIB of course...) ===> Refant: 22 $ W2 ^7. Calibrators ***Check out the calibrators in the on-line calibrator manual: http://www.vla.nrao.edu/astro/calib/manual/index.shtml ***Max baseline at 21 cm in B array is 54.3 klambda C array is 16.2 klambda D array is 4.9 klambda primary (flux/bandpass) calibrators: 0137+331= 3C48 0542+498= 3C247 1331+305= 3C286 $ This one once @ beginning & at end ***You can ignore the uv-ranges for these, since there are now models for the most important ones. %%%HOWEVER, in UVPLT the amplitude for 0542+498 will drop off (as in CnB) because UVmax is 50 kL %%%Same for 0137+331, because UVmax is 40 kL 1331+305 J2000 A 13h31m08.287984s 30d30'32.958850" Aug01 3C286 1328+307 C2950 A 13h28m49.657700s 30d45'58.640000" ----------------------------------------------------- BAND A B C D FLUX(Jy) UVMIN(kL) UVMAX(kL) ===================================================== 90cm P S S S S 26.00 visplot 20cm L S S P P 15.00 visplot 6cm C S S S P 7.47 3.7cm X S P P P 5.23 400 visplot 2cm U S S S S 3.40 visplot 1.3cm K X S S P 2.59 visplot 0.7cm Q X S P P 1.45 300 visplot secondary (gain) calibrator: 1227+365 1227+365 J2000 A 12h27m58.725446s 36d35'11.827350" Aug01 1225+368 C2950 A 12h25m30.766000s 36d51'46.915000" ----------------------------------------------------- BAND A B C D FLUX(Jy) UVMIN(kL) UVMAX(kL) ===================================================== 20cm L P P P P 2.10 6cm C P P P P 0.80 3.7cm X S S S S 0.38 0.7cm Q X X X X 0.04 ===> secondary cal --- No UVMax restriction %%% Don't need to worry about restrictions because C array max is 16.2 kL ^7b. SETJY -> SU/1 executed on 23jun09 ***Set aparm(2) to correspond to date of observation. If date <1990 aparm(2)=3 If 19921998 aparm(2)=0 ***We need to enter a flux density for each primary (flux) calibrator. If we have only one FREQID, this is easy: default SETJY sources '1331+305','' $ primary (flux) calibrator(s) '0542+498','0137+331', optype 'CALC' freqid = 1 $ First FREQID aparm 0,0 $ data taken after 1998 (2008) getn 34 $ *.LINCOP ; --> / Flux calculated using known spectrum tortue> SETJY1: / Flux calculated using known spectrum tortue> SETJY1: BIF = 1 EIF = 1 /Range of IFs tortue> SETJY1: '1331+305 ' IF = 1 FLUX =14.7331 (Jy calcd) tortue> SETJY1: / Using (1999.2) VLA or Reynolds (1934-638) coefficients ***If we have more than one FREQID, we assume that the frequency offsets used are small, so that the flux densities of the flux calibrators are nearly the same for each FREQID. Typical frequency offsets are of order the bandwidth, +/-3 MHz; at 1420 MHz, for a worst-case spectral index of -1, this leads to an error of 2*3 MHz/1420 MHz= 0.4% -- not worth worrying about. So, we use any FREQID which covers all primary flux calibrators. If flux calibrator A is observed only with FREQID 1, while flux calibrator B is observed only with FREQID 2, we have to run SETJY twice: default SETJY sources '0137+331','' $ primary (flux) calibrator A optype 'CALC'; freqid=1 $ FREQID for A aparm 0,0 $ data taken after 1998 getn 34 $ *.LINCOP ; default SETJY sources '0542+498','' $ primary (flux) calibrator B optype 'CALC'; freqid=2 $ FREQID for B aparm 0,0 $ data taken after 1998 getn 34 $ *.LINCOP ; ^7c. CALRD executed on 23jun09 ***Read in models of flux density calibrators: $ default CALRD $ object '3c48'; band 'L';$ 0137+331 $ default CALRD $ $ object '3c147'; band 'L';$ 0542+498 default CALRD $ 4 object '3c286'; band 'L';$ 1331+305 ***Note: These models are in J2000 coordinates. If your data are in C1950, change the model images to C1950 with EPOSWTCH. We will later use UVFIX to fix the uv-data. %%% Data is in J2000 coordinates, so no EPOSWTCH needed ^8. PRTUV (used to find integration times on calibrators & sources) default PRTUV cparm 0; cparm(9)=807 $ Pick a baseline -- here, baseline 8-7 (large and both are VLA) docrt 132 getn 34 $ *.LINCOP --> calib: 10s (both) source: 10s ^9. UVFLG -> FG/1 executed on 23jun09 ***We toss the EVLA-EVLA baselines, to avoid dealing with aliasing. There should still be plenty of VLA-EVLA baselines to allow antenna-based solutions for the EVLA... but keep an eye out for oddities (e.g., in BPASS)! default EVLA $ In case doinvers was set to 1 (true) getn 1 $ *.CH0 print EVLA %%% EVLA list is accurate default UVFLG getn 1 $ *.CH0 $ Note that we use FILLM's CH0 for initial flags -- we'll TACOP later. antenna=EVLA; baseline=EVLA; outfgver 1; opcode 'flag'; reason 'EVLA' ***NOTE!!! do NOT run UVFLG if EVLA=0 (try PRINT EVLA to check) -- otherwise you'll delete ALL of your data. ^10. TVFLG -> FG/1 executed on 23jun09 ***Again, we *only* use the original CH 0 from FILLM for initial flagging. Here we flag calibrators only, to remove any gross, obvious problems. ^ Check the first scan carefully -- often the system isn't "organized" on this first scan x On-line flagging isn't as reliable as in the old days, so there are plenty of hot pixels and hiccups. x We are NOT quacking, because (1) FILLM's NX table isn't correct; (2) QUACK flags data from the beginning-of-scan, whereas we want to flag data from antennas-on-source. default TVFLG docat -1 $ avoid saving temporary files dohist -1 $ avoid creation of history entries calcode '*' $ calibrators only freqid 1 $ must step through all FREQIDs! docalib -1 flagver 1; outfgver 1 $ keep all flags in FG/1 dparm 0 dparm(3) 1 $ show baselines twice, to treat all antennas identically -- $ this displays baseline 27-1 as well as 1-27 dparm(6)=10 $ time resolution: should be set to the calibrators' integration $ time, in seconds getn 1 $ *.CH0 $ note this is the ONLY time we use FILLM's Channel 0! ***Within TVFLG: ^ Set useful defaults: ^SMOOTH=1 to avoid averaging date before displays ^SCAN= 20 to use a long time for median filters (AMP/PH DIFF) xFLAG ALL CHANNELS ^FLAG STOKES FULL (usually -- sometimes you'll want NORR or NOLL) ***If individual Stokes need to be flagged, make sure you set the STOKES FLAG to correspond to the polarization that is displayed on the TV ^SWITCH SOURCE FLAG to ONE-SOURCE to avoid inadvertantly flagging galaxy (though sometimes you'll want to of course) ^ Be sure to inspect BOTH polarizations! ***We suggest the following steps: ^ Set the above defaults x Flag first integration in every scan (manual QUACK) -- this should be the first integration AFTER most antennas are on-source, which is why we can't use the usual QUACK. %%% In Amp: flagging straggler times (timeline), but not *every* single scan... ^ Inspect the following: ^AMPLITUDE to check for missing records or antennas %%% Ant 2, 5, 29 out completely (as in PRTAN, but 2 & 29 not mentioned in log) !!! Some shadowing: most of 2nd Pri of Ant 16 & all of last 2 Secs in Ant 21 %%% EVLA-EVLA baselines flagged properly %%% RR: 0.101 - 2.654, LL: 0.109 - 2.945 No hot pixels? Trimmed 0 straggly timelines from Secs Trimmed 6 straggly timelines from Pris: 1 from 2nd, 5 from 1st Final: RR: (0.101 - 2.654), LL: (0.109 - 2.945) ^AMP DIFF to check for variable gains %%% RR: 0.00 - 97.68 (pretty clean) %%% LL: 0.0 - 184.9 (pretty clean, but at least 1 hot pixel) Flagging LL: 15-21, 09:31:26; 8-22, 11:15:46; 11:18:16 12-17 & 22-27 -> now 94.49 Clipping interactively LL then RR to 80-> now RR & LL are 82.37 & 79.99 Final: RR: (0.00 - 82.37), LL: (0.00 - 79.99) ^PHS DIFF to check for variable atmosphere/gains %%% RR: 0.00 - 18.23 (highest values consistently in Secs) %%% LL: 0.00 - 17.74 (same as above) Final: RR: (0.00 - 18.23), LL: (0.00 - 17.74) %%% Saved as Figures/C2TVFLG_10_(AMP/AMPDIFF/PHSDIFF)_(RR/LL).tiff using Grab x If your data set is in D array (if your source is southern then also check for this problem in the C array) then keep an open eye for solar interference. In TVFLG, choose SORT BY BASELINE. If the short baselines are brighter than the long baselines, then you probably have solar interference. If solar interference is affecting your data, then in CALIB you should use a UVRANGE. %%% No signs of solar interference %%% 70 Flagging commands applied (mainly b/c of interactive clipping) ***Note: occasionally, flagging using UVFLG can be more straightforward (e.g., deleting an antenna). ^10b. TABED FG/1 executed on 23jun09 ***Here we TABED the CH 0 flags to LINCOP (with FREQID= -1). After this we're done with FILLM's channel 0. default TABED inext 'fg' inver 1; outver 1; bcount 1; ecount 0; $ until recently there was a parameter called ncount which is no longer there opty 'repl' aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...to FREQID= -1 getn 1 $ *.CH0 getona 34 $ *.LINCOP --> LINCOP FG/1 ^10c. (EXTRA) WIPER on Calibrators in LINCOP executed on 23jun09 (Just to see if there are any hot pixels) default WIPER $ sources '1331+305','' $ Primary $ sources '1227+365','' $ Secondary calcode '*' $ just the calibrators flagver 1 $ only FG table so far smooth 7, 215 $ boxcar average over all channels -- use $ smooth 7, 215 if you started with 255 channels & 7, 107 if you started with 127 channels bparm 0 $ amp. vs. uv-distance imsize 512, 512 getn 34 $ *.LINCOP %%% No hot columns or hot dots- max is ~4.3 Jy (C2WIPER_10c.tiff)-> Looks good ^11. BPASS ***This is a first-order BPASS leading to a new Channel 0. The goal is to avoid closure errors in Channel 0 calibration due to huge delays (phase slopes) on VLA-EVLA baselines. We divide each visibility by the vector average of the inner 3/4 of the band (i.e., an on-the-fly channel 0). Thus we remove source structure (tho' getting the weights wrong) and take care of the amplitude scale. ***There is a split here between the easy case (one FREQID for all sources) and the Galactic HI case (multiple FREQIDs, usually different for the bandpass calibrator and the galaxy (and phase calibrator)). Check LISTR/SCAN to see which you're doing. ^11a. BPASS: one FREQID for all sources -> BP/1 executed several times on 23jun09 default BPASS calsour '1331+305','' $ Select bandpass calibrators '0542+498','0137+331', qual -1 freqid 1 $ here we have only one FREQID docal 1; gainuse 2 $ apply VLANT changes. Probably irrelevant. flagver 1 $ apply initial flags solint 0; soltype '' $ one solution per scan refant 22 $ Change this to your refant smooth 0 $ no smoothing weightit 0 $ L1, L1R, etc. seem _less_ stable -- weird minamper 7; minphser 7 $ report closures > 7%/7d bpassprm 0 bpassprm(2) 1 $ some closure info is printed bpassprm(5) 0 $ derive "channel 0" on a record-by-record basis -- $ more biased than averaging first, but avoids $ some subtle pitfalls (see EXPLAIN file) bpassprm(6) 2 $ print avg. closure errors > 2% bpassprm(7) 2 $ print avg. closure errors > 2d ichansel 0 $ derive channel 0 from inner 3/4 of the band getn 34 $ *.LINCOP --> BP/1 x11b. BPASS: Multiple FREQIDs -> BP/1,2,3 not necessary ***The overall plan here is as follows (assuming FREQIDs 1 and 2 refer to the offset [bandpass calibrator] frequencies, and FREQID 3 refers to that of the galaxy & phase calibrator): (1) run BPASS once for FREQID=1 (-> BP/1) and once for FREQID=2 (-> BP/2). (2) check both BP tables with POSSM. They should look virtually identical. (3) If they do appear virtually identical, we concatenate them: (a) write out both tables [TBOUT], (b) concatenate the two [vi/emacs], (c) read them back in [TBIN] as BP/3, (4) If they do NOT appear identical, there is Something Wrong. The case we've come across involves the use of a front-end filter combined with the use of unexpected LOs (see Adrienne's note), so that one FREQID was observed through the edge of the filter. The resulting bandpasses show a strong slope in the amplitude gains for most VLA antennas. So far we've seen this only for central frequencies around 1423 MHz. In this case, simply copy the "good" BP table to BP/3 using TACOP. (5) modify BP/3 to refer to FREQID=3 [TABED]. ***It is a VERY good idea to use POSSM carefully throughout to be sure you're doing what you think you're doing. x11b1. BPASS FREQID 1 -> BP/1 not necessary default BPASS calsour '0137+331','0542+498','' $ Select bandpass calibrators docal 1 ; gainuse 2 $ apply VLANT changes. Probably irrelevant. flagver 1 $ apply initial flags refant 22 $ Change this to your refant Qual -1 solint 0 $ one solution per scan minamper 7 ; minphser 7 $ report closures > 7%/7d smooth 0 $ no smoothing soltype '' ; weightit 0 $ L1, L1R, etc. seem _less_ stable -- weird bpassprm 0 bpassprm(5) 0 $ derive "channel 0" on a record-by-record basis -- $ more biased than averaging first, but avoids $ some subtle pitfalls (see EXPLAIN file) bpassprm(2) 1 $ some closure info is printed bpassprm(6) 2 $ print avg. closure errors > 2% bpassprm(7) 2 $ print avg. closure errors > 2d ichansel 0 $ derive channel 0 from inner 3/4 of the band freqid 1 $ 1st offset FREQID getn 34 $ *.LINCOP --> BP/1 x11b2. BPASS FREQID 2 -> BP/2 not necessary ***Same as 11C2, now on FREQID 2 default BPASS calsour '0137+331','0542+498','' $ Select bandpass calibrators docal 1 ; gainuse 2 $ apply VLANT changes. Probably irrelevant. flagver 1 $ apply initial flags refant 22 $ Change this to your refant Qual -1 solint 0 $ one solution per scan minamper 7 ; minphser 7 $ report closures > 7%/7d smooth 0 $ no smoothing soltype '' ; weightit 0 $ L1, L1R, etc. seem _less_ stable -- weird bpassprm 0 bpassprm(5) 0 $ derive "channel 0" on a record-by-record basis -- $ more biased than averaging first, but avoids $ some subtle pitfalls (see EXPLAIN file) bpassprm(2) 1 $ some closure info is printed bpassprm(6) 2 $ print avg. closure errors > 2% bpassprm(7) 2 $ print avg. closure errors > 2d ichansel 0 $ derive channel 0 from inner 3/4 of the band freqid 2 $ 2nd offset FREQID getn 34 $ *.LINCOP --> BP/2 x11b3. POSSM to compare BP/1 and BP/2 default POSSM $ to check BPASS results flagver 1 aparm 0, 1, 0.7, 1.3, -180, 180, 0, 2, 0, 0 $ Plot BP, with amp/ph ranges source '0137+331','0542+498','1331+305','' $ POSSM doesn't work with $ source '' for some reason! solint -1 $ Separate plots for each scan nplots 9 $ 9 plots per page bparm 0 dotv 1 freqid 1; bpver 1 ; grch 1 freqid 2; bpver 2 ; grch 2 getn 34 $ *.LINCOP tvinit If worried: try POSSM on secondary calibrator, applying this BPASS (if BPASS stable, secondary should look flat) x11b4. *If* BP/1 and BP/2 appear virtually identical, concantenate them to form BP/3: x11b4a. Write the two tables to disk: default TBOUT docrt 500 getn 34 $ *.LINCOP inext 'bp' ; inver 1 outfile 'LT1:bp1.out inext 'bp' ; inver 2 outfile 'LT1:bp2.out x11b4b. Outside AIPS: concatenate the two tables cd $LT1 cat bp1.out bp2.out > bp3.out emacs bp3.out - change NAXIS2 to be equal to the *sum* of NAXIS2 in the two tables - delete from first ***END*PASS*** through ***BEGIN*PASS***, inclusive x11b4c. Read the new concatenated table in as BP/3: default TBIN infile 'LT1:bp3.out getona 34 $ *.LINCOP --> reads in BP/3 x11b5. *If* BP/1 and BP/2 are NOT virtually identical, pick the one that best matches the behavior of the phase calibrator (possibly by doing a quickie BPASS on the phase calibrator and comparing the results), and copy that BP table to BP/3: default TACOP inext 'bp' inver 2 $ Set this to the "good" BP table getn 34 $ *.LINCOP getona 34 $ *.LINCOP --> BP/3 ***You should IGNORE the "bad" FREQID for all subsequent processing. x11b6. TABED BP/3 to set FREQID=-1 (so we can use the same BP table for everyone) --> BP/4 default TABED opty 'repl' inext 'bp' inver 3 ; outver 4 aparm 0 aparm(1) 8 $ Changing column 8 = FREQID keyval= -1,0 $ ...which we change to FREQID= -1 getn 34 $ *.LINCOP --> BP/4 ^11c. POSSM to check BP table ^11c1. Plot BP table itself default POSSM $ to check BPASS results source '0137+331','0542+498','1331+305','' $ POSSM doesn't work with $ source '' for some reason! freqid 1; bpver 1 $ freqid 3; bpver 4 $ for multiple-FREQID data sets flagver 1 aparm 0, 1, 0.7, 1.3, -180, 180, 0, 2, 0, 0 $ Plot BP, with amp/ph ranges solint -1 $ Separate plots for each scan nplots 9 $ 9 plots per page bparm 0 dotv 1 getn 34 $ *.LINCOP tvinit dotv -1 & go %%% PL 1-12 for LINCOP are POSSM results, 9 per page There are two plots for each antenna (RR & LL) for the before & after primary calibrator In general, the VLA antennas have very flat bandpasses around 1.0 with near 0 phase !!! However, the after BP for Ant 16 is much noisier than the before BP (b/c only a few time scans) !!! so go back and flag those few time scans in 2nd Pri in Ant 16 and then redo BP default lwpla $ to print the plots to a ps file getn 34 $ *.LINCOP outfile '/Users/herrmann/Desktop/C2POSSMplots11c1.ps invers 0 for i = 1 to 12; plver = i; go; wait lwpla; end ^11c2. Apply BP table to 2ndary calibrator & plot individual baselines default POSSM source='1227+365','' $ Secondary (phase) calibrator freqid 1; bpver 1 $ for single-FREQID data sets $ freqid 3; bpver 4 $ for multiple-FREQID data sets docal 1; gainuse 2; flagver 1; doband 1 $ average all BP entries aparm 0 $ Plot data aparm(1) 1 $ vector average solint -1 $ Separate plots for each scan nplots 9 $ 9 plots per page dotv 1 getn 34 $ *.LINCOP tvinit %%% Everything looks normal (looked at one whole time) ^11c3. Apply BP table to 2ndary calibrator & vector average all data default POSSM source='1227+365','' $ Secondary (phase) calibrator freqid 1; bpver 1 $ for single-FREQID data sets $ freqid 3; bpver 4 $ for multiple-FREQID data sets docal 1; gainuse 2; flagver 1; doband 1 $ average all BP entries aparm 0 $ Plot data aparm(1) 1 $ vector average solint 0 $ average all time nplots 0 $ average all baselines dotv 1 getn 34 $ *.LINCOP tvinit ***This plot should be flat in both amp. and phase as a function of frequency, with no slope.. If some channels are off, note which ones those are and keep an eye out for interference or other bad data. If there are large errors consider running BPASS on the secondary calibrator and using that to correct the galaxy. Note that this will be somewhat painful since AIPS does not allow incremental BP tables -- unlike SN or CL tables. Sigh. 1(RR): Quite flat around 7.5 mJy for all channels 1(RR): phase is generally -70 +/- 20 degrees 1(LL): Very flat around 4 mJy for all channels 1(LL): phase is generally 200 +/- 30 degrees dotv -1; go tget lwpla for i = 13 to 14; plver = i; go; wait lwpla; end %%% (Added to C2POSSMplots11c1.ps) ^12. AVSPC -> NEWCH0.1 (2,3) executed on 23jun09 ***AVSPC must be run once for each FREQID (unfortunately FREQID=-1 purports to work, but creates an empty data set). This entails some nasty bookkeeping for data sets with multiple FREQIDs. Here I assume we have one or three FREQIDs. If BPASS checks above show that one FREQID is useless, you should ignore that one entirely in this and all subsequent processing. ***We will use these NEWCH0 files for (1) further flagging, and (2) time-dependent gain calibration. ^12a. FREQID=1 --> NEWCH0.1 default AVSPC getn 34 $ *.LINCOP freqid 1; bpver 1 $ for single-FREQID data sets $ freqid 1; bpver 4 $ for multiple-FREQID data sets docalib -1; gainuse 0; flagver -1 $ do NOT apply flags doband 1 outname inna ; outcl 'NEWCH0' --> NEWCH0.1 (35) x12b. FREQID=2 (if multiple-FREQID data set) --> NEWCH0.2 ***Skip FREQID=2 if the corresponding BP table looked irrelevant (see 11b5) default AVSPC docalib -1;gainuse 0; flagver -1 $ do NOT apply flags doband 1 freqid 2; bpver 4 $ for multiple-FREQID data sets getn 34 $ *.LINCOP outname inna ; outcl 'NEWCH0' ; outse= freqid --> NEWCH0.2 x12c. FREQID=3 (if multiple-FREQID data set) --> NEWCH0.3 ***Skip FREQID=3 if the corresponding BP table looked irrelevant (see 11b5) default AVSPC docalib -1;gainuse 0; flagver -1 $ do NOT apply flags doband 1 freqid 3; bpver 4 $ for multiple-FREQID data sets getn 34 $ *.LINCOP outname inna ; outcl 'NEWCH0' ; outse= freqid --> NEWCH0.3 ^12d. LISTR/SCAN ***It is a VERY good idea to run LISTR/SCAN on each of the NEWCH0 data sets at this point, to be sure each has the data you expect. tget LISTR getn 35 $ *.NEWCH0 outprint '/Users/herrmann/Desktop/Haro29-C2_12d.listr tortue LISTR(31DEC08) 4 23-JUN-2009 13:36:33 Page 1 File = Haro29-C2 .NEWCH0. 1 Vol = 1 Userid = 4 Freq = 1.419003570 GHz Ncor = 2 No. vis = 202589 Scan summary listing Scan Source Qual Calcode Sub Timerange FrqID START VIS END VIS 1 1331+305 : 0001 A 1 0/09:27:55 - 0/09:31:35 1 1 6061 2 1227+365 : 0001 A 1 0/09:32:25 - 0/09:35:35 1 6062 12561 3 HARO29 : 0001 1 0/09:36:15 - 0/09:55:35 1 12562 50492 4 1227+365 : 0001 A 1 0/09:56:15 - 0/09:59:35 1 50493 57292 5 HARO29 : 0001 1 0/10:00:15 - 0/10:19:25 1 57293 94967 6 1227+365 : 0001 A 1 0/10:20:05 - 0/10:23:25 1 94968 101792 7 HARO29 : 0001 1 0/10:24:05 - 0/10:43:25 1 101793 139568 8 1227+365 : 0001 A 1 0/10:44:05 - 0/10:47:25 1 139569 145868 9 HARO29 : 0001 1 0/10:48:05 - 0/11:07:25 1 145869 183893 10 1227+365 : 0001 A 1 0/11:08:05 - 0/11:11:15 1 183894 189293 11 1331+305 : 0001 A 1 0/11:11:55 - 0/11:19:15 1 189294 202589 Source summary Velocity type = ' ' Definition = ' ' ID Source Qual Calcode RA(2000.0) Dec(2000.0) IFlux QFlux UFlux VFlux No. vis 1 1331+305 : 0001 A 13:31:08.2879 30:30:32.958 14.733 0.000 0.000 0.000 19357 2 1227+365 : 0001 A 12:27:58.7254 36:35:11.827 0.000 0.000 0.000 0.000 31825 3 HARO29 : 0001 12:26:16.0000 48:29:37.000 0.000 0.000 0.000 0.000 151407 ID Source Freq(GHz) Velocity(Km/s) Rest freq (GHz) 1 1331+305 1.4190 -138.0387 0.0000 2 1227+365 1.4190 0.0000 0.0000 3 HARO29 1.4190 0.0000 0.0000 Frequency Table summary FQID IF# Freq(GHz) BW(kHz) Ch.Sep(kHz) Sideband 1 1 1.41900357 4.5705 982.6661 1 ^13. TABED LINCOP FG/1 -> NEWCH0 FG/1 ***We use TABED to set FREQID to -1 (apply to all FREQIDs) in the FG table, since AVSPC will change all FREQIDs to 1 in the NEWCH0 data sets. ^13a. NEWCH0.1 default TABED inext 'fg' inver 1; outver 1 opty 'repl' aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...to FREQID= -1 getn 34 $ *.LINCOP getona 35 $ *.NEWCH0.1 --> NEWCH0.1, FG/1 x13b. If multiple FREQIDs: NEWCH0.2 default TABED inext 'fg' inver 1 ; outver 1 opty 'repl' aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...to FREQID= -1 getn 34 $ *.LINCOP getona 35 $ *.NEWCH0.2 --> NEWCH0.2, FG/1 x13c. If multiple FREQIDs: NEWCH0.3 default TABED inext 'fg' inver 1 ; outver 1 opty 'repl' aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...to FREQID= -1 getn 34 $ *.LINCOP getona 35 $ *.NEWCH0.3 --> NEWCH0.3, FG/1 ^14. CALIB -> NEWCH0.1(,2,3) SN/1 executed on 23jun09 (full uvrange) ***If we only have one FREQID, all CALIBs are run on the same NEWCH0.1 . If we have multiple FREQIDs, CALIBs for a given source must be run for all NEWCH0.1,2,3 in which that source appears (probably easiest to check with LISTR/SCAN). ***Note: if 'SN' table must be destroyed: task 'extdest'; inext 'sn'; invers 0 ***If solar interference is affecting your data then in CALIB you should use a UVRANGE. The worst case scenario, baselines up to a distance of 1 kilolambda could be affected, while in the best case scenario baselines are affected only up to 0.5 kilolambda distance. We recommend using: UVRANGE 0.7,0 for D array UVRANGE 0.7,0 for C array After calibration, if UVPLT still shows signs of solar interference, it means that not enough short baselines were discarded; therefore the calibration has to be redone and UVRANGE to be reset. Note that the Sun might rise or set, especially during a long B-array run, in which case you might wish to split the calibration by timerange in a set affected and a set without solar interference. ^14a. Primary (flux density) calibrators --> SN/1 default CALIB get2n 4 $ 3C286_L.MODEL.1 calsour '1331+305','' $ flux density calibrator #1 freqid -1 uvrange 0, 0 $ no signs of solar interference in primary weightit 1 docal 1; gainuse 2; flagver 1 inver 1; ncomp 1e6, 0; nmap 1; cmethod 'DFT' refant 22 $ Change this to your refant solint 0 aparm 4,0,0,0,0,2; $ min 4 antennas; print closures soltype 'L1'; solmode 'A&P' $ true L1 minimization solcon 0 minamper 10; minphser 10 $ complain if >10%/10d off cparm 0,0,10,10,1 $ complain if avg > 10%/10d off snver 1 getn 35 $ *.NEWCH0 $ ***NOTE: must run this for all NEWCH0.1,2,3 in which this calibrator appears! --> SN/1 tortue> CALIB1: RPOL, IF= 1 The average gain over these antennas is 3.166E+00 tortue> CALIB1: LPOL, IF= 1 The average gain over these antennas is 3.103E+00 tortue> CALIB1: Found 102 good solutions tortue> CALIB1: Average closure rms = 0.0009 +- 0.0002 tortue> CALIB1: No data were found > 99.0 rms from solution $ This time there is no second primary default CALIB get2n 210 $ 3C247_L.MODEL.2 calsour '0542+498','' $ no second flux density calibrator freqid -1 uvrange 0, 0 $ no signs of solar interference in primary weightit 1 docal 1; gainuse 2; flagver 1 inver 1; ncomp 1e6, 0; nmap 1; cmethod 'DFT' refant 22 $ Change this to your refant solint 0 aparm 4,0,0,0,0,2; $ min 4 antennas; print closures soltype 'L1'; solmode 'A&P' $ true L1 minimization solcon 0 minamper 10; minphser 10 $ complain if >10%/10d off cparm 0,0,10,10,1 $ complain if avg > 10%/10d off snver 1 getn 35 $ *.NEWCH0 $ ***NOTE: must run this for all NEWCH0.1,2,3 in which this calibrator appears! --> SN/1 ^14b. Secondary (phase) calibrator --> SN/1 ***Check uv restrictions for secondary calibrators carefully. For 1227+365: no restrictions, no solar interference, so uvra= 0.0,0 default CALIB calsour '1227+365','' $ phase calibrator freqid -1 uvrange 0.0, 0 $ Some solar interference wtuv 0.0 $ normally 0.0, but may have to set wtuv 0.01 if solutions are $ crazy and uvrange is not 0,0 weightit 1 docal 1; gainuse 2; flagver 1 refant 22 $ Change this to your refant solint 0 aparm 4,0,0,0,0,2; $ min 4 antennas; print closures soltype 'L1'; solmode 'A&P' $ true L1 minimization solcon 0 minamper 10; minphser 10 $ complain if >10%/10d off cparm 0,0,10,10,1 $ complain if avg > 10%/10d off snver 1 getn 35 $ *.NEWCH0 $ ***NOTE: must run this for all NEWCH0.1,2,3 in which $ this calibrator appears! tortue> CALIB1: RPOL, IF= 1 The average gain over these antennas is 2.219E+00 tortue> CALIB1: LPOL, IF= 1 The average gain over these antennas is 2.156E+00 tortue> CALIB1: Found 256 good solutions tortue> CALIB1: Average closure rms = 0.0088 +- 0.0008 tortue> CALIB1: No data were found > 99.0 rms from solution x15a. TABED all SN tables to NEWCH0.1 --> SN/2,3 ***This step is only required if we have more than one FREQID (NEWCH0). We copy everything to NEWCH0.1 to match the FREQID=1 case. ***Skip this step if you only have one FREQID! default TABED inext 'sn' inver 1; outver 0 opty 'repl' aparm 0 aparm(1) 6 $ Changing column 3 = FREQID keyval= -1,0 $ ...which we change to FREQID= -1 getn 35 $ *.NEWCH0.2 getona 35 $ *.NEWCH0.1 --> NEWCH0.1, SN/2 default TABED inext 'sn' inver 1 ; outver 0 opty 'repl' aparm 0 aparm(1) 6 $ Changing column 3 = FREQID keyval= -1,0 $ ...which we change to FREQID= -1 getn 35 $ *.NEWCH0.3 getona 35 $ *.NEWCH0.1 --> NEWCH0.1, SN/3 ^15b. GETJY SN/1-3, SU/1 executed on 23jun09 ***Find flux density of secondary calibrator, and set SN table amplitude gains to reflect a common flux density scale. default GETJY sources '1227+365','' $ Secondary (phase) calibrators) calsour '1331+305','' $ Primary (flux) calibrators '0542+498','0137+331', freqid -1 snver 0 $ Use all SN tables getn 35 $ *.NEWCH0.1 tortue> GETJY1: Task GETJY (release of 31DEC08) begins tortue> GETJY1: Source:Qual CALCODE IF Flux (Jy) tortue> GETJY1: 1227+365 : 1 A 1 2.05025 +/- 0.00638 %%% (Pretty close to expected 2.10 Jy.) x15c. CLCAL/MERG to merge all SN tables -> SN/4 ***This step is only required if we have more than one FREQID (NEWCH0). Skip this step if you only have one FREQID! default CLCAL opcode 'MERG' $ Merge SN tables, for ease of plotting etc. refant 22 $ Change this to your refant getn 35 $ *.NEWCH0.1 --> SN/4 $ creates a merged SN table -- doesn't change CL tables at all. Must now copy this new SN table to all other NEWCH0: default TACOP inext 'SN' getn 35 $ *.NEWCH0.1 getona 35 $ *.NEWCH0.2 getona 35 $ *.NEWCH0.3 ^16. SN table checks ^16a. SNPLT last SN table executed on 23jun09 ^16a1. SNPLT phase: default SNPLT inext 'sn'; inver 0 pixrange 0; nplots 9; xinc 1 optype 'phas'; opcode 'alsi' do3col 1; symbol 5; factor 2 dotv 1 getn 35 $ *.NEWCH0.1 ===> Note any phase jumps (on the phase calibrator) for future flagging. The EVLA antennas, even after applying VLANT, still show quite a bit of phase drift. This is OK so long as a linear interpolation between the phases looks like it will work. %%% Note: displaying first primary, all 5 secondary observations, then second primary In general, few jumps (1-28) (besides the jump from primary to secondary which is ok) (Note: Ref antenna 22 red triangles at values of 0 because everything relative to it.) !!! Last 2 Secs in Ant 21 missing, so must flag last 2 galaxy scans in Ant 21 FULL %%% Grabbed each frame: C2SNPLT_16a1_PHS(a-c).tiff ^16a2. SNPLT amplitude: default SNPLT inext 'sn'; inver 0 pixrange 0; nplots 9; xinc 1 optype 'amp'; opcode 'alsi' do3col 1; symbol 5; factor 2 dotv 1 getn 35 $ *.NEWCH0.1 ===> Note whether the amp. is roughly constant for a given antenna/pol'n/IF. %%% In general, some small jumps (1-28) (besides the jump from primary to secondary which is ok) %%% Grabbed each frame: C2SNPLT_16a2_AMP(a-c).tiff ***We have seen a couple cases where the first phase cal scan has a significantly different amplitude gain for the EVLA antennas. The reason is not clear but the raw data do show this effect, so CALIB is doing the right thing. This area warrants further tests, to learn whether we should simply flag the EVLA antennas on the first phase calibrator scan. ^16b. LISTR/GAIN print SN table executed on 23jun09 default LISTR optype 'gain'; inext 'sn'; inver 1; freqid -1 antennas -2,5,29,0; $ may have to list missing antennas explicitly, to avoid $ column overrun. To list missing antennas, use the form $ANTENNAS -3,2,0 to have antennas 3 and 2 left out. dparm 5,0; $ Amp & phase factor 0; docrt -1 $ instead of docrt 132 outprint '/Users/herrmann/Desktop/Haro29-C2_16b.listr getn 35 $ *.NEWCH0.1 --> check for phase jumps and other inconsistencies. ***We have seen a couple cases where the first phase cal scan has a significantly different amplitude gain for the EVLA antennas. The reason is not clear but the raw data do show this effect, so CALIB is doing the right thing. This area warrants further tests, to learn whether we should simply flag the EVLA antennas on the first phase calibrator scan. tortue LISTR(31DEC08) 4 23-JUN-2009 13:53:02 Page 1 File = Haro29-C2 .NEWCH0. 1 Vol = 1 Userid = 4 IF = 1 Freq= 1.419003570 GHz Ncor= 2 No. vis= 202589 Polarization = R Subarray = 0 Listing SN table, version 1 SN table has not been applied to a CL table Gain amplitudes, 1000 = 10.000000 Stokes = R IF = 1 Freq = 1.419003570 GHz Time Source -1- -3- -4- -6- -7- -8- -9--10--11--12--13--14--15--16--17--18--19--20--21--22--23--24--25--26--27--28- max % diff 2.1 1.0 2.4 2.4 0.9 1.9 0.8 1.6 3.0 1.0 1.1 1.9 0.8 3.4 3.2 4.7 2.5 0.6 2.2 1.1 4.2 1.4 0.9 2.7 1.4 1.2 Day # 0 09:30:15 1331+305 212 256 313 265 310 291 242 311 274 270 360 404 302 355 288 442 353 292 377 272 382 307 467 343 246 293 09:34:00 1227+365 219 256 317 269 309 299 240 317 273 269 358 403 301 349 292 436 357 289 372 274 381 312 462 342 244 290 09:57:55 1227+365 210 254 312 274 309 295 239 322 278 268 355 404 299 355 290 435 362 289 379 270 378 305 464 341 244 288 10:21:45 1227+365 215 258 307 265 313 290 241 319 275 270 355 417 303 368 299 441 351 289 388 273 389 313 466 343 244 291 10:45:45 1227+365 213 257 318 264 311 293 242 314 276 271 360 411 303 361 303 455 363 292 275 387 307 470 355 247 290 11:09:40 1227+365 216 253 319 266 314 290 243 312 286 273 362 418 301 373 308 468 367 292 273 404 309 466 348 249 294 11:15:40 1331+305 214 257 307 265 311 290 242 310 279 272 359 411 302 306 458 361 293 354 274 392 309 470 349 246 292 tortue LISTR(31DEC08) 4 23-JUN-2009 13:53:02 Page 2 File = Haro29-C2 .NEWCH0. 1 Vol = 1 Userid = 4 IF = 1 Freq= 1.419003570 GHz Ncor= 2 No. vis= 202589 Polarization = L Subarray = 0 Listing SN table, version 1 SN table has not been applied to a CL table Gain amplitudes, 1000 = 10.000000 Stokes = L IF = 1 Freq = 1.419003570 GHz Time Source -1- -3- -4- -6- -7- -8- -9--10--11--12--13--14--15--16--17-*18*-19--20--21--22--23--24--25--26--27--28- max % diff 2.8 0.7 1.6 2.2 1.0 1.4 1.0 2.0 2.0 1.2 1.9 2.1 0.8 3.3 3.3 5.1 2.1 0.8 2.4 1.1 3.1 1.6 1.4 1.2 1.4 0.4 Day # 0 09:30:15 1331+305 262 299 295 287 305 245 214 292 339 260 332 366 261 366 253 402 382 299 397 244 357 370 407 317 243 288 09:34:00 1227+365 267 297 299 290 303 248 211 296 338 256 328 360 256 359 258 393 359 297 387 242 355 376 398 316 240 283 09:57:55 1227+365 257 295 299 294 301 245 210 299 344 254 328 366 257 366 257 396 362 294 400 242 352 370 391 315 240 281 10:21:45 1227+365 268 299 296 285 304 242 211 297 342 257 329 372 260 383 261 398 352 295 403 243 364 379 401 316 241 282 10:45:45 1227+365 265 297 302 286 307 245 213 293 341 260 331 367 260 368 246 409 358 298 246 361 376 396 322 242 282 11:09:40 1227+365 265 296 305 284 305 243 214 289 350 258 337 374 257 380 250 425 366 298 244 372 380 397 322 245 283 11:15:40 1331+305 264 300 299 287 305 244 215 292 347 261 332 370 260 245 417 357 299 407 246 365 378 400 320 243 287 tortue LISTR(31DEC08) 4 23-JUN-2009 13:53:02 Page 3 File = Haro29-C2 .NEWCH0. 1 Vol = 1 Userid = 4 IF = 1 Freq= 1.419003570 GHz Ncor= 2 No. vis= 202589 Polarization = R Subarray = 0 Listing SN table, version 1 SN table has not been applied to a CL table Gain phases in degrees Stokes = R IF = 1 Freq = 1.419003570 GHz Time Source -1- -3- -4- -6- -7- -8- -9--10--11--12--13-*14*-15--16--17--18--19--20--21--22--23-*24*-25--26--27--28- max diff 3 2 3 1 4 4 1 1 2 3 2 15 1 2 3 2 4 2 2 0 3 11 2 2 3 1 Day # 0 09:30:15 1331+305-126 91-160 145 66 -32-103 39 -78 37 -35 126 -33-173 35 103 70 95 122 0 83 135 -7 109 -52-107 09:34:00 1227+365-124 92-157 148 67 -31-107 41 -69 37 -31 127 -32-171 43 105 71 95 127 0 90 134 -4 113 -51-106 09:57:55 1227+365-126 90-159 147 67 -32-106 40 -67 36 -31 139 -31-171 43 103 69 94 129 0 89 128 -4 114 -49-105 10:21:45 1227+365-126 90-162 146 69 -36-106 39 -65 36 -29 130 -31-173 40 103 68 92 129 0 89 117 -4 114 -48-105 10:45:45 1227+365-129 91-163 145 65 -37-107 39 -65 35 -31 145 -32-174 43 101 67 91 0 92 112 -6 113 -51-106 11:09:40 1227+365-132 90-161 145 64 -36-106 38 -65 32 -31 138 -32-175 43 99 63 90 0 93 105 -8 111 -52-106 11:15:40 1331+305-132 89-160 145 64 -33-108 38 -69 33 -32 141 -31 38 99 64 89 126 0 88 104 -10 108 -51-107 tortue LISTR(31DEC08) 4 23-JUN-2009 13:53:02 Page 4 File = Haro29-C2 .NEWCH0. 1 Vol = 1 Userid = 4 IF = 1 Freq= 1.419003570 GHz Ncor= 2 No. vis= 202589 Polarization = L Subarray = 0 Listing SN table, version 1 SN table has not been applied to a CL table Gain phases in degrees Stokes = L IF = 1 Freq = 1.419003570 GHz Time Source -1- -3- -4- -6- -7- -8- -9--10--11--12--13-*14*-15--16--17--18--19--20--21--22--23-*24*-25--26--27--28- max diff 6 5 4 5 5 6 6 4 3 8 4 14 2 4 4 6 7 6 2 0 4 13 7 6 6 3 Day # 0 09:30:15 1331+305 -69 28 35 119 142 16-125 1-151 -90 -41-141 47-120 7 -23-114 -79 117 0 106 42 -36 132 154-137 09:34:00 1227+365 -67 28 38 121 142 16-125 1-143 -91 -39-141 50-119 15 -22-115 -79 121 0 113 40 -33 136 154-137 09:57:55 1227+365 -69 27 36 119 141 15-124 1-141 -93 -38-127 52-119 14 -24-117 -80 123 0 112 35 -34 136 154-136 10:21:45 1227+365 -70 25 32 115 141 9-125 -2-140 -96 -38-139 51-121 10 -25-119 -84 122 0 110 22 -33 136 153-137 10:45:45 1227+365 -74 27 31 114 137 9-126 -3-140 -97 -39-125 50-123 12 -28-120 -85 0 114 18 -36 134 149-138 11:09:40 1227+365 -80 22 29 109 132 5-132 -7-143-105 -43-133 48-127 9 -34-127 -91 0 111 6 -43 128 143-141 11:15:40 1331+305 -80 22 30 109 132 8-132 -7-147-104 -44-129 49 5 -33-126 -91 115 0 106 6 -44 126 145-141 %%% Max Phase dips/jumps: 4 bounces by 11-15 degrees, otherwise everything <10 degrees, so leave as is %%% Amp changes: Everything <= 5.1% differences, so leave as is %%% Only flagging needed is because of shadowing of last 2 Secs in Ant 21 ^17. UVFLG -> NEWCH0.1 FG/1 executed on 23jun09 ***If the SN table shows a phase jump on the phase calibrator, you should flag the data between the two phase cal scans which show the jump (since those cannot be calibrated). ***Note that we flag NEWCH0.1, *regardless* of whether the galaxy appears in this data set. This is because later on (step 20/TVFLG) we flag the NEWCH0 data in order from inseq 1 through inseq freqid_max, copying the FG table from one file to the next. UVFLG itself doesn't care whether the flags you enter actually do anything -- it just adds entries to the FG table, which are then applied (or ignored if irrelevant) by other tasks. ***This step may of course be skipped if there are no obvious phase jumps. Need to flag last 2 galaxy scans in Ant 21 FULL default UVFLG timer 0 10 24 00 0 10 43 30 $ the source scan between the offending ph.cal scans (3rd galaxy) antenna 21, 0 $ the antennas which "jumped" stokes '' outfgver 1 opcode 'FLAG' reason 'some secs shadowed' $ normally 'phase jump' getn 35 $ *.NEWCH0.1 timer 0 10 48 00 0 11 07 30 --> NEWCH0.1 FG/1 ^18. CLCAL NEWCH0 --> CL/3 executed on 23jun09 ***For multi-FREQID data this becomes rather complicated, since we need a new CL table for every NEWCH0 file, to allow detailed checks and second-order flagging. ***Note that there is no need to work around any phase jumps, since the intervening data are flagged (see step 17 above [UVFLG]). ^18a. CLCAL for the primary calibrators -> CL/3 default CLCAL sour= '1331+305','' $ Primary (flux) calibrators '0542+498','0137+331', calsour= sour interpol 'SELF' dobtween -1 $ Don't interpolate entries for different sources snver 1 $ if single FREQID $ snver 4 $ if multiple FREQIDs gainver 2; gainuse 3 refant 22 $ Change this to your refant getn 35 $ *.NEWCH0.1 $ do this for all NEWCH0 with primary (flux) $ calibrator data ^18b. CLCAL for the phase calibrator and galaxy -> CL/3 default CLCAL sour= '1227+365','Haro29','' $ Secondary (phase) calibrator + galaxy calsour= '1227+365','' $ Secondary (phase) calibrator interpol 'SIMP' cutoff 120 $ Don't extrapolate/interpolate beyond 120 minutes dobtween -1 $ Don't interpolate entries for different sources snver 1 $ if single FREQID $ snver 4 $ if multiple FREQIDs gainver 2; gainuse 3 refant 22 $ Change this to your refant ***If your data set used +/- frequency switching for the phase calibrator (our observations did not, but some archival data may), you should use BPARM with SAMPTYPE='BOX' to select a smoothing time which covers both frequency settings. LISTR/SCAN on LINCOP will help you choose this; normally something like 12 minutes should be OK. bparm 12/60 ; samptype='BOX' getn 35 $ *.NEWCH0.1 $ do this for all NEWCH0 with secondary (phase) $ calibrator or galaxy data ***At this point we have a new CL table for all NEWCH0 files. ^19a. ANBPL executed on 23jun09 ***We use ANBPL to check the data weights. Data with very high weights (factor 5-10 or more above normal) should be flagged with UVFLG. ***Note: Red is RR and Blue is LL default ANBPL docalib 1; gainuse 3 flagver 1 do3col 1 $ ...using different colors opcode 'alsi' $ Plot all IFs together bparm 2,17,0 $ Plot antenna-based weight vs. time nplots 9; dotv 1 docrt -1 $ Print as well as plotting weights -- useful for $ finding exact times of bad weights $ Note you can also use outprint to send to a file. outprint '/Users/herrmann/Desktop/C2ANBPL_19a.txt getn 35 $ *.NEWCH0.1 $ Must do this separately for every NEWCH0 file %%% Grabbed each frame: C2ANBPL_19(a-c).tiff (MIDDLE times!) Everything looks good! x19b. UVFLG to eliminate very high weights executed on [not needed!] ***Should UVFLG on NEWCH0.1, even if Evil Weights are seen in NEWCH0.2 or NEWCH0.3 -- we'll be copying FG/1 from NEWCH0.1 to NEWCH0.2 for subsequent second-order flagging. default UVFLG getn 35 $ *.NEWCH0 timerang 0 05 27 10 0 05 27 20 antennas 0 stokes '' outfgver 1 opcode 'FLAG' reason 'HIGH WEIGHT' timer 0 06 29 50 0 06 30 00 timer 0 07 01 40 0 07 01 50 timer 0 08 33 10 0 08 33 20 timer 0 09 04 40 0 09 04 50 tget ANBPL; outprint '/Users/herrmann/Desktop/C2ANBPL_19a1.txt Now everything looks good! default prtmsg docrt -1 outprint '/Users/herrmann/Desktop/AIPSMSGSRV_C2_Steps1_19.log prtmsg clrmsg ^20. TVFLG FG/1 executed on 23jun09 ^20a. TVFLG on calibrators: NEWCH0.1 The calibrators should now have constant amplitude and zero phase...apart from source structure for the primary (flux) calibrators, and any uvrange for the secondary (phase) calibrators. If we see huge problems on the calibrators we may have to re-run CALIB etc. -- let's hope not!! default TVFLG docat -1 $ avoid saving temporary files dohist -1 $ avoid creation of history entries calcode '*' $ calibrators only docalib 1; gainuse 3 $ apply the new CL table flagver 1; outfgver 1 $ keep all flags in FG/1 dparm 0 dparm(3) 1 $ show baselines twice, to treat all antennas identically -- $ this displays baseline 27-1 as well as 1-27 dparm(6)=10 $ time resolution: should be set to the calibrators' $ integration time, in seconds getn 35 $ *.NEWCH0.1 ***Within TVFLG: ^ Set useful defaults: ^SMOOTH=1 to avoid averaging date before displays ^SCAN= 20 to use a long time for median filters (AMP/PH DIFF) xFLAG ALL CHANNELS ^FLAG STOKES FULL (usually -- sometimes you'll want NORR or NOLL) ***If individual Stokes need to be flagged, make sure you set the STOKES FLAG to correspond to the polarization that is displayed on the TV ^SWITCH SOURCE FLAG to ONE-SOURCE to avoid inadvertantly flagging your galaxy (though sometimes you'll want to of course) ^ Be sure to inspect BOTH polarizations! ***We suggest the following steps: ^ Set the above defaults ^ Check AMPLITUDE, AMP DIFF, PHS DIFF. Be wary of known source structure and uv-range limits!! %%% AMP RR: (1.50 - 15.76) Looks good (normally min is ~1.4) AMP LL: (1.46 - 15.64) Looks good (same as above) AMP DIFF RR: (0.0 - 664.7) Looks good AMP DIFF LL: (0.0 - 721.4) Looks good PHS DIFF RR: (0.0 - 19.03) Looks good PHS DIFF LL: (0.0 - 16.41) Looks good ***Note: occasionally, flagging using UVFLG can be more straightforward (e.g., deleting an antenna). %%% No flagging needed. =) x20b. If we have multiple NEWCH0s (FREQIDs): (1) Copy the FG table: default TABED opty 'repl' inext 'FG' ; inver 1 ; outver 2 bcount 1;ecount 0; aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...to FREQID= -1 getn 35 $ *.NEWCH0.1 getona 35 $ *.NEWCH0.2 Re-run TVFLG with same inputs as above, except: flagver 2 ; outfgver 2 getn 35 $ *.NEWCH0.2 (2) Assuming there are three FREQIDs, we do this yet again: Copy the FG table: default TABED opty 'repl' inext 'FG' ; inver 2 ;outver 2 bcount 1;ecount 0; aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...to FREQID= -1 getn 35 $ *.NEWCH0.2 getona 35 $ *.NEWCH0.3 Re-run TVFLG with same inputs as above, except: flagver 2 ; outfgver 2 getn 35 $ *.NEWCH0.3 ^21. Calibration/flagging checks: calibrators ^21a. UVPLT executed on 23jun09 ***Check the amp & phase vs. uv-distance for all calibrators. Amplitude should match the results of SETJY/GETJY. If there are obvious outliers which are not expected due to source structure, go back and flag those (and possibly re-run CALIB etc.). default UVPLT calcode '*' docal 1; gainuse 3 flagver 1 $ set this to the latest FG version -- may be >1 if $ there are multiple NEWCH0s (FREQIDs). do3col 1 dotv 1 getn 35 $ *.NEWCH0.1 $ do this for each NEWCH0 file bparm 0 $ amp. vs. uv-distance dotv -1; go -> PL version 1 same as grabbed C2UVPLT_21a_AMP.tiff -> Looks beautiful! Primary generally ~14.7 +/- 0.7 Jy; supposed to be 15.0 Jy; pretty flat & clean Secondary generally ~2.0 +/- 0.3 Jy; supposed to be 2.10 Jy; quite clean Constant the whole way-> as expected because no limits on UVmax bparm 0, 2 $ phase vs. uv-distance dotv -1; go -> PL version 2 same as grabbed C2UVPLT_21a_PHS.tiff %%% Pretty clean! Looks like Pris are roughly 0 +/- 5 degrees and Secs are 0 +/- 10 degs All scatter within -20 to 25 degrees ^21b. IMAGR executed on 23jun09 [if desired -- this is not really necessary] ***Note: If uvwtfn is set to 'NA' it will override any value given to robust. default IMAGR sources '1227+365','' $ calibrator to image docalib 1; gainuse 3 $ apply latest calibration flagver 1 $ apply latest flags -- set this to the $ highest-numbered FG table outname 'Haro29C2sec $ cellsize 1 $ for B configuration cellsize 3.5 $ for C configuration $ cellsize 10 $ for D configuration $ imsize 1024 $ for B array imsize 512 $ for C and D array uvwtfn 'NA'; robust 0.5 niter 1000 $ nbox 1; clbox -1,5,512,513 $ calibrator should be in the center (for B) nbox 1; clbox -1,5,256,257 $ calibrator should be in the center (for C & D) minpa 121 dotv 1 getn 35 $ *.NEWCH0.xx $ whichever file has the calibrator you're imaging --> shouldn't see obvious calibration errors or striping. CLEANed flux density should roughly match SETJY/GETJY. %%% Looks clean, but the secondary is extended, with at least 2 other point sources in the vicinity tortue> IMAGR1: Loading field 1 from -2.87E-02 to 2.05E+00 interp by 2 tortue> IMAGR1: Field 1 final Clean flux 1.885 Jy (Kind of low wrt expected 2.05 Jy from GETJY and 2.10 Jy from catalog.) *** Note: If you have extended sources (instead of point sources), probably you just have poor uv-coverage. You can look at your uv-coverage using UVPLT with bparm 6, 7, 0 where good uv-coverage should result in a roughly circular pattern whereas bad uv-coverage may be more like a snowflake with outer gaps. The sources will not be extended when all the data sets are combined. %%% Plot of uv-coverage is not very circular (poor uv coverage) Grabbed C2UVPLT_uv_coverage.tiff (same as PL 3) ^22. TVFLG on the galaxy: NEWCH0.xx ***This is our first run of flagging on the galaxy. ^ Check the first scan carefully -- often the system isn't "organized" on this first scan x On-line flagging isn't as reliable as in the old days, so there are plenty of hot pixels and hiccups. x We are NOT quacking, because (1) FILLM's NX table isn't correct; (2) QUACK flags data from the beginning-of-scan, whereas we want to flag data from antennas-on-source. ^22a. If there's only one NEWCH0 (FREQID): default TVFLG docat -1 $ avoid saving temporary files dohist -1 $ avoid creation of history entries calcode '-CAL' $ non-calibrators only docalib 1; gainuse 3 $ apply the new CL table flagver 1; outfgver 1 $ keep all flags in FG/1 dparm 0 dparm(3) 1 $ show baselines twice, to treat all antennas identically -- $ this displays baseline 27-1 as well as 1-27 dparm(6)=10 $ time resolution: should be set to the sources' $ integration time, in seconds getn 35 $ *.NEWCH0.1 ***Within TVFLG: ^ Set useful defaults: ^SMOOTH=1 to avoid averaging date before displays ^SCAN= 20 to use a long time for median filters (AMP/PH DIFF) xFLAG ALL CHANNELS ^FLAG STOKES FULL (usually -- sometimes you'll want NORR or NOLL) ***If individual Stokes need to be flagged, make sure you set the STOKES FLAG to correspond to the polarization that is displayed on the TV ^SWITCH SOURCE FLAG to ONE-SOURCE to avoid inadvertantly flagging your galaxy (though sometimes you'll want to of course) ^ Be sure to inspect BOTH polarizations! ***We suggest the following steps: ^ Set the above defaults x Flag first integration in every scan (manual QUACK) -- this should be the first integration AFTER most antennas are on-source, which is why we can't use the usual QUACK. ^ Check AMPLITUDE, AMP DIFF, PHS DIFF. Be wary of known source structure and uv-range limits!! ***Note: occasionally, flagging using UVFLG can be more straightforward (e.g., deleting an antenna). Flagging 1 straggly timeline in 1st galaxy scan AMPLITUDE RR: (0.001 - 1.844) Looks pretty clean, but a few hot pixels Flagging RR: 09:37:56 17-22 & 9-17-> now 0.6-742.8 AMPLITUDE LL: (0.000 - 1.075) Looks very clean, but at least 1 hot pixel Flagging LL: 09:45:06 1-6-> now 0.4-720.8 AMPL DIFF RR: (0.0 - 591.2) Looks pretty good AMPL DIFF LL: (0.0 - 528.6) Looks pretty good PHAS DIFF RR: (0.0 - 179.9) Pretty random PHAS DIFF LL: (0.0 - 179.9) Pretty random Only 4 flagging commands needed. x22b. If there's more than one NEWCH0 (FREQID): ***I assume here that the galaxy is in NEWCH0.3 . If not, you should first TACOP FG/2 from NEWCH0.3 to the file with the galaxy in it. This will now be FG/3 . default TVFLG calcode '-CAL' $ non-calibrators only docat -1 $ avoid saving temporary files dohist -1 $ avoid creation of history entries docalib 1 ; gainuse 3 $ apply the new CL table flagver 2;outfgver 2 $ or flagver 3 ; outfgver 3 if you had to TACOP $ the FG table from another file dparm 0 dparm(3) 1 $ show baselines twice, to treat all antennas identically -- $ this displays baseline 27-1 as well as 1-27 dparm(6)=10 $ time resolution: should be set to the sources' $ integration time, in seconds getn 35 $ *.NEWCH0.xx $ This should be the file with the galaxy data ***Within TVFLG: - Set useful defaults: SMOOTH=1 to avoid averaging date before displays SCAN= 20 to use a long time for median filters (AMP/PH DIFF) FLAG ALL CHANNELS FLAG STOKES FULL (usually -- sometimes you'll want NORR or NOLL) ***If individual Stokes need to be flagged, make sure you set the STOKES FLAG to correspond to the polarization that is displayed on the TV SWITCH SOURCE FLAG to ONE-SOURCE to avoid inadvertantly flagging your galaxy (though sometimes you'll want to of course) - Be sure to inspect BOTH polarizations! ***We suggest the following steps: - Set the above defaults - Flag first integration in every scan (manual QUACK) -- this should be the first integration AFTER most antennas are on-source, which is why we can't use the usual QUACK. - Check AMPLITUDE (for missing data), AMP DIFF . PHS DIFF may occasionally be useful, but it's likely to be mostly random, unless you have a strong continuum source near your galaxy. ***Note: occasionally, flagging using UVFLG can be more straightforward (e.g., deleting an antenna). ^23. Calibration/flagging checks: sources ^23a. UVPLT executed on 23jun09 ***Check the amp vs. uv-distance for the galaxy. If there are obvious outliers which are not expected due to source structure or RFI (i.e., not mostly on short spacings), go back and flag those. Note any obvious short-spacing horrors, which may be due to solar or terrestrial RFI. default UVPLT source 'Haro29','' docal 1; gainuse 3 flagver 1 $ set this to the latest FG version -- may be >1 if $ there are multiple NEWCH0s (FREQIDs). do3col 1 dotv 1 getn 35 $ *.NEWCH0.1 $ whichever file holds the galaxy bparm 0 $ amp. vs. uv-distance Looks good- a little scatter Some structure; amplitude a bit higher at low kL dotv -1; go -> PL version 4 same as grabbed C2UVPLT_23a_AMP.tiff ^23b. IMAGR executed on 23jun09 *** Note: If uvwtfn is set to 'NA' it will override any value given to robust. default IMAGR sources 'Haro29','' $ the galaxy docalib 1; gainuse 3 $ apply latest calibration flagver 1 $ apply latest flags -- set this to the $ highest-numbered FG table outname 'Haro29C2_23b $ cellsize 1 $ for B configuration cellsize 3.5 $ for C configuration $ cellsize 10 $ for D configuration $ imsize 1024 $ for B configuration imsize 512 $ for C and D configurations uvwtfn 'NA'; robust 0.5 niter 1000 nbox 0 minpa 121 dotv 1 getn 35 $ *.NEWCH0.xx $ whichever file has the source you're imaging --> shouldn't see obvious calibration errors or striping. Note that this "channel 0" includes HI emission, so you may see some odd effects (e.g., very woofly noise in B configuration) -- don't panic! ### If you find a strong continuum source rippling your map even in a 512x512 imsize D array configuration channel zero image, then refer to Elias and Dana for further steps. %%% Fuzzy, extended galaxy smudge plus at least 7 point sources. ^24. TASAV -> CH0SAV.1,2,3 executed on 23jun09 default TASAV getn 35 $ *.NEWCH0 $ loop over NEWCH0 files (= FREQIDs) outna 'Haro29C2MdTb outcla 'ch0sav' outse inseq outdi 2 $ Ideally set this to a different disk from indisk, $ in case of disk crashes ^25. TABED SN, FG tables to LINCOP executed on 23jun09 ***Use TABED to ensure FREQID=-1 for all tables (paranoia is your friend...) ^25a. NEWCH0.xx FG/yy -> LINCOP FG/2 default TABED inext 'fg' inver 1 $ if single FREQID $ inver 3 $ if multiple FREQIDs: set this to max. flag table number outver 2 opty 'repl' aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...which we change to FREQID= -1 getn 35 $ *.NEWCH0.1 $ if single FREQID $ getn 35 $ *.NEWCH0.3 $ if multiple FREQIDs: set this to file you flagged $ on most recently (usually the file with the $ galaxy in it) getona 34 $ *.LINCOP --> LINCOP FG/2 ^25b. NEWCH0.xx SN/yy -> LINCOP SN/1 default TABED inext 'sn' inver 1 $ if single FREQID $ inver 4 $ if multiple FREQIDs outver 0 opty 'repl' aparm 0 aparm(1) 6 $ Changing column 3 = FREQID keyval= -1,0 $ ...which we change to FREQID= -1 getn 35 $ *.NEWCH0 $ if multiple FREQIDs: all should have same merged SN $ table so you can use whichever NEWCH0 file you want getona 34 $ *.LINCOP --> LINCOP SN/1 ^26. CLCAL LINCOP SN/1 --> CL/3 executed on 23jun09 ***We do CLCAL directly on LINCOP rather than copying, to avoid (even more) confusion in the multiple-FREQID case. ***Note that there is no need to work around any phase jumps, since the intervening data are flagged (see step 17 above [UVFLG]). ^26a. CLCAL for the primary calibrators -> CL/3 default CLCAL sour= '1331+305','' $ Primary (flux) calibrators '0542+498','0137+331', calsour= sour freqid= 1 $ You must run CLCAL once for each FREQID with $ the relevant calibators present interpol 'SELF' dobtween -1 $ Don't interpolate entries for different sources snver 1 gainver 2; gainuse 3 refant 22 $ Change this to your refant getn 34 $ *.LINCOP ^26b. CLCAL for the phase calibrator and galaxy -> CL/3 default CLCAL sour= '1227+365','Haro29','' $ Secondary (phase) calibrator + galaxy calsour= '1227+365','' $ Secondary (phase) calibrator freqid= 1 $ You must run CLCAL once for each FREQID with $ the phase calibrator or galaxy present interpol 'SIMP' cutoff 120 $ Don't extrapolate/interpolate beyond 120 minutes dobtween -1 $ Don't interpolate entries for different sources snver 1 gainver 2; gainuse 3 refant 22 $ Change this to your refant ***If your data set used +/- frequency switching for the phase calibrator (our observations did not, but some archival data may), you should use BPARM with SAMPTYPE='BOX' to select a smoothing time which covers both frequency settings. LISTR/SCAN on LINCOP will help you choose this; normally something like 12 minutes should be OK. bparm 12/60 ; samptype='BOX' getn 34 $ *.LINCOP ^27. Calibration/flagging checks: calibrators ^27a. WIPER executed on 23jun09 ###It shows a plot similar to the UVPLT output just quicker. It is also useful for identifying which antennas or baselines have calibration problems. ***Check the amp & phase vs. uv-distance for all calibrators. Amplitude should match the results of SETJY/GETJY, and phase should be zero, apart from known structure (reflected in source model for gain calibrators and uvrange for phase calibrators). If there are obvious, unexpected outliers, go back and flag those (and possibly re-run various tasks...). default WIPER calcode '*' freqid 1 $ set this to match the calibrator docal 1; gainuse 3 flagver 2 $ should be the latest FG table doband 1; bpver 1 $ for single-FREQID data sets $ doband 3; bpver 4 $ for multiple-FREQID data sets smooth 7, 215 $ boxcar average over all channels -- use $ smooth 7, 215 if you started with 255 channels & 7, 107 if you started with 127 channels bparm 0 imsize 512, 512 $ So it doesn't fill the whole screen! getn 34 $ *.LINCOP bparm(2) 1 $ amp. vs. uv-distance Grabbed as C2WIPER_27a_AMP.tiff-> looks pretty clean! Primary: ~15.0 +/- 4.0 Jy (15.0 Jy in catalog) (a little larger scatter, though) Secondary: ~2.5 +/- 2.5 Jy (2.10 Jy in catalog) (but some scatter...) No solar interference evident bparm(2) 2 $ phase vs. uv-distance %%% Probably as expected On Pris: C2WIPER_27a_PHS_Pri.tiff: Good- generally 0 +/- 15 with all scatter within -30 to 35 On all 12 Secs: C2WIPER_27a_PHS_Secs.tiff: full range -180 to 180 (because relatively faint) ^27b. POSSM executed on 23jun09 ***Check vector average of all data for each calibrator. Amplitude should match the results of SETJY/GETJY; phase should be flat, and consistent with zero (corresponding to a point source at the origin)...apart from known source structure and possibly HI absorption. default POSSM source='1227+365','' $ Secondary (phase) calibrator freqid 1 $ set this to match the calibrator uvrange= 0.0,0 $ should be set to eliminate known source structure, $ as in CALIB docal 1; gainuse 3 flagver 2 $ should be the latest FG table doband 1; bpver 1 $ for single-FREQID data sets $ doband 3; bpver 4 $ for multiple-FREQID data sets aparm 0 $ Plot data aparm(1) 1 $ vector average solint 0 $ average all time nplots 0 $ average all baselines dotv 1 getn 34 $ *.LINCOP tvinit %%% Grabbed C2POSSM_27b_RR.tiff & C2POSSM_27b_LL.tiff 1(RR): Roughly 2.05 Jy and fairly flat 1(RR): Fairly flat at 0 +/- 0.5 degrees 1(LL): Roughly 2.05 Jy and fairly flat 1(LL): Fairly flat at 0 +/- 0.5 degrees ^27c. IMAGR not necessary [if desired -- this is not really necessary] executed on 23jun09 *** Note: If uvwtfn is set to 'NA' it will override any value given to robust. default IMAGR source='1227+365','' $ Secondary (phase) calibrator freqid 1 $ set this to match the calibrator docal 1; gainuse 3 flagver 2 $ should be the latest FG table doband 1; bpver 1 $ for single-FREQID data sets $ doband 3; bpver 4 $ for multiple-FREQID data sets outname 'Haro29C2Sec2 $ cellsize 1 $ for B configuration cellsize 3.5 $ for C configuration $ cellsize 10 $ for D configuration $ imsize 1024 $ for B array imsize 512 $ for C and D array uvwtfn 'NA'; robust 0.5 niter 200 $ reasonable for a point source $ nbox 1; clbox -1,5,512,513 $ calibrator should be in the center minpa 121 dotv -1 $ so you can go eat lunch getn 34 $ *.LINCOP Started 15:01:00 and finished 15:04:56 ***You shouldn't see obvious calibration errors or striping. CLEANed flux density should roughly match SETJY/GETJY. If you _do_ have Evil Stuff, UVLSF will likely take care of it, so don't get too worked up. default tvlod; getn 41 tblc 0 0 108; ttrc 0 0 108 $ also tried 88 & 128: No real differences (as expected) default tvmovie; ltype 6; getn 41; tvinit; tvmovie Looks pretty constant & clean. -28. Calibration/flagging checks: sources ^28a.1 WIPER executed on 23jun09 ###It shows a plot similar to the UVPLT output just quicker. It is also useful for identifying which antennas or baselines have calibration problems. If you do find things you want to flag, UVFLG is highly recommended. ***Check the amp vs. uv-distance for the galaxy. If there are obvious outliers which are not expected due to source structure or RFI (i.e., not mostly on short spacings), go back and flag those. Note any obvious short-spacing horrors, which may be due to solar or terrestrial RFI. default WIPER sources 'Haro29','' freqid 1 $ set this to match the galaxy docal 1; gainuse 3 flagver 2 $ should be the latest FG table doband 1; bpver 1 $ for single-FREQID data sets $ doband 3; bpver 4 $ for multiple-FREQID data sets smooth 7, 215 $ boxcar average over all channels -- use $ smooth 7, 215 if you started with 255 channels & 7, 107 if you started with 127 channels bparm 0 imsize 512, 512 $ So it doesn't fill the whole screen! getn 34 $ *.LINCOP bparm(2) 1 $ amp. vs. uv-distance Grabbed C2WIPER_28a.tiff: maximum is 8.8 Jy, so pretty clean. There is slight banding, but that could be real signal. bparm(2) 2 $ phase vs. uv-distance Range: full -180 to 180 in all columns but a few empty ones ^28a.2 Up to which level most of the values (leaving aside the very hot pixels) comfortably fit in? Answer= 8 Jy (Could possibly clip a FEW high values...) ###This is the value that you will be using in CLIP when combining your data!!! ^28x. POSSM [Eliminated from the recipe] executed on 23jun09 anyways ***Check vector average of all data for the galaxy. You should see your HI line! default POSSM source='Haro29','' $ your galaxy freqid 1 $ set this to match the calibrator docal 1; gainuse 3 flagver 2 $ should be the latest FG table doband 1; bpver 1 $ for single-FREQID data sets $ doband 3; bpver 4 $ for multiple-FREQID data sets aparm 0 $ Plot data aparm(1) 1 $ vector average solint 0 $ average all time nplots 0 $ average all baselines dotv 1 getn 34 $ *.LINCOP tvinit %%% Results: Clearly there! 1 RR: phs: 0 +/- 150 on ends, except for ~90-120 where it's ~0 +/- 10 amp: about 7 mJy on ends, but peaks ~30 mJy C2POSSM_28_RR.tiff 1 LL: phs: 0 +/- 150 on ends, except for ~90-120 where it's ~0 +/- 10 amp: about 7 mJy on ends, but peaks ~30 mJy C2POSSM_28_LL.tiff ^28b. IMAGR executed on 23jun09 default IMAGR sources 'Haro29', '' freqid 1 $ set this to match the calibrator docal 1; gainuse 3 flagver 2 $ should be the latest FG table doband 1; bpver 1 $ for single-FREQID data sets $ doband 3; bpver 4 $ for multiple-FREQID data sets outname 'Haro29C2gal $ cellsize 1 $ for B configuration cellsize 3.5 $ for C configuration $ cellsize 10 $ for D configuration $ imsize 1024 $ for B configuration imsize 512 $ for C configuration $ imsize 256 $ for D configuration uvwtfn 'NA'; robust 0.5 niter 1000 $ a light clean, just to see what we've got. niter 0 $ would be ok too, esp. if you IMLIN afterwards nbox 0; clbox 0 minpa 121 dotv -1 $ so you can go eat lunch getn 34 $ *.LINCOP Started 15:14:30, and done by 15:27:30 ***You shouldn't see obvious calibration errors or striping. You should however see of order 100 mJy of continuum sources in the field, as well as some indication of your galaxy. The latter may be quite confusing for B configuration, which resolves out most of the structure. Don't fret until you've combined all the array configurations. ***Note: If uvwtfn is set to 'NA' it will override any value given to robust. ###If you find a strong continuum source rippling your map even after trying a 512x512 imsize D array configuration cube than refer to Elias and Dana for further steps. default tvlod; getn 43 tblc 0 0 108; ttrc 0 0 108 $ also tried 88 & 128: The faint galaxy blob moved. default tvmovie; ltype 6; getn 43; tvinit; tvmovie The galaxy is there, and it *is* rotating (channels ~76-136). There are also a few continuum sources. ?28c. Noise Estimations: calculated on 23jun09 ##The easiest way to calculate the expected sensitivity is to say 7 S(mJy) = ---------------------------- sqrt{ N (N-1) delta_nu t} where 7 is a constant that depends on the system temperature of the receivers(a quite conservative value) N = number of antennas in the array, delta_nu = channel resolution in MHz, and t = integration time in hours. You need to use for N the number of Antennas which have on average been giving good data during the run. The total time should be the actual time spent on source. No need to be super precise, of course. One simply wants to get a ballpark figure which is good to 10-20%. ###Note that for data which are Hanning smoothed (archive data) the channel spacing is equal to the resolution delta_nu. Without Hanning smoothing, the resolution is ~1.4 x delta_nu (note that after offline Hanning smoothing, if you preserve all channels, the resolution becomes 2 x delta_nu; it reverts to a new "double the old delta_nu" if you delete every other channel). ####Finally, if you want to know the noise in a single visibility, use N=2 and t = 1/360, and probably multiply by sqrt{2} because a visibility is a single polarisation as well. The Expected noise level is: 2.5 mJy x expected rms = K/SQRT[N(N-1)(N_IF*T_int*Delta_nu_M)] in mJy ^ expected rms = 2.5 mJy (here) where: K = 8.0 (for L band) N = # of Antennas (26 here) N_IF = 2 (for 2 polarizations) T_int = total on-source integration time in HOURS (1.294 hrs here = 77:40 mins) Delta_nu_M = effective continuum bandwidth or spectral-line channel in MHz (FREQ Coord incr in the header, but that number is in Hz) = 6.1035156e-03 (at least normally- check it) x measured rms: use TVSTAT (or IMSTAT) to measure the noise in a non-signal area ^ measured rms = 3.0 mJy x continuum channels are a good place, or just a clear off-galaxy area x can isolate main galaxy & continuum source area (TVWIN after TVLOD) & then use IMSTAT on outside area ^ TVWIN: blc = 159 225; trc = 476 356 default IMSTAT getn 43 $ Haro29C2gal movie blc 159 225 10 $ 10th channel, bottom left corner of box containing primary sources in the image trc 476 356 10 $ 10th channel, top right corner of box doinvers 1 $ full image except for box defined by blc & trc (afterwards, set doinvers -1) The rms Noise level in a line free channel is: 3.0 mJy ^29. TASAV -> EndTaB.LINSAV.1 executed on 23jun09 default TASAV outna 'Haro29C2EdTb outcla 'linsav' outdi 2 $ Ideally set this to a different disk from indisk, $ in case of disk crashes getn 34 $ *.LINCOP ^30. FITTP executed on 23jun09 dataout '/Users/herrmann/Desktop/C2-BeginTasav.FITS create: ^Haro29_C2_UV_CALIB_NEWCH0.FITS $ one per FREQID ^Haro29_C2_UV_CALIB_LINCOP.FITS ^Haro29_C2-BeginTasav.FITS ^Haro29_C2-MidTasav.FITS $ one per FREQID ^Haro29_C2-EndTasav.FITS ^Add the end date to the start of this file! ^PRTMSG & CLRMSG -31. Send to DEIDRE 23jun09 See Little THINGS Web site for current instructions. Apart from the FITS data from step 30/FITTP (in calib), the following should be archived (via ftp): * Observing log (in obs) * This data reduction log (in notes) * LISTR/SCAN output (if saved to a file- works well if you just insert it into this log, though) E-mail to Deidre: (See example e-mail below.) * This data reduction log * Any notes about the data set * The names of the .FITS files being ftped * Total time on source (in minutes and also in hours (decimal)) * Expected rms and measured rms 32. Celebrate your victory with an appropriate beverage! ================================================================================ ================================================================================ Ater the data has been checked by an independent member of the team and changes/corrections have been suggested the log should continue here with the steps that have been reiterated and the values used in the reiteration. If you need to recreate tables it is best at this stage to not delete the already existing ones but rather to give the tables higher version numbers. Haro29 C2 (AW) calibration Hi Deidre, The Haro29 C2 array (AW) data is ready to be ftped, but I'll do the actual ftping once the NRAO system is all set up. Attached is the data reduction log/filled-in-recipe file. Here is the rest of the information that you requested: Several notes about the data: Some shadowing: most of 2nd Pri of Ant 16 (flagging the little bit there) & all of last 2 Secs in Ant 21 The galaxy is there, and it *is* rotating (channels ~76-136). There are also a few continuum sources. Total Time on Source = 77:40 min (1.294 hrs) (Only 1 10s scan was lost due to flagging straggly time scans.) The expected rms is 2.5 (?) mJy and the measured rms is 3.0 mJy, so 2.5 (?) [3.0]. The measured value is quite higher than the expected value, which is might be expected since 14 out of 26 antennas were EVLA, but it's farther off than usual. (Only Antennas 2, 5 [EVLA testing], and 29 were lost. Again, there were no explanations in the log for antennas 2 and 29 being lost, but I don't think Ant 29 has even been used.) N = 26 antennas, Tint = 1.294 hrs, delta_nu_M = 6.1035156e-3 MHz, N_IF = 2, K = 8.0 (for L band) The uv data files that I will eventually ftp to the NRAO site are: Haro29_C2_UV_CALIB_NEWCH0.FITS Haro29_C2_UV_CALIB_LINCOP.FITS Haro29_C2-BeginTasav.FITS Haro29_C2-MidTasav.FITS Haro29_C2-EndTasav.FITS In addition, I will create a figuresC2 subdirectory (in the calib directory) as usual and will upload all the .tiff and .ps files mentioned in the data reduction log. I'll also put the data reduction log and 2 log files from the AIPS_MSGSRV window in the notes directory. Lastly, the observation log should already be in the obs directory as an html file, so I probably won't need to add anything to the obs directory. I think that's it! Three more Haro29 data sets to go! Kim =)