LITTLE THINGS AIPS Reduction of DDO165, C config.: VLA Obs. of 6th of July 2008 ===================================================================== calibration recipe v. 2.0: mrupen 10oct08 calibration recipe v. 2.1: mrupen 13oct08 calibration recipe v. 2.1.update: Dana Ficut Vicas 29 Oct 08 (new adverbs in Aips) calibration recipe v. 2.2: Dana Ficut Vicas 11Dec 08(tiny bits) calibration recipe v. 2.3: Dana Ficut Vicas 11 Feb 09(UVCOP ambiguities) calibration recipe v. 2.4: Dana Ficut Vicas 3 Mar 09(team raised issues) calibration recipe v. 2.5: Dana Ficut Vicas 23 September 2009 (no smoothing with WIPER on the source data) Latest update: 3rd March 2009 Data reduced by Dana Ficut Vicas, Hertfordshire 7 of July 2010 Suggestion: STARTING with D ARRAY and then working through C array and B array is recommended. D array data will allow you to have a look at the whole field ( the strong continuum sources that might give problems will be obvious here), is more stable and will give you the best feel for the data. The recipe lists the B-array reduction, but obviously the same steps apply to all configurations. 0. Basic stuff B configuration From observing log (available online at http://www.vla.nrao.edu/cgi-bin/oplogs.cgi): * Wind/API rms phase/clouds: yy:yy 1.2 -4.8 m/s 1.0-135.2d 10-30% stratiform clouds * ant.1 4 11 13 14 16 17 18 19 21 23 24 25 26 EVLA antenas included in the project * ant.7 15 25 26 27 updated baseline parameters * ant.2 4 moved recently * ant 10 used for VLBI * ant. 21 L band receiver low * ant. 4 LO problems * ant. 6 stuck in azimuth limit 1. FILLM executed on 7 of July 2010 a. Request archive data: copy public project data : AH927 from this archive file : /home/archive_VLA6/files/2008-03/vla2008-03-23.dat    to this output file : /home/e2earchive/AH927_AM080323.xp1 copy public project data : AH927 from this archive file : /home/archive_VLA6/files/2008-04/vla2008-04-14.dat    to this output file : /home/e2earchive/AH927_AU080414.xp1 copy public project data : AH927 from this archive file : vla2008-07-07.dat to this output file : /home/e2earchive/AH927_BF080707.xp2 copy public project data : AH927 from this archive file : vla2008-07-31.dat to this output file : /home/e2earchive/AH927_BS080731.xp1 copy public project data : AH927 from this archive file : /home/archive_VLA6/files/2008-07/vla2008-07-31.dat    to this output file : /home/e2earchive/AH927_BS080731.xp1 b. FILLM -> DDO165-D1.CH 0.1, DDO165-D1.LINE.1 default FILLM datain 'ARCHIVE:DDO165/Archive/AH927_AM080323.xp band 'l';vlaobs 'AH927'; doall -1 ; qual 3 $ restricts FILLM to the galaxy+calibrators of interest nfiles 0; ncount 1 $ read one filetget fillm, outna 'ddo165-C1' outdisk 1; outseq 0 douvcomp= -1 $ allow channel/IF-dependent weights doweight 10 $ use memo 108 weights (i.e., put weights in 1/Jy^2) bparm= -1,-1 $ avoid opacity & gain corrections cparm 0 cparm(4)=25.1 $ one needs to explicitly flag shadowed antennas $ since the ModComps were retired on 27 June 2007 $ this requires FILLM in 31DEC08 after 18Nov08 MNJ cparm(7)= 0 $ assigns new FREQID if frequency changes by more than $ the max. Doppler shift between sources 180 degrees $ apart. Setting this to -1 forces all data to have same $ FREQID. doconcat=-1 $ Change this to DOCONCAT=1 to add data to an existing file ***N.B. FILLM's channel 0 will ONLY be used for initial flagging. We're quite paranoid here. 2. TASAV -> LINSAV.1 executed on 7 of July 2010 ***We TASAV right away, because VLANT changes the AN table. Did I mention we're paranoid? default TASAV outna 'D165-1BeTaC outcla 'LINSAV' outdi 2 $ Ideally set this to a different disk from indisk, $ in case of disk crashes getn *.LINE 3. UVCOP -> LINCOP.1 executed on 7 of July 2010 ***Discard the first and last channels: 1st and last 10 channels if 127 channels total 1st and last 20 channels if 255 channels total ***We discard these Evil Channels because (1) they're pretty much useless; (2) they seem to confuse BPASS (which takes the solution from channel N as the initial guess for channel N+1); (3) their noise characteristics are quite different from the rest of the channels, which can be confusing e.g. in clipping and imaging. default UVCOP outcla 'LINCOP' bchan 11; echan 127-10 $ Use bchan 21 ; echan 255-20 if 255 channels total uvcopprm 0 uvcopprm(4) 1 $ report progress getn *.LINE ***From now on we operate on LINCOP data unless otherwise specified. 4. LISTR/SCAN --> DDO165-D1.listr ***We do this before VLANT because we need to know FREQIDs for VLANT default LISTR optype 'SCAN' docrt 132 getn *.LINCOP --> uhppc51 LISTR(31DEC08) 524 07-JUL-2010 13:10:07 Page 1 File = DDO165-C1 .LINCOP. 1 Vol = 3 Userid = 524 Freq = 1.423218290 GHz Ncor = 2 No. vis = 614223 Scan summary listing Scan Source Qual Calcode Sub Timerange FrqID START VIS END VIS 1 1331+305 : 0003 A 1 0/10:11:45 - 0/10:18:05 1 1 11064 2 1331+305 : 0003 A 1 0/10:18:25 - 0/10:22:25 2 11065 18564 3 1313+675 : 0003 C 1 0/10:24:25 - 0/10:28:35 3 18565 25579 4 DDO165 : 0003 1 0/10:28:55 - 0/10:53:55 3 25580 70207 5 1313+675 : 0003 C 1 0/10:54:15 - 0/10:58:15 3 70208 77707 6 DDO165 : 0003 1 0/10:58:35 - 0/11:23:35 3 77708 120799 7 1313+675 : 0003 C 1 0/11:23:55 - 0/11:27:55 3 120800 128299 8 DDO165 : 0003 1 0/11:28:15 - 0/11:53:15 3 128300 173599 9 1313+675 : 0003 C 1 0/11:53:35 - 0/11:57:35 3 173600 180475 10 DDO165 : 0003 1 0/11:57:55 - 0/12:22:55 3 180476 225775 11 1313+675 : 0003 C 1 0/12:23:15 - 0/12:27:15 3 225776 233275 12 DDO165 : 0003 1 0/12:27:35 - 0/12:52:35 3 233276 278575 13 1313+675 : 0003 C 1 0/12:52:55 - 0/12:56:55 3 278576 286075 14 DDO165 : 0003 1 0/12:57:15 - 0/13:22:05 3 286076 331075 15 1313+675 : 0003 C 1 0/13:22:25 - 0/13:26:35 3 331076 338875 16 DDO165 : 0003 1 0/13:26:55 - 0/13:51:45 3 338876 383875 17 1313+675 : 0003 C 1 0/13:52:05 - 0/13:56:05 3 383876 391375 18 DDO165 : 0003 1 0/13:56:25 - 0/14:21:25 3 391376 436075 19 1313+675 : 0003 C 1 0/14:21:45 - 0/14:25:45 3 436076 443575 20 DDO165 : 0003 1 0/14:26:05 - 0/14:51:05 3 443576 488803 21 1313+675 : 0003 C 1 0/14:51:25 - 0/14:55:25 3 488804 496303 22 DDO165 : 0003 1 0/14:55:45 - 0/15:20:45 3 496304 541603 23 1313+675 : 0003 C 1 0/15:21:05 - 0/15:25:05 3 541604 549103 24 DDO165 : 0003 1 0/15:25:25 - 0/15:50:25 3 549104 593803 25 1313+675 : 0003 C 1 0/15:50:45 - 0/15:54:45 3 593804 601303 26 0137+331 : 0003 B 1 0/15:57:05 - 0/16:01:15 1 601304 608421 27 0137+331 : 0003 B 1 0/16:01:35 - 0/16:04:55 2 608422 614223 Type Q to stop, just hit RETURN to continue uhppc51 LISTR(31DEC08) 524 07-JUL-2010 13:10:08 Page 2 File = DDO165-C1 .LINCOP. 1 Vol = 3 Userid = 524 Source summary Velocity type = ' ' Definition = ' ' ID Source Qual Calcode RA(2000.0) Dec(2000.0) IFlux QFlux UFlux VFlux No. vis 1 1331+305 : 0003 A 13:31:08.2879 30:30:32.958 0.000 0.000 0.000 0.000 18564 2 1313+675 : 0003 C 13:13:27.9848 67:35:50.376 0.000 0.000 0.000 0.000 89191 3 DDO165 : 0003 13:06:24.8000 67:42:25.000 0.000 0.000 0.000 0.000 493548 4 0137+331 : 0003 B 01:37:41.2994 33:09:35.132 0.000 0.000 0.000 0.000 12920 ID Source Freq(GHz) Velocity(Km/s) Rest freq (GHz) 1 All Sources 1.4232 0.0000 0.0000 Frequency Table summary FQID IF# Freq(GHz) BW(kHz) Ch.Sep(kHz) Sideband 1 1 1.42321829 1312.2560 6.1035 1 2 1 1.41721829 1312.2560 6.1035 1 3 1 1.42021829 1312.2560 6.1035 1 AIPS 1: Resumes 220 min on source 5. VLANT -> AN/1, CL/2 executed on 7 of July 2010 ***Note that VLANT can be run only for data observed from 1992 onwards. Data earlier than 1991 produce the following error message: VLANT1: Task VLANT (release of 31DEC07) begins VLANT1: ANT DATA UNAVAILABLE FOR YEAR 1991 DATA START WITH 1992 VLANT1: Purports to die of UNNATURAL causes For earlier data we skip baseline corrections entirely, and hope for the best. If there are clear and systematic phase gradients with time, consult the baseline corrections at http://www.vla.nrao.edu/astro/archive/baselines/ and apply corrections via CLCOR (which is basically what VLANT does). ***10oct08: Currently VLANT works on only one FREQID at a time. We therefore have to run VLANT multiple times for data with multiple FREQIDs. Unfortunately VLANT (1) produces a new CL table every time, and (2) updates the AN table positions every time as well. : CL tables: I'd like to maintain the convention that CL/1 is the original CL table and CL/2 has all the corrections that should have been applied on-line but weren't -- mainly, antenna position corrections. For multiple FREQIDs therefore this recipe calls for deleting the intermediate CL tables created by VLANT, using the rather clumsy mechanism of TASAVing to a temporary file, deleting the original CL tables, and copying the latest one back from the TASAV'd data set. Blah. : AN table: For now, this recipe resets to the original AN table just before running VLANT the last time. This means that only one run of VLANT updates the AN entries, leading to a correct AN table as needed for (e.g.) UVFIX. I've e-mailed DAIP to see about fixing all this, by allowing FREQID= -1 to mean "calculate corrections for all FREQIDs" (currently FREQID= -1 is reset to FREQID= 1). We'll see what Eric says. #####VLANT no longer has freqid as a parameter. 5a. default VLANT getn *.LINCOP 6. PRTAN AN/1 default PRTAN docrt 132 getn *.LINCOP Location Of VLA Antennas N18 ( 7) N16 (13)* N14 (27) N12 (18)* N8 ( 9) N6 (26)* N4 (12) N2 (25)* N1 (15) (22) W2 E2 (21)* *(19) W4 ( ) *(16) W6 E6 (28) ( ) E8 (10) *( 1) W10 E10 (11)* *(24) W12 E12 (20) *(17) W14 E14 ( 3) ( 8) W16 E16 (14)* *( 4) W18 E18 (23)* VLA:_OUT ( 2) VLA:_OUT ( 5) VLA:_OUT ( 6) VPT:_OUT (29) * => EVLA ANTENNA ***To choose the reference antenna the following algorithm should be followed: 1. should be present throughout the run 2. should be on an "inner" pad, but NOT N1/E1/W1 (to avoid shadowing) 3. NOT on the master pad (since those are always weird) 4. NOT an EVLA antenna (since those are often weird) 5. try to avoid the north arm in the smaller configurations (to avoid shadowing) 6. NOT listed in any interesting way in the log file (to avoid problems with the reference antenna) 7. preferably consistent with other recent runs 8. should be a fairly stable antenna (can't tell until TVFLG/CALIB of course...) ===> Refant: 22 $ W2 7. Calibrators ***Check out the calibrators in the on-line calibrator manual: http://www.vla.nrao.edu/astro/calib/manual/index.shtml ***Max baseline at 21 cm in B array is 54.3 klambda C array is 16.2 klambda D array is 4.9 klambda primary (flux/bandpass) calibrators: 1331+305=3C286 ***You can ignore the uv-ranges for these, since there are now models for the most important ones. secondary (gain) calibrator: 1313+675 1313+675 J2000 C 13h13m27.9848s 67d35'50.376" 1311+678 B1950 C 13h11m45.0360s 67d51'42.310" ----------------------------------------------------- BAND A B C D FLUX(Jy) UVMIN(kL) UVMAX(kL) ===================================================== 20cm L P P P P 2.40 ===> secondary cal --- NO restrictions 7b. SETJY -> SU/1 executed on 7 of July 2010 ***Set aparm(2) to corespond to date of observation. If date <1990 aparm(2)=3 If 19921998 aparm(2)=0 ***We need to enter a flux density for each primary (flux) calibrator. ***If we have more than one FREQID, we assume that the frequency offsets used are small, so that the flux densities of the flux calibrators are nearly the same for each FREQID. Typical frequency offsets are of order the bandwidth, +/-3 MHz; at 1420 MHz, for a worst-case spectral index of -1, this leads to an error of 2*3 MHz/1420 MHz= 0.4% -- not worth worrying about. So, we use any FREQID which covers all primary flux calibrators. If flux calibrator A is observed only with FREQID 1, while flux calibrator B is observed only with FREQID 2, we have to run SETJY twice: default SETJY sources '1331+305','' $ primary (flux) calibrator A optype 'CALC'; freqid=1 $ FREQID for A aparm 0,0 $ data taken after 1998 getn *.LINCOP; / Flux calculated using known spectrum uhppc5> SETJY1: BIF = 1 EIF = 1 /Range of IFs uhppc5> SETJY1: '1331+305 ' IF = 1 FLUX =14.7123 (Jy calcd) uhppc5> SETJY1: / Using (1999.2) VLA or Reynolds (1934-638) coefficients default SETJY sources '1331+305','' $ primary (flux) calibrator B optype 'CALC'; freqid=2 $ FREQID for B aparm 0,0 $ data taken after 1998 getn *.LINCOP; / Flux calculated using known spectrum uhppc5> SETJY1: BIF = 1 EIF = 1 /Range of IFs uhppc5> SETJY1: '1331+305 ' IF = 1 FLUX =14.7419 (Jy calcd) uhppc5> SETJY1: / Using (1999.2) VLA or Reynolds (1934-638) coefficients 7c. CALRD executed on 2 July 2010 ***Read in models of flux density calibrators: default CALRD object '3c286';band 'L'; ***Note: These models are in J2000 coordinates. If your data are in B1950, change the model images to B1950 with EPOSWTCH. We will later use UVFIX to fix the uv-data. Both in J2000!!! 8. PRTUV (used to find integration times on calibrators & sources) default PRTUV cparm 0; cparm(9)=103 $ Pick a baseline -- here, baseline 1-3 docrt 132 getn *.LINCOP --> calib: 10s source: 10s 9. UVFLG -> FG/1 executed on 7 July 2010 ***We toss the EVLA-EVLA baselines, to avoid dealing with aliasing. There should still be plenty of VLA-EVLA baselines to allow antenna-based solutions for the EVLA...but keep an eye out for oddities (e.g., in BPASS)! default UVFLG outfgver 1;opcode 'flag';reason 'EVLA' getn *.CH0 $ Note that we use FILLM's CH0 for initial flags -- we'll $ TACOP later. antenna=EVLA;baseline=EVLA; ***NOTE!!! do NOT run UVFLG if EVLA=0 (try PRINT EVLA to check) -- otherwise you'll delete ALL of your data. 10. TVFLG -> FG/1 executed on 7 July 2010 ***Again, we *only* use the original CH 0 from FILLM for initial flagging. Here we flag calibrators only, to remove any gross, obvious problems. - Check the first scan carefully -- often the system isn't "organized" on this first scan - On-line flagging isn't as reliable as in the old days, so there are plenty of hot pixels and hiccups. - We are NOT quacking, because (1) FILLM's NX table isn't correct; (2) QUACK flags data from the beginning-of-scan, whereas we want to flag data from antennas-on-source. default TVFLG calcode '*' $ calibrators only docat -1 $ avoid saving temporary files dohist -1 $ avoid creation of history entries Freqid 1 $ must step through all FREQIDs! docalib -1 flagver 1;outfgver 1 $ keep all flags in FG/1 dparm 0 dparm(3) 1 $ show baselines twice, to treat all antennas identically -- $ this displays baseline 27-1 as well as 1-27 dparm(6)=10 $ time resolution: should be set to the calibrators' integration $ time, in seconds getn *.CH0 $ note this is the ONLY time we use FILLM's Channel 0! ***Within TVFLG: - Set useful defaults: SMOOTH=1 to avoid averaging date before displays SCAN= 20 to use a long time for median filters (AMP/PH DIFF) FLAG ALL CHANNELS FLAG STOKES FULL (usually -- sometimes you'll want NORR or NOLL) ***If individual Stokes need to be flagged, make sure you set the STOKES FLAG to correspond to the polarization that is displayed on the TV SWITCH SOURCE FLAG to ONE-SOURCE to avoid inadvertantly flagging your galaxy (though sometimes you'll want to of course) - Be sure to inspect BOTH polarizations! ***We suggest the following steps: - Set the above defaults - Flag first integration in every scan (manual QUACK) -- this should be the first integration AFTER most antennas are on-source, which is why we can't use the usual QUACK. - Inspect the following: AMPLITUDE to check for missing records or antennas AMP DIFF to check for variable gains PHS DIFF to check for variable atmosphere/gains - If your data set is in D array(if your source is southern than also check for this problem in the C array) than keep an open eye for solar interference. It will be obvious if in TVFLG you choose a SORT BY BASELINE display, showing you how the short baselines behave,the ones affected by solar interference.If solar interference is affecting your data than in CALIB you should use a UVRANGE. ***Note: occasionally, flagging using UVFLG can be more straightforward (e.g., deleting an antenna). Example: default UVFLG antenna 21,0 stokes 'll' $ the antenna which "jumped" opcode 'FLAG' reason 'bad BP' outfgver 1 getn *.CH0.1 10b. TABED FG/1 executed on 7 July 2010 ***Here we TABED the CH 0 flags to LINCOP (with FREQID= -1). After this we're done with FILLM's channel 0. default TABED opty 'repl' inext 'fg' inver 1 ; outver 1; bcount 1;ecount 0 ; $until recently there was a parameter called $ncount which is no longer there aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...to FREQID= -1 getn *.CH 0 getona *.LINCOP --> LINCOP FG/1 11. BPASS ***This is a first-order BPASS leading to a new Channel 0. The goal is to avoid closure errors in Channel 0 calibration due to huge delays (phase slopes) on VLA-EVLA baselines. We divide each visibility by the vector average of the inner 3/4 of the band (i.e., an on-the-fly channel 0). Thus we remove source structure (tho' getting the weights wrong) and take care of the amplitude scale. ***There is a split here between the easy case (one FREQID for all sources) and the Galactic HI case (multiple FREQIDs, usually different for the bandpass calibrator and the galaxy (and phase calibrator)). Check LISTR/SCAN to see which you're doing. 11b. BPASS: Multiple FREQIDs -> BP/1,2,3 executed on 7 July 2010 ***The overall plan here is as follows (assuming FREQIDs 1 and 2 refer to the offset [bandpass calibrator] frequencies, and FREQID 3 refers to that of the galaxy & phase calibrator): (1) run BPASS once for FREQID=1 (-> BP/1) and once for FREQID=2 (-> BP/2). (2) check both BP tables with POSSM. They should look virtually identical. (3) If they do appear virtually identical, we concatenate them: (a) write out both tables [TBOUT], (b) concatenate the two [vi/emacs], (c) read them back in [TBIN] as BP/3, (4) If they do NOT appear identical, there is Something Wrong. The case we've come across involves the use of a front-end filter combined with the use of unexpected LOs (see Adrienne's note), so that one FREQID was observed through the edge of the filter. The resulting bandpasses show a strong slope in the amplitude gains for most VLA antennas. So far we've seen this only for central frequencies around 1423 MHz. In this case, simply copy the "good" BP table to BP/3 using TACOP. (5) modify BP/3 to refer to FREQID=3 [TABED]. ***It is a VERY good idea to use POSSM carefully throughout to be sure you're doing what you think you're doing. 11b1. BPASS FREQID 1 -> BP/1 executed on DDmonYY default BPASS calsour '1331+305','' $ Select bandpass calibrators docal 1 ; gainuse 2 $ apply VLANT changes. Probably irrelevant. flagver 1 $ apply initial flags refant 22 $ Change this to your refant Qual -1 solint 0 $ one solution per scan minamper 7 ; minphser 7 $ report closures > 7%/7d smooth 0 $ no smoothing soltype '' ; weightit 0 $ L1, L1R, etc. seem _less_ stable -- weird bpassprm 0 bpassprm(5) 0 $ derive "channel 0" on a record-by-record basis -- $ more biased than averaging first, but avoids $ some subtle pitfalls (see EXPLAIN file) bpassprm(2) 1 $ some closure info is printed bpassprm(6) 2 $ print avg. closure errors > 2% bpassprm(7) 2 $ print avg. closure errors > 2d ichansel 0 $ derive channel 0 from inner 3/4 of the band freqid 1 $ 1st offset FREQID getn *.LINCOP --> BP/1 11b2. BPASS FREQID 2 -> BP/2 executed on DDmonYY ***Same as 11b1, now on FREQID 2 default BPASS calsour '1331+305','' $ Select bandpass calibrators docal 1 ; gainuse 2 $ apply VLANT changes. Probably irrelevant. flagver 1 $ apply initial flags refant 22 $ Change this to your refant Qual -1 solint 0 $ one solution per scan minamper 7 ; minphser 7 $ report closures > 7%/7d smooth 0 $ no smoothing soltype '' ; weightit 0 $ L1, L1R, etc. seem _less_ stable -- weird bpassprm 0 bpassprm(5) 0 $ derive "channel 0" on a record-by-record basis -- $ more biased than averaging first, but avoids $ some subtle pitfalls (see EXPLAIN file) bpassprm(2) 1 $ some closure info is printed bpassprm(6) 2 $ print avg. closure errors > 2% bpassprm(7) 2 $ print avg. closure errors > 2d ichansel 0 $ derive channel 0 from inner 3/4 of the band freqid 2 $ 2nd offset FREQID getn *.LINCOP --> BP/2 11b3. POSSM to compare BP/1 and BP/2 default POSSM $ to check BPASS results flagver 1 aparm 0, 1, 0.7, 1.3, -180, 180, 0, 2, 0, 0 $ Plot BP, with amp/ph ranges source '0137+331','0542+498','1331+305','' $ POSSM doesn't work with $ source '' for some reason! solint -1 $ Separate plots for each scan nplots 9 $ 9 plots per page bparm 0 dotv 1 freqid 1; bpver 1 ; grch 1 freqid 2; bpver 2 ; grch 2 getn *.LINCOP tvinit If worried: try POSSM on secondary calibrator, applying this BPASS (if BPASS stable, secondary should look flat) 11b5. *If* BP/1 and BP/2 are NOT virtually identical, pick the one that best matches the behavior of the phase calibrator (possibly by doing a quickie BPASS on the phase calibrator and comparing the results), and copy that BP table to BP/3: default TACOP inext 'bp' inver 2 $ Set this to the "good" BP table getn *.LINCOP ; getona *.LINCOP --> BP/3 ***You should IGNORE the "bad" FREQID for all subsequent processing. 11b6. TABED BP/3 to set FREQID=-1 (so we can use the same BP table for everyone) --> BP/4 default TABED opty 'repl' inext 'bp' inver 3 ; outver 4 aparm 0 aparm(1) 8 $ Changing column 8 = FREQID keyval= -1,0 $ ...which we change to FREQID= -1 getn *.LINCOP --> BP/4 11c. POSSM to check BP table 11c1. Plot BP table itself default POSSM $ to check BPASS results flagver 1 aparm 0, 1, 0.7, 1.3, -180, 180, 0, 2, 0, 0 $ Plot BP, with amp/ph ranges source '1331+305','' $ POSSM doesn't work with $ source '' for some reason! solint -1 $ Separate plots for each scan nplots 9 $ 9 plots per page bparm 0 docal 1 ; gainuse 2 ; doband 1 dotv 1 freqid 3; bpver 4 $ for multiple-FREQID data sets getn *.LINCOP tvinit 11c2. Apply BP table to 2ndary calibrator & plot individual baselines default POSSM flagver 1 aparm 0 $ Plot data solint -1 $ Separate plots for each scan nplots 9 $ 9 plots per page aparm 0 aparm(1) 1 $ vector average source='1313+675','' $ Secondary (phase) calibrator docal 1 ; gainuse 2 ; doband 1 $ average all BP entries dotv 1 freqid 3; bpver 4 $ for multiple-FREQID data sets getn *.LINCOP tvinit 11c3. Apply BP table to 2ndary calibrator & vector average all data default POSSM flagver 1 aparm 0 $ Plot data solint 0 $ average all time nplots 0 $ average all baselines aparm 0 aparm(1) 1 $ vector average source='1313+675','' $ Secondary (phase) calibrator docal 1 ; gainuse 2 ; doband 1 $ average all BP entries dotv 1 freqid 3; bpver 4 $ for multiple-FREQID data sets getn *.LINCOP tvinit ***This plot should be flat in both amp. and phase as a function of frequency, with no slope.. If some channels are off, note which ones those are and keep an eye out for interference or other bad data. If there are large errors consider running BPASS on the secondary calibrator and using that to correct the galaxy. Note that this will be somewhat painful since AIPS does not allow incremental BP tables -- unlike SN or CL tables. Sigh. 12. AVSPC -> NEWCH0.1 (2,3) executed on 7 July 2010 ***AVSPC must be run once for each FREQID (unfortunately FREQID=-1 purports to work, but creates an empty data set). This entails some nasty bookkeeping for data sets with multiple FREQIDs. Here I assume we have one or three FREQIDs. If BPASS checks above show that one FREQID is useless, you should ignore that one entirely in this and all subsequent processing. ***We will use these NEWCH0 files for (1) further flagging, and (2) time-dependent gain calibration. 12a. FREQID=1 --> NEWCH0.1 default AVSPC docalib -1;gainuse 0; flagver -1 $ do NOT apply flags doband 1 freqid 1; bpver 4 $ for multiple-FREQID data sets getn *.LINCOP outname inna ; outcl 'NEWCH0' --> NEWCH0.1 12b. FREQID=2 (if multiple-FREQID data set) --> NEWCH0.2 ***Skip FREQID=2 if the corresponding BP table looked irrelevant (see 11b5) default AVSPC docalib -1;gainuse 0; flagver -1 $ do NOT apply flags doband 1 freqid 2; bpver 4 $ for multiple-FREQID data sets getn *.LINCOP outname inna ; outcl 'NEWCH0' ; outse= freqid --> NEWCH0.2 12c. FREQID=3 (if multiple-FREQID data set) --> NEWCH0.3 ***Skip FREQID=3 if the corresponding BP table looked irrelevant (see 11b5) default AVSPC docalib -1;gainuse 0; flagver -1 $ do NOT apply flags doband 1 freqid 3; bpver 4 $ for multiple-FREQID data sets getn *.LINCOP outname inna ; outcl 'NEWCH0' ; outse= freqid --> NEWCH0.3 12d. LISTR/SCAN ***It is a VERY good idea to run LISTR/SCAN on each of the NEWCH0 data sets at this point, to be sure each has the data you expect. 13. TABED LINCOP FG/1 -> NEWCH0 FG/1 ***We use TABED to set FREQID to -1 (apply to all FREQIDs) in the FG table, since AVSPC will change all FREQIDs to 1 in the NEWCH0 data sets. 13a. NEWCH0.1 default TABED opty 'repl' inext 'fg' inver 1 ; outver 1 aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...to FREQID= -1 getn *.LINCOP getona *.NEWCH0.1 --> NEWCH0.1, FG/1 13b. If multiple FREQIDs: NEWCH0.2 default TABED opty 'repl' inext 'fg' inver 1 ; outver 1 aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...to FREQID= -1 getn *.LINCOP getona *.NEWCH0.2 --> NEWCH0.2, FG/1 13c. If multiple FREQIDs: NEWCH0.3 default TABED opty 'repl' inext 'fg' inver 1 ; outver 1 aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...to FREQID= -1 getn *.LINCOP getona *.NEWCH0.3 --> NEWCH0.3, FG/1 14. CALIB -> NEWCH0.1(,2,3) SN/1 executed on 7 July 2010 ***If we only have one FREQID, all CALIBs are run on the same NEWCH0.1 . If we have multiple FREQIDs, CALIBs for a given source must be run for all NEWCH0.1,2,3 in which that source appears (probably easiest to check with LISTR/SCAN). ***Note: if 'SN' table must be destroyed: task 'extdest'; inext 'sn'; invers 0 ***If solar interference is affecting your data than in CALIB you should use a UVRANGE. The worst case scenario, baselines up to a distance of 1 kilolambda could be afected, while in the best case scenario baselines are affected only up to 0.5kilolambda distance. We recommend using: UVRANGE 0.7,0 for D array UVRANGE 0.7,0 for C array After calibration, if UVPLT still shows signs of solar interference,it means that not enough short baselines were discarded; therefore the calibration has to be redone and UVRANGE to be reset. Note that the Sun might rise or set, especially during a long B-array run, in which case you might wish to split the calibration by timerange in a set affected and a set without solar interference. 14a. Primary (flux density) calibrators --> SN/1 default CALIB calsour '1331+305','' $ flux density calibrator #1 get2n 3C286_L.MODEL.1 nmap 1 ; ncomp 1e6,0 ; inver 1 ; cmethod 'DFT' freqid -1 docal 1 ; gainuse 2 flagver 1 refant 22 $ Change this to your refant solint 0 aparm 4,0,0,0,0,2; $ min 4 antennas; print closures soltype 'L1'; solmode 'A&P'; weightit 1 $ true L1 minimization solcon 0 minamper 10; minphser 10 $ complain if >10%/10d off cparm 0,0,10,10,1 $ complain if avg > 10%/10d off snver 1 getn *.NEWCH0 $ ***NOTE: must run this for all NEWCH0.1,2 in which $ this calibrator appears! --> SN/1 14b. Secondary (phase) calibrator --> SN/1 ***Check uv restrictions for secondary calibrators carefully. For 0702+445: no restrictions, so uvra= 0,0 . default CALIB calsour '1313+675','' $ phase calibrator uvrange 0,0 wtuv 0.0 $ may have to set wtuv 0.01 if solutions are $ crazy and uvrange is not 0,0 freqid -1 docal 1 ; gainuse 2 flagver 1 refant 22 $ Change this to your refant solint 0 aparm 4,0,0,0,0,2; $ min 4 antennas; print closures soltype 'L1'; solmode 'A&P'; weightit 1 $ true L1 minimization solcon 0 minamper 10; minphser 10 $ complain if >10%/10d off cparm 0,0,10,10,1 $ complain if avg > 10%/10d off snver 1 getn *.NEWCH0 $ ***NOTE: must run this for all NEWCH0.1,2,3 in which $ this calibrator appears! 15a. TABED all SN tables to NEWCH0.1 --> SN/2,3 ***This step is only required if we have more than one FREQID (NEWCH0). We copy everything to NEWCH0.1 to match the FREQID=1 case. ***Skip this step if you only have one FREQID! default TABED opty 'repl' inext 'sn' inver 1 ; outver 0 aparm 0 aparm(1) 6 $ Changing column 3 = FREQID keyval= -1,0 $ ...which we change to FREQID= -1 getn *.NEWCH0.2 getona *.NEWCH0.1 --> NEWCH0.1, SN/2 default TABED opty 'repl' inext 'sn' inver 1 ; outver 0 aparm 0 aparm(1) 6 $ Changing column 3 = FREQID keyval= -1,0 $ ...which we change to FREQID= -1 getn *.NEWCH0.3 getona *.NEWCH0.1 --> NEWCH0.1, SN/3 15b. GETJY SN/1-3, SU/1 executed on 7 July 2010 ***Find flux density of secondary calibrator, and set SN table amplitude gains to reflect a common flux density scale. default GETJY sources '1313+675','' $ Secondary (phase) calibrators) calsour '1331+305','' $ Primary (flux) calibrators freqid -1 snver 0 $ Use all SN tables getn *.NEWCH0.1 uhppc51 31DEC08 OLD: Cpu= 0.0 Real= 1 uhppc5> GETJY1: Task GETJY (release of 31DEC08) begins uhppc5> GETJY1: Source:Qual CALCODE IF Flux (Jy) uhppc5> GETJY1: 1313+675 : 3 C 1 2.32991 +/- 0.00892 uhppc5> GETJY1: Appears to have ended successfully 15c. CLCAL/MERG to merge all SN tables -> SN/4 ***This step is only required if we have more than one FREQID (NEWCH0). Skip this step if you only have one FREQID! default CLCAL opcode 'MERG' $ Merge SN tables, for ease of plotting etc. refant 22 $ Change this to your refant getn *.NEWCH0.1 --> SN/4 $ creates a merged SN table -- doesn't change CL tables at all. Must now copy this new SN table to all other NEWCH0: default TACOP inext 'SN';inver 4 getn *.NEWCH0.1 getona *.NEWCH0.2 getona *.NEWCH0.3 16. SN table checks 16a. SNPLT last SN table executed on 7 July 2010 16a1. SNPLT phase: default SNPLT inext 'sn';inver 0 pixrange 0 opcode 'alsi';do3col 1;dotv 1; nplots 9 factor 2; symbol 5 xinc 1; optype 'phas'; getn *.NEWCH0.1 ===> Note any phase jumps (on the phase calibrator) for future flagging. The EVLA antennas, even after applying VLANT, still show quite a bit of phase drift. This is OK so long as a linear interpolation between the phases looks like it will work. 16a2. SNPLT amplitude: default SNPLT inext 'sn';inver 0 pixrange 0 opcode 'alsi';do3col 1;dotv 1; nplots 9 factor 2; symbol 5 xinc 1; optype 'amp'; getn *.NEWCH0.1 ===> Note whether the amp. is roughly constant for a given antenna/pol'n/IF. ***We have seen a couple cases where the first phase cal scan has a significantly different amplitude gain for the EVLA antennas. The reason is not clear but the raw data do show this effect, so CALIB is doing the right thing. This area warrants further tests, to learn whether we should simply flag the EVLA antennas on the first phase calibrator scan. 16b. LISTR/GAIN print SN table executed on 2 July 2010 default LISTR optype 'gain'; Inext 'sn'; inver 0; freqid -1 dparm 5,0; $ Amp & phase factor 0; docrt 132 outprint '' antennas 0; $ may have to list missing antennas explicitly, to avoid $ column overrun. To list missing antennas, use the form $ANTENNAS -3,2,0 to have antennas 3 and 2 left out. getn *.NEWCH0.1 --> check for phase jumps and other inconsistencies. ***We have seen a couple cases where the first phase cal scan has a significantly different amplitude gain for the EVLA antennas. The reason is not clear but the raw data do show this effect, so CALIB is doing the right thing. This area warrants further tests, to learn whether we should simply flag the EVLA antennas on the first phase calibrator scan. uhppc51 LISTR(31DEC08) 524 07-JUL-2010 16:17:36 Page 1 File = DDO165-C1 .NEWCH0. 1 Vol = 3 Userid = 524 IF = 1 Freq= 1.423218290 GHz Ncor= 2 No. vis= 18182 Polarization = R Subarray = 0 Listing SN table, version 4 SN table has not been applied to a CL table Gain amplitudes, 1000 = 10.000000 Stokes = R IF = 1 Freq = 1.423218290 GHz Time Source -- 1-- 2-- 3-- 4-- 6-- 7-- 8-- 9--10--11--12--13--14--15--16--17--18--19--20--21--22--23--24--25--26--27--28 Day # 0 10:14:55 1331+305 212 272 289 326 287 248 324 269 291 356 362 302 348 278 421 331 301 344 269 371 315 479 327 254 308 10:20:25 1331+305 201 264 284 317 290 238 314 241 282 329 340 306 333 268 402 333 297 335 262 349 291 422 323 251 297 10:26:35 1313+675 204 266 282 319 285 244 319 252 287 347 354 302 273 409 326 302 338 265 357 301 448 320 255 302 10:56:15 1313+675 205 265 282 318 288 243 325 252 283 345 354 301 337 279 415 326 302 339 264 357 306 450 317 252 304 11:25:55 1313+675 205 268 284 317 288 244 321 252 283 344 352 303 337 279 410 328 303 335 265 357 306 454 320 253 303 11:55:35 1313+675 205 267 283 317 288 244 321 251 285 339 355 303 344 273 406 330 300 332 265 358 312 453 320 252 303 12:25:15 1313+675 205 268 283 315 286 242 318 251 286 341 354 305 340 270 407 327 303 338 265 360 307 454 322 251 302 12:54:55 1313+675 204 266 282 319 287 242 319 254 285 343 354 303 341 281 408 331 303 337 264 362 310 452 322 251 306 13:24:30 1313+675 207 267 283 315 285 242 320 254 286 343 354 305 342 284 411 332 302 338 264 362 314 458 322 253 303 13:54:05 1313+675 205 267 284 315 286 242 318 258 284 345 359 302 343 284 414 336 302 339 265 366 311 457 324 251 303 14:23:45 1313+675 206 265 287 318 286 242 319 256 282 340 357 302 345 283 420 334 303 332 264 372 312 454 326 252 302 14:53:25 1313+675 207 265 286 317 285 243 321 257 282 343 357 303 352 291 421 341 302 343 263 370 312 452 326 250 301 15:23:05 1313+675 206 266 286 316 286 243 319 260 282 346 358 303 355 296 431 340 302 345 269 377 315 456 329 252 302 15:52:45 1313+675 208 265 287 320 284 241 317 260 287 344 362 300 359 293 417 348 298 335 265 380 317 463 329 253 300 Type Q to stop, just hit RETURN to continue uhppc51 LISTR(31DEC08) 524 07-JUL-2010 16:18:07 Page 2 File = DDO165-C1 .NEWCH0. 1 Vol = 3 Userid = 524 IF = 1 Freq= 1.423218290 GHz Ncor= 2 No. vis= 18182 Polarization = L Subarray = 0 Listing SN table, version 4 SN table has not been applied to a CL table Gain amplitudes, 1000 = 10.000000 Stokes = L IF = 1 Freq = 1.423218290 GHz Time Source -- 1-- 2-- 3-- 4-- 6-- 7-- 8-- 9--10--11--12--13--14--15--16--17--18--19--20--21--22--23--24--25--26--27--28 Day # 0 10:14:55 1331+305 258 305 284 323 260 232 304 339 270 334 359 264 356 232 376 327 324 336 262 348 374 415 304 256 310 10:20:25 1331+305 248 300 275 317 251 222 298 305 264 305 333 268 345 226 376 339 310 331 253 332 355 368 303 248 302 10:26:35 1313+675 252 301 275 313 254 225 294 318 258 325 342 264 226 372 330 310 333 253 338 368 394 302 252 304 10:56:15 1313+675 252 300 276 313 254 224 296 316 259 326 342 261 351 229 379 329 312 332 251 337 371 393 300 251 304 11:25:55 1313+675 254 302 276 313 253 224 294 315 257 323 342 262 351 229 378 330 312 334 252 340 375 397 298 251 302 11:55:35 1313+675 252 302 275 313 254 223 296 317 260 321 343 263 353 225 371 330 312 333 253 338 378 387 301 251 306 12:25:15 1313+675 254 301 275 312 251 221 295 317 260 324 343 263 352 226 375 326 311 333 254 343 375 389 302 250 301 12:54:55 1313+675 252 300 275 315 254 224 293 320 261 322 343 263 353 231 372 332 311 334 254 339 378 389 302 250 304 13:24:30 1313+675 252 299 276 312 252 223 294 319 261 320 344 264 356 232 375 328 312 339 253 342 388 394 302 251 303 13:54:05 1313+675 255 302 278 313 251 222 293 322 259 320 347 261 358 232 379 333 309 333 254 344 381 393 303 251 301 14:23:45 1313+675 256 301 279 313 253 224 293 323 259 319 344 260 356 232 381 329 308 336 255 349 383 389 304 251 302 14:53:25 1313+675 257 300 280 313 255 225 296 325 260 324 341 263 366 235 383 336 310 344 252 346 391 389 302 249 302 15:23:05 1313+675 255 299 276 311 254 223 293 321 258 326 346 265 365 239 391 336 313 346 256 354 391 389 306 251 300 15:52:45 1313+675 256 300 280 313 254 224 293 322 261 322 349 259 371 237 385 340 310 342 256 357 393 396 304 251 304 Type Q to stop, just hit RETURN to continue uhppc51 LISTR(31DEC08) 524 07-JUL-2010 16:18:55 Page 3 File = DDO165-C1 .NEWCH0. 1 Vol = 3 Userid = 524 IF = 1 Freq= 1.423218290 GHz Ncor= 2 No. vis= 18182 Polarization = R Subarray = 0 Listing SN table, version 4 SN table has not been applied to a CL table Gain phases in degrees Stokes = R IF = 1 Freq = 1.423218290 GHz Time Source -- 1-- 2-- 3-- 4-- 6-- 7-- 8-- 9--10--11--12--13--14--15--16--17--18--19--20--21--22--23--24--25--26--27--28 Day # 0 10:14:55 1331+305 -68 106-119 -113 174 49 159 -53 -81 132-164 108 117 -9 179 58 107 73 0 -52 45-139 166 30 163 10:20:25 1331+305 -33 102 169 101 165 -93 103 136 -45 116 -99-145-170-178 -82 22-124-132 0 64 104 -17 149 -69 -69 10:26:35 1313+675 -120 24 141 128-139 -30-129 161 104 54 170 118 26 158 -32 119 84 0 116 6-144 -87 20 101 10:56:15 1313+675 -122 24 141 127-140 -29-129 162 104 54 173 120 -91 17 158 -34 118 84 0 118 4-145 -89 20 102 11:25:55 1313+675 -125 23 139 125-141 -31-131 163 103 52 175 118 -93 11 156 -36 116 84 0 118 2-147 -92 19 101 11:55:35 1313+675 -125 23 139 128-140 -31-130 162 102 54-179 118 -93 11 157 -39 115 83 0 118 0-148 -92 23 101 12:25:15 1313+675 -125 22 140 127-141 -32-132 163 102 54-172 116 -93 11 155 -41 113 84 0 118 0-147 -92 21 100 12:54:55 1313+675 -127 18 138 125-143 -34-133 162 99 54 179 114 -94 10 152 -42 110 83 0 115 -3-149 -94 18 98 13:24:30 1313+675 -130 17 136 121-145 -34-133 167 99 52-167 112 -94 10 150 -43 110 83 0 117 -4-149 -95 17 98 13:54:05 1313+675 -127 18 139 122-145 -31-134 173 99 56-175 113 -91 16 153 -39 110 86 0 121 -4-146 -93 16 98 14:23:45 1313+675 -122 22 142 124-144 -29-133-180 99 62-168 116 -86 21 156 -34 114 93 0 126 -1-142 -89 17 100 14:53:25 1313+675 -118 26 149 125-141 -26-130-176 102 66-158 118 -80 25 162 -31 118 99 0 132 4-136 -81 21 103 15:23:05 1313+675 -117 27 150 125-142 -27-129-172 102 67-166 117 -78 30 165 -28 121 102 0 136 6-134 -78 20 102 15:52:45 1313+675 -116 23 150 125-144 -28-132-169 99 70-164 113 -77 31 165 -30 114 105 0 139 8-134 -76 19 99 Type Q to stop, just hit RETURN to continue uhppc51 LISTR(31DEC08) 524 07-JUL-2010 16:19:30 Page 4 File = DDO165-C1 .NEWCH0. 1 Vol = 3 Userid = 524 IF = 1 Freq= 1.423218290 GHz Ncor= 2 No. vis= 18182 Polarization = L Subarray = 0 Listing SN table, version 4 SN table has not been applied to a CL table Gain phases in degrees Stokes = L IF = 1 Freq = 1.423218290 GHz Time Source -- 1-- 2-- 3-- 4-- 6-- 7-- 8-- 9--10--11--12--13--14--15--16--17--18--19--20--21--22--23--24--25--26--27--28 Day # 0 10:14:55 1331+305 -110 -52-134 -110 34 56 162 166-115 57-138 -32 -75-115 -12 -14 30-176 0 50-150 128 -23-160 -73 10:20:25 1331+305 -49 -45-178 162 36 -83 126 24 -60 70 -43 97 27 104 114 -20 168 6 0-163 -65 -83 -12 122 51 10:26:35 1313+675 -130 -116 157 -171 93 -11-111 53 89 11-130 0 -46 -2 -71 47-134 0-108-159 154 116-147-146 10:56:15 1313+675 -134 -116 156 -175 90 -13-113 53 85 10-129 1 108 -53 -3 -75 44-135 0-108-162 152 113-149-146 11:25:55 1313+675 -139 -120 152 180 85 -17-117 51 82 6-129 -4 104 -59 -7 -79 38-138 0-111-166 148 108-154-149 11:55:35 1313+675 -140 -121 152 -180 85 -18-117 51 80 8-125 -6 103 -58 -7 -83 36-140 0-111-169 145 107-153-151 12:25:15 1313+675 -141 -125 151 177 82 -21-120 49 79 6-120 -11 102 -60 -11 -86 31-140 0-113-170 144 105-157-153 12:54:55 1313+675 -144 -131 149 173 80 -23-123 48 77 5-127 -14 100 -62 -14 -88 27-141 0-115-173 142 103-161-155 13:24:30 1313+675 -147 -132 147 169 78 -23-122 53 77 4-113 -17 100 -61 -16 -89 26-141 0-113-175 142 103-163-155 13:54:05 1313+675 -143 -130 150 171 78 -23-123 58 77 8-121 -14 103 -55 -13 -85 26-139 0-109-175 145 105-163-155 14:23:45 1313+675 -139 -125 153 174 79 -21-122 66 75 14-116 -8 108 -50 -10 -80 32-132 0-104-171 149 108-160-152 14:53:25 1313+675 -132 -116 163 -177 87 -14-115 74 82 21-102 -2 117 -42 -1 -72 43-122 0 -94-163 158 120-152-147 15:23:05 1313+675 -129 -114 166 -175 88 -13-111 78 85 23-110 -2 121 -36 3 -69 46-117 0 -89-160 162 124-151-145 15:52:45 1313+675 -130 -121 164 -178 85 -16-115 79 82 25-109 -8 120 -35 2 -72 38-116 0 -88-160 160 124-154-149 AIPS 1: Resumes 17. UVFLG -> NEWCH0.1 FG/1 executed on DDmonYY ***If the SN table shows a phase jump on the phase calibrator, you should flag the data between the two phase cal scans which show the jump (since those cannot be calibrated). ***Note that we flag NEWCH0.1, *regardless* of whether the galaxy appears in this data set. This is because later on (step 20/TVFLG) we flag the NEWCH0 data in order from inseq 1 through inseq freqid_max, copying the FG table from one file to the next. UVFLG itself doesn't care whether the flags you enter actually do anything -- it just adds entries to the FG table, which are then applied (or ignored if irrelevant) by other tasks. ***This step may of course be skipped if there are no obvious phase jumps. This example deals with a phase jump on antenna 18. default UVFLG antenna 18,0 $ the antenna which "jumped" timer 0 6 33 0 0 6 59 0; $ the source scan between the offending ph.cal scans opcode 'FLAG' reason 'phase jump' outfgver 1 getn *.NEWCH0.1 --> NEWCH0.1 FG/1 NOT NEEDED! 18. CLCAL NEWCH0 --> CL/3 executed on 7 July 2010 ***For multi-FREQID data this becomes rather complicated, since we need a new CL table for every NEWCH0 file, to allow detailed checks and second-order flagging. ***Note that there is no need to work around any phase jumps, since the intervening data are flagged (see step 17 above [UVFLG]). 18a. CLCAL for the primary calibrators -> CL/3 default CLCAL sour= '1331+305','' $ Primary (flux) calibrators calsour= sour interpol 'SELF' gainver 2 ; gainuse 3 refant 22 $ Change this to your refant dobtween -1 $ Don't interpolate entries for different sources snver 4 $ if multiple FREQIDs getn *.NEWCH0.1 $ do this for all NEWCH0 with primary (flux) $ calibrator data default CLCAL sour= '1331+305','' $ Primary (flux) calibrators calsour= sour interpol 'SELF' gainver 2 ; gainuse 3 refant 22 $ Change this to your refant dobtween -1 $ Don't interpolate entries for different sources snver 2 $ if multiple FREQIDs getn *.NEWCH0.1 $ do this for all NEWCH0 with primary (flux) 18b. CLCAL for the phase calibrator and galaxy -> CL/3 default CLCAL sour= '1313+675','DDO165','' $ Secondary (phase) calibrator + galaxy calsour= '1313+675','' $ Secondary (phase) calibrator interpol 'SIMP' gainver 2 ; gainuse 3 refant 22 $ Change this to your refant dobtween -1 $ Don't interpolate entries for different sources cutoff 120 $ Don't extrapolate/interpolate beyond 120 minutes snver 2 $ if multiple FREQIDs ***If your data set used +/- frequency switching for the phase calibrator (our observations did not, but some archival data may), you should use BPARM with SAMPTYPE='BOX' to select a smoothing time which covers both frequency settings. LISTR/SCAN on LINCOP will help you choose this; normally something like 12 minutes should be OK. bparm 12/60 ; samptype='BOX' getn *.NEWCH0.1 $ do this for all NEWCH0 with secondary (phase) $ calibrator or galaxy data ***At this point we have a new CL table for all NEWCH0 files. 19a. ANBPL executed on 7 July 2010 ***We use ANBPL to check the data weights. Data with very high weights (factor 5-10 or more above normal) should be flagged with UVFLG. default ANBPL docalib 1;gainuse 3 flagver 1 bparm 2,17,0 $ Plot antenna-based weight vs. time nplots 9; dotv 1 docrt 132 $ Print as well as plotting weights -- useful for $ finding exact times of bad weights $ Note you can also use outprint to send to a file. opcode 'alsi' $ Plot all IFs together do3col 1 $ ...using different colors getn *.NEWCH0.1 $ Must do this separately for every NEWCH0 file 19b. UVFLG to eliminate very high weights ***Should UVFLG on NEWCH0.1, even if Evil Weights are seen in NEWCH0.2 or NEWCH0.3 -- we'll be copying FG/1 from NEWCH0.1 to NEWCH0.2 for subsequent second-order flagging. 20. TVFLG FG/1 executed on 7 July 2010 20a. TVFLG on calibrators: NEWCH0.1 The calibrators should now have constant amplitude and zero phase...apart from source structure for the primary (flux) calibrators, and any uvrange for the secondary (phase) calibrators. If we see huge problems on the calibrators we may have to re-run CALIB etc. -- let's hope not!! default TVFLG calcode '*' $ calibrators only docat -1 $ avoid saving temporary files dohist -1 $ avoid creation of history entries docalib 1 ; gainuse 3 $ apply the new CL table flagver 1;outfgver 1 $ keep all flags in FG/1 dparm 0 dparm(3) 1 $ show baselines twice, to treat all antennas identically -- $ this displays baseline 27-1 as well as 1-27 dparm(6)=10 $ time resolution: should be set to the calibrators' $ integration time, in seconds getn *.NEWCH0.1 ***Within TVFLG: - Set useful defaults: SMOOTH=1 to avoid averaging date before displays SCAN= 20 to use a long time for median filters (AMP/PH DIFF) FLAG ALL CHANNELS FLAG STOKES FULL (usually -- sometimes you'll want NORR or NOLL) ***If individual Stokes need to be flagged, make sure you set the STOKES FLAG to correspond to the polarization that is displayed on the TV SWITCH SOURCE FLAG to ONE-SOURCE to avoid inadvertantly flagging your galaxy (though sometimes you'll want to of course) - Be sure to inspect BOTH polarizations! ***We suggest the following steps: - Set the above defaults - Check AMPLITUDE, AMP DIFF, PHS DIFF. Be wary of known source structure and uv-range limits!! ***Note: occasionally, flagging using UVFLG can be more straightforward (e.g., deleting an antenna). 20b. If we have multiple NEWCH0s (FREQIDs): (1) Copy the FG table: default TABED opty 'repl' inext 'FG' ; inver 1 ; outver 2 bcount 1;ecount 0; aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...to FREQID= -1 getn *.NEWCH0.1 getona *.NEWCH0.2 Re-run TVFLG with same inputs as above, except: flagver 2 ; outfgver 2 getn *.NEWCH0.2 (2) Assuming there are three FREQIDs, we do this yet again: Copy the FG table: default TABED opty 'repl' inext 'FG' ; inver 2 ;outver 2 bcount 1;ecount 0; aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...to FREQID= -1 getn *.NEWCH0.2 getona *.NEWCH0.3 Re-run TVFLG with same inputs as above, except: flagver 2 ; outfgver 2 getn *.NEWCH0.3 Some phase oddities in the primary calibrator have been flagged!!! 21. Calibration/flagging checks: calibrators 21a. UVPLT executed on 9 July 2010 ***Check the amp & phase vs. uv-distance for all calibrators. Amplitude should match the results of SETJY/GETJY. If there are obvious outliers which are not expected due to source structure, go back and flag those (and possibly re-run CALIB etc.). default UVPLT calco '*' docal 1 ; gainuse 3 flagver 2 $ set this to the latest FG version -- may be >1 if $ there are multiple NEWCH0s (FREQIDs). dotv 1 do3col 1 getn *.NEWCH0.1 $ do this for each NEWCH0 file bparm 0 $ amp. vs. uv-distance bparm 0,2 $ phase vs. uv-distance The primary calibrator looks unusual in the phase vs uv-distance plot. 21b. IMAGR executed on DDmonYY [if desired -- this is not really necessary] default IMAGR sources '0702+445','' $ calibrator to image docalib 1; gainuse 3 $ apply latest calibration flagver 1 $ apply latest flags -- set this to the $ highest-numbered FG table outname 'junkcal' $ some obviously cruddy name cellsize 1 $ for B configuration cellsize 3.5 $ for C configuration cellsize 10 $ for D configuration imsize 1024 $for B array imsize 512 $for C and D array niter 1000 nbox 1 ; clbox -1,5,512,513 $ calibrator should be in the center minpa 121 uvwtfn 'NA'; robust 0.5 dotv 1 getn *.NEWCH0.xx $ whichever file has the calibrator you're imaging --> shouldn't see obvious calibration errors or striping. CLEANed flux density should roughly match SETJY/GETJY. Note: If uvwtfn is set to 'NA' it will override any value given to robust. 22. TVFLG on the galaxy: NEWCH0.xx ***This is our first run of flagging on the galaxy. - Check the first scan carefully -- often the system isn't "organized" on this first scan - On-line flagging isn't as reliable as in the old days, so there are plenty of hot pixels and hiccups. - We are NOT quacking, because (1) FILLM's NX table isn't correct; (2) QUACK flags data from the beginning-of-scan, whereas we want to flag data from antennas-on-source. 22b. If there's more than one NEWCH0 (FREQID): ***I assume here that the galaxy is in NEWCH0.3 . If not, you should first TACOP FG/2 from NEWCH0.3 to the file with the galaxy in it. This will now be FG/3 . default TVFLG calcode '-CAL' $ non-calibrators only docat -1 $ avoid saving temporary files dohist -1 $ avoid creation of history entries docalib 1 ; gainuse 3 $ apply the new CL table flagver 2;outfgver 2 $ or flagver 3 ; outfgver 3 if you had to TACOP $ the FG table from another file dparm 0 dparm(3) 1 $ show baselines twice, to treat all antennas identically -- $ this displays baseline 27-1 as well as 1-27 dparm(6)=10 $ time resolution: should be set to the sources' $ integration time, in seconds getn *.NEWCH0.xx $ This should be the file with the galaxy data ***Within TVFLG: - Set useful defaults: SMOOTH=1 to avoid averaging date before displays SCAN= 20 to use a long time for median filters (AMP/PH DIFF) FLAG ALL CHANNELS FLAG STOKES FULL (usually -- sometimes you'll want NORR or NOLL) ***If individual Stokes need to be flagged, make sure you set the STOKES FLAG to correspond to the polarization that is displayed on the TV SWITCH SOURCE FLAG to ONE-SOURCE to avoid inadvertantly flagging your galaxy (though sometimes you'll want to of course) - Be sure to inspect BOTH polarizations! ***We suggest the following steps: - Set the above defaults - Flag first integration in every scan (manual QUACK) -- this should be the first integration AFTER most antennas are on-source, which is why we can't use the usual QUACK. - Check AMPLITUDE (for missing data), AMP DIFF . PHS DIFF may occasionally be useful, but it's likely to be mostly random, unless you have a strong continuum source near your galaxy. ***Note: occasionally, flagging using UVFLG can be more straightforward (e.g., deleting an antenna). 23. Calibration/flagging checks: sources 23a. UVPLT executed on 9 July 2010 ***Check the amp vs. uv-distance for the galaxy. If there are obvious outliers which are not expected due to source structure or RFI (i.e., not mostly on short spacings), go back and flag those. Note any obvious short-spacing horrors, which may be due to solar or terrestrial RFI. default UVPLTkkleenexk docal 1 ; gainuse 3 flagver 2 $ set this to the latest FG version -- may be >1 if $ there are multiple NEWCH0s (FREQIDs). dotv 1 do3col 1 source 'DDO165','' getn *.NEWCH0.3 $ whichever file holds the galaxy bparm 0 $ amp. vs. uv-distance 23b. IMAGR executed on 9 July 2010 default IMAGR sources 'DDO165','' $ the galaxy docalib 1; gainuse 3 $ apply latest calibration flagver 2 $ apply latest flags -- set this to the $ highest-numbered FG table outname 'junk' $ some obviously cruddy name cellsize 10 $ for D configuration imsize 512 $ for C and D configurations niter 1000 nbox 0 minpa 121 uvwtfn 'na'; robust 0.5 dotv -1 getn *.NEWCH0.3 $ whichever file has the source you're imaging --> shouldn't see obvious calibration errors or striping. Note that this "channel 0" includes HI emission, so you may see some odd effects (e.g., very woofly noise in B configuration) -- don't panic! Note: If uvwtfn is set to 'NA' it will override any value given to robust. ### If you find a strong continuum source rippling your map even in a 512x512 imsize D array configuration channel zero image than refer to Elias and Dana for further steps. 24. TASAV -> CH0SAV.1,2,3 executed on 9 July 2010 default TASAV outna 'D165-1MidTaC outcla 'ch0sav' outdi 2 $ Ideally set this to a different disk from indisk, $ in case of disk crashes getn *.NEWCH0 $ loop over NEWCH0 files (= FREQIDs) outse inseq 25. TABED SN, FG tables to LINCOP executed on 9 July 2010 ***Use TABED to ensure FREQID=-1 for all tables (paranoia is your friend...) 25a. NEWCH0.xx FG/yy -> LINCOP FG/2 default TABED opty 'repl' inext 'fg' aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...which we change to FREQID= -1 inver 2 $ if multiple FREQIDs: set this to max. flag table number outver 2 getn *.NEWCH0.3 $ if multiple FREQIDs: set this to file you flagged $ on most recently (usually the file with the $ galaxy in it) getona *.LINCOP --> LINCOP FG/2 25b. NEWCH0.xx SN/yy -> LINCOP SN/1 default TABED opty 'repl' inext 'sn' inver 4 $ if multiple FREQIDs outver 0 aparm 0 aparm(1) 6 $ Changing column 3 = FREQID keyval= -1,0 $ ...which we change to FREQID= -1 getn *.NEWCH0 $ if multiple FREQIDs: all should have same merged SN $ table so you can use whichever NEWCH0 file you want getona *.LINCOP --> LINCOP SN/1 26. CLCAL LINCOP SN/1 --> CL/3 executed on 9 July 2010 ***We do CLCAL directly on LINCOP rather than copying, to avoid (even more) confusion in the multiple-FREQID case. ***Note that there is no need to work around any phase jumps, since the intervening data are flagged (see step 17 above [UVFLG]). 26a. CLCAL for the primary calibrators -> CL/3 default CLCAL sour= '1331+305','' $ Primary (flux) calibrators calsour= sour interpol 'SELF' gainver 2 ; gainuse 3 refant 22 $ Change this to your refant dobtween -1 $ Don't interpolate entries for different sources snver 1 freqid= 1 $ You must run CLCAL once for each FREQID with $ the relevant calibators present bparm 12/60 ; samptype='BOX' getn *.LINCOP 26b. CLCAL for the phase calibrator and galaxy -> CL/3 default CLCAL sour= '1313+675','DDO165','' $ Secondary (phase) calibrator + galaxy calsour= '1313+675','' $ Secondary (phase) calibrator interpol 'SIMP' gainver 2 ; gainuse 3 refant 22 $ Change this to your refant dobtween -1 $ Don't interpolate entries for different sources cutoff 120 $ Don't extrapolate/interpolate beyond 120 minutes snver 1 ***If your data set used +/- frequency switching for the phase calibrator (our observations did not, but some archival data may), you should use BPARM with SAMPTYPE='BOX' to select a smoothing time which covers both frequency settings. LISTR/SCAN on LINCOP will help you choose this; normally something like 12 minutes should be OK. bparm 12/60 ; samptype='BOX' freqid= 3 $ You must run CLCAL once for each FREQID with $ the phase calibrator or galaxy present getn *.LINCOP 27. Calibration/flagging checks: calibrators 27a. WIPER executed on 9 July 2010 ***Check the amp & phase vs. uv-distance for all calibrators. Amplitude should match the results of SETJY/GETJY, and phase should be zero, apart from known structure (reflected in source model for gain calibrators and uvrange for phase calibrators). If there are obvious, unexpected outliers, go back and flag those (and possibly re-run various tasks...). default WIPER calcode '*' docal 1 ; gainuse 3 doband 3; bpver 4 $ for multiple-FREQID data sets freqid 1 $ set this to match the calibrator flagver 2 $ should be the latest FG table smooth 7, 117 $ boxcar average over all channels -- use $ smooth 7, 235 if you started with 255 channels dotv 1 do3col 1 bparm 0 getn *.LINCOP bparm(2) 1 $ amp. vs. uv-distance bparm(2) 2 $ phase vs. uv-distance Self clcal on the primary looks all over the palce!!! ###It shows a plot similar to the UVPLT output just quicker.It is also useful for identifying which antennas or baselines have calibration problems. 27b. POSSM executed on 9 July 2010 ***Check vector average of all data for each calibrator. Amplitude should match the results of SETJY/GETJY; phase should be flat, and consistent with zero (corresponding to a point source at the origin)...apart from known source structure and possibly HI absorption. default POSSM calcode '*' docal 1 ; gainuse 3 doband 3; bpver 4 $ for multiple-FREQID data sets freqid 3 $ set this to match the calibrator flagver 2 $ should be the latest FG table aparm 0 $ Plot data solint 0 $ average all time nplots 0 $ average all baselines aparm 0 aparm(1) 1 $ vector average source='1313+675','' $ Secondary (phase) calibrator uvrange= 0,0 $ should be set to eliminate known source structure, $ as in CALIB dotv 1 getn *.LINCOP tvinit 27c. IMAGR executed on DDmonYY [if desired -- this is not really necessary] default IMAGR docal 1 ; gainuse 3 doband 1; bpver 1 $ for single-FREQID data sets doband 3; bpver 4 $ for multiple-FREQID data sets freqid 1 $ set this to match the calibrator flagver 2 $ should be the latest FG table outname 'junk' $ some obviously cruddy name cellsize 1 $ for B configuration cellsize 3.5 $ for C configuration cellsize 10 $ for D configuration imsize 1024 $ for B array imsize 512 $ for C and D array niter 200 $ reasonable for a point source nbox 1 ; clbox -1,5,512,513 $ calibrator should be in the center minpa 121 uvwtfn 'na'; robust 0.5 dotv -1 $ so you can go eat lunch getn *.LINCOP ***You shouldn't see obvious calibration errors or striping. CLEANed flux density should roughly match SETJY/GETJY. If you _do_ have Evil Stuff, UVLSF will likely take care of it, so don't get too worked up. Note: If uvwtfn is set to 'NA' it will override any value given to robust. NOT DONE!!! 28. Calibration/flagging checks: sources 28a.1 WIPER executed on 7 July 2010 ***Check the amp vs. uv-distance for the galaxy. If there are obvious outliers which are not expected due to source structure or RFI (i.e., not mostly on short spacings), go back and flag those. Note any obvious short-spacing horrors, which may be due to solar or terrestrial RFI. default WIPER docal 1 ; gainuse 3 doband 3; bpver 4 $ for multiple-FREQID data sets freqid 3 $ set this to match the galaxy flagver 2 $ should be the latest FG table smooth 0 $do not smooth: smoothing will decrease your noise and $consequently show you a lower flux level than the level $that your data has in fact dotv 1 do3col 1 sources 'DDO165','' bparm 0 getn *.LINCOP bparm(2) 1 $ amp. vs. uv-distance bparm(2) 2 $ phase vs. uv-distance Use bparm(3)=1;bparm(6)=0;bparm(7)=20 if you want to force a range to the Y axis of the WIPER plot. ###It shows a plot similar to the UVPLT output just quicker.It is also useful for identifying which antennas or baselines have calibration problems.If you do find things you want to flag, UVFLG is highly recommended. #####CAREFUL with smoothing when doing WIPER on the source, it should NOT be done at this step.Smoothing will decrease your noise and consequently show you a lower flux level than the level that your data has in fact. #######It is very probable that when doing a WIPER on all the line data, some channels with junk will ruin your WIPER display and you will not be able to really make out what the clipping level should be. If the junk consists of random hot pixels then just run another WIPER in which you force the y axis to a 0-20 range (bparm(3)=1;bparm(6)=0;bparm(7)=20). If the junk comes in a structured manner than further investigations are needed to identify which baselines, in which channels might be missbehaving. Use WIPER only to identify the problematic baselines and channels, and use TVFLG or UVFLG to remove them form the data. DEFAULT UVFLG opcode 'FLAG' reason 'HOT' anten 9,0 basel 21,0 outfgver 2 getn *.LINCOP DEFAULT UVFLG opcode 'FLAG' reason 'HOT' anten 17,0 basel 7,20,15,0 outfgver 2 getn *.LINCOP 28a.2 Up to which level most of the values(leaving aside the very hot pixels) comfortably fit in? 15Jy ###This is the value that you will be using in CLIP when combining your data!!! 28b. IMAGR executed on 9 July 2010 default IMAGR docal 1 ; gainuse 3 doband 3; bpver 4 $ for multiple-FREQID data sets freqid 3 $ set this to match the galaxy flagver 2 $ should be the latest FG table outname 'junk_line' $ some obviously cruddy name cellsize 3.5 $ for C configuration imsize 512 $ for C configuration niter 1000 $ a light clean, just to see what we've got. niter 0 $ would be ok too, esp. if you IMLIN afterwards nbox 0 ; clbox 0 minpa 121 uvwtfn 'NA'; robust 0.5 dotv -1 $ so you can go eat lunch sourc 'ddo165','' getn *.LINCOP ***You shouldn't see obvious calibration errors or striping. You should however see of order 100 mJy of continuum sources in the field, as well as some indication of your galaxy. The latter may be quite confusing for B configuration, which resolves out most of the structure. Don't fret until you've combined all the array configurations. Note: If uvwtfn is set to 'NA' it will override any value given to robust. ### If you find a strong continuum source rippling your map even after trying a 512x512 imsize D array configuration cube than refer to Elias and Dana for further steps. 28c. Noise Estimations: calculated on 9 of July 2010 ##The easiest way to calculate the expected sensitivity is to say 7 S(mJy) = ---------------------------- sqrt{ N (N-1) delta_nu t} where 7 is a constant that depends on the system temperature of the receivers(a quite conservative value) N = number of antennas in the array, delta_nu = channel resolution in MHz, and t = integration time in hours. You need to use for N the number of Antennas which have on average been giving good data during the run. The total time should be the actual time spent on source. No need to be super precise, of course. One simply wants to get a ballpark figure which is good to 10-20%. ###Note that for data which are Hanning smoothed (archive data) the channel spacing is equal to the resolution delta_nu. Without Hanning smoothing, the resolution is ~1.4 x delta_nu (note that after offline Hanning smoothing, if you preserve all channels, the resolution becomes 2 x delta_nu; it reverts to a new "double the old delta_nu" if you delete every other channel). ####Finally, if you want to know the noise in a single visibility, use N=2 and t = 1/360, and probably multiply by sqrt{2} because a visibility is a single polarisation as well. N =25; t=220/60; delta_nu=0.006 The Expected noise level is: 1.62mJy The rms Noise level in a line free channel is: 2.14mJy 29. TASAV -> EndTaB.LINSAV.1 executed on 7th of July 2010 default TASAV outna 'D165-1EndTaC outcla 'linsav' outdi 2 $ Ideally set this to a different disk from indisk, $ in case of disk crashes getn *.LINCOP I AM HERE !!!! 30. FITTP executed on DDmonYY create: DDO210_B_UV_CALIB_NEWCH0.FITS $ one per FREQID DDO210_B_UV_CALIB_LINCOP.FITS DDO210_B-BeginTasav.FITS DDO210_B-MidTasav.FITS $ one per FREQID DDO210_B-EndTasav.FITS 31. Send to DEIDRE DDmonYY See Little THINGS Web site for current instructions. Apart from the FITS data from step 29/FITTP, the following should be archived: * Observing log * This data reduction log * LISTR/SCAN output (if saved to a file) 31. Celebrate your victory with an appropriate beverage! ================================================================================ ================================================================================ Ater the data has been checked by an independent member of the team and changes/corrections have been suggested the log should continue here with the steps that have been reiterated and the values used in the reiteration. If you need to recreate tables it is best at this stage to not delete the already existing ones but rather to give the tables higher version numbers.