LITTLE THINGS AIPS Reduction of DDO75, B config.: VLA Obs. of 09May2005 ===================================================================== calibration recipe v. 2.0: mrupen 10oct08 calibration recipe v. 2.1: mrupen 13oct08 calibration recipe v. 2.1.update: Dana Ficut Vicas 29 Oct 08 (new adverbs in Aips) calibration recipe v. 2.2: Dana Ficut Vicas 11Dec 08(tiny bits) calibration recipe v. 2.3: Dana Ficut Vicas 11 Feb 09(UVCOP ambiguities) calibration recipe v. 2.4: Dana Ficut Vicas 3 Mar 09(team raised issues) calibration recipe v. 2.5: Dana Ficut Vicas 23 September 2009 (no smoothing with WIPER on the source data) Latest update: 3rd March 2009 Data reduced by Caroline Simpson, FIU, 19Jul11 These data are the first day of observations (May 9) of AH 866; the second day (May 10) were 21 hours later, so are being reduced separately as B1b. aips number 753 setenv B1 /export/galaxy1/d75/B1 >> 01Aug11: redoing from CALIB; first time around, forgot to use the flux calibration model in CALIB! Flux calibration was wrong. >> setenv B1A /export/galaxy1/d75/B1/B1a ^0. Basic stuff B configuration From observing log (available online at http://www.vla.nrao.edu/cgi-bin/oplogs.cgi): 2005-05-10_0059_AH866.pdf 10May 0:59:35 -3.2 22 WNW at 6 m/sec 784.5 6.6 Sky cover 10%. Cumuliform clouds 10May 4:38:00 -6.9 12.9 SW at 4 m/sec 786.6 2.2 Sky clear. * ant. 13, 14, 16 stolen for EVLA tests ^1. FILLM executed on 19Jul11 a. Request archive data: copy public project data : AH866 from this archive file : Public File available : ftp://ftp.aoc.nrao.edu/e2earchive/d75_b1_1 Public File available : ftp://ftp.aoc.nrao.edu/e2earchive/d75_b1_2 b. FILLM -> D75_B1.CH 0.1, D75_B1.LINE.1 default FILLM datain 'FITS:d75_b1_ band 'l';vlaobs 'AH866'; doall -1 ; qual 2 $ two galaxies observed in this run; sextansB $ has qual 1; sextansA has qual 2. nfiles 0; ncount 1 $ read first day only May 9 outna 'd75_b1a' outdisk 1; outseq 0 douvcomp= -1 $ allow channel/IF-dependent weights doweight 10 $ use memo 108 weights (i.e., put weights in 1/Jy^2) bparm= -1,-1 $ avoid opacity & gain corrections cparm 0 cparm(4)=25.1 $ one needs to explicitly flag shadowed antennas $ since the ModComps were retired on 27 June 2007 $ this requires FILLM in 31DEC08 after 18Nov08 MNJ cparm(7)= 0 $ assigns new FREQID if frequency changes by more than $ the max. Doppler shift between sources 180 degrees $ apart. Setting this to -1 forces all data to have same $ FREQID. doconcat=-1 $ Change this to DOCONCAT=1 to add data to an existing file ***N.B. FILLM's channel 0 will ONLY be used for initial flagging. We're quite paranoid here. galaxy> FILLM2: Task FILLM (release of 31DEC08) begins galaxy> FILLM2: ****************************************************** galaxy> FILLM2: ** Times written by FILLM are now centered in ** galaxy> FILLM2: ** the integration, before they were at the end ** galaxy> FILLM2: ****************************************************** galaxy> FILLM2: Shadow flag limit = 2.510E+01 meters. galaxy> FILLM2: No opacity correction in CL table. galaxy> FILLM2: No gain curve correction in CL table. galaxy> FILLM2: Opening FITS:d75_b1_1 galaxy> FILLM2: galaxy> FILLM2: *** ATTENTION - default: loading subarray 1 *** galaxy> FILLM2: galaxy> FILLM2: tape file # 1, start date/time = 20050509/00:00:00 galaxy> FILLM2: MCINI: Processing Correlator Code '2AC ' with 24 antennas. galaxy> FILLM2: MCINI - Mode 2AC compatible galaxy> FILLM2: Program = AH866 ; Tape revision number = 26. galaxy> FILLM2: Create D75_B1A .CH 0 . 1 (UV) on disk 1 cno 1 galaxy> FILLM2: Ref. date = 20050509 A-C = 1.418788 B-D = 1.418788 GHz galaxy> FILLM2: Create D75_B1A .LINE . 1 (UV) on disk 1 cno 2 galaxy> FILLM2: Ref. date = 20050509 A-C = 1.418788 B-D = 1.418788 GHz galaxy> FILLM2: FLMFQ: FQ entry tolerance = 1.609D+02 galaxy> FILLM2: Found 0542+498 : 2 1.562 MHz at IAT 0/ 01:39:35.0 galaxy> FILLM2: MCINI: Processing Correlator Code '2AC ' with 24 antennas. galaxy> FILLM2: MCINI - Mode 2AC compatible galaxy> FILLM2: Ref. date = 20050509 A-C = 1.418788 B-D = 1.418788 GHz galaxy> FILLM2: Appending new data to: D75_B1A .CH 0 . 1 disk 1 galaxy> FILLM2: Ref. date = 20050509 A-C = 1.418788 B-D = 1.418788 GHz galaxy> FILLM2: Appending new data to: D75_B1A .LINE . 1 disk 1 galaxy> FILLM2: Found 0542+498 : 2 1.562 MHz at IAT 0/ 01:39:45.0 galaxy> FILLM2: MCINI: Processing Correlator Code '2AC ' with 24 antennas. galaxy> FILLM2: MCINI - Mode 2AC compatible galaxy> FILLM2: Ref. date = 20050509 A-C = 1.418741 B-D = 1.418741 GHz galaxy> FILLM2: Appending new data to: D75_B1A .CH 0 . 1 disk 1 galaxy> FILLM2: Ref. date = 20050509 A-C = 1.418741 B-D = 1.418741 GHz galaxy> FILLM2: Appending new data to: D75_B1A .LINE . 1 disk 1 galaxy> FILLM2: Found 0943-083 : 2 1.562 MHz at IAT 0/ 01:49:45.0 galaxy> FILLM2: Found SEXTANSA : 2 1.562 MHz at IAT 0/ 01:53:35.0 galaxy> FILLM2: Found 0943-083 : 2 1.562 MHz at IAT 0/ 02:22:25.0 galaxy> FILLM2: Found SEXTANSA : 2 1.562 MHz at IAT 0/ 02:25:55.0 galaxy> FILLM2: Found 0943-083 : 2 1.562 MHz at IAT 0/ 02:54:55.0 galaxy> FILLM2: Found SEXTANSA : 2 1.562 MHz at IAT 0/ 02:58:25.0 galaxy> FILLM2: Found 0943-083 : 2 1.562 MHz at IAT 0/ 03:27:15.0 galaxy> FILLM2: Found SEXTANSA : 2 1.562 MHz at IAT 0/ 03:30:45.0 galaxy> FILLM2: Found 0943-083 : 2 1.562 MHz at IAT 0/ 03:59:45.0 galaxy> FILLM2: Read 200658 visibilities from 1 files galaxy> FILLM2: Appears to have ended successfully 2. TASAV -> LINSAV.1 executed on 19Jul11 ***We TASAV right away, because VLANT changes the AN table. Did I mention we're paranoid? default TASAV outna 'D75B1aBeTa outcla 'LINSAV' outdi 1 $ Ideally set this to a different disk from indisk, $ in case of disk crashes getn 2 $ *.LINE >> AIPS 2: Got(1) disk= 1 user= 753 type=UV D75_B1A.LINE.1 >> ----> D75B1aBeTa.LINSAV.1 ^3. UVCOP -> LINCOP.1 executed on 19Jul11 ***Discard the first and last channels: 1st and last 10 channels if 127 channels total 1st and last 20 channels if 255 channels total ***We discard these Evil Channels because (1) they're pretty much useless; (2) they seem to confuse BPASS (which takes the solution from channel N as the initial guess for channel N+1); (3) their noise characteristics are quite different from the rest of the channels, which can be confusing e.g. in clipping and imaging. default UVCOP outcla 'LINCOP' bchan 11; echan 127-10 $ Use bchan 21 ; echan 255-20 if 255 channels total uvcopprm 0 uvcopprm(4) 1 $ report progress getn 2 $*.LINE ***From now on we operate on LINCOP data unless otherwise specified. >> AIPS 2: Got(1) disk= 1 user= 753 type=UV D75_B1A.LINE.1 >> ----> D75_B1A.LINCOP.1 ^ 4. LISTR/SCAN --> D75B1a.listr ***We do this before VLANT because we need to know FREQIDs for VLANT default LISTR optype 'SCAN' docrt -1 outpr 'B1:D75B1a.listr getn 4 $ *.LINCOP --> *.listr File = D75_B1A .LINCOP. 1 Vol = 1 Userid = 753 Freq = 1.418787650 GHz Ncor = 2 No. vis = 200658 Scan summary listing Scan Source Qual Calcode Sub Timerange FrqID START VIS END VIS 1 0542+498 : 0002 A 1 0/01:39:45 - 0/01:46:25 1 1 9975 2 0943-083 : 0002 C 1 0/01:49:45 - 0/01:52:55 1 9976 14662 3 SEXTANSA : 0002 1 0/01:53:35 - 0/02:21:55 1 14663 54005 4 0943-083 : 0002 C 1 0/02:22:25 - 0/02:25:15 1 54006 58307 5 SEXTANSA : 0002 1 0/02:25:55 - 0/02:54:15 1 58308 101262 6 0943-083 : 0002 C 1 0/02:54:55 - 0/02:57:45 1 101263 105772 7 SEXTANSA : 0002 1 0/02:58:25 - 0/03:26:35 1 105773 148606 8 0943-083 : 0002 C 1 0/03:27:15 - 0/03:30:05 1 148607 153072 9 SEXTANSA : 0002 1 0/03:30:45 - 0/03:59:05 1 153073 195642 10 0943-083 : 0002 C 1 0/03:59:45 - 0/04:02:55 1 195643 200658 Source summary Velocity type = 'BARYCENT' Definition = 'OPTICAL ' ID Source Qual Calcode RA(2000.0) Dec(2000.0) IFlux QFlux UFlux VFlux No. vis 1 0542+498 : 0002 A 05:42:36.1379 49:51:07.234 0.000 0.000 0.000 0.000 9975 2 0943-083 : 0002 C 09:43:36.9480 -08:19:30.857 0.000 0.000 0.000 0.000 22981 3 SEXTANSA : 0002 10:10:50.1070 -04:39:49.960 0.000 0.000 0.000 0.000 167702 ID Source Freq(GHz) Velocity(Km/s) Rest freq (GHz) 1 0542+498 1.4188 325.0000 1.4204 2 0943-083 1.4187 325.0000 1.4204 3 SEXTANSA 1.4187 325.0000 1.4204 Frequency Table summary FQID IF# Freq(GHz) BW(kHz) Ch.Sep(kHz) Sideband 1 1 1.41878765 1306.1525 12.2070 1 5. VLANT -> AN/1, CL/2 executed on 19Jul11 ***Note that VLANT can be run only for data observed from 1992 onwards. Data earlier than 1991 produce the following error message: VLANT1: Task VLANT (release of 31DEC07) begins VLANT1: ANT DATA UNAVAILABLE FOR YEAR 1991 DATA START WITH 1992 VLANT1: Purports to die of UNNATURAL causes For earlier data we skip baseline corrections entirely, and hope for the best. If there are clear and systematic phase gradients with time, consult the baseline corrections at http://www.vla.nrao.edu/astro/archive/baselines/ and apply corrections via CLCOR (which is basically what VLANT does). ***10oct08: Currently VLANT works on only one FREQID at a time. We therefore have to run VLANT multiple times for data with multiple FREQIDs. Unfortunately VLANT (1) produces a new CL table every time, and (2) updates the AN table positions every time as well. : CL tables: I'd like to maintain the convention that CL/1 is the original CL table and CL/2 has all the corrections that should have been applied on-line but weren't -- mainly, antenna position corrections. For multiple FREQIDs therefore this recipe calls for deleting the intermediate CL tables created by VLANT, using the rather clumsy mechanism of TASAVing to a temporary file, deleting the original CL tables, and copying the latest one back from the TASAV'd data set. Blah. : AN table: For now, this recipe resets to the original AN table just before running VLANT the last time. This means that only one run of VLANT updates the AN entries, leading to a correct AN table as needed for (e.g.) UVFIX. I've e-mailed DAIP to see about fixing all this, by allowing FREQID= -1 to mean "calculate corrections for all FREQIDs" (currently FREQID= -1 is reset to FREQID= 1). We'll see what Eric says. #####VLANT no longer has freqid as a parameter. ^ 5a. default VLANT getn 4 $ *.LINCOP galaxy> VLANT2: Task VLANT (release of 31DEC08) begins galaxy> VLANT2: /tmp/baselines.vlais11 copied from the VLA web site galaxy> VLANT2: WARNING: 1 ANTENNAS MAY STILL GET MORE CORRECTION galaxy> VLANT2: Copied CL file from vol/cno/vers 1 4 1 to 1 4 2 galaxy> VLANT2: CL version input 1 output 2 galaxy> VLANT2: VLANT STNID( 1) = 'N36' galaxy> VLANT2: VLANT XCOR( 1) = 0.0000 galaxy> VLANT2: VLANT YCOR( 1) = 0.0015 galaxy> VLANT2: VLANT ZCOR( 1) = -0.0004 galaxy> VLANT2: VLANT STNID( 5) = 'N28' galaxy> VLANT2: VLANT XCOR( 5) = -0.0020 galaxy> VLANT2: VLANT YCOR( 5) = -0.0009 galaxy> VLANT2: VLANT ZCOR( 5) = -0.0010 galaxy> VLANT2: VLANT STNID( 6) = 'W8 ' galaxy> VLANT2: VLANT XCOR( 6) = -0.0050 galaxy> VLANT2: VLANT YCOR( 6) = 0.0007 galaxy> VLANT2: VLANT ZCOR( 6) = -0.0002 galaxy> VLANT2: VLANT STNID( 7) = 'N4 ' galaxy> VLANT2: VLANT XCOR( 7) = -0.0021 galaxy> VLANT2: VLANT YCOR( 7) = -0.0001 galaxy> VLANT2: VLANT ZCOR( 7) = -0.0008 galaxy> VLANT2: VLANT STNID( 8) = 'W4 ' galaxy> VLANT2: VLANT XCOR( 8) = -0.0019 galaxy> VLANT2: VLANT YCOR( 8) = 0.0006 galaxy> VLANT2: VLANT ZCOR( 8) = -0.0014 galaxy> VLANT2: VLANT STNID( 9) = 'N8 ' galaxy> VLANT2: VLANT XCOR( 9) = -0.0029 galaxy> VLANT2: VLANT YCOR( 9) = 0.0023 galaxy> VLANT2: VLANT ZCOR( 9) = -0.0021 galaxy> VLANT2: VLANT STNID(10) = 'E8 ' galaxy> VLANT2: VLANT XCOR(10) = -0.0050 galaxy> VLANT2: VLANT YCOR(10) = 0.0023 galaxy> VLANT2: VLANT ZCOR(10) = -0.0016 galaxy> VLANT2: VLANT STNID(11) = 'W16' galaxy> VLANT2: VLANT XCOR(11) = -0.0005 galaxy> VLANT2: VLANT YCOR(11) = -0.0010 galaxy> VLANT2: VLANT ZCOR(11) = 0.0000 galaxy> VLANT2: VLANT STNID(15) = 'E4 ' galaxy> VLANT2: VLANT XCOR(15) = -0.0013 galaxy> VLANT2: VLANT YCOR(15) = 0.0013 galaxy> VLANT2: VLANT ZCOR(15) = 0.0003 galaxy> VLANT2: VLANT STNID(17) = 'E12' galaxy> VLANT2: VLANT XCOR(17) = 0.0000 galaxy> VLANT2: VLANT YCOR(17) = 0.0005 galaxy> VLANT2: VLANT ZCOR(17) = 0.0000 galaxy> VLANT2: VLANT STNID(19) = 'E16' galaxy> VLANT2: VLANT XCOR(19) = 0.0000 galaxy> VLANT2: VLANT YCOR(19) = 0.0003 galaxy> VLANT2: VLANT ZCOR(19) = 0.0000 galaxy> VLANT2: VLANT STNID(24) = 'N32' galaxy> VLANT2: VLANT XCOR(24) = -0.0019 galaxy> VLANT2: VLANT YCOR(24) = 0.0000 galaxy> VLANT2: VLANT ZCOR(24) = -0.0005 galaxy> VLANT2: VLANT STNID(25) = 'N24' galaxy> VLANT2: VLANT XCOR(25) = -0.0014 galaxy> VLANT2: VLANT YCOR(25) = 0.0000 galaxy> VLANT2: VLANT ZCOR(25) = 0.0000 galaxy> VLANT2: VLANT STNID(26) = 'N16' galaxy> VLANT2: VLANT XCOR(26) = -0.0060 galaxy> VLANT2: VLANT YCOR(26) = 0.0010 galaxy> VLANT2: VLANT ZCOR(26) = -0.0040 galaxy> VLANT2: VLANT STNID(27) = 'N20' galaxy> VLANT2: VLANT XCOR(27) = -0.0004 galaxy> VLANT2: VLANT YCOR(27) = -0.0004 galaxy> VLANT2: VLANT ZCOR(27) = -0.0012 galaxy> VLANT2: Appears to have ended successfully x 5b. If VLANT does not create a new CL table (no antennas moved), or the data were taken before 1992: default TACOP getn *.LINCOP getona *.LINCOP inext 'CL' ; inver 1 ; ncount 1 ; outver 2 ***The goal here is to keep the recipe uniform for all data. ^6. PRTAN AN/1 default PRTAN docrt 132 getn 4 $ *.LINCOP Array= VLA Freq= 1418.787650 MHz Ref.date= 09-MAY-2005 Location Of VLA Antennas N36 ( 1) N32 (24) N28 ( 5) N24 (25) N20 (27) N16 (26) N8 ( 9) N4 ( 7) ( 8) W4 E4 (15) ( 6) W8 E8 (10) ( ) E12 (17) (11) W16 E16 (19) (20) W20 E20 ( 3) (23) W24 ( ) (21) W28 E28 (12) ( 4) W32 E32 ( 2) (22) W36 E36 (28) VLA:_OUT (13) - EVLA tests VLA:_OUT (14) - EVLA tests VLA:_OUT (16) - EVLA tests VLA:_OUT (18) ***To choose the reference antenna the following algorithm should be followed: 1. should be present throughout the run 2. should be on an "inner" pad, but NOT N1/E1/W1 (to avoid shadowing) 3. NOT on the master pad (since those are always weird) 4. NOT an EVLA antenna (since those are often weird) 5. try to avoid the north arm in the smaller configurations (to avoid shadowing) 6. NOT listed in any interesting way in the log file (to avoid problems with the reference antenna) 7. preferably consistent with other recent runs 8. should be a fairly stable antenna (can't tell until TVFLG/CALIB of course...) ===> Refant: 15 $ E4 ^7. Calibrators ***Check out the calibrators in the on-line calibrator manual: http://www.vla.nrao.edu/astro/calib/manual/index.shtml ***Max baseline at 21 cm in B array is 54.3 klambda C array is 16.2 klambda D array is 4.9 klambda primary (flux/bandpass) calibrators: 0542+498= 3C147 ***You can ignore the uv-ranges for these, since there are now models for the most important ones. secondary (gain) calibrator: 0943-083 0943-083 J2000 B 09h43m36.944364s -08d19'30.812400" Aug01 0941-080 B1950 B 09h41m08.642400s -08d05'43.986000" ----------------------------------------------------- BAND A B C D FLUX(Jy) UVMIN(kL) UVMAX(kL) ==================================================== 20cm L P P P P 2.70 ===> secondary cal --- No restrictions ^7b. SETJY -> SU/1 executed on 19Jul11 ***Set aparm(2) to corespond to date of observation. If date <1990 aparm(2)=3 If 19921998 aparm(2)=0 ***We need to enter a flux density for each primary (flux) calibrator. If we have only one FREQID, this is easy: ^ default SETJY sources '0542+498','' $ primary (flux) calibrator(s) optype 'CALC'; freqid=1 $ First FREQID aparm 0,0 $ data taken after 1998 getn 4 $ *.LINCOP; galaxy> SETJY2: BIF = 1 EIF = 1 /Range of IFs galaxy> SETJY2: '0542+498 ' IF = 1 FLUX =21.9614 (Jy calcd) ^7c. CALRD executed on 19Jul11 ***Read in models of flux density calibrators: default CALRD object '3c147';band 'L'; >> ----> 3C147_L.MODEL.1 ***Note: These models are in J2000 coordinates. If your data are in B1950, change the model images to B1950 with EPOSWTCH. We will later use UVFIX to fix the uv-data. >> data are in J2000 ^8. PRTUV (used to find integration times on calibrators & sources) default PRTUV cparm 0; cparm(9)=103 $ Pick a baseline -- here, baseline 1-3 docrt 132 getn 4 $ *.LINCOP --> calib: 10s source: 10s x9. UVFLG -> FG/1 executed on DDmonYY >> Three antennas being used for EVLA tests (13, 14, 16); already out of >> array ***We toss the EVLA-EVLA baselines, to avoid dealing with aliasing. There should still be plenty of VLA-EVLA baselines to allow antenna-based solutions for the EVLA...but keep an eye out for oddities (e.g., in BPASS)! default UVFLG outfgver 1;opcode 'flag';reason 'EVLA' getn *.CH0 $ Note that we use FILLM's CH0 for initial flags -- we'll $ TACOP later. antenna=EVLA;baseline=EVLA; ***NOTE!!! do NOT run UVFLG if EVLA=0 (try PRINT EVLA to check) -- otherwise you'll delete ALL of your data. ^10.0 UVPLT first because I like to 25Jul11 >> Flux cal default UVPLT calco 'a' dotv -1 $ PLVER 1 do3col 1 getn 1 $ *.CH0 bparm 0 $ amp. vs. uv-distance >> print to file default lwpla outfile 'B1:d75_b1a_fluxcal_uvplt_10.0.ps >> some low stuff RR; some high stuff LL; nothing very bad though >> Phase cal default UVPLT calco 'c' dotv -1 $ PLVER 2 do3col 1 getn 1 $ *.CH0 bparm 0 $ amp. vs. uv-distance >> print to file default lwpla outfile 'B1:d75_b1a_phasecal_uvplt_10.0.ps >> some lowish stuff (RR, LL) at longer baselines...? 10. TVFLG -> FG/1 executed on 25Jul11 ***Again, we *only* use the original CH 0 from FILLM for initial flagging. Here we flag calibrators only, to remove any gross, obvious problems. - Check the first scan carefully -- often the system isn't "organized" on this first scan - On-line flagging isn't as reliable as in the old days, so there are plenty of hot pixels and hiccups. - We are NOT quacking, because (1) FILLM's NX table isn't correct; (2) QUACK flags data from the beginning-of-scan, whereas we want to flag data from antennas-on-source. default TVFLG calcode 'a' $ calibrators only docat -1 $ avoid saving temporary files dohist -1 $ avoid creation of history entries Freqid 1 $ must step through all FREQIDs! docalib -1 flagver 1;outfgver 1 $ keep all flags in FG/1 dparm 0 dparm(3) 1 $ show baselines twice, to treat all antennas identically -- $ this displays baseline 27-1 as well as 1-27 dparm(6)=10 $ time resolution: should be set to the calibrators' integration $ time, in seconds getn 1 $ *.CH0 $ note this is the ONLY time we use FILLM's Channel 0! ***Within TVFLG: - Set useful defaults: ^ SMOOTH=1 to avoid averaging date before displays ^ SCAN= 20 to use a long time for median filters (AMP/PH DIFF) ^ FLAG ALL CHANNELS x FLAG STOKES FULL (usually -- sometimes you'll want NORR or NOLL) ***If individual Stokes need to be flagged, make sure you set the STOKES FLAG to correspond to the polarization that is displayed on the TV ^ SWITCH SOURCE FLAG to ONE-SOURCE to avoid inadvertantly flagging your galaxy (though sometimes you'll want to of course) - Be sure to inspect BOTH polarizations! ***We suggest the following steps: - Set the above defaults - Flag first integration in every scan (manual QUACK) -- this should be the first integration AFTER most antennas are on-source, which is why we can't use the usual QUACK. - Inspect the following: AMPLITUDE to check for missing records or antennas AMP DIFF to check for variable gains PHS DIFF to check for variable atmosphere/gains - If your data set is in D array(if your source is southern than also check for this problem in the C array) than keep an open eye for solar interference. It will be obvious if in TVFLG you choose a SORT BY BASELINE display, showing you how the short baselines behave,the ones affected by solar interference.If solar interference is affecting your data than in CALIB you should use a UVRANGE. ***Note: occasionally, flagging using UVFLG can be more straightforward (e.g., deleting an antenna). >> Flux cal: RR Amp: Now load the TV memory from 1.4169E+00 TO 3.0508E+00 Antenna 4, 18 out in addition to 13, 15, 16; antenna 28 v. cold FLAG A TIME: first integration all antennas FLAG ANT/TIME: 2nd integration, antenna 10 Now load the TV memory from 1.7114E+00 TO 3.0508E+00 RR Amp Diff: Now load the TV memory from 2.3842E-07 TO 5.3951E-01 Baseline 10-15 stands out: FLAG BASELINE Now load the TV memory from 2.3842E-07 TO 2.7894E-01 Some stuff on short baselines: 7-15, 8-15: FLAG BASELINES Now load the TV memory from 2.3842E-07 TO 1.7164E-01 FLAG AREAS: ant 6 2nd integration, ant 19 2nd integration Now load the TV memory from 2.3842E-07 TO 1.4455E-01 10-17 standing out now; FLAG Now load the TV memory from 2.3842E-07 TO 7.6905E-02 Good enough. RR Phase Diff: Now load the TV memory from 1.5026E-04 TO 9.8088E+00 Some bad times for some antennas; but at low level (max 9.8 deg). Ok. LL Amp: Now load the TV memory from 1.5830E+00 TO 3.6591E+00 Antennas 4, 18 out in addition to 13, 15, 16. Antenna 24 hot. FLAG A TIME: first integration all antennas FLAG ANT/TIME: 2nd integration, antenna 10 Now load the TV memory from 2.0502E+00 TO 3.6591E+00 LL Amp Diff: Now load the TV memory from 1.9073E-06 TO 5.7328E-01 FLAG BASELINES: 10-15, 7-15, 8-15 Now load the TV memory from 1.9073E-06 TO 1.6921E-01 FLAG 10-17; FLAG PIXEL: 6-19 2nd integration FLAG AREA: antenna 6 2nd integration Now load the TV memory from 1.9073E-06 TO 1.3274E-01 A few pixels here and there; good enough. LL Phase diff: Now load the TV memory from 1.3660E-05 TO 7.6796E+00 Some bad times for some antennas; but at low level (max 7.6 deg). Ok. >> Phase cal: calcode 'c' RR Amp: Now load the TV memory from 2.2619E-02 TO 3.8424E-01 Antennas 4, 18 out in addition to 13, 15, 16. Antenna 28 cold. FLAG TIMES: first two integrations of first scan Now load the TV memory from 2.2619E-02 TO 3.8424E-01 RR Amp Diff: Now load the TV memory from 2.6822E-07 TO 2.8171E-01 FLAG TIMES: first integration, scans 2, 5 Now load the TV memory from 2.6822E-07 TO 4.9869E-02 RR Phase Diff: Now load the TV memory from 2.7321E-04 TO 1.3167E+01 FLAG PIXEL 3-? Now load the TV memory from 2.7321E-04 TO 1.2206E+01 Fine. Nothing systemic. LL Amp: Now load the TV memory from 5.8006E-03 TO 4.8950E-01 Antennas 4, 18 out in addition to 13, 15, 16. Antenna 28 cold. FLAG TIMES: first two integrations of first scan LL Amp Diff: Now load the TV memory from 2.3842E-07 TO 2.9909E-01 FLAG TIMES: first integration, scans 2, 5 Now load the TV memory from 2.3842E-07 TO 6.0800E-02 LL Phase Diff: Now load the TV memory from 4.6445E-04 TO 1.1504E+01 Fine. 10.0.1 redo UVPLT for phase cal default UVPLT calco 'c' dotv -1 $ PLVER 3 do3col 1 getn 1 $ *.CH0 bparm 0 $ amp. vs. uv-distance >> print to file default lwpla outfile 'B1:d75_b1a_phasecal_uvplt_10.0.1.ps >> Still some weird lowish stuff at longer baselines. This must be from antenna 28! Leave and let calibration deal with it. ^10b. TABED FG/1 executed on 25Jul11 ***Here we TABED the CH 0 flags to LINCOP (with FREQID= -1). After this we're done with FILLM's channel 0. default TABED opty 'repl' inext 'fg' inver 1 ; outver 1; bcount 1;ecount 0 ; $until recently there was a parameter called $ncount which is no longer there aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...to FREQID= -1 getn 1 $ *.CH 0 getona 4 $ *.LINCOP --> LINCOP FG/1 ^11. BPASS ***This is a first-order BPASS leading to a new Channel 0. The goal is to avoid closure errors in Channel 0 calibration due to huge delays (phase slopes) on VLA-EVLA baselines. We divide each visibility by the vector average of the inner 3/4 of the band (i.e., an on-the-fly channel 0). Thus we remove source structure (tho' getting the weights wrong) and take care of the amplitude scale. ***There is a split here between the easy case (one FREQID for all sources) and the Galactic HI case (multiple FREQIDs, usually different for the bandpass calibrator and the galaxy (and phase calibrator)). Check LISTR/SCAN to see which you're doing. ^11a. BPASS: one FREQID for all sources -> BP/1 executed on 25Jul11 default BPASS calsour '0542+498','' $ Select bandpass calibrators docal 1 ; gainuse 2 $ apply VLANT changes. Probably irrelevant. flagver 1 $ apply initial flags refant 15 $ Change this to your refant Qual -1 solint 0 $ one solution per scan minamper 7 ; minphser 7 $ report closures > 7%/7d smooth 0 $ no smoothing soltype '' ; weightit 0 $ L1, L1R, etc. seem _less_ stable -- weird bpassprm 0 bpassprm(5) 0 $ derive "channel 0" on a record-by-record basis -- $ more biased than averaging first, but avoids $ some subtle pitfalls (see EXPLAIN file) bpassprm(2) 1 $ some closure info is printed bpassprm(6) 2 $ print avg. closure errors > 2% bpassprm(7) 2 $ print avg. closure errors > 2d ichansel 0 $ derive channel 0 from inner 3/4 of the band freqid 1 $ here we have only one FREQID getn 4 $ *.LINCOP >> No closure errors printed --> BP/1 ^11c. POSSM to check BP table ^11c1. Plot BP table itself default POSSM $ to check BPASS results flagver 1 aparm 0, 1, 0.7, 1.3, -180, 180, 0, 2, 0, 0 $ Plot BP, with amp/ph ranges source '0542+498','' $ POSSM doesn't work with $ source '' for some reason! solint -1 $ Separate plots for each scan nplots 9 $ 9 plots per page bparm 0 dotv -1 $ PLVER 1-6 freqid 1; bpver 1 $ for single-FREQID data sets $ freqid 3; bpver 4 $ for multiple-FREQID data sets getn 4 $ *.LINCOP tvinit >> Write to output file: >> PL 1-6 for LINCOP are POSSM results, 9 per page default lwpla $ to print the plots to a ps file getn 4 $ *.LINCOP outfile 'B1:d75_b1a_POSSMplots11c1.ps plver 1; invers 6 >> Ok. Antenna 28 LL has a bit of slope at the beginning of the bandpass, but ok. >> Skipped next step as this is sort-of archival data: only EVLA antenna >> was not used. x 11c2. Apply BP table to 2ndary calibrator & plot individual baselines default POSSM flagver 1 aparm 0 $ Plot data solint -1 $ Separate plots for each scan nplots 9 $ 9 plots per page aparm 0 aparm(1) 1 $ vector average source='0702+445','' $ Secondary (phase) calibrator docal 1 ; gainuse 2 ; doband 1 $ average all BP entries dotv 1 freqid 1; bpver 1 $ for single-FREQID data sets freqid 3; bpver 4 $ for multiple-FREQID data sets getn 4 $ *.LINCOP tvinit ^ 11c3. Apply BP table to 2ndary calibrator & vector average all data default POSSM flagver 1 aparm 0 $ Plot data solint 0 $ average all time nplots 0 $ average all baselines aparm 0 aparm(1) 1 $ vector average source='0943-083','' $ Secondary (phase) calibrator docal 1 ; gainuse 2 ; doband 1 $ average all BP entries dotv -1 $ PLVER 7,8 freqid 1; bpver 1 $ for single-FREQID data sets $ freqid 3; bpver 4 $ for multiple-FREQID data sets getn 4 $ *.LINCOP tvinit ***This plot should be flat in both amp. and phase as a function of frequency, with no slope.. If some channels are off, note which ones those are and keep an eye out for interference or other bad data. If there are large errors consider running BPASS on the secondary calibrator and using that to correct the galaxy. Note that this will be somewhat painful since AIPS does not allow incremental BP tables -- unlike SN or CL tables. Sigh. galaxy> POSSM2: Will plot 107 spectral channels from IF# 1 polarization RR galaxy> POSSM2: FILLPL: Amplitude mean: 1.0136E-02 rms: 7.1470E-04 galaxy> POSSM2: FILLPL: Phase mean: -1.5885E+02 rms: 3.4118E+00 alaxy> POSSM2: Plot file version 7 created galaxy> POSSM2: Will plot 107 spectral channels from IF# 1 polarization LL galaxy> POSSM2: FILLPL: Amplitude mean: 9.8840E-03 rms: 8.0944E-04 galaxy> POSSM2: FILLPL: Phase mean: -9.6269E+01 rms: 4.3094E+00 galaxy> POSSM2: Plot file version 8 created >> Write to output file: >> PL 7, 8 for LINCOP are POSSM results default lwpla $ to print the plots to a ps file getn 4 $ *.LINCOP outfile 'B1:d75_b1a_POSSMplots11c3.pst plver 7; invers 8 >> RR: Amp ~flat but slight rise at end; phase ~ -160 w scatter+/-5-10 deg. >> LL: Amp flat; phase ~ =95 with scatter +/-10 deg. ^12. AVSPC -> NEWCH0.1 (2,3) executed on 25Jul11 ***AVSPC must be run once for each FREQID (unfortunately FREQID=-1 purports to work, but creates an empty data set). This entails some nasty bookkeeping for data sets with multiple FREQIDs. Here I assume we have one or three FREQIDs. If BPASS checks above show that one FREQID is useless, you should ignore that one entirely in this and all subsequent processing. ***We will use these NEWCH0 files for (1) further flagging, and (2) time-dependent gain calibration. ^ 12a. FREQID=1 --> NEWCH0.1 default AVSPC docalib -1;gainuse 0; flagver -1 $ do NOT apply flags doband 1 freqid 1; bpver 1 $ for single-FREQID data sets $ freqid 1; bpver 4 $ for multiple-FREQID data sets getn 4 $ *.LINCOP outname inna ; outcl 'NEWCH0' --> NEWCH0.1 x 12b. FREQID=2 (if multiple-FREQID data set) --> NEWCH0.2 ***Skip FREQID=2 if the corresponding BP table looked irrelevant (see 11b5) default AVSPC docalib -1;gainuse 0; flagver -1 $ do NOT apply flags doband 1 freqid 2; bpver 4 $ for multiple-FREQID data sets getn 4 $ *.LINCOP outname inna ; outcl 'NEWCH0' ; outse= freqid --> NEWCH0.2 x 12c. FREQID=3 (if multiple-FREQID data set) --> NEWCH0.3 ***Skip FREQID=3 if the corresponding BP table looked irrelevant (see 11b5) default AVSPC docalib -1;gainuse 0; flagver -1 $ do NOT apply flags doband 1 freqid 3; bpver 4 $ for multiple-FREQID data sets getn 4 $ *.LINCOP outname inna ; outcl 'NEWCH0' ; outse= freqid --> NEWCH0.3 ^ 12d. LISTR/SCAN ***It is a VERY good idea to run LISTR/SCAN on each of the NEWCH0 data sets at this point, to be sure each has the data you expect. tget listr outprint 'B1:D75B1a_12d.listr galaxy LISTR(31DEC08) 753 25-JUL-2011 17:45:10 Page 1 File = D75_B1A .LINCOP. 1 Vol = 1 Userid = 753 Freq = 1.418787650 GHz Ncor = 2 No. vis = 200658 Scan summary listing Scan Source Qual Calcode Sub Timerange FrqID START VIS END VIS 1 0542+498 : 0002 A 1 0/01:39:45 - 0/01:46:25 1 1 9975 2 0943-083 : 0002 C 1 0/01:49:45 - 0/01:52:55 1 9976 14662 3 SEXTANSA : 0002 1 0/01:53:35 - 0/02:21:55 1 14663 54005 4 0943-083 : 0002 C 1 0/02:22:25 - 0/02:25:15 1 54006 58307 5 SEXTANSA : 0002 1 0/02:25:55 - 0/02:54:15 1 58308 101262 6 0943-083 : 0002 C 1 0/02:54:55 - 0/02:57:45 1 101263 105772 7 SEXTANSA : 0002 1 0/02:58:25 - 0/03:26:35 1 105773 148606 8 0943-083 : 0002 C 1 0/03:27:15 - 0/03:30:05 1 148607 153072 9 SEXTANSA : 0002 1 0/03:30:45 - 0/03:59:05 1 153073 195642 10 0943-083 : 0002 C 1 0/03:59:45 - 0/04:02:55 1 195643 200658 Source summary Velocity type = 'BARYCENT' Definition = 'OPTICAL ' ID Source Qual Calcode RA(2000.0) Dec(2000.0) IFlux QFlux UFlux VFlux No. vis 1 0542+498 : 0002 A 05:42:36.1379 49:51:07.234 21.961 0.000 0.000 0.000 9975 2 0943-083 : 0002 C 09:43:36.9480 -08:19:30.857 0.000 0.000 0.000 0.000 22981 3 SEXTANSA : 0002 10:10:50.1070 -04:39:49.960 0.000 0.000 0.000 0.000 167702 ID Source Freq(GHz) Velocity(Km/s) Rest freq (GHz) 1 0542+498 1.4188 188.0828 1.4204 2 0943-083 1.4187 325.0000 1.4204 3 SEXTANSA 1.4187 325.0000 1.4204 Frequency Table summary FQID IF# Freq(GHz) BW(kHz) Ch.Sep(kHz) Sideband 1 1 1.41878765 1306.1525 12.2070 1 ^13. TABED LINCOP FG/1 -> NEWCH0 FG/1 ***We use TABED to set FREQID to -1 (apply to all FREQIDs) in the FG table, since AVSPC will change all FREQIDs to 1 in the NEWCH0 data sets. ^ 13a. NEWCH0.1 default TABED opty 'repl' inext 'fg' inver 1 ; outver 1 aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...to FREQID= -1 getn 4 $ *.LINCOP getona 6 $ *.NEWCH0.1 --> NEWCH0.1, FG/1 >> 01Aug11: redoing from here on; first run on 26Jul11, I ran CALIB wrong on the flux calibrator. Also, when I ran UVFLG on antenna 26 because of a phase jump, I flagged the two calibrator scans as well as the source scan; should only have flagged the source scan. Will unflag that data now; and reflag properly (source scan only) later if phase jump is still a problem after re-calibrating. default UVFLG antenna 26,0 $ the antenna which "jumped" timer 0 02 22 20 0 02 58 00; $ the source scan between the offending ph.cal scans opcode 'reas' reason 'phase jump' outfgver 1 getn 6 $ *.NEWCH0.1 --> NEWCH0.1 FG/1 14. CALIB -> NEWCH0.1(,2,3) SN/1 executed on 26Jul11 reexecuted 01Aug11; using flux cal model this time! ***Note: if 'SN' table must be destroyed: >> 01Aug 11: redoing calibration, so... task 'extdest'; inext 'sn'; invers 0 getn 6 $ *.NEWCH0 inext 'cl'; invers 0 ***If solar interference is affecting your data than in CALIB you should use a UVRANGE. The worst case scenario, baselines up to a distance of 1 kilolambda could be afected, while in the best case scenario baselines are affected only up to 0.5kilolambda distance. We recommend using: UVRANGE 0.7,0 for D array UVRANGE 0.7,0 for C array After calibration, if UVPLT still shows signs of solar interference,it means that not enough short baselines were discarded; therefore the calibration has to be redone and UVRANGE to be reset. Note that the Sun might rise or set, especially during a long B-array run, in which case you might wish to split the calibration by timerange in a set affected and a set without solar interference. ^ 14a. Primary (flux density) calibrators --> SN/1 default CALIB calsour '0542+498','' $ flux density calibrator get2n 5 $ 3C147_L.MODEL.1 nmap 1 ; ncomp 1e6,0 ; inver 1 ; cmethod 'DFT' freqid -1 docal 1 ; gainuse 2 flagver 1 refant 15 $ Change this to your refant solint 0 aparm 4,0,0,0,0,2; $ min 4 antennas; print closures soltype 'L1'; solmode 'A&P'; weightit 1 $ true L1 minimization solcon 0 minamper 10; minphser 10 $ complain if >10%/10d off cparm 0,0,10,10,1 $ complain if avg > 10%/10d off snver 1 getn 6 $ *.NEWCH0 $ ***NOTE: must run this for all NEWCH0.1,2,3 in which $ this calibrator appears! --> SN/1 galaxy> CALIB2: CALIB USING D75_B1A . NEWCH0 . 1 DISK= 1 USID= 753 galaxy> CALIB2: L1 Solution type galaxy> CALIB2: UVGET: Using flag table version 1 to edit data galaxy> CALIB2: Selecting, editing and calibrating the data galaxy> CALIB2: Doing self-cal mode with CC model galaxy> CALIB2: FACSET: source model will be scaled to 21.961 Jy galaxy> CALIB2: FACSET: 20.884239 Jy found from 345 components galaxy> CALIB2: FACSET: scaling factor set to 1.05158E+00 galaxy> CALIB2: QINIT: did a GET of 5120 Kwords, OFF -345209657 galaxy> CALIB2: VISDFT: Begin DFT component division galaxy> CALIB2: VISDFT: fields 1 - 1 chns 1 - 1 in 1 CC models galaxy> CALIB2: VISDFT: Model components of type Point galaxy> CALIB2: I Polarization model processed galaxy> CALIB2: Model computation is 40 percent complete galaxy> CALIB2: Model computation is 90 percent complete galaxy> CALIB2: Field 1 used 345 CCs galaxy> CALIB2: Determining solutions using amp-scalar averaging galaxy> CALIB2: Writing SN table 1 galaxy> CALIB2: RPOL, IF= 1 The average gain over these antennas is 3.041E+00 galaxy> CALIB2: LPOL, IF= 1 The average gain over these antennas is 2.953E+00 galaxy> CALIB2: Found 46 good solutions galaxy> CALIB2: Average closure rms = 0.0007 +- 0.0000 galaxy> CALIB2: No data were found > 99.0 rms from solution >> 23 antennas * 2 polarizations * 1 scan = 46 ^ 14b. Secondary (phase) calibrator --> SN/1 ***Check uv restrictions for secondary calibrators carefully. For 0943-083: no restrictions, so uvra= 0,0 . default CALIB calsour '0943-083','' $ phase calibrator uvrange 0,0 wtuv 0.0 $ may have to set wtuv 0.01 if solutions are $ crazy and uvrange is not 0,0 freqid -1 docal 1 ; gainuse 2 flagver 1 refant 15 $ Change this to your refant solint 0 aparm 4,0,0,0,0,2; $ min 4 antennas; print closures soltype 'L1'; solmode 'A&P'; weightit 1 $ true L1 minimization solcon 0 minamper 10; minphser 10 $ complain if >10%/10d off cparm 0,0,10,10,1 $ complain if avg > 10%/10d off snver 1 getn 6 $ *.NEWCH0 $ ***NOTE: must run this for all NEWCH0.1,2,3 in which $ this calibrator appears! >> No closure errors!!!! :) galaxy> CALIB2: Task CALIB (release of 31DEC08) begins galaxy> CALIB2: CALIB USING D75_B1A . NEWCH0 . 1 DISK= 1 USID= 753 galaxy> CALIB2: L1 Solution type galaxy> CALIB2: UVGET: Using flag table version 1 to edit data galaxy> CALIB2: Selecting, editing and calibrating the data galaxy> CALIB2: Doing cal transfer mode with point model for each source galaxy> CALIB2: This is not self-calibration galaxy> CALIB2: Dividing data by source flux densities galaxy> CALIB2: Determining solutions using amp-scalar averaging galaxy> CALIB2: Writing SN table 1 galaxy> CALIB2: RPOL, IF= 1 The average gain over these antennas is 2.998E+00 galaxy> CALIB2: LPOL, IF= 1 The average gain over these antennas is 2.897E+00 galaxy> CALIB2: Found 230 good solutions galaxy> CALIB2: Average closure rms = 0.0039 +- 0.0002 galaxy> CALIB2: No data were found > 99.0 rms from solution >> 23 antennas * 2 polarizations * 5 scans = 230 ^15b. GETJY SN/1-3, SU/1 executed on 26Jul11 reexecuted 01Aug11 ***Find flux density of secondary calibrator, and set SN table amplitude gains to reflect a common flux density scale. default GETJY sources '0943-083','' $ Secondary (phase) calibrators) calsour '','0542+498','' $ Primary (flux) calibrators freqid -1 snver 0 $ Use all SN tables getn 6 $ *.NEWCH0.1 galaxy> GETJY2: Source:Qual CALCODE IF Flux (Jy) galaxy> GETJY2: 0943-083 : 2 C 1 2.82341 +/- 0.00989 ^16. SN table checks ^16a. SNPLT last SN table executed on 26Jul11 reexecuted 01Aug11 ^16a1. SNPLT phase: default SNPLT inext 'sn';inver 0 pixrange 0 opcode 'alsi';do3col 1;dotv -1; $PLVER 1, 2, 3 nplots 9 factor 2; symbol 5 xinc 1; optype 'phas'; getn 6 $ *.NEWCH0.1 >> Write to file: default LWPLA getn 6 $ NEWCHO outfile 'B1A:d75_b1a_phs_snplt16a.ps plver 1; invers 3 ===> Note any phase jumps (on the phase calibrator) for future flagging. The EVLA antennas, even after applying VLANT, still show quite a bit of phase drift. This is OK so long as a linear interpolation between the phases looks like it will work. >> Phase jump antenna 26 between scans 2 and 3 ~50deg or more. ^ 16a2. SNPLT amplitude: default SNPLT inext 'sn';inver 0 pixrange 0 opcode 'alsi';do3col 1;dotv -1; $ PLVER 4, 5, 6 nplots 9 factor 2; symbol 5 xinc 1; optype 'amp'; getn 6 $ *.NEWCH0.1 >> Write to file: default LWPLA getn 6 $ NEWCHO outfile 'B1A:d75_b1a_amp_snplt16a.ps plver 4; invers 6 ===> Note whether the amp. is roughly constant for a given antenna/pol'n/IF. >> All fine. ^16b. LISTR/GAIN print SN table executed on 26Jul11 reexecuted 01Aug11 default LISTR optype 'gain'; Inext 'sn'; inver 1; freqid -1 dparm 5,0; $ Amp & phase factor 0; docrt -1 outprint 'B1A:d75_b1a_postcallistr16b_2' antennas 0; $ may have to list missing antennas explicitly, to avoid $ column overrun. To list missing antennas, use the form $ANTENNAS -3,2,0 to have antennas 3 and 2 left out. getn 6 $ *.NEWCH0.1 --> check for phase jumps and other inconsistencies. >> Output to d75_b1a_postcallistr16b_1. Following Kim's example, I have >> used a spreadsheet to calculate the average flux for each antenna >> over all phase cal scans, then calculated the percentage difference >> of each scan from that average, and I've noted the max % difference >> from that average for each antenna. Phase differences are from scan >> to scan, in degrees. I have ignored the flux calibrator. File = D75_B1A .NEWCH0. 1 Vol = 1 Userid = 753 IF = 1 Freq= 1.418787650 GHz Ncor= 2 No. vis= 200658 Polarization = R Subarray = 0 Listing SN table, version 1 SN table has not been applied to a CL table Gain amplitudes, 1000 = 10.000000 Stokes = R IF = 1 Freq = 1.418787650 GHz Time Source -- 1-- 2-- 3-- 4-- 5-- 6-- 7-- 8-- 9--10--11--12--13--14--15--16--17--18--19--20--21--22--23--24--25--26--27--28 Day # 0 01:43:10 0542+498 283 280 307 330 309 286 300 315 306 312 292 300 305 311 298 302 281 299 290 302 292 306 388 01:51:30 0943-083 285 287 311 333 313 287 299 312 304 309 292 295 304 307 301 303 287 301 293 305 290 304 398 02:23:55 0943-083 286 287 306 333 312 289 297 314 303 308 291 298 307 309 300 303 288 300 291 303 289 303 396 02:56:20 0943-083 285 288 308 328 308 288 296 311 307 311 288 301 305 310 295 303 289 302 288 306 292 303 391 03:28:40 0943-083 285 290 309 327 311 284 299 314 305 313 291 296 305 310 294 303 287 303 289 303 290 303 394 04:01:25 0943-083 284 288 305 327 308 285 302 317 306 316 293 299 303 309 299 306 285 299 293 304 290 307 397 Polarization = L Subarray = 0 Listing SN table, version 1 SN table has not been applied to a CL table Gain amplitudes, 1000 = 10.000000 Stokes = L IF = 1 Freq = 1.418787650 GHz Time Source -- 1-- 2-- 3-- 4-- 5-- 6-- 7-- 8-- 9--10--11--12--13--14--15--16--17--18--19--20--21--22--23--24--25--26--27--28 Day # 0 01:43:10 0542+498 283 280 306 304 310 267 304 314 299 304 298 290 304 290 308 271 278 307 237 297 287 321 333 01:51:30 0943-083 284 287 309 312 313 268 302 311 297 302 296 286 301 288 301 269 282 306 239 297 282 314 338 02:23:55 0943-083 286 289 304 310 314 268 301 312 297 299 296 289 304 288 301 269 285 307 238 296 282 305 339 02:56:20 0943-083 285 287 308 307 312 267 300 308 298 301 293 289 303 288 301 269 284 309 235 297 285 306 334 03:28:40 0943-083 285 289 306 307 311 266 303 310 295 303 293 288 305 290 299 271 283 309 235 293 283 307 337 04:01:25 0943-083 282 289 305 307 309 267 304 312 298 307 294 289 303 290 303 272 280 304 237 297 280 319 340 Polarization = R Subarray = 0 Listing SN table, version 1 SN table has not been applied to a CL table Gain phases in degrees Stokes = R IF = 1 Freq = 1.418787650 GHz Time Source -- 1-- 2-- 3-- 4-- 5-- 6-- 7-- 8-- 9--10--11--12--13--14--15--16--17--18--19--20--21--22--23--24--25--26--27--28 Day # 0 01:43:10 0542+498 -69 -75 87 -136 30 -10 110 158 80-166 145 0 -55 -71-131 -85 113 134 -62 136 123 -71 -21 01:51:30 0943-083 -67 -84 79 -133 34 -12 109 156 81-162 137 0 -56 -75-142 -84 118 134 -57 138 121 -71 -36 02:23:55 0943-083 -64 -88 79 -132 34 -10 110 157 81-167 133 0 -56 -75-143 -82 119 134 -54 140 126 -70 -39 02:56:20 0943-083 -63 -90 75 -130 36 -10 110 159 81-161 131 0 -59 -79-140 -76 127 138 -52 142-148 -69 -40 03:28:40 0943-083 -64 -96 76 -132 35 -10 109 159 82-161 128 0 -57 -78-133 -73 134 141 -55 141-149 -70 -47 04:01:25 0943-083 -71 -91 74 -135 37 -9 109 163 81-158 131 0 -58 -77-129 -72 137 143 -61 139-150 -70 -42 Polarization = L Subarray = 0 Listing SN table, version 1 SN table has not been applied to a CL table Gain phases in degrees Stokes = L IF = 1 Freq = 1.418787650 GHz Time Source -- 1-- 2-- 3-- 4-- 5-- 6-- 7-- 8-- 9--10--11--12--13--14--15--16--17--18--19--20--21--22--23--24--25--26--27--28 Day # 0 01:43:10 0542+498-174 5 139 175 -82-177 64 91 88 -97 -69 0 10 -87 -72 98 174-106 160-126-163 -68 -16 01:51:30 0943-083-173 -5 130 177 -78-178 63 88 88 -94 -78 0 9 -91 -71 99 179-106 163-124-163 -70 -32 02:23:55 0943-083-170 -10 129 179 -79-178 62 89 86 -99 -84 0 8 -93 -75 101 178-107 166-124-161 -69 -38 02:56:20 0943-083-168 -12 124 -178 -78-179 62 91 86 -94 -87 0 5 -98 -73 107-175-106 168-122 -86 -65 -39 03:28:40 0943-083-170 -19 124 179 -80 179 61 92 86 -95 -90 0 4 -97 -71 109-169-103 164-124 -88 -68 -45 04:01:25 0943-083-178 -14 123 174 -78 180 60 92 86 -91 -85 0 3 -97 -67 109-165-101 159-125 -88 -69 -38 >> Amplitude variations below 1% mostly (highest was 3% change); most >> phase changes a few degrees except for: >> Antenna 26 has phase jump between scans 2 and 3: 86 deg RR, 75 deg LL. Need to flag the galaxy data between those two scans. ^17. UVFLG -> NEWCH0.1 FG/1 executed on 26Jul11 reexecuted 01Aug11; just flagging source data between cal scans; not flagging cal scans as well this time around. ***If the SN table shows a phase jump on the phase calibrator, you should flag the data between the two phase cal scans which show the jump (since those cannot be calibrated). ***Note that we flag NEWCH0.1, *regardless* of whether the galaxy appears in this data set. This is because later on (step 20/TVFLG) we flag the NEWCH0 data in order from inseq 1 through inseq freqid_max, copying the FG table from one file to the next. UVFLG itself doesn't care whether the flags you enter actually do anything -- it just adds entries to the FG table, which are then applied (or ignored if irrelevant) by other tasks. ***This step may of course be skipped if there are no obvious phase jumps. ^ default UVFLG antenna 26,0 $ the antenna which "jumped" timer 0 02 25 30 0 02 54 30; $ the source scan between the offending ph.cal scans opcode 'FLAG' reason 'phase jump' outfgver 1 getn 6 $ *.NEWCH0.1 --> NEWCH0.1 FG/1 ^18. CLCAL NEWCH0 --> CL/3 executed on 26Jul11 reexecuted 01Aug11 ***For multi-FREQID data this becomes rather complicated, since we need a new CL table for every NEWCH0 file, to allow detailed checks and second-order flagging. ***Note that there is no need to work around any phase jumps, since the intervening data are flagged (see step 17 above [UVFLG]). ^ 18a. CLCAL for the primary calibrators -> CL/3 default CLCAL sour= '','0542+498','' $ Primary (flux) calibrators calsour= sour interpol 'SELF' gainver 2 ; gainuse 3 refant 15 $ Change this to your refant dobtween -1 $ Don't interpolate entries for different sources snver 1 $ if single FREQID $ snver 4 $ if multiple FREQIDs getn 6 $ *.NEWCH0.1 $ do this for all NEWCH0 with primary (flux) $ calibrator data ^ 18b. CLCAL for the phase calibrator and galaxy -> CL/3 default CLCAL sour= '0943-083','sextansa','' $ Secondary (phase) calibrator + galaxy calsour= '0943-083','' $ Secondary (phase) calibrator interpol 'SIMP' gainver 2 ; gainuse 3 refant 15 $ Change this to your refant dobtween -1 $ Don't interpolate entries for different sources cutoff 120 $ Don't extrapolate/interpolate beyond 120 minutes snver 1 $ if single FREQID $ snver 4 $ if multiple FREQIDs ***If your data set used +/- frequency switching for the phase calibrator (our observations did not, but some archival data may), you should use BPARM with SAMPTYPE='BOX' to select a smoothing time which covers both frequency settings. LISTR/SCAN on LINCOP will help you choose this; normally something like 12 minutes should be OK. $ bparm 12/60 ; samptype='BOX' getn 6 $ *.NEWCH0.1 $ do this for all NEWCH0 with secondary (phase) $ calibrator or galaxy data ***At this point we have a new CL table for all NEWCH0 files. ^19a. ANBPL executed on 26Jul11 reexecuted 01Aug11 ***We use ANBPL to check the data weights. Data with very high weights (factor 5-10 or more above normal) should be flagged with UVFLG. default ANBPL docalib 1;gainuse 3 flagver 1 bparm 2,17,0 $ Plot antenna-based weight vs. time nplots 9; dotv -1 $ PLVER 7, 8, 9 docrt 132 $ Print as well as plotting weights -- useful for $ finding exact times of bad weights $ Note you can also use outprint to send to a file. opcode 'alsi' $ Plot all IFs together do3col 1 $ ...using different colors getn 6 $ *.NEWCH0.1 $ Must do this separately for every NEWCH0 file >> write to file: default lwpla $ to print the plots to a ps file getn 6 $ *.NEWCH0 outfile 'B1A:d75_ba1_anbpl_19a_2.ps plver 7; invers 9 >> Mostly ok. Antenna 24 LL weights have sinusoidal variations of about 10? 1/Jy*82, as do both RR/LL for antenna 25. Antenna 19 has two points that jump by ~factor of 2 or so (100->200). Not bad enough to flag anything. x 19b. UVFLG to eliminate very high weights ***Should UVFLG on NEWCH0.1, even if Evil Weights are seen in NEWCH0.2 or NEWCH0.3 -- we'll be copying FG/1 from NEWCH0.1 to NEWCH0.2 for subsequent second-order flagging. 20.0. UVPLT executed on 26Jul11 reexecuted on 01Aug11 -- done before TVFLG because I like to ***Check the amp & phase vs. uv-distance for all calibrators. Amplitude should match the results of SETJY/GETJY. If there are obvious outliers which are not expected due to source structure, go back and flag those (and possibly re-run CALIB etc.). default UVPLT docal 1 ; gainuse 3 flagver 1 $ set this to the latest FG version -- may be >1 if $ there are multiple NEWCH0s (FREQIDs). dotv -1 $ PLVER 10 do3col 1 getn 6 $ *.NEWCH0.1 $ do this for each NEWCH0 file >> Flux cal calco 'a' >> flux cal phase bparm(2) 2 $ PLVER 11 >> write to file default lwpla getn 6 $ *.NEWCH0 outfile 'B1A:d75_b1a_fluxcal_uvplt_20.0_2.ps plver 10; invers 11 >> Flux ~23 Jy with drop off to 22 at long bl; this is correct for this calibrator. >> Phases: ~ 0 with most scatter +/-5 deg; increasing to +/-10 with baseline length. >> Phase cal: tget uvplt calcode 'c' bparm 0 $ amp; PLVER 12 >> phase bparm(2) 2 $ phase; PLVER 13 >> write to file default lwpla getn 6 $ *.NEWCH0 outfile 'B1A:d75_b1a_phasecal_uvplt_20.0_2.ps plver 12; invers 13 >> Flux: ~ 2.8 Jy; >> Phase: ~ 0, +/- 5deg mostly; some scatter to +/-10 deg. Looks good. ^20. TVFLG FG/1 executed on 26Jul11 reexecuted on 01Aug11 ^ 20a. TVFLG on calibrators: NEWCH0.1 The calibrators should now have constant amplitude and zero phase...apart from source structure for the primary (flux) calibrators, and any uvrange for the secondary (phase) calibrators. If we see huge problems on the calibrators we may have to re-run CALIB etc. -- let's hope not!! default TVFLG calcode '*' $ calibrators only docat -1 $ avoid saving temporary files dohist -1 $ avoid creation of history entries docalib 1 ; gainuse 3 $ apply the new CL table flagver 1;outfgver 1 $ keep all flags in FG/1 dparm 0 dparm(3) 1 $ show baselines twice, to treat all antennas identically -- $ this displays baseline 27-1 as well as 1-27 dparm(6)=10 $ time resolution: should be set to the calibrators' $ integration time, in seconds getn 6 $ *.NEWCH0.1 ***Within TVFLG: - Set useful defaults: ^ SMOOTH=1 to avoid averaging date before displays ^ SCAN= 20 to use a long time for median filters (AMP/PH DIFF) ^ FLAG ALL CHANNELS x FLAG STOKES FULL (usually -- sometimes you'll want NORR or NOLL) ***If individual Stokes need to be flagged, make sure you set the STOKES FLAG to correspond to the polarization that is displayed on the TV ^ SWITCH SOURCE FLAG to ONE-SOURCE to avoid inadvertantly flagging your galaxy (though sometimes you'll want to of course) - Be sure to inspect BOTH polarizations! ***We suggest the following steps: - Set the above defaults - Check AMPLITUDE, AMP DIFF, PHS DIFF. Be wary of known source structure and uv-range limits!! >> Flux cal: calcode 'a' RR Amp: Now load the TV memory from 2.1194E+01 TO 2.3792E+01 Looks fine. RR Amp Diff: Now load the TV memory from 1.7166E-05 TO 7.1964E-01 A few high pixels; nothing systemic. RR Phase: Now load the TV memory from -1.2976E+01 TO 1.4038E+01 Increase with baseline length. Within 15 deg though. RR Phs Diff: Now load the TV memory from 8.5377E-07 TO 9.9179E+00 Max change 10 deg; ok LL Amp: Now load the TV memory from 2.1175E+01 TO 2.4060E+01 Fine. LL Amp diff: Now load the TV memory from 1.1444E-05 TO 1.2127E+00 High points from first integration antenna 17; probably should have removed it, but didn't. Not that much data affected; not worth redoing everything. LL Phase: Now load the TV memory from -1.2424E+01 TO 1.3599E+01 Same as RR. LL Phase Diff: Now load the TV memory from 1.6526E-04 TO 7.5032E+00 Antennas 1, 24, 47 show up; but max is low level. fine. >> Phase cal calcode 'c' RR Amp: Now load the TV memory from 2.2984E+00 TO 3.3252E+00 Looks good. RR Amp Diff: Now load the TV memory from 3.5763E-06 TO 4.6597E-01 Looks good. RR Phase: Now load the TV memory from -1.5096E+01 TO 1.2807E+01 worst stuff antenna 3; scan 4; but not too bad. RR Phase Diff: Now load the TV memory from 9.5036E-05 TO 1.2502E+01 Looks fine. Low level. LL Amp: Now load the TV memory from 2.2972E+00 TO 3.4042E+00 Looks fine. LL Amp diff: Now load the TV memory from 1.1921E-06 TO 5.9113E-01 Fine. LL Phase: Now load the TV memory from -1.5720E+01 TO 1.2325E+01 Fine. LL Phase Diff: Now load the TV memory from 3.5778E-04 TO 1.2915E+01 Looks fine. Max 13 deg. >> Skip 21; did UVPLT before TVFLG x21. Calibration/flagging checks: calibrators x 21a. UVPLT executed on DDmonYY ***Check the amp & phase vs. uv-distance for all calibrators. Amplitude should match the results of SETJY/GETJY. If there are obvious outliers which are not expected due to source structure, go back and flag those (and possibly re-run CALIB etc.). default UVPLT calco '*' docal 1 ; gainuse 3 flagver 1 $ set this to the latest FG version -- may be >1 if $ there are multiple NEWCH0s (FREQIDs). dotv 1 do3col 1 getn 6 $ *.NEWCH0.1 $ do this for each NEWCH0 file bparm 0 $ amp. vs. uv-distance bparm 0,2 $ phase vs. uv-distance ^ 21b. IMAGR executed on 26Jul11 reexecuted 01Aug11 ----> JUNKCAL.ICL001.2 default IMAGR sources '0943-083','' $ calibrator to image docalib 1; gainuse 3 $ apply latest calibration flagver 1 $ apply latest flags -- set this to the $ highest-numbered FG table outname 'junkcal' $ some obviously cruddy name cellsize 1 $ for B configuration $ cellsize 3.5 $ for C configuration $ cellsize 10 $ for D configuration imsize 1024 $for B array $ imsize 512 $for C and D array niter 1000 nbox 1 ; clbox -1,5,512,513 $ calibrator should be in the center minpa 121 uvwtfn 'NA' dotv 1 getn 6 $ *.NEWCH0.xx $ whichever file has the calibrator you're imaging --> shouldn't see obvious calibration errors or striping. CLEANed flux density should roughly match SETJY/GETJY. >> Field 1 final Clean flux 2.821 Jy >> cf. 2.7 Jy from catalog; 2.82 Jy GETJY. :) >> Looks fine. 22.0 UVPLT executed on 26Jul11 -- done before TVFLG because I like to reexecuted 01Aug11 default UVPLT docal 1 ; gainuse 3 flagver 1 $ set this to the latest FG version -- may be >1 if $ there are multiple NEWCH0s (FREQIDs). dotv -1 $ PLVER 14 do3col 1 source 'sextansa','' getn 6 $ *.NEWCH0.1 $ whichever file holds the galaxy bparm 0 $ amp. vs. uv-distance >> write to file default lwpla getn 6 $ *.NEWCH0 outfile 'B1A:d75_b1a_galaxy_uvplt_22.0_2.ps plver 14; invers 0 >> 26Jul11: One bad baseline LL ~ 5 kl -- up to 450 Jy; LL for one antenna looks bad - between 50-100 Jy. >> 01Aug11: bad baseline deleted during 26Jul11 reduction, so UVPLT now looks fine. ^ 22. TVFLG on the galaxy: NEWCH0.xx ***This is our first run of flagging on the galaxy. - Check the first scan carefully -- often the system isn't "organized" on this first scan - On-line flagging isn't as reliable as in the old days, so there are plenty of hot pixels and hiccups. - We are NOT quacking, because (1) FILLM's NX table isn't correct; (2) QUACK flags data from the beginning-of-scan, whereas we want to flag data from antennas-on-source. ^ 22a. If there's only one NEWCH0 (FREQID): default TVFLG calcode '-CAL' $ non-calibrators only docat -1 $ avoid saving temporary files dohist -1 $ avoid creation of history entries docalib 1 ; gainuse 3 $ apply the new CL table flagver 1;outfgver 1 $ keep all flags in FG/1 dparm 0 dparm(3) 1 $ show baselines twice, to treat all antennas identically -- $ this displays baseline 27-1 as well as 1-27 dparm(6)=10 $ time resolution: should be set to the sources' $ integration time, in seconds getn 6 $ *.NEWCH0.1 ***Within TVFLG: - Set useful defaults: ^ SMOOTH=1 to avoid averaging date before displays ^ SCAN= 20 to use a long time for median filters (AMP/PH DIFF) ^ FLAG ALL CHANNELS x FLAG STOKES FULL (usually -- sometimes you'll want NORR or NOLL) ***If individual Stokes need to be flagged, make sure you set the STOKES FLAG to correspond to the polarization that is displayed on the TV ^ SWITCH SOURCE FLAG to ONE-SOURCE to avoid inadvertantly flagging your galaxy (though sometimes you'll want to of course) - Be sure to inspect BOTH polarizations! ***We suggest the following steps: - Set the above defaults - Flag first integration in every scan (manual QUACK) -- this should be the first integration AFTER most antennas are on-source, which is why we can't use the usual QUACK. - Check AMPLITUDE, AMP DIFF, PHS DIFF. Be wary of known source structure and uv-range limits!! ***Note: occasionally, flagging using UVFLG can be more straightforward (e.g., deleting an antenna). >> From 26Jul11: >> Sextans A: RR Amp: Now load the TV memory from 2.6526E-03 TO 8.1205E-01 Looks fine. Hmm. RR Amp Diff: Now load the TV memory from 0.0000E+00 TO 4.7308E-01 Also fine. RR Phs Diff: Now load the TV memory from 0.0000E+00 TO 1.7958E+02 Ok. Only a few high, scattered points LL Amp: Now load the TV memory from 1.9698E-03 TO 4.2837E+02 400 Jy stuff from three times on bl 7-17 : FLAG AREAs Now load the TV memory from 1.9698E-03 TO 1.4333E+02 Two bad times, most antennas; one or two other pixels FLAG SET #s: 0 - 25 Jy Now load the TV memory from 1.9698E-03 TO 1.9673E+01 FLAG PIXELS (two) Now load the TV memory from 1.9698E-03 TO 3.1040E+00 >> exit and redo UVPLT to see what's up. >> tget uvplt >> tget lwpla >> outfile 'B1A:d75_b1a_galaxy_uvplt_23.0.ps >> two points on one bl >> back to TVFLG >> tget TVFLG LL Amp: Now load the TV memory from 1.9698E-03 TO 3.1040E+00 FLAG PIXELS: 7-17; two times Now load the TV memory from 1.9698E-03 TO 7.9545E-01 Fine now. LL Amp Diff: Now load the TV memory from 2.5630E-06 TO 4.3546E-01 Fine. LL Phase Diff: Now load the TV memory from 5.5325E-04 TO 1.7994E+02 Looks fine. >> TVFLG on 01Aug11: RR Amp: Now load the TV memory from 2.7460E-03 TO 8.4041E-01 Looks fine. RR Amp Diff: SCAN 20 Now load the TV memory from 0.0000E+00 TO 4.8875E-01 Looks good RR Phs Diff: Now load the TV memory from 0.0000E+00 TO 1.7958E+02 only a few scattered high points; fine. LL Amp: Now load the TV memory from 2.0387E-03 TO 8.2256E-01 Looks fine. LL Amp Diff: Now load the TV memory from 1.5795E-06 TO 4.4978E-0 Looks fine. LL Phs Diff: Now load the TV memory from 2.2540E-04 TO 1.7994E+02 only a few scattered high points; fine. >> UVPLT already done; skip x23. Calibration/flagging checks: sources x23a. UVPLT executed on DDmonYY ***Check the amp vs. uv-distance for the galaxy. If there are obvious outliers which are not expected due to source structure or RFI (i.e., not mostly on short spacings), go back and flag those. Note any obvious short-spacing horrors, which may be due to solar or terrestrial RFI. default UVPLT docal 1 ; gainuse 3 flagver 1 $ set this to the latest FG version -- may be >1 if $ there are multiple NEWCH0s (FREQIDs). dotv 1 do3col 1 source 'DDO43','' getn 6 $ *.NEWCH0.1 $ whichever file holds the galaxy bparm 0 $ amp. vs. uv-distance ^ 23b. IMAGR executed on 26Jul1 reexecuted 01Aug11 ----> JUNKGAL.ICL001.2 default IMAGR sources 'SextansA','' $ the galaxy docalib 1; gainuse 3 $ apply latest calibration flagver 1 $ apply latest flags -- set this to the $ highest-numbered FG table outname 'junkgal' $ some obviously cruddy name cellsize 1 $ for B configuration $ cellsize 3.5 $ for C configuration $ cellsize 10 $ for D configuration imsize 1024 $ for B configuration $ imsize 512 $ for C and D configurations niter 1000 nbox 0 minpa 121 uvwtfn 'na' dotv 1 getn 6 $ *.NEWCH0.xx $ whichever file has the source you're imaging --> shouldn't see obvious calibration errors or striping. Note that this "channel 0" includes HI emission, so you may see some odd effects (e.g., very woofly noise in B configuration) -- don't panic! >> Ok. Galaxy emission not visible. ^24. TASAV -> CH0SAV.1,2,3 executed on 26Jul11 reexecuted on 01Aug11 ----> D75B1aAMidTa.CH0SAV.2 default TASAV outna 'D75B1aAMidTa outcla 'ch0sav' outdi 1 $ Ideally set this to a different disk from indisk, $ in case of disk crashes getn 6 $ *.NEWCH0 $ loop over NEWCH0 files (= FREQIDs) outse inseq >> 01Aug11: because I am redoing the data; I am deleting the FG;2 and SN;1 and CL;3 tables from the LINCOP from the original wrong reduction task 'extdest' inext 'fg' invers 2 inext 'sn' invers 1 inext 'cl' invers 3 ^25. TABED SN, FG tables to LINCOP executed on 27Jul11 reexecuted 01Aug11 ***Use TABED to ensure FREQID=-1 for all tables (paranoia is your friend...) ^ 25a. NEWCH0.xx FG/yy -> LINCOP FG/2 default TABED opty 'repl' inext 'fg' aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...which we change to FREQID= -1 inver 1 $ if single FREQID $ inver 3 $ if multiple FREQIDs: set this to max. flag table number outver 2 getn 6 $ *.NEWCH0.1 $ if single FREQID $ getn 6 $ *.NEWCH0.3 $ if multiple FREQIDs: set this to file you flagged $ on most recently (usually the file with the $ galaxy in it) getona 4 $ *.LINCOP --> LINCOP FG/2 ^ 25b. NEWCH0.xx SN/yy -> LINCOP SN/1 default TABED opty 'repl' inext 'sn' inver 1 $ if single FREQID $ inver 4 $ if multiple FREQIDs outver 0 aparm 0 aparm(1) 6 $ Changing column 3 = FREQID keyval= -1,0 $ ...which we change to FREQID= -1 getn 6 $ *.NEWCH0 $ if multiple FREQIDs: all should have same merged SN $ table so you can use whichever NEWCH0 file you want getona 4 $ *.LINCOP --> LINCOP SN/1 ^26. CLCAL LINCOP SN/1 --> CL/3 executed on 27Jul11 reexecuted on 01Aug11 ***We do CLCAL directly on LINCOP rather than copying, to avoid (even more) confusion in the multiple-FREQID case. ***Note that there is no need to work around any phase jumps, since the intervening data are flagged (see step 17 above [UVFLG]). ^ 26a. CLCAL for the primary calibrators -> CL/3 default CLCAL sour= '','0542+498','' $ Primary (flux) calibrators calsour= sour interpol 'SELF' gainver 2 ; gainuse 3 refant 15 $ Change this to your refant dobtween -1 $ Don't interpolate entries for different sources snver 1 freqid= 1 $ You must run CLCAL once for each FREQID with $ the relevant calibators present getn 4 $ *.LINCOP ^ 26b. CLCAL for the phase calibrator and galaxy -> CL/3 default CLCAL sour= '0943-083','SextansA','' $ Secondary (phase) calibrator + galaxy calsour= '0943-083','' $ Secondary (phase) calibrator interpol 'SIMP' gainver 2 ; gainuse 3 refant 15 $ Change this to your refant dobtween -1 $ Don't interpolate entries for different sources cutoff 120 $ Don't extrapolate/interpolate beyond 120 minutes snver 1 ***If your data set used +/- frequency switching for the phase calibrator (our observations did not, but some archival data may), you should use BPARM with SAMPTYPE='BOX' to select a smoothing time which covers both frequency settings. LISTR/SCAN on LINCOP will help you choose this; normally something like 12 minutes should be OK. $ bparm 12/60 ; samptype='BOX' freqid= 1 $ You must run CLCAL once for each FREQID with $ the phase calibrator or galaxy present getn 4 $ *.LINCOP ^27. Calibration/flagging checks: calibrators ^ 27a. WIPER executed on 27Jul11 reexecuted on 01Aug11 ***Check the amp & phase vs. uv-distance for all calibrators. Amplitude should match the results of SETJY/GETJY, and phase should be zero, apart from known structure (reflected in source model for gain calibrators and uvrange for phase calibrators). If there are obvious, unexpected outliers, go back and flag those (and possibly re-run various tasks...). default WIPER calcode 'a' imsize 512 512 docal 1 ; gainuse 3 doband 1; bpver 1 $ for single-FREQID data sets $ doband 3; bpver 4 $ for multiple-FREQID data sets freqid 1 $ set this to match the calibrator flagver 2 $ should be the latest FG table smooth 7, 117 $ boxcar average over all channels -- use $ smooth 7, 235 if you started with 255 channels dotv 1 do3col 1 bparm 0 getn 4 $ *.LINCOP bparm(2) 1 $ amp. vs. uv-distance bparm(2) 2 $ phase vs. uv-distance >> Flux cal: Amp: looks great; screen grab: ----> d75_b1a_fluxcal_wiper_amp_27a_2.jpg Phase: Also fine; scatter +/-20deg. Screen grab: ----> d75_b1a_fluxcal_wiper_phase_27a_2.jpg >> Phase cal: Amp: looks fine; Screen grab: ----> d75_b1a_phasecal_wiper_amp_27a_2.jpg Phase: looks ok; most scatter +/-50 deg; some point to +/-180 but not many. Screen grab: ----> d75_b1a_phasecal_wiper_phase_27a_2.jpg ^ 27b. POSSM executed on 27Jul11 reexecuted on 01Aug11 ***Check vector average of all data for each calibrator. Amplitude should match the results of SETJY/GETJY; phase should be flat, and consistent with zero (corresponding to a point source at the origin)...apart from known source structure and possibly HI absorption. default POSSM calcode '*' docal 1 ; gainuse 3 doband 1; bpver 1 $ for single-FREQID data sets $ doband 3; bpver 4 $ for multiple-FREQID data sets freqid 1 $ set this to match the calibrator flagver 2 $ should be the latest FG table aparm 0 $ Plot data solint 0 $ average all time nplots 0 $ average all baselines aparm 0 aparm(1) 1 $ vector average source='0943-083','' $ Secondary (phase) calibrator uvrange= 0,0 $ should be set to eliminate known source structure, $ as in CALIB dotv -1 $ PLVER 11, 12 getn 4 $ *.LINCOP tvinit galaxy> POSSM2: Will plot 107 spectral channels from IF# 1 polarization RR galaxy> POSSM2: FILLPL: Amplitude mean: 2.8199E+00 rms: 1.1085E-02 galaxy> POSSM2: FILLPL: Phase mean: -1.4871E-02 rms: 1.5690E-01 galaxy> POSSM2: Plot file version 11 created galaxy> POSSM2: GFINIS: number records used 17 galaxy> POSSM2: Will plot 107 spectral channels from IF# 1 polarization LL galaxy> POSSM2: FILLPL: Amplitude mean: 2.8211E+00 rms: 7.5747E-03 galaxy> POSSM2: FILLPL: Phase mean: -6.2666E-03 rms: 1.7428E-01 >> write to file default lwpla getn 4 $ *.LINCOP outfile 'B1A:d75_b1a_phasecal_possm_27b_2.ps plver 11; invers 12 >> Ok. RR Amp drops a bit toward high channel numbers, but only by a few milliJy; RR phase scatter is only +/- 0.3 deg. LL amp is flat; same phase scatter as RR. Good. ^ 27c. IMAGR executed on 27Jul11 ----> JUNKCALCUBE.ICL001.1 reexecuted on 01Aug11 ----> JUNKCALCUBE.ICL001.2 default IMAGR calcode 'c' docal 1 ; gainuse 3 doband 1; bpver 1 $ for single-FREQID data sets $ doband 3; bpver 4 $ for multiple-FREQID data sets freqid 1 $ set this to match the calibrator flagver 2 $ should be the latest FG table outname 'junkcalcube' $ some obviously cruddy name cellsize 1 $ for B configuration $ cellsize 3.5 $ for C configuration $ cellsize 10 $ for D configuration imsize 1024 $ for B array $ imsize 512 $ for C and D array niter 200 $ reasonable for a point source nbox 1 ; clbox -1,5,512,513 $ calibrator should be in the center minpa 121 uvwtfn 'na'; dotv -1 $ so you can go eat lunch getn 4 $ *.LINCOP ***You shouldn't see obvious calibration errors or striping. CLEANed flux density should roughly match SETJY/GETJY. If you _do_ have Evil Stuff, UVLSF will likely take care of it, so don't get too worked up. >> Field 1 final Clean flux 2.812 Jy >> Flux matches fine. Images look fine. ^28. Calibration/flagging checks: sources ^28a.1 WIPER executed on 27Jul11 reexecuted 01Aug11 ***Check the amp vs. uv-distance for the galaxy. If there are obvious outliers which are not expected due to source structure or RFI (i.e., not mostly on short spacings), go back and flag those. Note any obvious short-spacing horrors, which may be due to solar or terrestrial RFI. default WIPER imsize 512 512 docal 1 ; gainuse 3 doband 1; bpver 1 $ for single-FREQID data sets $ doband 3; bpver 4 $ for multiple-FREQID data sets freqid 1 $ set this to match the galaxy flagver 2 $ should be the latest FG table smooth 0 $do not smooth: smoothing will decrease your noise and $consequently show you a lower flux level than the level $that your data has in fact dotv 1 do3col 1 sources 'SextansA','' bparm 0 getn 4 $ *.LINCOP bparm(2) 1 $ amp. vs. uv-distance >> Ooh; interference spike (one baseline) up to 35 Jy at about 26 kL. Rest is fine. Baseline 2-6. >> screen grab: ----> d75_b1a_galaxy_wiper_amp_28a_2.jpg ###Use bparm(3)=1;bparm(6)=0;bparm(7)=20 if you want to force a range to the Y axis of the WIPER plot. ###It shows a plot similar to the UVPLT output just quicker.It is also ###useful for identifying which antennas or baselines have calibration ###problems.If you do find things you want to flag, UVFLG is highly ###recommended. #####CAREFUL with smoothing when doing WIPER on the source, it should ###NOT be done at this step.Smoothing will decrease your noise and ###consequently show you a lower flux level than the level that your ###data has in fact. #######It is very probable that when doing a WIPER on all the line data, ###some channels with junk will ruin your WIPER display and you will not ###be able to really make out what the clipping level should be. If the ###junk consists of random hot pixels then just run another WIPER in ###which you force the y axis to a 0-20 range ###(bparm(3)=1;bparm(6)=0;bparm(7)=20). If the junk comes in a ###structured manner than further investigations are needed to identify ###which baselines, in which channels might be missbehaving. Use WIPER ###only to identify the problematic baselines and channels, and use ###TVFLG or UVFLG to remove them form the data. >> SPFLG to find bad data for baseline 2-6 done 26Jul11; redone 01Aug11 default SPFLG source 'sextansa' '' antenna 2 0; baseline 6 0 docal 1; gainuse 3 doband 1; bpver 1 outfgver 2 dparm(6) 10 getn 4 $ .LINCOP >> bad time, all channels: 0/03:47:56 FLAG A TIME >> Fine now. Amp max 4.1 Jy. >> Redo WIPER tget WIPER >> Fine now: Screen grab: ----> d75_b1a_galaxy_wiper_amp_postedit_28a_2.jpg ^ 28a.2 Up to which level most of the values(leaving aside the very hot pixels) comfortably fit in? >> Clip level of 5 Jy is fine. Not really necessary, nothing over 6 Jy. ###This is the value that you will be using in CLIP when combining your data!!! 28b. IMAGR executed on 27Jul11 ----> JUNKGALCUBE.ICL001.1 reexecuted on 01Aug11 ----> JUNKGALCUBE.ICL001.2 default IMAGR source 'sextansa' '' docal 1 ; gainuse 3 doband 1; bpver 1 $ for single-FREQID data sets $ doband 3; bpver 4 $ for multiple-FREQID data sets freqid 1 $ set this to match the calibrator flagver 2 $ should be the latest FG table outname 'junkgalcube' $ some obviously cruddy name cellsize 1 $ for B configuration $ cellsize 3.5 $ for C configuration $ cellsize 10 $ for D configuration imsize 1024 $ for B configuration $ imsize 512 $ for C configuration $ imsize 256 $ for D configuration niter 1000 $ a light clean, just to see what we've got. niter 0 $ would be ok too, esp. if you IMLIN afterwards nbox 0 ; clbox 0 minpa 121 uvwtfn 'NA' dotv -1 $ so you can go eat lunch getn 4 $ *.LINCOP ***You shouldn't see obvious calibration errors or striping. You should however see of order 100 mJy of continuum sources in the field, as well as some indication of your galaxy. The latter may be quite confusing for B configuration, which resolves out most of the structure. Don't fret until you've combined all the array configurations. >> Looks ok; faint galaxy emission in central channels. ### If you find a strong continuum source rippling your map even after trying a 512x512 imsize D array configuration cube than refer to Elias and Dana for further steps. 28c. Noise Estimations: calculated on 27Jul11 ##The easiest way to calculate the expected sensitivity is to say 7 S(mJy) = ---------------------------- sqrt{ N (N-1) delta_nu t} where 7 is a constant that depends on the system temperature of the receivers(a quite conservative value) N = number of antennas in the array, delta_nu = channel resolution in MHz, and t = integration time in hours. You need to use for N the number of Antennas which have on average been giving good data during the run. The total time should be the actual time spent on source. No need to be super precise, of course. One simply wants to get a ballpark figure which is good to 10-20%. ###Note that for data which are Hanning smoothed (archive data) the channel spacing is equal to the resolution delta_nu. Without Hanning smoothing, the resolution is ~1.4 x delta_nu (note that after offline Hanning smoothing, if you preserve all channels, the resolution becomes 2 x delta_nu; it reverts to a new "double the old delta_nu" if you delete every other channel). ####Finally, if you want to know the noise in a single visibility, use N=2 and t = 1/360, and probably multiply by sqrt{2} because a visibility is a single polarisation as well. N = 23 delta_nu = 0.012207 MHz t = 1.91 hrs The Expected noise level is: 2.04 mJy/B The rms Noise level in a line free channel is: 1.86 mJy/B ^29. TASAV -> EndTaB.LINSAV.1 executed on 27Jul11 reexecuted on 01Aug11 ----> d75B1aEndTa.LINSAV.2 default TASAV outna 'd75B1aEndTa outcla 'linsav' outdi 1 $ Ideally set this to a different disk from indisk, $ in case of disk crashes getn 4 $ *.LINCOP ^30. FITTP executed on 27Jul11 reexecuted on 01Aug11 create: ^ DDO75_B1a_UV_CALIB_NEWCH0.FITS $ ^ DDO75_B1a_UV_CALIB_LINCOP.FITS ^ DDO75_B1a-BeginTasav.FITS ^ DDO75_B1a-MidTasav.FITS $ one per FREQID ^ DDO75_B1a-EndTasav.FITS default FITTP getn 6 >> AIPS 2: Got(1) disk= 1 user= 753 type=UV D75_B1A.NEWCH0.1 dataout 'B1A:DDO75_B1a_UV_CALIB_NEWCH0.FITS getn 4 >> AIPS 2: Got(1) disk= 1 user= 753 type=UV D75_B1A.LINCOP.1 dataout 'B1A:DDO75_B1a_UV_CALIB_LINCOP.FITS getn 3 >> AIPS 2: Got(1) disk= 1 user= 753 type=UV D75B1aBeTa.LINSAV.1 dataout 'B1A:DDO75_B1a-BeginTasav.FITS getn 17 >> AIPS 2: Got(1) disk= 1 user= 753 type=UV D75B1aAMidTa.CH0SAV.2 dataout 'B1A:DDO75_B1a-MidTasav.FITS getn 25 >> AIPS 2: Got(1) disk= 1 user= 753 type=UV d75B1aEndTa.LINSAV.2 dataout 'B1A:DDO75_B1a-EndTasav.FITS >> NOTE: Got this message when fittping MidTa: galaxy> FITTP2: Task FITTP (release of 31DEC08) begins galaxy> FITTP2: Writing to disk file: B1A:DDO75_B1a-MidTasav.FITS galaxy> FITTP2: Writing UV data: User 753 Disk 1 Name D75B1aAMidTa.CH0SAV.2 galaxy> FITTP2: Writing HI file galaxy> FITTP2: Now writing the uv data galaxy> FITTP2: FOLLOWING ONLY READ BY 15JAN94 OR LATER AIPS galaxy> FITTP2: Writing binary table of type NX galaxy> FITTP2: FOLLOWING ONLY READ BY 15JAN94 OR LATER AIPS galaxy> FITTP2: Writing binary table of type OF galaxy> FITTP2: Writing binary table of type AN galaxy> FITTP2: Writing binary table of type FQ galaxy> FITTP2: Writing binary table of type CL galaxy> FITTP2: Writing binary table of type CL galaxy> FITTP2: Writing binary table of type CL galaxy> FITTP2: Writing binary table of type SU galaxy> FITTP2: Writing binary table of type TY galaxy> FITTP2: Writing binary table of type WX galaxy> FITTP2: EXTWRT: WRITING 432 UNFLAGGED ROWS OUT OF galaxy> FITTP2: 433 TOTAL FOR TABLE FG VERSION 1 galaxy> FITTP2: Writing binary table of type FG galaxy> FITTP2: Writing binary table of type SN galaxy> FITTP2: Writing end-of-file marks galaxy> FITTP2: Appears to have ended successfully >> The TASAV itself didn't generate any unusual messages when creating the MidTa file though... 31. Send to DEIDRE 28Jul11; resent 02Aug11 See Little THINGS Web site for current instructions. Apart from the FITS data from step 29/FITTP, the following should be archived: * Observing log * This data reduction log * LISTR/SCAN output (if saved to a file) 31. Celebrate your victory with an appropriate beverage! ================================================================================ ================================================================================ Ater the data has been checked by an independent member of the team and changes/corrections have been suggested the log should continue here with the steps that have been reiterated and the values used in the reiteration. If you need to recreate tables it is best at this stage to not delete the already existing ones but rather to give the tables higher version numbers.