Comments: I've denoted my embedded comments with >> LITTLE THINGS AIPS Reduction of DDO75, D config.: VLA Obs. of 13Jul92 ===================================================================== calibration recipe v. 2.0: mrupen 10oct08 calibration recipe v. 2.1: mrupen 13oct08 calibration recipe v. 2.1.update: Dana Ficut Vicas 29 Oct 08 (new adverbs in Aips) calibration recipe v. 2.2: Dana Ficut Vicas 11Dec 08(tiny bits) calibration recipe v. 2.3: Dana Ficut Vicas 11 Feb 09(UVCOP ambiguities) calibration recipe v. 2.4: Dana Ficut Vicas 3 Mar 09(team raised issues) calibration recipe v. 2.5: Dana Ficut Vicas 23 September 2009 (no smoothing with WIPER on the source data) Latest update: 3rd March 2009 Data reduced by Caroline Simpson, FIU, 28Apr10/10June11 Usernumber 75 Suggestion: STARTING with D ARRAY and then working through C array and B array is recommended. D array data will allow you to have a look at the whole field ( the strong continuum sources that might give problems will be obvious here), is more stable and will give you the best feel for the data. The recipe lists the B-array reduction, but obviously the same steps apply to all configurations. ^0. Basic stuff D configuration >>Observing log not available ^1. FILLM executed on 28Apr10 a. Request archive data: >> had a problem here... this was the email message when I submitted the request. The TEST_1 data file WAS in the directory at the FTP site, and I ftped it to galaxy.fiu.edu. I have emailed jbenson@aoc.nrao.edu to ask if the file is ok. Meanwhile, I'll assume it is and proceed. Public File available : ftp://ftp.aoc.nrao.edu/e2earchive/TEST_1 2010-04-28T10:00:16.744:ngamsPClient.py:sendCmdGen:1005:28547:MainThread:NOTICE> Exception raised handling command RETRIEVE/[['file_id', 'VLA_XH92040_file6.dat'], ['processing', 'ngamsExtractVLADppi'], ['processingPars', 'outfile=/home/e2earchive/TEST_1,project=TEST'], ['time_out', '-1']] to aocngas-master.aoc.nrao.edu:7777 after 172.042s. Timeout: None. Error: Error communicating to specified server(s). (HTTP Get Request) Errors: - Error/aocngas-master.aoc.nrao.edu/7777: [Errno 2] No such file or directory: '/home/aocngas-2/export_staging/VLA_XH92040_file6.dat'. Timeout/time: Nones/172.042s Error executing command: Error communicating to specified server(s). (HTTP Get Request) Errors: - Error/aocngas-master.aoc.nrao.edu/7777: [Errno 2] No such file or directory: '/home/aocngas-2/export_staging/VLA_XH92040_file6.dat'. Timeout/time: Nones/172.042s ^ b. FILLM -> D75_D.CH 0.1 default FILLM datain 'FITS:TEST_' band 'l';vlaobs ''; doall -1 ; qual 1 $ restricts FILLM to the galaxy+calibrators of interest nfiles 0; ncount 1 $ read one filetget fillm, outna 'd75_d' outdisk 1; outseq 0 douvcomp= -1 $ allow channel/IF-dependent weights doweight 10 $ use memo 108 weights (i.e., put weights in 1/Jy^2) bparm= -1,-1 $ avoid opacity & gain corrections cparm 0 cparm(4)=25.1 $ one needs to explicitly flag shadowed antennas $ since the ModComps were retired on 27 June 2007 $ this requires FILLM in 31DEC08 after 18Nov08 MNJ cparm(7)= 0 $ assigns new FREQID if frequency changes by more than $ the max. Doppler shift between sources 180 degrees $ apart. Setting this to -1 forces all data to have same $ FREQID. doconcat=-1 $ Change this to DOCONCAT=1 to add data to an existing file ***N.B. FILLM's channel 0 will ONLY be used for initial flagging. We're quite paranoid here. >> FILLM seems to have worked. Running LISTR on line data to make sure; yes, the whole timerange seems to be there. ---> d75_d_listr1.ps File = D75_D .CH 0 . 1 Vol = 1 Userid = 75 Freq = 1.418786346 GHz Ncor = 2 No. vis = 42225 Scan summary listing Scan Source Qual Calcode Sub Timerange FrqID START VIS END VIS 1 0941-080 : 0001 C 1 0/19:46:45 - 0/19:46:45 1 1 0 2 0941-080 : 0001 C 1 0/19:47:15 - 0/19:52:45 1 1 3115 3 SEXTANSA : 0001 1 0/19:53:30 - 0/20:37:30 1 3116 16965 4 0941-080 : 0001 C 1 0/20:39:15 - 0/20:42:45 1 16966 19436 5 SEXTANSA : 0001 1 0/20:43:30 - 0/21:26:30 1 19437 34048 6 0941-080 : 0001 C 1 0/21:28:15 - 0/21:32:15 1 34049 36959 7 1328+307 : 0001 C 1 0/21:35:15 - 0/21:43:15 1 36960 42225 Source summary Velocity type = 'BARYCENT' Definition = 'OPTICAL ' ID Source Qual Calcode RA(1950.0) Dec(1950.0) IFlux QFlux UFlux VFlux No. vis 1 0941-080 : 0001 C 09:41:08.6460 -08:05:44.030 0.000 0.000 0.000 0.000 8497 2 SEXTANSA : 0001 10:08:30.0000 -04:25:60.000 0.000 0.000 0.000 0.000 28462 3 1328+307 : 0001 C 13:28:49.6570 30:45:58.640 0.000 0.000 0.000 0.000 5266 ID Source Freq(GHz) Velocity(Km/s) Rest freq (GHz) 1 0941-080 1.4188 325.0000 1.4204 2 SEXTANSA 1.4188 325.0000 1.4204 3 1328+307 1.4188 325.0000 1.4204 Frequency Table summary FQID IF# Freq(GHz) BW(kHz) Ch.Sep(kHz) Sideband 1 1 1.41878635 1562.5001 1159.6681 1 ^2. TASAV -> D75-1BeTa.LINSAV.1 executed on 28Apr10 ***We TASAV right away, because VLANT changes the AN table. Did I mention we're paranoid? default TASAV outna 'D75_D-BeTa outcla 'LINSAV' outdi 1 $ Ideally set this to a different disk from indisk, $ in case of disk crashes getn 2 $*.LINE ^3. UVCOP -> LINCOP.1 executed on 30Apr10 ***Discard the first and last channels: ^ 1st and last 10 channels if 127 channels total 1st and last 20 channels if 255 channels total ***We discard these Evil Channels because (1) they're pretty much useless; (2) they seem to confuse BPASS (which takes the solution from channel N as the initial guess for channel N+1); (3) their noise characteristics are quite different from the rest of the channels, which can be confusing e.g. in clipping and imaging. default UVCOP outcla 'LINCOP' bchan 11; echan 127-10 $ Use bchan 21 ; echan 255-20 if 255 channels total uvcopprm 0 uvcopprm(4) 1 $ report progress getn 2 $*.LINE ***From now on we operate on LINCOP data unless otherwise specified. ^4. LISTR/SCAN --> listr executed on 30Apr10 ***We do this before VLANT because we need to know FREQIDs for VLANT default LISTR optype 'SCAN' docrt -1 outpr ' getn 4 $*.LINCOP --> d75_d_listr2.ps File = D75_D .LINCOP. 1 Vol = 1 Userid = 75 Freq = 1.418786346 GHz Ncor = 2 No. vis = 42225 Scan summary listing Scan Source Qual Calcode Sub Timerange FrqID START VIS END VIS 1 0941-080 : 0001 C 1 0/19:48:15 - 0/19:52:45 1 1 3115 2 SEXTANSA : 0001 1 0/19:53:30 - 0/20:37:30 1 3116 16965 3 0941-080 : 0001 C 1 0/20:39:15 - 0/20:42:45 1 16966 19436 4 SEXTANSA : 0001 1 0/20:43:30 - 0/21:26:30 1 19437 34048 5 0941-080 : 0001 C 1 0/21:28:15 - 0/21:32:15 1 34049 36959 6 1328+307 : 0001 C 1 0/21:35:45 - 0/21:43:15 1 36960 42225 Source summary Velocity type = 'BARYCENT' Definition = 'OPTICAL ' ID Source Qual Calcode RA(1950.0) Dec(1950.0) No. vis 1 0941-080 : 0001 C 09:41:08.6460 -08:05:44.030 8497 2 SEXTANSA : 0001 10:08:30.0000 -04:25:60.000 28462 3 1328+307 : 0001 C 13:28:49.6570 30:45:58.640 5266 ID Source Freq(GHz) Velocity(Km/s) Rest freq (GHz) 1 0941-080 1.4188 325.0000 1.4204 2 SEXTANSA 1.4188 325.0000 1.4204 3 1328+307 1.4188 325.0000 1.4204 Frequency Table summary FQID IF# Freq(GHz) BW(kHz) Ch.Sep(kHz) Sideband 1 1 1.41878635 1306.1525 12.2070 1 5. VLANT -> AN/1, CL/2 executed on DDmonYY ***Note that VLANT can be run only for data observed from 1992 onwards. Data earlier than 1991 produce the following error message: VLANT1: Task VLANT (release of 31DEC07) begins VLANT1: ANT DATA UNAVAILABLE FOR YEAR 1991 DATA START WITH 1992 VLANT1: Purports to die of UNNATURAL causes For earlier data we skip baseline corrections entirely, and hope for the best. If there are clear and systematic phase gradients with time, consult the baseline corrections at http://www.vla.nrao.edu/astro/archive/baselines/ and apply corrections via CLCOR (which is basically what VLANT does). ***10oct08: Currently VLANT works on only one FREQID at a time. We therefore have to run VLANT multiple times for data with multiple FREQIDs. Unfortunately VLANT (1) produces a new CL table every time, and (2) updates the AN table positions every time as well. : CL tables: I'd like to maintain the convention that CL/1 is the original CL table and CL/2 has all the corrections that should have been applied on-line but weren't -- mainly, antenna position corrections. For multiple FREQIDs therefore this recipe calls for deleting the intermediate CL tables created by VLANT, using the rather clumsy mechanism of TASAVing to a temporary file, deleting the original CL tables, and copying the latest one back from the TASAV'd data set. Blah. : AN table: For now, this recipe resets to the original AN table just before running VLANT the last time. This means that only one run of VLANT updates the AN entries, leading to a correct AN table as needed for (e.g.) UVFIX. I've e-mailed DAIP to see about fixing all this, by allowing FREQID= -1 to mean "calculate corrections for all FREQIDs" (currently FREQID= -1 is reset to FREQID= 1). We'll see what Eric says. #####VLANT no longer has freqid as a parameter. ^5a. default VLANT getn 4 $ *.LINCOP galaxy> VLANT1: Task VLANT (release of 31DEC08) begins galaxy> VLANT1: Copied CL file from vol/cno/vers 1 4 1 to 1 4 2 galaxy> VLANT1: CL version input 1 output 2 galaxy> VLANT1: VLANT STNID( 1) = 'W5 ' galaxy> VLANT1: VLANT XCOR( 1) = 0.0017 galaxy> VLANT1: VLANT YCOR( 1) = 0.0009 galaxy> VLANT1: VLANT ZCOR( 1) = -0.0006 galaxy> VLANT1: VLANT STNID( 2) = 'N2 ' galaxy> VLANT1: VLANT XCOR( 2) = -0.0022 galaxy> VLANT1: VLANT YCOR( 2) = 0.0013 galaxy> VLANT1: VLANT ZCOR( 2) = 0.0000 galaxy> VLANT1: VLANT STNID( 3) = 'W4 ' galaxy> VLANT1: VLANT XCOR( 3) = -0.0011 galaxy> VLANT1: VLANT YCOR( 3) = 0.0011 galaxy> VLANT1: VLANT ZCOR( 3) = -0.0011 galaxy> VLANT1: VLANT STNID( 4) = 'E5 ' galaxy> VLANT1: VLANT XCOR( 4) = -0.0025 galaxy> VLANT1: VLANT YCOR( 4) = 0.0000 galaxy> VLANT1: VLANT ZCOR( 4) = -0.0006 galaxy> VLANT1: VLANT STNID( 5) = 'E1 ' galaxy> VLANT1: VLANT XCOR( 5) = -0.0018 galaxy> VLANT1: VLANT YCOR( 5) = 0.0002 galaxy> VLANT1: VLANT ZCOR( 5) = 0.0000 galaxy> VLANT1: VLANT STNID( 6) = 'N3 ' galaxy> VLANT1: VLANT XCOR( 6) = 0.0008 galaxy> VLANT1: VLANT YCOR( 6) = -0.0210 galaxy> VLANT1: VLANT ZCOR( 6) = 0.0027 galaxy> VLANT1: VLANT STNID( 7) = 'E3 ' galaxy> VLANT1: VLANT XCOR( 7) = -0.0047 galaxy> VLANT1: VLANT YCOR( 7) = 0.0013 galaxy> VLANT1: VLANT ZCOR( 7) = -0.0022 galaxy> VLANT1: VLANT STNID( 9) = 'W8 ' galaxy> VLANT1: VLANT XCOR( 9) = 0.0219 galaxy> VLANT1: VLANT YCOR( 9) = 0.0020 galaxy> VLANT1: VLANT ZCOR( 9) = 0.0187 galaxy> VLANT1: VLANT STNID(10) = 'W6 ' galaxy> VLANT1: VLANT XCOR(10) = -0.0327 galaxy> VLANT1: VLANT YCOR(10) = 0.0016 galaxy> VLANT1: VLANT ZCOR(10) = -0.0225 galaxy> VLANT1: VLANT STNID(11) = 'W3 ' galaxy> VLANT1: VLANT XCOR(11) = -0.0007 galaxy> VLANT1: VLANT YCOR(11) = -0.0220 galaxy> VLANT1: VLANT ZCOR(11) = 0.0000 galaxy> VLANT1: VLANT STNID(12) = 'W9 ' galaxy> VLANT1: VLANT XCOR(12) = -0.0017 galaxy> VLANT1: VLANT YCOR(12) = 0.0000 galaxy> VLANT1: VLANT ZCOR(12) = -0.0009 galaxy> VLANT1: VLANT STNID(13) = 'N9 ' galaxy> VLANT1: VLANT XCOR(13) = 0.0162 galaxy> VLANT1: VLANT YCOR(13) = 0.0179 galaxy> VLANT1: VLANT ZCOR(13) = 0.0000 galaxy> VLANT1: VLANT STNID(14) = 'W7 ' galaxy> VLANT1: VLANT XCOR(14) = 0.0000 galaxy> VLANT1: VLANT YCOR(14) = 0.0004 galaxy> VLANT1: VLANT ZCOR(14) = 0.0017 galaxy> VLANT1: VLANT STNID(15) = 'N4 ' galaxy> VLANT1: VLANT XCOR(15) = -0.0028 galaxy> VLANT1: VLANT YCOR(15) = 0.0002 galaxy> VLANT1: VLANT ZCOR(15) = 0.0000 galaxy> VLANT1: VLANT STNID(16) = 'E6 ' galaxy> VLANT1: VLANT XCOR(16) = -0.0025 galaxy> VLANT1: VLANT YCOR(16) = 0.0016 galaxy> VLANT1: VLANT ZCOR(16) = -0.0001 galaxy> VLANT1: VLANT STNID(17) = 'E9 ' galaxy> VLANT1: VLANT XCOR(17) = 0.0000 galaxy> VLANT1: VLANT YCOR(17) = 0.0003 galaxy> VLANT1: VLANT ZCOR(17) = 0.0000 galaxy> VLANT1: VLANT STNID(18) = 'E2 ' galaxy> VLANT1: VLANT XCOR(18) = -0.0020 galaxy> VLANT1: VLANT YCOR(18) = 0.0016 galaxy> VLANT1: VLANT ZCOR(18) = 0.0000 galaxy> VLANT1: VLANT STNID(19) = 'N6 ' galaxy> VLANT1: VLANT XCOR(19) = -0.0033 galaxy> VLANT1: VLANT YCOR(19) = 0.0000 galaxy> VLANT1: VLANT ZCOR(19) = 0.0000 galaxy> VLANT1: VLANT STNID(20) = 'W1 ' galaxy> VLANT1: VLANT XCOR(20) = 0.0026 galaxy> VLANT1: VLANT YCOR(20) = 0.0017 galaxy> VLANT1: VLANT ZCOR(20) = 0.0019 galaxy> VLANT1: VLANT STNID(21) = 'E4 ' galaxy> VLANT1: VLANT XCOR(21) = -0.0039 galaxy> VLANT1: VLANT YCOR(21) = 0.0007 galaxy> VLANT1: VLANT ZCOR(21) = 0.0000 galaxy> VLANT1: VLANT STNID(22) = 'W2 ' galaxy> VLANT1: VLANT XCOR(22) = -0.0024 galaxy> VLANT1: VLANT YCOR(22) = 0.0018 galaxy> VLANT1: VLANT ZCOR(22) = 0.0000 galaxy> VLANT1: VLANT STNID(23) = 'E8 ' galaxy> VLANT1: VLANT XCOR(23) = -0.0130 galaxy> VLANT1: VLANT YCOR(23) = 0.0000 galaxy> VLANT1: VLANT ZCOR(23) = -0.0030 galaxy> VLANT1: VLANT STNID(24) = 'E7 ' galaxy> VLANT1: VLANT XCOR(24) = -0.0011 galaxy> VLANT1: VLANT YCOR(24) = 0.0027 galaxy> VLANT1: VLANT ZCOR(24) = -0.0017 galaxy> VLANT1: VLANT STNID(25) = 'N7 ' galaxy> VLANT1: VLANT XCOR(25) = -0.0032 galaxy> VLANT1: VLANT YCOR(25) = 0.0000 galaxy> VLANT1: VLANT ZCOR(25) = 0.0000 galaxy> VLANT1: VLANT STNID(26) = 'N5 ' galaxy> VLANT1: VLANT XCOR(26) = -0.0021 galaxy> VLANT1: VLANT YCOR(26) = 0.0000 galaxy> VLANT1: VLANT ZCOR(26) = 0.0000 galaxy> VLANT1: VLANT STNID(27) = 'N8 ' galaxy> VLANT1: VLANT XCOR(27) = 0.1085 galaxy> VLANT1: VLANT YCOR(27) = -0.0015 galaxy> VLANT1: VLANT ZCOR(27) = 0.0680 galaxy> VLANT1: Appears to have ended successfully x 5b. If VLANT does not create a new CL table (no antennas moved), or the data were taken before 1992: default TACOP getn *.LINCOP getona *.LINCOP inext 'CL' ; inver 1 ; ncount 1 ; outver 2 ***The goal here is to keep the recipe uniform for all data. ^6. PRTAN AN/1 default PRTAN docrt 132 getn 4 $*.LINCOP Array= VLA Freq= 1418.786346 MHz Ref.date= 13-JUL-1992 Location Of VLA Antennas N9 (13) N8 (27) N7 (25) N6 (19) N5 (26) N4 (15) N3 ( 6) N2 ( 2) N1 ( 8) (20) W1 E1 ( 5) (22) W2 E2 (18) (11) W3 E3 ( 7) ( 3) W4 E4 (21) ( 1) W5 E5 ( 4) (10) W6 E6 (16) (14) W7 E7 (24) ( 9) W8 E8 (23) (12) W9 E9 (17) VLA:_OUT (28) VPT:_OUT (29) Antenna 7 missing for 1st phase cal scan Antenna 20 missing for 2 phase cal scan Antenna 13 missing for 1st half of 3rd ph cal scan ***To choose the reference antenna the following algorithm should be followed: 1. should be present throughout the run 2. should be on an "inner" pad, but NOT N1/E1/W1 (to avoid shadowing) 3. NOT on the master pad (since those are always weird) 4. NOT an EVLA antenna (since those are often weird) 5. try to avoid the north arm in the smaller configurations (to avoid shadowing) 6. NOT listed in any interesting way in the log file (to avoid problems with the reference antenna) 7. preferably consistent with other recent runs 8. should be a fairly stable antenna (can't tell until TVFLG/CALIB of course...) ===> Refant: 18 $ E2 ^7. Calibrators ***Check out the calibrators in the on-line calibrator manual: http://www.vla.nrao.edu/astro/calib/manual/index.shtml ***Max baseline at 21 cm in B array is 54.3 klambda C array is 16.2 klambda D array is 4.9 klambda primary (flux/bandpass) calibrators: 1328+307 (B1950) 1331+305 J2000 A 13h31m08.287984s 30d30'32.958850" Aug01 3C286 1328+307 B1950 A 13h28m49.657700s 30d45'58.640000" ----------------------------------------------------- BAND A B C D FLUX(Jy) UVMIN(kL) UVMAX(kL) ===================================================== 20cm L S S P P 15.00 visplot ***You can ignore the uv-ranges for these, since there are now models for the most important ones. secondary (gain) calibrator: 0941-080 (B1950) 0943-083 J2000 B 09h43m36.944364s -08d19'30.812400" Aug01 0941-080 B1950 B 09h41m08.642400s -08d05'43.986000" ----------------------------------------------------- BAND A B C D FLUX(Jy) UVMIN(kL) UVMAX(kL) ===================================================== 20cm L P P P P 2.70 ===> secondary cal --- No UVMax restriction 7b. SETJY -> SU/1 executed on 30Apr10 ***Set aparm(2) to corespond to date of observation. If date <1990 aparm(2)=3 ^If 19921998 aparm(2)=0 ***We need to enter a flux density for each primary (flux) calibrator. If we have only one FREQID, this is easy: default SETJY sources '1328+307' '' $ primary (flux) calibrator(s) optype 'CALC'; freqid=1 $ First FREQID aparm 0,2 $ data taken between 1992 and 1998 getn 4 $ *.LINCOP; --> / Flux calculated using known spectrum galaxy> SETJY1: / Flux calculated using known spectrum galaxy> SETJY1: BIF = 1 EIF = 1 /Range of IFs galaxy> SETJY1: '1328+307 ' IF = 1 FLUX =14.7749 (Jy calcd) galaxy> SETJY1: / Using (1995.2) VLA or Reynolds (1934-638) coefficients ^7c. CALRD executed on 30Apr10 ***Read in models of flux density calibrators: default CALRD object '3c286';band 'L'; ***Note: These models are in J2000 coordinates. If your data are in B1950, change the model images to B1950 with EPOSWTCH. We will later use UVFIX to fix the uv-data. >> Data are in B1950, so running EPOSW on model ^ default EPOSW getn 5 $3C286_L.MODEL.1 ^8. PRTUV (used to find integration times on calibrators & sources) default PRTUV cparm 0; cparm(9)=103 $ Pick a baseline -- here, baseline 1-3 docrt 132 getn 4 $*.LINCOP --> calib: 30s source: 60s x9. UVFLG -> FG/1 executed on DDmonYY ***We toss the EVLA-EVLA baselines, to avoid dealing with aliasing. There should still be plenty of VLA-EVLA baselines to allow antenna-based solutions for the EVLA...but keep an eye out for oddities (e.g., in BPASS)! >> No EVLA antennas; data taken in 1992 default UVFLG outfgver 1;opcode 'flag';reason 'EVLA' getn *.CH0 $ Note that we use FILLM's CH0 for initial flags -- we'll $ TACOP later. antenna=EVLA;baseline=EVLA; ***NOTE!!! do NOT run UVFLG if EVLA=0 (try PRINT EVLA to check) -- otherwise you'll delete ALL of your data. ^10.0 >> UVPLT for first look at data >> Primary: --> d75_d_fluxcal_uvplt.ps default UVPLT sourc '1328+307' '' do3col 1 getn 1 $ *.CH 0 >> Not too bad >> Secondary: --> d75_d_phasecal_uvplt.ps default UVPLT sourc '0941-080' '' do3col 1 getn 1 $ *.CH 0 >> solar interference (high stuff at short bl); also low scans for both RR, LL ^10. TVFLG -> FG/1 executed on 30Apr10; 04May10 ***Again, we *only* use the original CH 0 from FILLM for initial flagging. Here we flag calibrators only, to remove any gross, obvious problems. - Check the first scan carefully -- often the system isn't "organized" on this first scan - On-line flagging isn't as reliable as in the old days, so there are plenty of hot pixels and hiccups. - We are NOT quacking, because (1) FILLM's NX table isn't correct; (2) QUACK flags data from the beginning-of-scan, whereas we want to flag data from antennas-on-source. >> I prefer to do my primary and secondary calibrators separately default TVFLG $ calcode '*' $ calibrators only source '1328+307' '' $ primary first $ source '0941-080' '' $ secondary second docat -1 $ avoid saving temporary files dohist -1 $ avoid creation of history entries Freqid 1 $ must step through all FREQIDs! docalib -1 flagver 1;outfgver 1 $ keep all flags in FG/1 dparm 0 dparm(3) 1 $ show baselines twice, to treat all antennas identically -- $ this displays baseline 27-1 as well as 1-27 dparm(6)=30 $ time resolution: should be set to the calibrators' integration $ time, in seconds getn 1 $ *.CH0 $ note this is the ONLY time we use FILLM's Channel 0! uvrange 0.7 0 ***Within TVFLG: - Set useful defaults: SMOOTH=1 to avoid averaging date before displays SCAN= 20 to use a long time for median filters (AMP/PH DIFF) FLAG ALL CHANNELS FLAG STOKES FULL (usually -- sometimes you'll want NORR or NOLL) ***If individual Stokes need to be flagged, make sure you set the STOKES FLAG to correspond to the polarization that is displayed on the TV SWITCH SOURCE FLAG to ONE-SOURCE to avoid inadvertantly flagging your galaxy (though sometimes you'll want to of course) - Be sure to inspect BOTH polarizations! ***We suggest the following steps: - Set the above defaults - Flag first integration in every scan (manual QUACK) -- this should be the first integration AFTER most antennas are on-source, which is why we can't use the usual QUACK. - Inspect the following: AMPLITUDE to check for missing records or antennas AMP DIFF to check for variable gains PHS DIFF to check for variable atmosphere/gains - If your data set is in D array(if your source is southern than also check for this problem in the C array) than keep an open eye for solar interference. It will be obvious if in TVFLG you choose a SORT BY BASELINE display, showing you how the short baselines behave,the ones affected by solar interference.If solar interference is affecting your data than in CALIB you should use a UVRANGE. ***Note: occasionally, flagging using UVFLG can be more straightforward (e.g., deleting an antenna). >> NOTE: Solar interference worse at beginning of run (first ph cal >> scan); primary observed last, so interference much less. >> Primary: RR: Now load the TV memory from 7.0521E-01 TO 1.3704E+00 antenna 4 warm, 24 hot; 21, 27 cool first real scan ok, but 2 antennas have 1 pixel before first scan: FLAG TIME to delete amp: variations at short bl; sun? scan time: 3 (10 minutes of 30 sec scans, so limited here) amp diff: Now load the TV memory from 3.5763E-07 TO 1.6036E-01 short bl in map prominent ph diff: ditto; but max = 7.9 deg - not bad LL: Now load the TV memory from 5.4238E-01 TO 1.3488E+00 antenna 4 cool (!), 24 very hot; 21, 22 cool first scan ok; but 2 antennas have 1 pixel before first scan: FLAG TIME to delete scan time: 3 (10 minutes of 30 sec scans, so limited here) amp: Now load the TV memory from 1.1921E-06 TO 1.6727E-01 variations at short bl; sun? ph diff: ditto, but max = 8.7 deg - not bad >> Secondary RR: Now load the TV memory from 1.0728E-03 TO 7.2033E-01 amp: bad short bl: solar interference. >> Rerun using UVRANGE UVRANGE 0.7 0 Now load the TV memory from 1.0728E-03 TO 3.0960E-01 antenna 24 warm. amp: bad first integrations in scan 2 and 3. FLAG A TIME Now load the TV memory from 8.4497E-02 TO 3.0960E-01 editing out last of high stuff at short BL Now load the TV memory from 8.4497E-02 TO 2.6698E-01 SCAN TIME 3 amp diff: Now load the TV memory from 1.1027E-06 TO 7.5588E-02 short bl again; FLAG AREA: took out 3 bl in first scan Now load the TV memory from 1.1027E-06 TO 4.8399E-02 ph diff: Now load the TV memory from 1.2294E-04 TO 3.1001E+01 FLAG AREA: 3 bl in 2nd scan; 1 in 3rd. Now load the TV memory from 1.2294E-04 TO 1.9287E+01 LL: Now load the TV memory from 1.6367E-03 TO 3.0874E-01 amp: bad first integrations in scan 2 and 3. FLAG A TIME (all three scans) Now load the TV memory from 4.7980E-02 TO 3.0874E-01 SCAN TIME 3 amp diff: Now load the TV memory from 3.2783E-07 TO 9.3183E-02 clip interactive; removed 58 pixels > .045 mostly at short bl Now load the TV memory from 0.0000E+00 TO 5.2681E-02 ph diff: Now load the TV memory from 0.0000E+00 TO 4.3547E+01 short bl again. clip interacative: removed 22 pixels > 20 deg Now load the TV memory from 0.0000E+00 TO 1.7288E+01 ^10.02 >> UVPLT again executed on 04May10 >> Primary: --> d75_d_fluxcal_uvplt2.ps default UVPLT sourc '1328+307' '' do3col 1 getn 1 $ *.CH 0 >> looks ok >> Secondary: --> d75_d_phasecal_uvplt2.ps default UVPLT sourc '0941-080' '' uvran 0.7 0 do3col 1 getn 1 $ *.CH 0 >> looks fine ^10b. TABED FG/1 executed on 04May10 ***Here we TABED the CH 0 flags to LINCOP (with FREQID= -1). After this we're done with FILLM's channel 0. default TABED opty 'repl' inext 'fg' inver 1 ; outver 1; bcount 1;ecount 0 ; $until recently there was a parameter called $ncount which is no longer there aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...to FREQID= -1 getn 1 $*.CH 0 getona 4 $ *.LINCOP --> LINCOP FG/1 11. BPASS ***This is a first-order BPASS leading to a new Channel 0. The goal is to avoid closure errors in Channel 0 calibration due to huge delays (phase slopes) on VLA-EVLA baselines. We divide each visibility by the vector average of the inner 3/4 of the band (i.e., an on-the-fly channel 0). Thus we remove source structure (tho' getting the weights wrong) and take care of the amplitude scale. ***There is a split here between the easy case (one FREQID for all sources) and the Galactic HI case (multiple FREQIDs, usually different for the bandpass calibrator and the galaxy (and phase calibrator)). Check LISTR/SCAN to see which you're doing. >> Note, first time through, used antenna 7 as refant; but antenna 7 >> not present for entire run for phase cal. Switching to antenna 18 >> EXTDEST BP;1 >> EXTDEST PL; 1-10 (spectra from first run of BP) ^11a. BPASS: one FREQID for all sources -> BP/1 executed on 04May10 default BPASS calsour '1328+307','' $ Select bandpass calibrators docal 1 ; gainuse 2 $ apply VLANT changes. Probably irrelevant. flagver 1 $ apply initial flags refant 18 $ Change this to your refant Qual -1 solint 0 $ one solution per scan minamper 7 ; minphser 7 $ report closures > 7%/7d smooth 0 $ no smoothing soltype '' ; weightit 0 $ L1, L1R, etc. seem _less_ stable -- weird bpassprm 0 bpassprm(5) 0 $ derive "channel 0" on a record-by-record basis -- $ more biased than averaging first, but avoids $ some subtle pitfalls (see EXPLAIN file) bpassprm(2) 1 $ some closure info is printed bpassprm(6) 2 $ print avg. closure errors > 2% bpassprm(7) 2 $ print avg. closure errors > 2d ichansel 0 $ derive channel 0 from inner 3/4 of the band freqid 1 $ here we have only one FREQID getn 4 $ *.LINCOP --> BP/1 ^11c. POSSM to check BP table 11c1. Plot BP table itself default POSSM $ to check BPASS results flagver 1 aparm 0, 1, 0.7, 1.3, -180, 180, 0, 2, 0, 0 $ Plot BP, with amp/ph ranges source '1328+307','' $ POSSM doesn't work with $ source '' for some reason! solint -1 $ Separate plots for each scan nplots 9 $ 9 plots per page bparm 0 dotv 1 freqid 1; bpver 1 $ for single-FREQID data sets $ freqid 3; bpver 4 $ for multiple-FREQID data sets getn 4 $*.LINCOP tvinit dotv -1 >> PL 1-6 for LINCOP are POSSM results, 9 per page default lwpla $ to print the plots to a ps file getn 4 $ *.LINCOP outfile 'd75:d75_d_possm11c1.ps invers 0 for i = 1 to 6; plver = i; go; wait lwpla; end >> In general, the VLA antennas have very flat bandpasses around 1.0 with near 0 phase >> 11c1a. Plot BP table vector average -- something I like to do. default POSSM $ to check BPASS results flagver 1 aparm 0K aparm(8) 2 $ to plot the BP spectrum source '1328+307','' $ POSSM doesn't work with $ source '' for some reason! solint 0 nplots 0 bparm 0 dotv -1 freqid 1; bpver 1 $ for single-FREQID data sets $ freqid 3; bpver 4 $ for multiple-FREQID data sets getn 4 $*.LINCOP >> PL 7, 8 for LINCOP are the BP spectrum, RR, LL default lwpla $ to print the plots to a ps file getn 4 $ *.LINCOP outfile 'd75:d75_d_possm11c1.ps invers 0 for i = 7 to 8; plver = i; go; wait lwpla; end >> (Added to d75_d_possm11c1.ps) >> Looks ok ^ 11c2. Apply BP table to 2ndary calibrator & plot individual baselines default POSSM flagver 1 aparm 0 $ Plot data aparm 0, 1, .1, .5, -180, 180, 0 $ so I can easily see trends solint -1 $ Separate plots for each scan nplots 9 $ 9 plots per page source='0941-080','' $ Secondary (phase) calibrator docal 1 ; gainuse 2 ; doband 1 $ average all BP entries dotv 1 freqid 1; bpver 1 $ for single-FREQID data sets $ freqid 3; bpver 4 $ for multiple-FREQID data sets getn 4 $*.LINCOP tvinit >> looked at whole first scan: amps quite flat for all antennas; most phases flat, except for occasional baselines where phases seemed to be bimodally distributed: jumps (180?) +++++ +++ like that. ++ ^ 11c3. Apply BP table to 2ndary calibrator & vector average all data default POSSM flagver 1 aparm 0 $ Plot data solint 0 $ average all time nplots 0 $ average all baselines aparm 0 aparm(1) 1 $ vector average source='0941-080','' $ Secondary (phase) calibrator UVRANGE 0.7, 0 $ to exclude solar interference for this calibrator docal 1 ; gainuse 2 ; doband 1 $ average all BP entries dotv 1 freqid 1; bpver 1 $ for single-FREQID data sets $ freqid 3; bpver 4 $ for multiple-FREQID data sets getn 4 $ *.LINCOP tvinit ***This plot should be flat in both amp. and phase as a function of frequency, with no slope.. If some channels are off, note which ones those are and keep an eye out for interference or other bad data. If there are large errors consider running BPASS on the secondary calibrator and using that to correct the galaxy. Note that this will be somewhat painful since AIPS does not allow incremental BP tables -- unlike SN or CL tables. Sigh. >> 1(RR): Quite flat around 6.5 mJy with variation btw 5.5 and 7.5 Phase is around 135 +/- 5 degrees FILLPL: Amplitude mean: 6.3238E-03 rms: 5.6875E-04 FILLPL: Phase mean: 1.3307E+02 rms: 5.8217E+00 >> 1(LL): Quite flat around 12 Mjy with variation btw 11.0, 13.0 Phase is around 137 +/- 5 FILLPL: Amplitude mean: 1.1740E-02 rms: 6.1357E-04 FILLPL: Phase mean: 1.3624E+02 rms: 2.8046E+00 dotv -1; go tget lwpla for i = 9 to 10; plver = i; go; wait lwpla; end >> (Added to d75_d_possm11c1.ps) 12. AVSPC -> NEWCH0.1 (2,3) executed on 04May10 ***AVSPC must be run once for each FREQID (unfortunately FREQID=-1 purports to work, but creates an empty data set). This entails some nasty bookkeeping for data sets with multiple FREQIDs. Here I assume we have one or three FREQIDs. If BPASS checks above show that one FREQID is useless, you should ignore that one entirely in this and all subsequent processing. ***We will use these NEWCH0 files for (1) further flagging, and (2) time-dependent gain calibration. ^ 12a. FREQID=1 --> NEWCH0.1 default AVSPC docalib -1;gainuse 0; flagver -1 $ do NOT apply flags doband 1 freqid 1; bpver 1 $ for single-FREQID data sets $ freqid 1; bpver 4 $ for multiple-FREQID data sets getn 4 $ *.LINCOP outname inna ; outcl 'NEWCH0' --> NEWCH0.1 ^ 12d. LISTR/SCAN ***It is a VERY good idea to run LISTR/SCAN on each of the NEWCH0 data sets at this point, to be sure each has the data you expect. default LISTR optype 'SCAN' docrt -1 outpr ' getn 6 $*.LINCOP --> d75_d_listr3.ps docrt 132 $ for cut and paste into this file File = D75_D .NEWCH0. 1 Vol = 1 Userid = 75 Freq = 1.418786346 GHz Ncor = 2 No. vis = 42225 Scan summary listing Scan Source Qual Calcode Sub Timerange FrqID START VIS END VIS 1 0941-080 : 0001 C 1 0/19:48:15 - 0/19:52:45 1 1 3115 2 SEXTANSA : 0001 1 0/19:53:30 - 0/20:37:30 1 3116 16965 3 0941-080 : 0001 C 1 0/20:39:15 - 0/20:42:45 1 16966 19436 4 SEXTANSA : 0001 1 0/20:43:30 - 0/21:26:30 1 19437 34048 5 0941-080 : 0001 C 1 0/21:28:15 - 0/21:32:15 1 34049 36959 6 1328+307 : 0001 C 1 0/21:35:45 - 0/21:43:15 1 36960 42225 Source summary Velocity type = 'BARYCENT' Definition = 'OPTICAL ' ID Source Qual Calcode RA(1950.0) Dec(1950.0) IFlux QFlux UFlux VFlux No. vis 1 0941-080 : 0001 C 09:41:08.6460 -08:05:44.030 0.000 0.000 0.000 0.000 8497 2 SEXTANSA : 0001 10:08:30.0000 -04:25:60.000 0.000 0.000 0.000 0.000 28462 3 1328+307 : 0001 C 13:28:49.6570 30:45:58.640 14.775 0.000 0.000 0.000 5266 ID Source Freq(GHz) Velocity(Km/s) Rest freq (GHz) 1 0941-080 1.4188 325.0000 1.4204 2 SEXTANSA 1.4188 325.0000 1.4204 3 1328+307 1.4188 188.0803 1.4204 Frequency Table summary FQID IF# Freq(GHz) BW(kHz) Ch.Sep(kHz) Sideband 1 1 1.41878635 9.2408 988.7695 1 ^ 13. TABED LINCOP FG/1 -> NEWCH0 FG/1 executed 04May10 ***We use TABED to set FREQID to -1 (apply to all FREQIDs) in the FG table, since AVSPC will change all FREQIDs to 1 in the NEWCH0 data sets. ^ 13a. NEWCH0.1 default TABED opty 'repl' inext 'fg' inver 1 ; outver 1 aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...to FREQID= -1 getn 4 $*.LINCOP getona 6 $*.NEWCH0.1 --> NEWCH0.1, FG/1 14. CALIB -> NEWCH0.1(,2,3) SN/1 executed on 04May10 ***If we only have one FREQID, all CALIBs are run on the same NEWCH0.1 . If we have multiple FREQIDs, CALIBs for a given source must be run for all NEWCH0.1,2,3 in which that source appears (probably easiest to check with LISTR/SCAN). ***Note: if 'SN' table must be destroyed: task 'extdest'; inext 'sn'; invers 0 >> Note: first time through, ran CALIB with refant 7. Used EXTDEST to >> delete SN;1 >> Note: second time through, used UVFLG to delete baselines/times with closure errors; Used EXTDEST to delete SN;1 >> Note: third time through, used UVFLG to delete baselines/times with closure errors; Used EXTDEST to delete SN;1 >> Note: reexecuted on new NEWCH0 on 12May10; see notes below ***If solar interference is affecting your data than in CALIB you should use a UVRANGE. The worst case scenario, baselines up to a distance of 1 kilolambda could be afected, while in the best case scenario baselines are affected only up to 0.5kilolambda distance. We recommend using: UVRANGE 0.7,0 for D array UVRANGE 0.7,0 for C array After calibration, if UVPLT still shows signs of solar interference,it means that not enough short baselines were discarded; therefore the calibration has to be redone and UVRANGE to be reset. Note that the Sun might rise or set, especially during a long B-array run, in which case you might wish to split the calibration by timerange in a set affected and a set without solar interference. ^ 14a. Primary (flux density) calibrators --> SN/1 default CALIB calsour '1328+307','' $ flux density calibrator get2n 5 $ 3C286_L.MODEL;1 nmap 1 ; ncomp 1e6,0 ; inver 1 ; cmethod 'DFT' freqid -1 docal 1 ; gainuse 2 flagver 1 refant 18 $ Change this to your refant solint 0 aparm 4,0,0,0,0,2; $ min 4 antennas; print closures soltype 'L1'; solmode 'A&P'; weightit 1 $ true L1 minimization solcon 0 minamper 10; minphser 10 $ complain if >10%/10d off cparm 0,0,10,10,1 $ complain if avg > 10%/10d off snver 1 getn 6 $*.NEWCH0 $ ***NOTE: must run this for all NEWCH0.1,2,3 in which $ this calibrator appears! --> SN/1 galaxy> CALIB1: RPOL, IF= 1 The average gain over these antennas is 3.890E+00 galaxy> CALIB1: LPOL, IF= 1 The average gain over these antennas is 3.866E+00 galaxy> CALIB1: Found 54 good solutions galaxy> CALIB1: Average closure rms = 0.0003 +- 0.0000 galaxy> CALIB1: No data were found > 99.0 rms from solution >> 27 antennas -> 27*2(RR&LL) * 1 scan = 54 ^ 14b. Secondary (phase) calibrator --> SN/1 ***Check uv restrictions for secondary calibrators carefully. For 0941-080: no uv restrictions for D array, but has solar interference, so uvrange 0.7, 0 default CALIB calsour '0941-080','' $ phase calibrator uvrange 0.7,0 $ this calibrator has solar interference wtuv 0.0 $ may have to set wtuv 0.01 if solutions are $ crazy and uvrange is not 0,0 freqid -1 docal 1 ; gainuse 2 flagver 1 refant 18 $ Change this to your refant solint 0 aparm 4,0,0,0,0,2; $ min 4 antennas; print closures soltype 'L1'; solmode 'A&P'; weightit 1 $ true L1 minimization solcon 0 minamper 10; minphser 10 $ complain if >10%/10d off cparm 0,0,10,10,1 $ complain if avg > 10%/10d off snver 1 getn 6 $*.NEWCH0 $ ***NOTE: must run this for all NEWCH0.1,2,3 in which $ this calibrator appears! galaxy> CALIB1: Closure errors at 0/19:50:30 0941-080 IF no. 1 Rpol galaxy> CALIB1: 04-05 11.6% 6d 11-21 0.6% 10d galaxy> CALIB1: Antenna 4 had 1 excess closure errors, 1 printed galaxy> CALIB1: Antenna 5 had 1 excess closure errors, 1 printed galaxy> CALIB1: Antenna 11 had 1 excess closure errors, 1 printed galaxy> CALIB1: Antenna 21 had 1 excess closure errors, 1 printed galaxy> CALIB1: Closure errors at 0/19:50:30 0941-080 IF no. 1 Lpol galaxy> CALIB1: 18-26 24.7% 1d galaxy> CALIB1: Antenna 18 had 1 excess closure errors, 1 printed galaxy> CALIB1: Antenna 26 had 1 excess closure errors, 1 printed galaxy> CALIB1: Closure errors at 0/20:41:15 0941-080 IF no. 1 Lpol galaxy> CALIB1: 01-05 17.1% 1d 04-05 23.0% 5d 04-18 9.3% 15d galaxy> CALIB1: 04-22 16.7% 4d 04-24 18.6% 11d 05-19 11.9% 2d galaxy> CALIB1: 07-11 40.0% 12d 09-10 23.5% 18d 21-22 13.2% 15d galaxy> CALIB1: Antenna 1 had 1 excess closure errors, 1 printed galaxy> CALIB1: Antenna 4 had 4 excess closure errors, 4 printed galaxy> CALIB1: Antenna 5 had 3 excess closure errors, 3 printed galaxy> CALIB1: Antenna 7 had 1 excess closure errors, 1 printed galaxy> CALIB1: Antenna 9 had 1 excess closure errors, 1 printed galaxy> CALIB1: Antenna 10 had 1 excess closure errors, 1 printed galaxy> CALIB1: Antenna 11 had 1 excess closure errors, 1 printed galaxy> CALIB1: Antenna 18 had 1 excess closure errors, 1 printed galaxy> CALIB1: Antenna 19 had 1 excess closure errors, 1 printed galaxy> CALIB1: Antenna 21 had 1 excess closure errors, 1 printed galaxy> CALIB1: Antenna 22 had 2 excess closure errors, 2 printed galaxy> CALIB1: Antenna 24 had 1 excess closure errors, 1 printed galaxy> CALIB1: Closure errors at 0/21:30:29 0941-080 IF no. 1 Lpol galaxy> CALIB1: 02-21 11.1% 1d 07-11 4.2% 14d 21-22 21.9% 10d galaxy> CALIB1: Antenna 2 had 1 excess closure errors, 1 printed galaxy> CALIB1: Antenna 7 had 1 excess closure errors, 1 printed galaxy> CALIB1: Antenna 11 had 1 excess closure errors, 1 printed galaxy> CALIB1: Antenna 21 had 2 excess closure errors, 2 printed galaxy> CALIB1: Antenna 22 had 1 excess closure errors, 1 printed galaxy> CALIB1: RPOL, IF= 1 The average gain over these antennas is 2.378E+00 galaxy> CALIB1: LPOL, IF= 1 The average gain over these antennas is 2.338E+00 galaxy> CALIB1: Found 158 good solutions galaxy> CALIB1: Average closure rms = 0.0088 +- 0.0015 galaxy> CALIB1: No data were found > 99.0 rms from solution galaxy> CALIB1: Appears to have ended successfully galaxy> CALIB1: galaxy 31DEC08 NEW: Cpu= 0.0 Real= 0 I >> 27 antennas -> 27*2(RR&LL) * 3 scans - (1 antennas*2*1 scan) - (1 antennas*2*1 scan) = 158. >> Using UVFLG to flag above baslines/times/polarizations default UVFLG sourc '0941-080' '' outfgver 1 opcode 'flag' reason 'closure errors' getn 6 $ *.NEWCH0 timeran 0 19 48 00 0 19 53 00 $first scan stoke 'rr' antenna 4 baseline 5 go antenna 11; baseline 21 go stokes 'll' antenna 18; baseline 26 go timera 0 20 39 00 0 20 43 00 $ second ph cal scan stoke 'll' antenna 5; baseline 1, 19 go antenna 4; baseline 5, 18, 22, 24 go antenna 7; baseline 11 go antenna 9; baseline 10 go antenna 21; baseline 22 go timera 0 21 28 00 0 21 32 30 $ 3rd ph cal scan stoke 'll' antenna 21; baseline 2, 22 go antenna 7;baseline 11 go >> Done. Rerunning CALIB from step 14. galaxy> CALIB1: Closure errors at 0/21:30:29 0941-080 IF no. 1 Lpol galaxy> CALIB1: 11-21 10.7% 1d galaxy> CALIB1: Antenna 11 had 1 excess closure errors, 1 printed galaxy> CALIB1: Antenna 21 had 1 excess closure errors, 1 printed galaxy> CALIB1: RPOL, IF= 1 The average gain over these antennas is 2.378E+00 galaxy> CALIB1: LPOL, IF= 1 The average gain over these antennas is 2.338E+00 galaxy> CALIB1: Found 158 good solutions galaxy> CALIB1: Average closure rms = 0.0080 +- 0.0004 galaxy> CALIB1: No data were found > 99.0 rms from solution >> Using UVFLG to remove this one baseline default UVFLG sourc '0941-080' '' outfgver 1 opcode 'flag' reason 'closure errors' getn 6 $ *.NEWCH0 timera 0 21 28 00 0 21 32 30 $ 3rd ph cal scan stoke 'll' antenna 11; baseline 21 go >> Done. Rerun CALIB from step 14. galaxy> CALIB1: RPOL, IF= 1 The average gain over these antennas is 2.378E+00 galaxy> CALIB1: LPOL, IF= 1 The average gain over these antennas is 2.339E+00 galaxy> CALIB1: Found 158 good solutions galaxy> CALIB1: Average closure rms = 0.0080 +- 0.0004 galaxy> CALIB1: No data were found > 99.0 rms from solution >> No closure errors. Success. ^15b. GETJY SN/1-3, SU/1 executed on 11May10 ***Find flux density of secondary calibrator, and set SN table amplitude gains to reflect a common flux density scale. default GETJY sources '0941-080','' $ Secondary (phase) calibrators) calsour '1328+307','' $ Primary (flux) calibrators freqid -1 snver 0 $ Use all SN tables getn 6 $ *.NEWCH0.1 galaxy> GETJY1: Task GETJY (release of 31DEC08) begins galaxy> GETJY1: Source:Qual CALCODE IF Flux (Jy) galaxy> GETJY1: 0941-080 : 1 C 1 2.70568 +/- 0.00857 galaxy> GETJY1: Appears to have ended successfully >> compare to catalog value of 2.70 -- very nice! ^16. SN table checks 16a. SNPLT last SN table executed on 11May10 16a1. SNPLT phase: default SNPLT inext 'sn';inver 0 pixrange 0 opcode 'alsi';do3col 1;dotv 1; nplots 9 factor 2; symbol 5 xinc 1; optype 'phas'; getn 6 $ *.NEWCH0.1 ===> Note any phase jumps (on the phase calibrator) for future flagging. The EVLA antennas, even after applying VLANT, still show quite a bit of phase drift. This is OK so long as a linear interpolation between the phases looks like it will work. >> Everything looks very well-behaved for all antennas; all stokes. ^ 16a2. SNPLT amplitude: default SNPLT inext 'sn';inver 0 pixrange 0 opcode 'alsi';do3col 1;dotv 1; nplots 9 factor 2; symbol 5 xinc 1; optype 'amp'; getn 6 $ *.NEWCH0.1 ===> Note whether the amp. is roughly constant for a given antenna/pol'n/IF. ***We have seen a couple cases where the first phase cal scan has a significantly different amplitude gain for the EVLA antennas. The reason is not clear but the raw data do show this effect, so CALIB is doing the right thing. This area warrants further tests, to learn whether we should simply flag the EVLA antennas on the first phase calibrator scan. >> Everything looks very well-behaved for all antennas; all stokes. ^ 16b. LISTR/GAIN print SN table executed on 11May10 default LISTR optype 'gain'; Inext 'sn'; inver 1; freqid -1 dparm 5,0; $ Amp & phase factor 0; docrt -1 outprint '' antennas 0; $ may have to list missing antennas explicitly, to avoid $ column overrun. To list missing antennas, use the form $ANTENNAS -3,2,0 to have antennas 3 and 2 left out. getn 6 $ *.NEWCH0.1 >> wrote to d75_d_listr_gain.ps --> check for phase jumps and other inconsistencies. ***We have seen a couple cases where the first phase cal scan has a significantly different amplitude gain for the EVLA antennas. The reason is not clear but the raw data do show this effect, so CALIB is doing the right thing. This area warrants further tests, to learn whether we should simply flag the EVLA antennas on the first phase calibrator scan. >> phases: RR: - antenna 6 shows a jump of 54 deg between the last phase cal scan and the flux cal scan, but there's no galaxy data in between so it's not important. - antenna 8 has phase changes of ~20-30 deg between scans, but it's well-behaved so interpolation should be fine. Another large jump (87 deg!) between the last phase scan and the flux cal scan; but no galaxy data there. - All else very well behaved. LL: - antenna 6: same behavior as for RR - antenna 8: same behavior as for LL - All else very well behaved. x17. UVFLG -> NEWCH0.1 FG/1 executed on 11May10 ***If the SN table shows a phase jump on the phase calibrator, you should flag the data between the two phase cal scans which show the jump (since those cannot be calibrated). ***Note that we flag NEWCH0.1, *regardless* of whether the galaxy appears in this data set. This is because later on (step 20/TVFLG) we flag the NEWCH0 data in order from inseq 1 through inseq freqid_max, copying the FG table from one file to the next. UVFLG itself doesn't care whether the flags you enter actually do anything -- it just adds entries to the FG table, which are then applied (or ignored if irrelevant) by other tasks. ***This step may of course be skipped if there are no obvious phase jumps. >> No phase jumps worth flagging. This example deals with a phase jump on antenna 18. default UVFLG antenna 18,0 $ the antenna which "jumped" timer 0 6 33 0 0 6 59 0; $ the source scan between the offending ph.cal scans opcode 'FLAG' reason 'phase jump' outfgver 1 getn *.NEWCH0.1 --> NEWCH0.1 FG/1 ^18. CLCAL NEWCH0 --> CL/3 executed on 11May10 ***For multi-FREQID data this becomes rather complicated, since we need a new CL table for every NEWCH0 file, to allow detailed checks and second-order flagging. ***Note that there is no need to work around any phase jumps, since the intervening data are flagged (see step 17 above [UVFLG]). ^18a. CLCAL for the primary calibrators -> CL/3 default CLCAL sour= '1328+307','' $ Primary (flux) calibrators calsour= sour interpol 'SELF' gainver 2 ; gainuse 3 refant 18 $ Change this to your refant dobtween -1 $ Don't interpolate entries for different sources snver 1 $ if single FREQID $ snver 4 $ if multiple FREQIDs getn 6 $*.NEWCH0.1 $ do this for all NEWCH0 with primary (flux) $ calibrator data ^ 18b. CLCAL for the phase calibrator and galaxy -> CL/3 default CLCAL sour= '0941-080','sextansa','' $ Secondary (phase) calibrator + galaxy calsour= '0941-080','' $ Secondary (phase) calibrator interpol 'SIMP' gainver 2 ; gainuse 3 refant 18 $ Change this to your refant dobtween -1 $ Don't interpolate entries for different sources cutoff 120 $ Don't extrapolate/interpolate beyond 120 minutes snver 1 $ if single FREQID $ snver 4 $ if multiple FREQIDs ***If your data set used +/- frequency switching for the phase calibrator (our observations did not, but some archival data may), you should use BPARM with SAMPTYPE='BOX' to select a smoothing time which covers both frequency settings. LISTR/SCAN on LINCOP will help you choose this; normally something like 12 minutes should be OK. x bparm 12/60 ; samptype='BOX' getn 6 $*.NEWCH0.1 $ do this for all NEWCH0 with secondary (phase) $ calibrator or galaxy data ***At this point we have a new CL table for all NEWCH0 files. ^19a. ANBPL executed on 11may10 ***We use ANBPL to check the data weights. Data with very high weights (factor 5-10 or more above normal) should be flagged with UVFLG. tvinit default ANBPL docalib 1;gainuse 3 flagver 1 bparm 2,17,0 $ Plot antenna-based weight vs. time nplots 9; dotv 1 docrt -1 $ Print as well as plotting weights -- useful for $ finding exact times of bad weights $ Note you can also use outprint to send to a file. opcode 'alsi' $ Plot all IFs together do3col 1 $ ...using different colors getn 6 $*.NEWCH0.1 $ Must do this separately for every NEWCH0 file >> Everything looked very nice. x 19b. UVFLG to eliminate very high weights ***Should UVFLG on NEWCH0.1, even if Evil Weights are seen in NEWCH0.2 or NEWCH0.3 -- we'll be copying FG/1 from NEWCH0.1 to NEWCH0.2 for subsequent second-order flagging. ^20. TVFLG FG/1 executed on 11may10 ^20a. TVFLG on calibrators: NEWCH0.1 The calibrators should now have constant amplitude and zero phase...apart from source structure for the primary (flux) calibrators, and any uvrange for the secondary (phase) calibrators. If we see huge problems on the calibrators we may have to re-run CALIB etc. -- let's hope not!! >> Flux cal first default TVFLG sourc '1328+307' $ calibrators only docat -1 $ avoid saving temporary files dohist -1 $ avoid creation of history entries docalib 1 ; gainuse 3 $ apply the new CL table flagver 1;outfgver 1 $ keep all flags in FG/1 dparm 0 dparm(3) 1 $ show baselines twice, to treat all antennas identically -- $ this displays baseline 27-1 as well as 1-27 dparm(6)=30 $ time resolution: should be set to the calibrators' $ integration time, in seconds getn 6 $*.NEWCH0.1 RR: Now load the TV memory from 1.2149E+01 TO 1.7959E+01 LL: Now load the TV memory from 1.1631E+01 TO 1.7630E+01 Solar int on short bl makes it hard to see if anything is bad; reload with uvran 0.5 0 RR: 1.4087E+01 TO 1.5428E+0 LL: 1.3902E+01 TO 1.5504E+01 >> All looks fine Phase diff: scan 3 RR: 1.0779E-05 TO 4.8509E+00: max diff 5 deg. First integrations for antennas 19 and 25 and mid integrations antenna 17 the worst. Still ok though! LL: 4.7859E-04 TO 5.0258E+0: same as RR >> fine Amp diff: scan 3 RR: 1.4305E-05 TO 5.9834E-01: max 0.6 Jy; 2 shortish baselines: 2-11, 3-8 LL: 4.2915E-05 TO 6.3050E-01: max 0.6 Jy; 1 shortish baseline: 3-8 >> fine >> Phase cal second default TVFLG sourc '0941-080' $ calibrators only docat -1 $ avoid saving temporary files dohist -1 $ avoid creation of history entries docalib 1 ; gainuse 3 $ apply the new CL table flagver 1;outfgver 1 $ keep all flags in FG/1 dparm 0 dparm(3) 1 $ show baselines twice, to treat all antennas identically -- $ this displays baseline 27-1 as well as 1-27 dparm(6)=30 $ time resolution: should be set to the calibrators' $ integration time, in seconds uvrang 0.7 0 getn 6 $*.NEWCH0.1 >> Amp RR: 1.8238E+00 TO 3.7151E+00; a few hot points at short bl. LL: 1.7189E+00 TO 3.6669E+00; ditto >> Amp diff: scan 10 RR: 2.9802E-05 TO 1.0328E+00; ~35% variation (1/2.7); short bl LL: 4.2915E-06 TO 1.0408E+00: ditto >> Ph diff: scan 10 RR: 2.8431E-04 TO 2.3491E+01: max 23.5 deg. Hmm. Short bl again (7-11 in 2nd scan). LL: 5.6242E-04 TO 2.4699E+01: max 24.7 deg. Hmm again. Not same bl as RR ***Within TVFLG: - Set useful defaults: SMOOTH=1 to avoid averaging date before displays SCAN= 20 to use a long time for median filters (AMP/PH DIFF) FLAG ALL CHANNELS FLAG STOKES FULL (usually -- sometimes you'll want NORR or NOLL) ***If individual Stokes need to be flagged, make sure you set the STOKES FLAG to correspond to the polarization that is displayed on the TV SWITCH SOURCE FLAG to ONE-SOURCE to avoid inadvertantly flagging your galaxy (though sometimes you'll want to of course) - Be sure to inspect BOTH polarizations! ***We suggest the following steps: - Set the above defaults - Check AMPLITUDE, AMP DIFF, PHS DIFF. Be wary of known source structure and uv-range limits!! ***Note: occasionally, flagging using UVFLG can be more straightforward (e.g., deleting an antenna). ^21. Calibration/flagging checks: calibrators 21a. UVPLT executed on 11may10 ***Check the amp & phase vs. uv-distance for all calibrators. Amplitude should match the results of SETJY/GETJY. If there are obvious outliers which are not expected due to source structure, go back and flag those (and possibly re-run CALIB etc.). default UVPLT $ calco '*' sourc '1328+307' '' $flux cal first docal 1 ; gainuse 3 flagver 1 $ set this to the latest FG version -- may be >1 if $ there are multiple NEWCH0s (FREQIDs). dotv -1 $ put to file do3col 1 getn 6 $*.NEWCH0.1 $ do this for each NEWCH0 file bparm 0 $ amp. vs. uv-distance --> d75_d_fluxcal_uvpltamp.ps bparm 0,2 $ phase vs. uv-distance d75_d_fluxcal_uvpltphase.ps >> amp: Primary shows some solar interference on short baselines (< 0.3 kl; 20% variation is worst). >> Phase: scatter +/-15 deg; fine default UVPLT $ calco '*' sourc '0941-080' '' $phase cal second docal 1 ; gainuse 3 flagver 1 $ set this to the latest FG version -- may be >1 if $ there are multiple NEWCH0s (FREQIDs). dotv -1 $ put to file do3col 1 uvran 0.7 0 getn 6 $*.NEWCH0.1 $ do this for each NEWCH0 file bparm 0 $ amp. vs. uv-distance --> d75_d_fluxcal_uvpltamp.ps bparm 0,2 $ phase vs. uv-distance d75_d_fluxcal_uvpltphase.ps >> amp: still some solar int on short (<1 kl) baselines >> phase: scatter +/- 20 deg; on short bl. 21b. IMAGR executed on 11May10 [if desired -- this is not really necessary] ^ default IMAGR sources '0941-080','' $ calibrator to image docalib 1; gainuse 3 $ apply latest calibration flagver 1 $ apply latest flags -- set this to the $ highest-numbered FG table outname 'junkcal' $ some obviously cruddy name $ cellsize 1 $ for B configuration $ cellsize 3.5 $ for C configuration cellsize 10 $ for D configuration $ imsize 1024 $for B array imsize 512 $for C and D array uvran 0.7 0 $ to remove solar interference niter 1000 $ nbox 1 ; clbox -1,5,512,513 $ calibrator should be in the center minpa 121 uvwtfn 'NA'; robust 0.5 dotv 1 getn 6 $*.NEWCH0.xx $ whichever file has the calibrator you're imaging --> shouldn't see obvious calibration errors or striping. CLEANed flux density should roughly match SETJY/GETJY. Note: If uvwtfn is set to 'NA' it will override any value given to robust. >> Total Cleaned flux density = 2.957 Jy 1000 comps; cf. 2.7 GETJY value. Image looks fine. -------------------------------------------------------------------------- >>>> After consideration, I have decided to remove the short bl for the flux calibrator that have solar interference, and the "bad" baselines in the phase cal based on the last TVFLG. Use step 20 to flag the bad data since they only show up best in the calibrated data. Then copy the FG;1 table over to the original .CH 0 data and start over from Step 10. Delete the original .NEWCH0 ^^ 20. TVFLG *.NEWCH0 on phase cal; 12May10 scan 10; PH DIFF RR: flag 7-11 in 2nd scan; 1-8 in 1st scan; 12-14 in 1st scan Now: max ph diff: 19.8 deg LL: flag 16-23 in 3rd scan; 4-18 in 3rd scan; 4-20 in 3rd scan Now: max ph diff: 18.8 deg TVFLG on flux cal: RR and LL: flagged worst short bl ^^ 20. TVFLG *.NEWCH0 on flux cal; 12may10 AMP only iterative flagging of short bl, both stokes, until UVPLT shows solar interference gone. Done. Now load the TV memory from 1.4087E+01 TO 1.5652E+01 ^^ UVPLT: *.NEWCH0, docal 1, source '1328+307' --> d75_d_fluxcal_uvpltamp2.ps ^^ UVPLT: *.NEWCH0, docal 1, source '1328+307' bparm(2) 2 for phase --> d75_fluxcal_uvpltphase2.ps >> Now replace the *.CH 0/FG;1 table with the one from *.NEWCH0 ^^ TABED ^^ TACOP *.NEWCH0/FG;1 --> *.CH 0/FG;1 ^^ Starting over from Step 10b. ^^ 10b. TABED the *.CH 0/FG;1 to LINCOP/FG;1 ^^ *.LINCOP: EXTDEST BP;1, EXTDEST PL; 1-10 (spectra from second run of BP) >> Redo BPASS ^^11a. BPASS: executed 12May10 ^^11c. POSSM to check BP table ^^ 11c1. Plot BP table itself --> d75_d_possm11c1.ps >> In general, the VLA antennas have very flat bandpasses around 1.0 with near 0 phase ^^ 11c1a. Plot BP table vector average -- something I like to do. >> (Added to d75_d_possm11c1.ps) >> Looks ok ^^ 11c2. Apply BP table to 2ndary calibrator & plot individual baselines >> looks the same as from earlier run: ok. ^^ 11c3. Apply BP table to 2ndary calibrator & vector average all data >> RR: Quite flat around 6.5 mJy with variation btw 5.5 and 7.5 Phase is around 135 +/- 5 degrees FILLPL: Amplitude mean: 6.4285E-03 rms: 5.7527E-04 FILLPL: Phase mean: 1.3444E+02 rms: 5.7237E+00 LL: Quite flat around 12 Mjy with variation btw 11.0, 13.0 Phase is around 137 +/- 5 FILLPL: Amplitude mean: 1.1657E-02 rms: 6.2129E-04 FILLPL: Phase mean: 1.3406E+02 rms: 2.8268E+00 >> (Added to d75_d_possm11c1.ps) ^^ 12. AVSPC -> NEWCH0.1 (2,3) executed on 12May10 ^^ 12d. LISTR/SCAN --> d75_d_listr4.ps >> identical to previous one (d75_d_listr3.ps) ^^ 13. TABED LINCOP FG/1 -> NEWCH0 FG/1 executed 12May10 ^^ 14. CALIB -> NEWCH0.1(,2,3) SN/1 executed on 12May10 ^^ 14a. Primary (flux density) calibrators --> SN/1 galaxy> CALIB1: RPOL, IF= 1 The average gain over these antennas is 3.890E+00 galaxy> CALIB1: LPOL, IF= 1 The average gain over these antennas is 3.867E+00 galaxy> CALIB1: Found 54 good solutions galaxy> CALIB1: Average closure rms = 0.0002 +- 0.0000 galaxy> CALIB1: No data were found > 99.0 rms from solution ^^ 14b. Secondary (phase) calibrator --> SN/1 galaxy> CALIB1: RPOL, IF= 1 The average gain over these antennas is 2.378E+00 galaxy> CALIB1: LPOL, IF= 1 The average gain over these antennas is 2.339E+00 galaxy> CALIB1: Found 158 good solutions galaxy> CALIB1: Average closure rms = 0.0080 +- 0.0004 galaxy> CALIB1: No data were found > 99.0 rms from solution >> very similar to previous run. ^^15b. GETJY SN/1-3, SU/1 executed on 12May10 galaxy> GETJY1: Task GETJY (release of 31DEC08) begins galaxy> GETJY1: Source:Qual CALCODE IF Flux (Jy) galaxy> GETJY1: 0941-080 : 1 C 1 2.70638 +/- 0.00859 galaxy> GETJY1: Appears to have ended successfully >> Still good. ^^16. SN table checks >> Everything looks very well-behaved for all antennas; all stokes. ^^16b. LISTR/GAIN print SN table executed on 12May10 >> Same results as before: some jumps but ok. >> wrote to d75_d_listr_gain.ps ^^18. CLCAL NEWCH0 --> CL/3 executed on 14May10 ^^ 18a. CLCAL for the primary calibrators -> CL/3 ^^ 18b. CLCAL for the phase calibrator and galaxy -> CL/3 ^^19a. ANBPL executed on 14may10 >> Everything looked very nice. ^^20. TVFLG FG/1 executed on 11may10 ^20a. TVFLG on calibrators: NEWCH0.1 >> Flux cal first RR: Amp: 1.4107E+01 TO 1.5655E+01 LL: Amp: 1.3923E+01 TO 1.5680E+0 >> both look fine; better than earlier RR: Amp diff (scan 3) 5.1498E-05 TO 5.9926E-01 >> high points from baselines 3-8, 1-11, 2-11. Not bad enough to flag and redo everything LL: Amp diff (scan 3) 4.7684E-06 TO 6.3143E-01 >> high points from baseline 3-20; not bad enough to flag and redo everything. RR: Ph diff: 1.1851E-04 TO 4.8504E+00 >> Fine LL: Ph diff: 2.9429E-05 TO 5.0260E+00 >> Fine >> Phase cal second RR: Amp: 1.9438E+00 TO 3.5332E+00 LL: Amp: 1.8146E+00 TO 3.4717E+00 >> look fine; slightly better than before RR: Amp diff: scan 10; 4.7684E-06 TO 7.4681E-0; improved Ph Diff: 1.2206E-03 TO 1.9825E+01: max 19.8 deg. Improved (ver few high points). LL: Amp diff: scan 10; 8.5831E-06 TO 8.6820E-01: improved Ph Diff: 1.2241E-03 TO 1.8821E+01: max 18 deg. Improved (very few high points) ^^21. Calibration/flagging checks: calibrators ^^21a. UVPLT executed on 14may10 >> Primary: ---> d75_d_fluxcal_calib_uvpltamp.ps amp: looks better now; solar interference mostly gone Phase: scatter +/-15 deg; fine >> Secondary ---> d75_d_phasecal_calib_uvplt.ps amp: still some solar int on short (<1 kl) baselines phase: scatter +/- 20 deg; on short bl. ^^ Not rerunning IMAGR. Was fine the first time, and editing has made slight improvements, if any. ---------------------------------- 22. TVFLG on the galaxy: NEWCH0.xx ***This is our first run of flagging on the galaxy. - Check the first scan carefully -- often the system isn't "organized" on this first scan - On-line flagging isn't as reliable as in the old days, so there are plenty of hot pixels and hiccups. - We are NOT quacking, because (1) FILLM's NX table isn't correct; (2) QUACK flags data from the beginning-of-scan, whereas we want to flag data from antennas-on-source. >>********** DID UVPLT BEFORE TVFLG ******************* ^23. Calibration/flagging checks: sources ^23a. UVPLT executed on 14May10 ***Check the amp vs. uv-distance for the galaxy. If there are obvious outliers which are not expected due to source structure or RFI (i.e., not mostly on short spacings), go back and flag those. Note any obvious short-spacing horrors, which may be due to solar or terrestrial RFI. default UVPLT docal 1 ; gainuse 3 flagver 1 $ set this to the latest FG version -- may be >1 if $ there are multiple NEWCH0s (FREQIDs). dotv -1 do3col 1 source 'SEXTANSA','' getn 6 $*.NEWCH0.1 $ whichever file holds the galaxy bparm 0 $ amp. vs. uv-distance ---> wrote to file: d75_source_ch0_uvplt.ps >> NASTY. Lots of high points at short bl (solar interference probably), and a secondary spike at about 0.8 kl. RR is worst; range up to 25 Jy (solar int) and 7 Jy for secondary spike; LL range up to ~ 10Jy (solar int) and ~ 2Jy for secondary spike. I'm quite sure the shortest baseline stuff is solar; but I'm not sure about the secondary spikes. >> After group discussion, Elias suggests that this stage isn't the right place to do a lot of editing of the source data; we can see how much of the solar interference UVLSF takes out of the line data; then use UVPLT/TVFLG to look at worst channels (as found by imaging the cube) to find the shortest useful baseline; set UVRANGE to that to exclude bad baselines. >> Using TVFLG here to flag only NON-solar, non short-bl RFI stuff. In other words - manual quack if neccesary. 22a. If there's only one NEWCH0 (FREQID): executed 17May10 default TVFLG calcode '-CAL' $ non-calibrators only docat -1 $ avoid saving temporary files dohist -1 $ avoid creation of history entries docalib 1 ; gainuse 3 $ apply the new CL table flagver 1;outfgver 1 $ keep all flags in FG/1 dparm 0 dparm(3) 1 $ show baselines twice, to treat all antennas identically -- $ this displays baseline 27-1 as well as 1-27 dparm(6) 60 $ time resolution: should be set to the sources' $ integration time, in seconds getn 6 $*.NEWCH0.1 ***Within TVFLG: - Set useful defaults: SMOOTH=1 to avoid averaging date before displays SCAN= 20 to use a long time for median filters (AMP/PH DIFF) FLAG ALL CHANNELS FLAG STOKES FULL (usually -- sometimes you'll want NORR or NOLL) ***If individual Stokes need to be flagged, make sure you set the STOKES FLAG to correspond to the polarization that is displayed on the TV SWITCH SOURCE FLAG to ONE-SOURCE to avoid inadvertantly flagging your galaxy (though sometimes you'll want to of course) - Be sure to inspect BOTH polarizations! ***We suggest the following steps: - Set the above defaults - Flag first integration in every scan (manual QUACK) -- this should be the first integration AFTER most antennas are on-source, which is why we can't use the usual QUACK. - Check AMPLITUDE, AMP DIFF, PHS DIFF. Be wary of known source structure and uv-range limits!! ***Note: occasionally, flagging using UVFLG can be more straightforward (e.g., deleting an antenna). >> RR Amp: Now load the TV memory from 1.8393E-03 TO 2.3335E+01 Appears to be mostly solar as decreases with time; 1st scan (of 2) most affected. Flagged first integrations of both scans. >> LL Amp: Now load the TV memory from 3.6229E-03 TO 1.1209E+01 Ditto. Flagged first integrations of both scans. ---> d75_source_ch0_tvflgRR.jpg; LL.jpg ----------------------------------------------------------------- ^ 23b. IMAGR executed on 20May10 default IMAGR sources 'SEXTANSA','' $ the galaxy docalib 1; gainuse 3 $ apply latest calibration flagver 1 $ apply latest flags -- set this to the $ highest-numbered FG table outname 'junk' $ some obviously cruddy name $ cellsize 1 $ for B configuration $ cellsize 3.5 $ for C configuration cellsize 10 $ for D configuration $ imsize 1024 $ for B configuration imsize 512 $ for C and D configurations niter 1000 nbox 0 minpa 121 uvwtfn 'na'; robust 0.5 dotv 1 getn 6 $*.NEWCH0.xx $ whichever file has the source you're imaging --> shouldn't see obvious calibration errors or striping. Note that this "channel 0" includes HI emission, so you may see some odd effects (e.g., very woofly noise in B configuration) -- don't panic! Note: If uvwtfn is set to 'NA' it will override any value given to robust. ### If you find a strong continuum source rippling your map even in a 512x512 imsize D array configuration channel zero image than refer to Elias and Dana for further steps. >> JUNK.ICLN;1 : Well, I have ripples of course; not as bad as I thought it'd be, actually. There IS a continuum source at RA 10 07 58.573 DEC -04 25 19.96 Galaxy is at RA 10 08 29.331 DEC -04 26 40.00; about 1.5' away >> for a test, I'm rerunning IMAGR with UVRANGE set to uvrang 0.7 0 $--> JUNK;2 >> big fuzzy stuff is gone; revealing underlying vertical corrugations much more clearly. Huh. >> IMAGR again; uvrang 1.0 0 $--> JUNK;3 >> much better. It's hard to tell how much galaxy HI I'm losing though. :( >> After more consultation with Elias, my plan is to just set a UVRANGE when looking at the data for purposes for checking the calibration. When it comes time (imaging recipe) for using the source data, Elias recommends "DBCON, UVLSF, and IMAGR and see what the damage is, and check on a line free channel what the shortest baseline is that you can still tolerate. Often UVLSF does the trick. You can then do the UVCOP trick, run WIPER (and if required CLIP), and then go on with the recipe as usual." The UVCOP trick is to use UVCOP to copy over everything except the contaminated short baselines. >> Apparently stopped here in late May 2010; picking it up again June >> 10, 2011 ^24. TASAV -> CH0SAV.1,2,3 executed on 10June11 default TASAV outna 'D70_D-MidTa outcla 'ch0sav' outdi 1 $ Ideally set this to a different disk from indisk, $ in case of disk crashes getn 6 $ *.NEWCH0 $ loop over NEWCH0 files (= FREQIDs) outse inseq ^25. TABED SN, FG tables to LINCOP executed on 10Jun11 ***Use TABED to ensure FREQID=-1 for all tables (paranoia is your friend...) ^ 25a. NEWCH0.xx FG/yy -> LINCOP FG/2 default TABED opty 'repl' inext 'fg' aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...which we change to FREQID= -1 inver 1 $ if single FREQID $ inver 3 $ if multiple FREQIDs: set this to max. flag table number outver 2 getn 6 $ *.NEWCH0.1 $ if single FREQID $ getn *.NEWCH0.3 $ if multiple FREQIDs: set this to file you flagged $ on most recently (usually the file with the $ galaxy in it) getona 4 $ *.LINCOP --> LINCOP FG/2 ^ 25b. NEWCH0.xx SN/yy -> LINCOP SN/1 default TABED opty 'repl' inext 'sn' inver 1 $ if single FREQID $ inver 4 $ if multiple FREQIDs outver 0 aparm 0 aparm(1) 6 $ Changing column 3 = FREQID keyval= -1,0 $ ...which we change to FREQID= -1 getn 6 $ *.NEWCH0 $ if multiple FREQIDs: all should have same merged SN $ table so you can use whichever NEWCH0 file you want getona 4 $ *.LINCOP --> LINCOP SN/1 ^26. CLCAL LINCOP SN/1 --> CL/3 executed on 10Jun11 ***We do CLCAL directly on LINCOP rather than copying, to avoid (even more) confusion in the multiple-FREQID case. ***Note that there is no need to work around any phase jumps, since the intervening data are flagged (see step 17 above [UVFLG]). ^ 26a. CLCAL for the primary calibrators -> CL/3 default CLCAL sour= '1328+307', '' $ Primary (flux) calibrators calsour= sour interpol 'SELF' gainver 2 ; gainuse 3 refant 18 $ Change this to your refant dobtween -1 $ Don't interpolate entries for different sources snver 1 freqid= 1 $ You must run CLCAL once for each FREQID with $ the relevant calibators present getn 4 $ *.LINCOP ^ 26b. CLCAL for the phase calibrator and galaxy -> CL/3 default CLCAL sour= '0941-080','SEXTANSA','' $ Secondary (phase) calibrator + galaxy calsour= '0941-080','' $ Secondary (phase) calibrator interpol 'SIMP' gainver 2 ; gainuse 3 refant 18 $ Change this to your refant dobtween -1 $ Don't interpolate entries for different sources cutoff 120 $ Don't extrapolate/interpolate beyond 120 minutes snver 1 ***If your data set used +/- frequency switching for the phase calibrator (our observations did not, but some archival data may), you should use BPARM with SAMPTYPE='BOX' to select a smoothing time which covers both frequency settings. LISTR/SCAN on LINCOP will help you choose this; normally something like 12 minutes should be OK. x bparm 12/60 ; samptype='BOX' freqid= 1 $ You must run CLCAL once for each FREQID with $ the phase calibrator or galaxy present getn 4 $ *.LINCOP ^27. Calibration/flagging checks: calibrators ^ 27a. WIPER executed on DDmonYY ***Check the amp & phase vs. uv-distance for all calibrators. Amplitude should match the results of SETJY/GETJY, and phase should be zero, apart from known structure (reflected in source model for gain calibrators and uvrange for phase calibrators). If there are obvious, unexpected outliers, go back and flag those (and possibly re-run various tasks...). default WIPER calcode '*' source '1328+307','' imsize 512, 512 docal 1 ; gainuse 3 doband 1; bpver 1 $ for single-FREQID data sets $ doband 3; bpver 4 $ for multiple-FREQID data sets freqid 1 $ set this to match the calibrator flagver 2 $ should be the latest FG table smooth 7, 117 $ boxcar average over all channels -- use $ smooth 7, 235 if you started with 255 channels dotv 1 do3col 1 bparm 0 getn 4 $ *.LINCOP bparm(2) 1 $ amp. vs. uv-distance >> Looks fine; amp ~ 15Jy +/- 3 Jy scatter galaxy> WIPER1: PLOTUV: X axis in Wavlngth 0.000E+00 4.510E+03 galaxy> WIPER1: PLOTUV: Y axis in Janskys 1.149E+01 1.801E+01 >> screen grab: -----> d75_d_1328_ampwiper_27a.jpg bparm(2) 2 $ phase vs. uv-distance galaxy> WIPER1: PLOTUV: X axis in Wavlngth 0.000E+00 4.510E+03 galaxy> WIPER1: PLOTUV: Y axis in Degrees -2.561E+01 2.350E+01 >> Also ok; phase avg ~0; scatter +/- 20 deg >> screen grab: -----> d75_d_1328_phswiper_27a.jpg >> do the phase cal: source '0941-080' '' bparm(2) 1 $ amp. vs. uv-distance galaxy> WIPER1: PLOTUV: X axis in Wavlngth 0.000E+00 4.994E+03 galaxy> WIPER1: PLOTUV: Y axis in Janskys 0.000E+00 1.284E+01 >> short bl (< 0.7 kl) show solar interference; quite bad. Rest is ok: >> avg ~ 2.5 Jy; scatter +/- 2.5 Jy >> screen grab: -----> d75_d_0941_ampwiper_27a.jpg bparm(2) 2 $ phase vs. uv-distance >> ignoring short bl; rest ok: avg ~0; scatter +/- 50 deg >> screen grab: -----> d75_d_0941_phswiper_27a.jpg ###It shows a plot similar to the UVPLT output just quicker.It is also useful for identifying which antennas or baselines have calibration problems. ^ 27b. POSSM executed on 10June11 ***Check vector average of all data for each calibrator. Amplitude should match the results of SETJY/GETJY; phase should be flat, and consistent with zero (corresponding to a point source at the origin)...apart from known source structure and possibly HI absorption. default POSSM calcode '*' docal 1 ; gainuse 3 doband 1; bpver 1 $ for single-FREQID data sets $ doband 3; bpver 4 $ for multiple-FREQID data sets freqid 1 $ set this to match the calibrator flagver 2 $ should be the latest FG table aparm 0 $ Plot data solint 0 $ average all time nplots 0 $ average all baselines aparm 0 aparm(1) 1 $ vector average source='0941-080','' $ Secondary (phase) calibrator uvrange= 0.7,0 $ should be set to eliminate known source structure, $ as in CALIB dotv -1 $ PLVER 11, 12 getn 4 $ *.LINCOP >> write to file: default LWPLA getn 4 $ *.LINCOP plver 11; invers 12 outfile 'D75D:d75_d_0941_possm_27b.ps -----> d75_d_0941_possm_27b.ps >> Looks good; amps flat with low scatter; same for phases. ^ 27c. IMAGR executed on 10Jun11 [if desired -- this is not really necessary] default IMAGR docal 1 ; gainuse 3 source '0941-080' '' doband 1; bpver 1 $ for single-FREQID data sets $ doband 3; bpver 4 $ for multiple-FREQID data sets freqid 1 $ set this to match the calibrator flagver 2 $ should be the latest FG table outname 'junkcal' $ some obviously cruddy name uvrange 0.7, 0 $ to avoid solar interference $ cellsize 1 $ for B configuration $ cellsize 3.5 $ for C configuration cellsize 10 $ for D configuration $ imsize 1024 $ for B array imsize 512 $ for C and D array niter 200 $ reasonable for a point source nbox 1 ; $ clbox -1,5,512,513 $ calibrator should be in the center minpa 121 uvwtfn 'na'; $ robust 0.5 dotv -1 $ so you can go eat lunch getn 4 $ *.LINCOP galaxy> IMAGR1: Field 1 final Clean flux 2.826 Jy >> cf. 271 Jy from GETJY >> tvmovie: looks good. ***You shouldn't see obvious calibration errors or striping. CLEANed flux density should roughly match SETJY/GETJY. If you _do_ have Evil Stuff, UVLSF will likely take care of it, so don't get too worked up. Note: If uvwtfn is set to 'NA' it will override any value given to robust. ^ 28. Calibration/flagging checks: sources >> Do NOT do WIPER/CLIP on this source data because of the solar interference. I suppose one could run WIPER with uvrange 1.0,0 or so to look for nasty stuff at longer baselines (i.e. random hot pixels not due to solar interference). >> will do the WIPER to look for problems on longer baselines; ignoring >> solar interference. I hope. 28a.1 WIPER executed on 10June11 ***Check the amp vs. uv-distance for the galaxy. If there are obvious outliers which are not expected due to source structure or RFI (i.e., not mostly on short spacings), go back and flag those. Note any obvious short-spacing horrors, which may be due to solar or terrestrial RFI. default WIPER imsize 512, 512 docal 1 ; gainuse 3 doband 1; bpver 1 $ for single-FREQID data sets $ doband 3; bpver 4 $ for multiple-FREQID data sets freqid 1 $ set this to match the galaxy flagver 2 $ should be the latest FG table smooth 0 $do not smooth: smoothing will decrease your noise and $consequently show you a lower flux level than the level $that your data has in fact dotv 1 do3col 1 sources 'SEXTANSA','' bparm 0 getn 4 $ *.LINCOP bparm(2) 1 $ amp. vs. uv-distance galaxy> WIPER1: PLOTUV: X axis in Wavlngth 0.000E+00 4.994E+03 galaxy> WIPER1: PLOTUV: Y axis in Janskys 0.000E+00 7.801E+01 >> Oh ho! Bad baseline: 8-10; points > 40 Jy. Spike at ~.8 kl is from >> 4-5; another smaller spike at ~8.5 kl is from 1-5; an even smaller >> spike at ~.6kl is from 21-22. >> screen grab: -----> d75_d_galaxywiper_28a.jpg >> no point looking at phases for sources x bparm(2) 2 $ phase vs. uv-distance >> SPFLG to find bad channel: default SPFLG source 'sextansa' '' antenna 8 0; baseline 10 0 docal 1; gainuse 3 doband 1; bpver 1 outfgver 2 dparm(6) 60 getn 4 $ .LINCOP >> RR stokes: >> galaxy> SPFLG1: Now load the TV memory from 6.2937E-03 TO 7.6110E+01 >> bad time in ALL channels: 0/21:10:30: FLAG A TIME >> galaxy> SPFLG1: Now load the TV memory from 6.2937E-03 TO 2.9338E+00 >> much better now... >> LL Stokes: no problem there. No flagging needed. >> now look at antenna 5 with all baselines...? antenna 5; baseline 0 >> stokes RR and LL: Some baselines quite bad; mostly in the first >> scan. Eventually loaded all antennas with all baselines and poked >> around; what I'm seeing is probably solar interference after all -- >> it seems to be from the short baselines. An example is here: >> -----> d75_d_baseline4-5_spflg.jpg >> So will just leave alone and hope UVLSF takes care of most of it. x Use bparm(3)=1;bparm(6)=0;bparm(7)=20 if you want to force a range to the Y axis of the WIPER plot. ###It shows a plot similar to the UVPLT output just quicker.It is also ###useful for identifying which antennas or baselines have calibration ###problems.If you do find things you want to flag, UVFLG is highly ###recommended. #####CAREFUL with smoothing when doing WIPER on the source, it should ###NOT be done at this step.Smoothing will decrease your noise and ###consequently show you a lower flux level than the level that your ###data has in fact. #######It is very probable that when doing a WIPER on all the line data, ###some channels with junk will ruin your WIPER display and you will not ###be able to really make out what the clipping level should be. If the ###junk consists of random hot pixels then just run another WIPER in ###which you force the y axis to a 0-20 range ###(bparm(3)=1;bparm(6)=0;bparm(7)=20). If the junk comes in a ###structured manner than further investigations are needed to identify ###which baselines, in which channels might be missbehaving. Use WIPER ###only to identify the problematic baselines and channels, and use ###TVFLG or UVFLG to remove them form the data. ^ 28a.2 Up to which level most of the values(leaving aside the very hot pixels) comfortably fit in? >> Rerun WIPER after UVLSF to see if further clipping is needed. I'd >> guess 5-6 Jy would be ok. ###This is the value that you will be using in CLIP when combining your data!!! >> ooh, this imagr is going to be ugly... ^ 28b. IMAGR executed on 10June11 default IMAGR calcode '-cal' docal 1 ; gainuse 3 doband 1; bpver 1 $ for single-FREQID data sets $ doband 3; bpver 4 $ for multiple-FREQID data sets freqid 1 $ set this to match the calibrator flagver 2 $ should be the latest FG table outname 'junkgalcube' $ some obviously cruddy name $ cellsize 1 $ for B configuration $ cellsize 3.5 $ for C configuration cellsize 10 $ for D configuration $ imsize 1024 $ for B configuration $ imsize 512 $ for C configuration imsize 256 $ for D configuration niter 1000 $ a light clean, just to see what we've got. niter 0 $ would be ok too, esp. if you IMLIN afterwards nbox 0 ; clbox 0 minpa 121 uvwtfn 'NA'; $ robust 0.5 dotv -1 $ so you can go eat lunch getn 4 $ *.LINCOP ***You shouldn't see obvious calibration errors or striping. You should however see of order 100 mJy of continuum sources in the field, as well as some indication of your galaxy. The latter may be quite confusing for B configuration, which resolves out most of the structure. Don't fret until you've combined all the array configurations. Note: If uvwtfn is set to 'NA' it will override any value given to robust. ### If you find a strong continuum source rippling your map even after trying a 512x512 imsize D array configuration cube than refer to Elias and Dana for further steps. >> Not as bad looking as I thought it would be, given the short bl >> nastiness. Screen shot of some of the central channels: >> -----> d75_d_dirtygalaxytvmovie.jpg 28c. Noise Estimations: calculated on 10June11 ##The easiest way to calculate the expected sensitivity is to say 7 S(mJy) = ---------------------------- sqrt{ N (N-1) delta_nu t} where 7 is a constant that depends on the system temperature of the receivers(a quite conservative value) N = number of antennas in the array, delta_nu = channel resolution in MHz, and t = integration time in hours. You need to use for N the number of Antennas which have on average been giving good data during the run. The total time should be the actual time spent on source. No need to be super precise, of course. One simply wants to get a ballpark figure which is good to 10-20%. ###Note that for data which are Hanning smoothed (archive data) the channel spacing is equal to the resolution delta_nu. Without Hanning smoothing, the resolution is ~1.4 x delta_nu (note that after offline Hanning smoothing, if you preserve all channels, the resolution becomes 2 x delta_nu; it reverts t o a new "double the old delta_nu" if you delete every other channel). ####Finally, if you want to know the noise in a single visibility, use N=2 and t = 1/360, and probably multiply by sqrt{2} because a visibility is a single polarisation as well. N = 27 delta nu = 12.207e-3 MHz t = 1.47 hr The Expected noise level is: 1.97 mJy/B The rms Noise level in a line free channel is: 2.52 mJy/B >> channel 25: rms= 2.5157E-03 JY/BEAM ^29. TASAV -> EndTaB.LINSAV.1 executed on 10June11 default TASAV outna 'D75_D-EndTa outcla 'linsav' outdi 1 $ Ideally set this to a different disk from indisk, $ in case of disk crashes getn 4 $ *.LINCOP ^30. FITTP executed on 10June11 create:^ DDO75_D_UV_CALIB_NEWCH0.FITS $ one per FREQID ^ DDO75_D_UV_CALIB_LINCOP.FITS ^ DDO75_D-BeginTasav.FITS ^ DDO75_D-MidTasav.FITS $ one per FREQID ^ DDO75_D-EndTasav.FITS 31. Send to DEIDRE 10June11 See Little THINGS Web site for current instructions. Apart from the FITS data from step 29/FITTP, the following should be archived: * Observing log * This data reduction log * LISTR/SCAN output (if saved to a file) 31. Celebrate your victory with an appropriate beverage! ================================================================================ ================================================================================ Ater the data has been checked by an independent member of the team and changes/corrections have been suggested the log should continue here with the steps that have been reiterated and the values used in the reiteration. If you need to recreate tables it is best at this stage to not delete the already existing ones but rather to give the tables higher version numbers.