NOTES: Ant 1, 11, 21 have no 2ndary observations- must be due to shadowing VERY little of first primary, but long obs of 2nd primary to make up for it The galaxy is there, but not really rotating (channels ~84-132) and there are a few continuum sources. LITTLE THINGS AIPS Reduction of Haro29, D2 (BQ) config.: VLA Obs. of 29jul08 ===================================================================== calibration recipe v. 2.0: mrupen 10oct08 calibration recipe v. 2.1: mrupen 13oct08 calibration recipe v. 2.1.update: Dana Ficut Vicas 29Oct08 (new adverbs in Aips) calibration recipe v. 2.2: Dana Ficut Vicas 11Dec08(tiny bits) calibration recipe v. 2.3: Dana Ficut Vicas 11 Feb 09(UVCOP ambiguities) calibration recipe v. 2.4: Dana Ficut Vicas 3 Mar 09(team raised issues) Latest update: 3rd March 2009 (Actually, this is a tiny bit different- all parameters are ordered as in AIPS) Data reduced by Kim Herrmann, Lowell 18jun09-18jun09 Suggestion: STARTING with D ARRAY and then working through C array and B array is recommended. D array data will allow you to have a look at the whole field (the strong continuum sources that might give problems will be obvious here), is more stable and will give you the best feel for the data. The recipe lists the B-array reduction, but obviously the same steps apply to all configurations. ^0. Basic stuff D2 configuration (BQ) From observing log (available incomplete online at http://www.lowell.edu/users/dah/littleteam/haro29/vla/obs/logs_AH927_BQ.html): Observing: 29Jul08 03:42:59-04:42:19 (28Jun08 20:42:59-21:42:19 local time) * Wind/API rms phase/clouds: 29Jul 02:42:40 NW at 3.5 m/s 6.5 API Sky cover 30%. Cumuliform clouds. * ant. 2, 3, 28 (do not have good baseline positions because recently moved) * EVLA antennas: 1, 2, 4, 5, 11, 13, 14, 17, 18, 19, 21, 23, 24, 25, 26 (15 antennas) * ant. 3 LOST (EVLA: Antenna is undergoing EVLA testing.) (whole time) * ant. 16 LOST (EVLA: Antenna is being used for a VLBA single dish observation.) ^1. FILLM executed on 18jun09 ^a. Request archive data: requested AH927_BQ_1 and saved temporarily as /Users/herrmann/Desktop/AH927_D_BQ_1 ^b. FILLM -> Haro29-D2.CH 0.1, Haro29-D2.LINE.1 (1 & 2) default FILLM datain '/Users/herrmann/Desktop/AH927_D_BQ_ nfiles 0 $ normally don't skip any files band 'L' qual -1 $ restricts FILLM to the galaxy+calibrators of interest vlaobs 'AH927' refdate '20080729' $ normally don't need this timerang 0 03 42 40 0 05 00 00 $ Other scans before & after Haro29 with unknown qual #'s outna 'Haro29-D2 outseq 0; outdisk 1 douvcomp=-1 $ allow channel/IF-dependent weights doconcat=-1 $ Change this to DOCONCAT=1 to add data to an existing file ncount 1 $ read one file doweight 10 $ use memo 108 weights (i.e., put weights in 1/Jy^2) cparm 0 cparm(4)=25.1 $ one needs to explicitly flag shadowed antennas $ since the ModComps were retired on 27 June 2007 $ this requires FILLM in 31DEC08 after 18Nov08 MNJ cparm(7)= 0 $ assigns new FREQID if frequency changes by more than $ the max. Doppler shift between sources 180 degrees $ apart. Setting this to -1 forces all data to have same FREQID. bparm= -1,-1 $ avoid opacity & gain corrections doall -1 $ DOESN'T SEEM TO BE THERE ***N.B. FILLM's channel 0 will ONLY be used for initial flagging. We're quite paranoid here. tortue> FILLM1: ****************************************************** tortue> FILLM1: ** Times written by FILLM are now centered in ** tortue> FILLM1: ** the integration, before they were at the end ** tortue> FILLM1: ****************************************************** tortue> FILLM1: Shadow flag limit = 2.510E+01 meters. tortue> FILLM1: No opacity correction in CL table. tortue> FILLM1: No gain curve correction in CL table. tortue> FILLM1: Opening /Users/herrmann/Desktop/AH927_D_BQ_1 tortue> FILLM1: Skipping data at 0/02:00:00 tortue> FILLM1: tape file # 1, start date/time = 20080729/02:43:30 tortue> FILLM1: Skipping data at 0/03:00:00 tortue> FILLM1: tortue> FILLM1: *** ATTENTION - default: loading subarray 1 *** tortue> FILLM1: tortue> FILLM1: MCINI: Processing Correlator Code '2AC ' with 25 antennas. tortue> FILLM1: MCINI - Mode 2AC compatible tortue> FILLM1: Program = AH927 ; Tape revision number = 33. tortue> FILLM1: Create Haro29-D2 .CH 0 . 1 (UV) on disk 1 cno 1 tortue> FILLM1: Ref. date = 20080729 A-C = 1.419032 B-D = 1.419032 GHz tortue> FILLM1: Create Haro29-D2 .LINE . 1 (UV) on disk 1 cno 2 tortue> FILLM1: Ref. date = 20080729 A-C = 1.419032 B-D = 1.419032 GHz tortue> FILLM1: FLMFQ: FQ entry tolerance = 1.609D+02 tortue> FILLM1: Found 1331+305 : 4 1.562 MHz at IAT 0/ 03:42:55.0 tortue> FILLM1: MCINI: Processing Correlator Code '2AC ' with 25 antennas. tortue> FILLM1: MCINI - Mode 2AC compatible tortue> FILLM1: Ref. date = 20080729 A-C = 1.419032 B-D = 1.419032 GHz tortue> FILLM1: Appending new data to: Haro29-D2 .CH 0 . 1 disk 1 tortue> FILLM1: Ref. date = 20080729 A-C = 1.419032 B-D = 1.419032 GHz tortue> FILLM1: Appending new data to: Haro29-D2 .LINE . 1 disk 1 tortue> FILLM1: Found 1331+305 : 4 1.562 MHz at IAT 0/ 03:43:05.0 tortue> FILLM1: Found 1331+305 : 4 1.562 MHz at IAT 0/ 03:47:45.0 tortue> FILLM1: Found 1227+365 : 4 1.562 MHz at IAT 0/ 03:53:15.0 tortue> FILLM1: Found HARO29 : 4 1.562 MHz at IAT 0/ 03:56:55.0 tortue> FILLM1: Found 1227+365 : 4 1.562 MHz at IAT 0/ 04:11:55.0 tortue> FILLM1: Found HARO29 : 4 1.562 MHz at IAT 0/ 04:15:55.0 tortue> FILLM1: Found 1227+365 : 4 1.562 MHz at IAT 0/ 04:30:55.0 tortue> FILLM1: Found 1331+305 : 4 1.562 MHz at IAT 0/ 04:34:55.0 tortue> FILLM1: Dropped 4807 shadowed vis at limit 2.5100E+01 meter tortue> FILLM1: Read 79100 visibilities from 1 files tortue> FILLM1: Appears to have ended successfully ^2. TASAV -> LINSAV.1 executed on 18jun09 ***We TASAV right away, because VLANT changes the AN table. Did I mention we're paranoid? default TASAV outna 'Haro29D2BgTb outcla 'LINSAV' outdi 2 $ Ideally set this to a different disk from indisk, $ in case of disk crashes getn 2 $ *.LINE ^3. UVCOP -> LINCOP.1 executed on 18jun09 ***Discard the first and last channels: 1st and last 10 channels if 127 channels total 1st and last 20 channels if 255 channels total ***We discard these Evil Channels because (1) they're pretty much useless; (2) they seem to confuse BPASS (which takes the solution from channel N as the initial guess for channel N+1); (3) their noise characteristics are quite different from the rest of the channels, which can be confusing e.g. in clipping and imaging. default UVCOP outcla 'LINCOP' bchan 21; echan 235 $ Use bchan 21; echan 235 for 255 channels $ Use bchan 11; echan 117 for 127 channels uvcopprm 0 uvcopprm(4) 1 $ report progress getn 2 $ *.LINE ***From now on we operate on LINCOP data (14) unless otherwise specified. ^4. LISTR/SCAN --> Haro29-D2.listr ***We do this before VLANT because we need to know FREQIDs for VLANT default LISTR optype 'SCAN' docrt -1 outpr '/Users/herrmann/Desktop/Haro29-D2.listr getn 14 $ *.LINCOP --> *.listr tortue LISTR(31DEC08) 4 18-JUN-2009 13:26:00 Page 1 File = Haro29-D2 .LINCOP. 1 Vol = 1 Userid = 4 Freq = 1.419032350 GHz Ncor = 2 No. vis = 79100 Scan summary listing Scan Source Qual Calcode Sub Timerange FrqID START VIS END VIS 1 1331+305 : 0004 A 1 0/03:43:25 - 0/03:52:25 1 1 2184 2 1227+365 : 0004 A 1 0/03:53:15 - 0/03:56:15 1 2185 6573 3 HARO29 : 0004 1 0/03:56:55 - 0/04:11:15 1 6574 31834 4 1227+365 : 0004 A 1 0/04:11:55 - 0/04:15:15 1 31835 36664 5 HARO29 : 0004 1 0/04:15:55 - 0/04:30:15 1 36665 62189 6 1227+365 : 0004 A 1 0/04:30:55 - 0/04:34:15 1 62190 67040 7 1331+305 : 0004 A 1 0/04:34:55 - 0/04:42:15 1 67041 79100 Source summary Velocity type = ' ' Definition = ' ' ID Source Qual Calcode RA(2000.0) Dec(2000.0) IFlux QFlux UFlux VFlux No. vis 1 1331+305 : 0004 A 13:31:08.2879 30:30:32.958 0.000 0.000 0.000 0.000 14244 2 1227+365 : 0004 A 12:27:58.7254 36:35:11.827 0.000 0.000 0.000 0.000 14070 3 HARO29 : 0004 12:26:16.0000 48:29:37.000 0.000 0.000 0.000 0.000 50786 ID Source Freq(GHz) Velocity(Km/s) Rest freq (GHz) 1 All Sources 1.4190 0.0000 0.0000 Frequency Table summary FQID IF# Freq(GHz) BW(kHz) Ch.Sep(kHz) Sideband 1 1 1.41903235 1312.2560 6.1035 1 Primary: 9:10, 7:30-> 16:40 Secondary: 3:10, 3:30, 3:30 -> 10:10 Galaxy: 14:30, 14:30 -> 29:00 total However, subtract 10s out of 0 scans-> so 29:00 total (0.483 hrs = 00:29:00) ^5. VLANT -> AN/1, CL/2 executed on 18jun09 ***Note that VLANT can be run only for data observed from 1992 onwards. Data earlier than 1991 produce the following error message: VLANT1: Task VLANT (release of 31DEC07) begins VLANT1: ANT DATA UNAVAILABLE FOR YEAR 1991 DATA START WITH 1992 VLANT1: Purports to die of UNNATURAL causes For earlier data we skip baseline corrections entirely, and hope for the best. If there are clear and systematic phase gradients with time, consult the baseline corrections at http://www.vla.nrao.edu/astro/archive/baselines/ and apply corrections via CLCOR (which is basically what VLANT does). ***Note that if you get an error like the following: /tmp/baselines.vlais09 copied from the VLA web site, ZABORS: signal 11 received, ABORT! you can probably solve this by going to http://www.vla.nrao.edu/astro/archive/baselines/ and copying the list of baseline corrections from the current year (say, 2009) into aips/TEXT/STARS/VLA.ant.2009 (Make sure there are no empty lines at the start of the file) ***10oct08: Currently VLANT works on only one FREQID at a time. We therefore have to run VLANT multiple times for data with multiple FREQIDs. Unfortunately VLANT (1) produces a new CL table every time, and (2) updates the AN table positions every time as well. : CL tables: I'd like to maintain the convention that CL/1 is the original CL table and CL/2 has all the corrections that should have been applied on-line but weren't -- mainly, antenna position corrections. For multiple FREQIDs therefore this recipe calls for deleting the intermediate CL tables created by VLANT, using the rather clumsy mechanism of TASAVing to a temporary file, deleting the original CL tables, and copying the latest one back from the TASAV'd data set. Blah. : AN table: For now, this recipe resets to the original AN table just before running VLANT the last time. This means that only one run of VLANT updates the AN entries, leading to a correct AN table as needed for (e.g.) UVFIX. I've e-mailed DAIP to see about fixing all this, by allowing FREQID= -1 to mean "calculate corrections for all FREQIDs" (currently FREQID= -1 is reset to FREQID= 1). We'll see what Eric says. #####VLANT no longer has freqid as a parameter. ^5a. default VLANT getn 14 $ *.LINCOP tortue> VLANT1: WARNING: 2 ANTENNAS MAY STILL GET MORE CORRECTION tortue> VLANT1: Copied CL file from vol/cno/vers 1 14 1 to 1 14 2 tortue> VLANT1: CL version input 1 output 2 tortue> VLANT1: VLANT STNID( 2) = 'E5 ' tortue> VLANT1: VLANT XCOR( 2) = -0.0048 tortue> VLANT1: VLANT YCOR( 2) = 0.0046 tortue> VLANT1: VLANT ZCOR( 2) = 0.0087 tortue> VLANT1: VLANT STNID(10) = 'E8 ' tortue> VLANT1: VLANT XCOR(10) = 0.0013 tortue> VLANT1: VLANT YCOR(10) = 0.0000 tortue> VLANT1: VLANT ZCOR(10) = 0.0004 tortue> VLANT1: Appears to have ended successfully %%% Probably the warning is about antennas 3, 16, 28, or 29 which aren't being used (from step 6 PRTAN) x5b. If VLANT does not create a new CL table (no antennas moved), or the data were taken before 1992: default TACOP getn 14 $ *.LINCOP getona 14 $ *.LINCOP inext 'CL' ; inver 1 ; ncount 1 ; outver 2 ***The goal here is to keep the recipe uniform for all data. ^6. PRTAN AN/1 default PRTAN docrt 132 getn 14 $ *.LINCOP Location Of VLA Antennas N9 ( 7) N8 ( 9) N7 (13)* N6 (26)* N5 (27) N4 (12) N3 (18)* N2 (25)* N1 (20) *( 1) W1 E1 (15) (22) W2 E2 (21)* *(24) W3 E3 (11)* *(19) W4 E4 ( 5)* *(17) W5 E5 ( 2)* ( 8) W7 E7 (14)* ( 6) W8 E8 (10) *( 4) W9 E9 (23)* VLA:_OUT ( 3) VLA:_OUT (16) VLA:_OUT (28) VPT:_OUT (29) * => EVLA ANTENNA ***To choose the reference antenna the following algorithm should be followed: 1. should be present throughout the run 2. should be on an "inner" pad, but NOT N1/E1/W1 (to avoid shadowing) 3. NOT on the master pad (since those are always weird) 4. NOT an EVLA antenna (since those are often weird) 5. try to avoid the north arm in the smaller configurations (to avoid shadowing) 6. NOT listed in any interesting way in the log file (to avoid problems with the reference antenna) 7. preferably consistent with other recent runs 8. should be a fairly stable antenna (can't tell until TVFLG/CALIB of course...) ===> Refant: 22 $ W2 ^7. Calibrators ***Check out the calibrators in the on-line calibrator manual: http://www.vla.nrao.edu/astro/calib/manual/index.shtml ***Max baseline at 21 cm in B array is 54.3 klambda C array is 16.2 klambda D array is 4.9 klambda primary (flux/bandpass) calibrators: 0137+331= 3C48 0542+498= 3D247 1331+305= 3C286 $ This one once @ beginning & at end ***You can ignore the uv-ranges for these, since there are now models for the most important ones. %%%HOWEVER, in UVPLT the amplitude for 0542+498 will drop off (as in CnB) because UVmax is 50 kL %%%Same for 0137+331, because UVmax is 40 kL 1331+305 J2000 A 13h31m08.287984s 30d30'32.958850" Aug01 3C286 1328+307 D2950 A 13h28m49.657700s 30d45'58.640000" ----------------------------------------------------- BAND A B C D FLUX(Jy) UVMIN(kL) UVMAX(kL) ===================================================== 90cm P S S S S 26.00 visplot 20cm L S S P P 15.00 visplot 6cm C S S S P 7.47 3.7cm X S P P P 5.23 400 visplot 2cm U S S S S 3.40 visplot 1.3cm K X S S P 2.59 visplot 0.7cm Q X S P P 1.45 300 visplot secondary (gain) calibrator: 1227+365 1227+365 J2000 A 12h27m58.725446s 36d35'11.827350" Aug01 1225+368 D2950 A 12h25m30.766000s 36d51'46.915000" ----------------------------------------------------- BAND A B C D FLUX(Jy) UVMIN(kL) UVMAX(kL) ===================================================== 20cm L P P P P 2.10 6cm C P P P P 0.80 3.7cm X S S S S 0.38 0.7cm Q X X X X 0.04 ===> secondary cal --- No UVMax restriction %%% Don't need to worry about restrictions because D array max is 4.9 kL ^7b. SETJY -> SU/1 executed on 18jun09 ***Set aparm(2) to correspond to date of observation. If date <1990 aparm(2)=3 If 19921998 aparm(2)=0 ***We need to enter a flux density for each primary (flux) calibrator. If we have only one FREQID, this is easy: default SETJY sources '1331+305','' $ primary (flux) calibrator(s) '0542+498','0137+331', optype 'CALC' freqid = 1 $ First FREQID aparm 0,0 $ data taken after 1998 (2008) getn 14 $ *.LINCOP ; --> / Flux calculated using known spectrum tortue> SETJY1: / Flux calculated using known spectrum tortue> SETJY1: BIF = 1 EIF = 1 /Range of IFs tortue> SETJY1: '1331+305 ' IF = 1 FLUX =14.7330 (Jy calcd) tortue> SETJY1: / Using (1999.2) VLA or Reynolds (1934-638) coefficients ***If we have more than one FREQID, we assume that the frequency offsets used are small, so that the flux densities of the flux calibrators are nearly the same for each FREQID. Typical frequency offsets are of order the bandwidth, +/-3 MHz; at 1420 MHz, for a worst-case spectral index of -1, this leads to an error of 2*3 MHz/1420 MHz= 0.4% -- not worth worrying about. So, we use any FREQID which covers all primary flux calibrators. If flux calibrator A is observed only with FREQID 1, while flux calibrator B is observed only with FREQID 2, we have to run SETJY twice: default SETJY sources '0137+331','' $ primary (flux) calibrator A optype 'CALC'; freqid=1 $ FREQID for A aparm 0,0 $ data taken after 1998 getn 14 $ *.LINCOP ; default SETJY sources '0542+498','' $ primary (flux) calibrator B optype 'CALC'; freqid=2 $ FREQID for B aparm 0,0 $ data taken after 1998 getn 14 $ *.LINCOP ; ^7c. CALRD executed on 18jun09 ***Read in models of flux density calibrators: $ default CALRD $ object '3c48'; band 'L';$ 0137+331 $ default CALRD $ $ object '3c147'; band 'L';$ 0542+498 default CALRD $ 4 object '3c286'; band 'L';$ 1331+305 ***Note: These models are in J2000 coordinates. If your data are in D2950, change the model images to D2950 with EPOSWTCH. We will later use UVFIX to fix the uv-data. %%% Data is in J2000 coordinates, so no EPOSWTCH needed ^8. PRTUV (used to find integration times on calibrators & sources) default PRTUV cparm 0; cparm(9)=607 $ Pick a baseline -- here, baseline 6-7 (large and both are VLA) docrt 132 getn 14 $ *.LINCOP --> calib: 10s (both) source: 10s ^9. UVFLG -> FG/1 executed on 18jun09 ***We toss the EVLA-EVLA baselines, to avoid dealing with aliasing. There should still be plenty of VLA-EVLA baselines to allow antenna-based solutions for the EVLA... but keep an eye out for oddities (e.g., in BPASS)! default EVLA $ In case doinvers was set to 1 (true) getn 1 $ *.CH0 print EVLA %%% EVLA list is accurate default UVFLG getn 1 $ *.CH0 $ Note that we use FILLM's CH0 for initial flags -- we'll TACOP later. antenna=EVLA; baseline=EVLA; outfgver 1; opcode 'flag'; reason 'EVLA' ***NOTE!!! do NOT run UVFLG if EVLA=0 (try PRINT EVLA to check) -- otherwise you'll delete ALL of your data. ^10. TVFLG -> FG/1 executed on 18jun09 ***Again, we *only* use the original CH 0 from FILLM for initial flagging. Here we flag calibrators only, to remove any gross, obvious problems. ^ Check the first scan carefully -- often the system isn't "organized" on this first scan x On-line flagging isn't as reliable as in the old days, so there are plenty of hot pixels and hiccups. x We are NOT quacking, because (1) FILLM's NX table isn't correct; (2) QUACK flags data from the beginning-of-scan, whereas we want to flag data from antennas-on-source. default TVFLG docat -1 $ avoid saving temporary files dohist -1 $ avoid creation of history entries calcode '*' $ calibrators only freqid 1 $ must step through all FREQIDs! docalib -1 flagver 1; outfgver 1 $ keep all flags in FG/1 dparm 0 dparm(3) 1 $ show baselines twice, to treat all antennas identically -- $ this displays baseline 27-1 as well as 1-27 dparm(6)=10 $ time resolution: should be set to the calibrators' integration $ time, in seconds getn 1 $ *.CH0 $ note this is the ONLY time we use FILLM's Channel 0! ***Within TVFLG: ^ Set useful defaults: ^SMOOTH=1 to avoid averaging date before displays ^SCAN= 20 to use a long time for median filters (AMP/PH DIFF) xFLAG ALL CHANNELS ^FLAG STOKES FULL (usually -- sometimes you'll want NORR or NOLL) ***If individual Stokes need to be flagged, make sure you set the STOKES FLAG to correspond to the polarization that is displayed on the TV ^SWITCH SOURCE FLAG to ONE-SOURCE to avoid inadvertantly flagging galaxy (though sometimes you'll want to of course) ^ Be sure to inspect BOTH polarizations! ***We suggest the following steps: ^ Set the above defaults x Flag first integration in every scan (manual QUACK) -- this should be the first integration AFTER most antennas are on-source, which is why we can't use the usual QUACK. %%% In Amp: flagging straggler times (timeline), but not *every* single scan... ^ Inspect the following: ^AMPLITUDE to check for missing records or antennas %%% Ant 3, 16, 28, 29 out completely (as in PRTAN) !!! Ant 1, 11, 21 have no 2ndary observations- must be due to shadowing !!! VERY little of first primary, but long obs of 2nd primary to make up for it %%% EVLA-EVLA baselines flagged properly %%% RR: 0.098 - 4.245, LL: 0.106 - 4.618 No hot pixels? Trimmed 0 straggly timelines from Secs Trimmed 3 straggly timelinse from 1st Pri Final: RR: (0.098 - 4.245), LL: (0.106 - 4.579) ^AMP DIFF to check for variable gains %%% RR: 0.0 - 184.1 (a little nastiness, especially in Ants 8 & 11 2nd Pri) %%% LL: 0.0 - 186.7 (same as above) Clipping interactively RR then LL to 80 -> now 84.41 & 93.39 Final: RR: (0.00 - 84.41), LL: (0.00 - 93.39) ^PHS DIFF to check for variable atmosphere/gains %%% RR: 0.00 - 21.19 (highest values consistently in Secs) %%% LL: 0.00 - 19.91 (same as above) Final: RR: (0.00 - 21.19), LL: (0.00 - 19.91) %%% Saved as Figures/D2TVFLG_10_(AMP/AMPDIFF/PHSDIFF)_(RR/LL).tiff using Grab x If your data set is in D array (if your source is southern then also check for this problem in the C array) then keep an open eye for solar interference. In TVFLG, choose SORT BY BASELINE. If the short baselines are brighter than the long baselines, then you probably have solar interference. If solar interference is affecting your data, then in CALIB you should use a UVRANGE. %%% No signs of solar interference %%% 335 Flagging commands applied (mainly b/c of interactive clipping) ***Note: occasionally, flagging using UVFLG can be more straightforward (e.g., deleting an antenna). ^10b. TABED FG/1 executed on 18jun09 ***Here we TABED the CH 0 flags to LINCOP (with FREQID= -1). After this we're done with FILLM's channel 0. default TABED inext 'fg' inver 1; outver 1; bcount 1; ecount 0; $ until recently there was a parameter called ncount which is no longer there opty 'repl' aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...to FREQID= -1 getn 1 $ *.CH0 getona 14 $ *.LINCOP --> LINCOP FG/1 ^10c. (EXTRA) WIPER on Calibrators in LINCOP executed on 18jun09 (Just to see if there are any hot pixels) default WIPER $ sources '1331+305','' $ Primary $ sources '1227+365','' $ Secondary calcode '*' $ just the calibrators flagver 1 $ only FG table so far smooth 7, 215 $ boxcar average over all channels -- use $ smooth 7, 215 if you started with 255 channels & 7, 107 if you started with 127 channels bparm 0 $ amp. vs. uv-distance imsize 512, 512 getn 14 $ *.LINCOP %%% No hot columns or hot dots- max is ~7.6 Jy (D2WIPER_10c.tiff)-> Looks good ^11. BPASS ***This is a first-order BPASS leading to a new Channel 0. The goal is to avoid closure errors in Channel 0 calibration due to huge delays (phase slopes) on VLA-EVLA baselines. We divide each visibility by the vector average of the inner 3/4 of the band (i.e., an on-the-fly channel 0). Thus we remove source structure (tho' getting the weights wrong) and take care of the amplitude scale. ***There is a split here between the easy case (one FREQID for all sources) and the Galactic HI case (multiple FREQIDs, usually different for the bandpass calibrator and the galaxy (and phase calibrator)). Check LISTR/SCAN to see which you're doing. ^11a. BPASS: one FREQID for all sources -> BP/1 executed on 18jun09 default BPASS calsour '1331+305','' $ Select bandpass calibrators '0542+498','0137+331', qual -1 freqid 1 $ here we have only one FREQID docal 1; gainuse 2 $ apply VLANT changes. Probably irrelevant. flagver 1 $ apply initial flags solint 0; soltype '' $ one solution per scan refant 22 $ Change this to your refant smooth 0 $ no smoothing weightit 0 $ L1, L1R, etc. seem _less_ stable -- weird minamper 7; minphser 7 $ report closures > 7%/7d bpassprm 0 bpassprm(2) 1 $ some closure info is printed bpassprm(5) 0 $ derive "channel 0" on a record-by-record basis -- $ more biased than averaging first, but avoids $ some subtle pitfalls (see EXPLAIN file) bpassprm(6) 2 $ print avg. closure errors > 2% bpassprm(7) 2 $ print avg. closure errors > 2d ichansel 0 $ derive channel 0 from inner 3/4 of the band getn 14 $ *.LINCOP --> BP/1 x11b. BPASS: Multiple FREQIDs -> BP/1,2,3 not necessary ***The overall plan here is as follows (assuming FREQIDs 1 and 2 refer to the offset [bandpass calibrator] frequencies, and FREQID 3 refers to that of the galaxy & phase calibrator): (1) run BPASS once for FREQID=1 (-> BP/1) and once for FREQID=2 (-> BP/2). (2) check both BP tables with POSSM. They should look virtually identical. (3) If they do appear virtually identical, we concatenate them: (a) write out both tables [TBOUT], (b) concatenate the two [vi/emacs], (c) read them back in [TBIN] as BP/3, (4) If they do NOT appear identical, there is Something Wrong. The case we've come across involves the use of a front-end filter combined with the use of unexpected LOs (see Adrienne's note), so that one FREQID was observed through the edge of the filter. The resulting bandpasses show a strong slope in the amplitude gains for most VLA antennas. So far we've seen this only for central frequencies around 1423 MHz. In this case, simply copy the "good" BP table to BP/3 using TACOP. (5) modify BP/3 to refer to FREQID=3 [TABED]. ***It is a VERY good idea to use POSSM carefully throughout to be sure you're doing what you think you're doing. x11b1. BPASS FREQID 1 -> BP/1 not necessary default BPASS calsour '0137+331','0542+498','' $ Select bandpass calibrators docal 1 ; gainuse 2 $ apply VLANT changes. Probably irrelevant. flagver 1 $ apply initial flags refant 22 $ Change this to your refant Qual -1 solint 0 $ one solution per scan minamper 7 ; minphser 7 $ report closures > 7%/7d smooth 0 $ no smoothing soltype '' ; weightit 0 $ L1, L1R, etc. seem _less_ stable -- weird bpassprm 0 bpassprm(5) 0 $ derive "channel 0" on a record-by-record basis -- $ more biased than averaging first, but avoids $ some subtle pitfalls (see EXPLAIN file) bpassprm(2) 1 $ some closure info is printed bpassprm(6) 2 $ print avg. closure errors > 2% bpassprm(7) 2 $ print avg. closure errors > 2d ichansel 0 $ derive channel 0 from inner 3/4 of the band freqid 1 $ 1st offset FREQID getn 14 $ *.LINCOP --> BP/1 x11b2. BPASS FREQID 2 -> BP/2 not necessary ***Same as 11D2, now on FREQID 2 default BPASS calsour '0137+331','0542+498','' $ Select bandpass calibrators docal 1 ; gainuse 2 $ apply VLANT changes. Probably irrelevant. flagver 1 $ apply initial flags refant 22 $ Change this to your refant Qual -1 solint 0 $ one solution per scan minamper 7 ; minphser 7 $ report closures > 7%/7d smooth 0 $ no smoothing soltype '' ; weightit 0 $ L1, L1R, etc. seem _less_ stable -- weird bpassprm 0 bpassprm(5) 0 $ derive "channel 0" on a record-by-record basis -- $ more biased than averaging first, but avoids $ some subtle pitfalls (see EXPLAIN file) bpassprm(2) 1 $ some closure info is printed bpassprm(6) 2 $ print avg. closure errors > 2% bpassprm(7) 2 $ print avg. closure errors > 2d ichansel 0 $ derive channel 0 from inner 3/4 of the band freqid 2 $ 2nd offset FREQID getn 14 $ *.LINCOP --> BP/2 x11b3. POSSM to compare BP/1 and BP/2 default POSSM $ to check BPASS results flagver 1 aparm 0, 1, 0.7, 1.3, -180, 180, 0, 2, 0, 0 $ Plot BP, with amp/ph ranges source '0137+331','0542+498','1331+305','' $ POSSM doesn't work with $ source '' for some reason! solint -1 $ Separate plots for each scan nplots 9 $ 9 plots per page bparm 0 dotv 1 freqid 1; bpver 1 ; grch 1 freqid 2; bpver 2 ; grch 2 getn 14 $ *.LINCOP tvinit If worried: try POSSM on secondary calibrator, applying this BPASS (if BPASS stable, secondary should look flat) x11b4. *If* BP/1 and BP/2 appear virtually identical, concantenate them to form BP/3: x11b4a. Write the two tables to disk: default TBOUT docrt 500 getn 14 $ *.LINCOP inext 'bp' ; inver 1 outfile 'LT1:bp1.out inext 'bp' ; inver 2 outfile 'LT1:bp2.out x11b4b. Outside AIPS: concatenate the two tables cd $LT1 cat bp1.out bp2.out > bp3.out emacs bp3.out - change NAXIS2 to be equal to the *sum* of NAXIS2 in the two tables - delete from first ***END*PASS*** through ***BEGIN*PASS***, inclusive x11b4c. Read the new concatenated table in as BP/3: default TBIN infile 'LT1:bp3.out getona 14 $ *.LINCOP --> reads in BP/3 x11b5. *If* BP/1 and BP/2 are NOT virtually identical, pick the one that best matches the behavior of the phase calibrator (possibly by doing a quickie BPASS on the phase calibrator and comparing the results), and copy that BP table to BP/3: default TACOP inext 'bp' inver 2 $ Set this to the "good" BP table getn 14 $ *.LINCOP getona 14 $ *.LINCOP --> BP/3 ***You should IGNORE the "bad" FREQID for all subsequent processing. x11b6. TABED BP/3 to set FREQID=-1 (so we can use the same BP table for everyone) --> BP/4 default TABED opty 'repl' inext 'bp' inver 3 ; outver 4 aparm 0 aparm(1) 8 $ Changing column 8 = FREQID keyval= -1,0 $ ...which we change to FREQID= -1 getn 14 $ *.LINCOP --> BP/4 ^11c. POSSM to check BP table ^11c1. Plot BP table itself default POSSM $ to check BPASS results source '0137+331','0542+498','1331+305','' $ POSSM doesn't work with $ source '' for some reason! freqid 1; bpver 1 $ freqid 3; bpver 4 $ for multiple-FREQID data sets flagver 1 aparm 0, 1, 0.7, 1.3, -180, 180, 0, 2, 0, 0 $ Plot BP, with amp/ph ranges solint -1 $ Separate plots for each scan nplots 9 $ 9 plots per page bparm 0 dotv 1 getn 14 $ *.LINCOP tvinit dotv -1 & go %%% PL 1-12 for LINCOP are POSSM results, 9 per page There are two plots for each antenna (RR & LL) for the before & after primary calibrator In general, the VLA antennas have very flat bandpasses around 1.0 with near 0 phase !!! BPs from 2nd Pri less noisy in general than from 1st Pri (b/c longer exposure) default lwpla $ to print the plots to a ps file getn 14 $ *.LINCOP outfile '/Users/herrmann/Desktop/D2POSSMplots11c1.ps invers 0 for i = 1 to 12; plver = i; go; wait lwpla; end ^11c2. Apply BP table to 2ndary calibrator & plot individual baselines default POSSM source='1227+365','' $ Secondary (phase) calibrator freqid 1; bpver 1 $ for single-FREQID data sets $ freqid 3; bpver 4 $ for multiple-FREQID data sets docal 1; gainuse 2; flagver 1; doband 1 $ average all BP entries aparm 0 $ Plot data aparm(1) 1 $ vector average solint -1 $ Separate plots for each scan nplots 9 $ 9 plots per page dotv 1 getn 14 $ *.LINCOP tvinit %%% Everything looks normal (looked at one whole time) ^11c3. Apply BP table to 2ndary calibrator & vector average all data default POSSM source='1227+365','' $ Secondary (phase) calibrator freqid 1; bpver 1 $ for single-FREQID data sets $ freqid 3; bpver 4 $ for multiple-FREQID data sets docal 1; gainuse 2; flagver 1; doband 1 $ average all BP entries aparm 0 $ Plot data aparm(1) 1 $ vector average solint 0 $ average all time nplots 0 $ average all baselines dotv 1 getn 14 $ *.LINCOP tvinit ***This plot should be flat in both amp. and phase as a function of frequency, with no slope.. If some channels are off, note which ones those are and keep an eye out for interference or other bad data. If there are large errors consider running BPASS on the secondary calibrator and using that to correct the galaxy. Note that this will be somewhat painful since AIPS does not allow incremental BP tables -- unlike SN or CL tables. Sigh. 1(RR): Quite flat around 13 mJy for all channels 1(RR): phase is generally -35 +/- 15 degrees 1(LL): Relatively flat around 21 mJy for all channels 1(LL): phase is generally -55 +/- 10 degrees dotv -1; go tget lwpla for i = 13 to 14; plver = i; go; wait lwpla; end %%% (Added to D2POSSMplots11c1.ps) ^12. AVSPC -> NEWCH0.1 (2,3) executed on 18jun09 ***AVSPC must be run once for each FREQID (unfortunately FREQID=-1 purports to work, but creates an empty data set). This entails some nasty bookkeeping for data sets with multiple FREQIDs. Here I assume we have one or three FREQIDs. If BPASS checks above show that one FREQID is useless, you should ignore that one entirely in this and all subsequent processing. ***We will use these NEWCH0 files for (1) further flagging, and (2) time-dependent gain calibration. ^12a. FREQID=1 --> NEWCH0.1 default AVSPC getn 14 $ *.LINCOP freqid 1; bpver 1 $ for single-FREQID data sets $ freqid 1; bpver 4 $ for multiple-FREQID data sets docalib -1; gainuse 0; flagver -1 $ do NOT apply flags doband 1 outname inna ; outcl 'NEWCH0' --> NEWCH0.1 (15) x12b. FREQID=2 (if multiple-FREQID data set) --> NEWCH0.2 ***Skip FREQID=2 if the corresponding BP table looked irrelevant (see 11b5) default AVSPC docalib -1;gainuse 0; flagver -1 $ do NOT apply flags doband 1 freqid 2; bpver 4 $ for multiple-FREQID data sets getn 14 $ *.LINCOP outname inna ; outcl 'NEWCH0' ; outse= freqid --> NEWCH0.2 x12c. FREQID=3 (if multiple-FREQID data set) --> NEWCH0.3 ***Skip FREQID=3 if the corresponding BP table looked irrelevant (see 11b5) default AVSPC docalib -1;gainuse 0; flagver -1 $ do NOT apply flags doband 1 freqid 3; bpver 4 $ for multiple-FREQID data sets getn 14 $ *.LINCOP outname inna ; outcl 'NEWCH0' ; outse= freqid --> NEWCH0.3 ^12d. LISTR/SCAN ***It is a VERY good idea to run LISTR/SCAN on each of the NEWCH0 data sets at this point, to be sure each has the data you expect. tget LISTR getn 15 $ *.NEWCH0 outprint '/Users/herrmann/Desktop/Haro29-D2_12d.listr tortue LISTR(31DEC08) 4 18-JUN-2009 14:36:30 Page 1 File = Haro29-D2 .NEWCH0. 1 Vol = 1 Userid = 4 Freq = 1.419032350 GHz Ncor = 2 No. vis = 79100 Scan summary listing Scan Source Qual Calcode Sub Timerange FrqID START VIS END VIS 1 1331+305 : 0004 A 1 0/03:43:25 - 0/03:52:25 1 1 2184 2 1227+365 : 0004 A 1 0/03:53:15 - 0/03:56:15 1 2185 6573 3 HARO29 : 0004 1 0/03:56:55 - 0/04:11:15 1 6574 31834 4 1227+365 : 0004 A 1 0/04:11:55 - 0/04:15:15 1 31835 36664 5 HARO29 : 0004 1 0/04:15:55 - 0/04:30:15 1 36665 62189 6 1227+365 : 0004 A 1 0/04:30:55 - 0/04:34:15 1 62190 67040 7 1331+305 : 0004 A 1 0/04:34:55 - 0/04:42:15 1 67041 79100 Source summary Velocity type = ' ' Definition = ' ' ID Source Qual Calcode RA(2000.0) Dec(2000.0) IFlux QFlux UFlux VFlux No. vis 1 1331+305 : 0004 A 13:31:08.2879 30:30:32.958 14.733 0.000 0.000 0.000 14244 2 1227+365 : 0004 A 12:27:58.7254 36:35:11.827 0.000 0.000 0.000 0.000 14070 3 HARO29 : 0004 12:26:16.0000 48:29:37.000 0.000 0.000 0.000 0.000 50786 ID Source Freq(GHz) Velocity(Km/s) Rest freq (GHz) 1 1331+305 1.4190 -138.0359 0.0000 2 1227+365 1.4190 0.0000 0.0000 3 HARO29 1.4190 0.0000 0.0000 Frequency Table summary FQID IF# Freq(GHz) BW(kHz) Ch.Sep(kHz) Sideband 1 1 1.41903235 4.5705 982.6661 1 ^13. TABED LINCOP FG/1 -> NEWCH0 FG/1 ***We use TABED to set FREQID to -1 (apply to all FREQIDs) in the FG table, since AVSPC will change all FREQIDs to 1 in the NEWCH0 data sets. ^13a. NEWCH0.1 default TABED inext 'fg' inver 1; outver 1 opty 'repl' aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...to FREQID= -1 getn 14 $ *.LINCOP getona 15 $ *.NEWCH0.1 --> NEWCH0.1, FG/1 x13b. If multiple FREQIDs: NEWCH0.2 default TABED inext 'fg' inver 1 ; outver 1 opty 'repl' aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...to FREQID= -1 getn 14 $ *.LINCOP getona 15 $ *.NEWCH0.2 --> NEWCH0.2, FG/1 x13c. If multiple FREQIDs: NEWCH0.3 default TABED inext 'fg' inver 1 ; outver 1 opty 'repl' aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...to FREQID= -1 getn 14 $ *.LINCOP getona 15 $ *.NEWCH0.3 --> NEWCH0.3, FG/1 ^14. CALIB -> NEWCH0.1(,2,3) SN/1 executed on 18jun09 (full uvrange) ***If we only have one FREQID, all CALIBs are run on the same NEWCH0.1 . If we have multiple FREQIDs, CALIBs for a given source must be run for all NEWCH0.1,2,3 in which that source appears (probably easiest to check with LISTR/SCAN). ***Note: if 'SN' table must be destroyed: task 'extdest'; inext 'sn'; invers 0 ***If solar interference is affecting your data then in CALIB you should use a UVRANGE. The worst case scenario, baselines up to a distance of 1 kilolambda could be affected, while in the best case scenario baselines are affected only up to 0.5 kilolambda distance. We recommend using: UVRANGE 0.7,0 for D array UVRANGE 0.7,0 for C array After calibration, if UVPLT still shows signs of solar interference, it means that not enough short baselines were discarded; therefore the calibration has to be redone and UVRANGE to be reset. Note that the Sun might rise or set, especially during a long B-array run, in which case you might wish to split the calibration by timerange in a set affected and a set without solar interference. ^14a. Primary (flux density) calibrators --> SN/1 default CALIB get2n 4 $ 3C286_L.MODEL.1 calsour '1331+305','' $ flux density calibrator #1 freqid -1 uvrange 0, 0 $ no signs of solar interference in primary weightit 1 docal 1; gainuse 2; flagver 1 inver 1; ncomp 1e6, 0; nmap 1; cmethod 'DFT' refant 22 $ Change this to your refant solint 0 aparm 4,0,0,0,0,2; $ min 4 antennas; print closures soltype 'L1'; solmode 'A&P' $ true L1 minimization solcon 0 minamper 10; minphser 10 $ complain if >10%/10d off cparm 0,0,10,10,1 $ complain if avg > 10%/10d off snver 1 getn 15 $ *.NEWCH0 $ ***NOTE: must run this for all NEWCH0.1,2,3 in which this calibrator appears! --> SN/1 tortue> CALIB1: RPOL, IF= 1 The average gain over these antennas is 3.107E+00 tortue> CALIB1: LPOL, IF= 1 The average gain over these antennas is 3.039E+00 tortue> CALIB1: Found 100 good solutions tortue> CALIB1: Average closure rms = 0.0009 +- 0.0002 tortue> CALIB1: No data were found > 99.0 rms from solution $ This time there is no second primary default CALIB get2n 210 $ 3C147_L.MODEL.2 calsour '0542+498','' $ no second flux density calibrator freqid -1 uvrange 0, 0 $ no signs of solar interference in primary weightit 1 docal 1; gainuse 2; flagver 1 inver 1; ncomp 1e6, 0; nmap 1; cmethod 'DFT' refant 22 $ Change this to your refant solint 0 aparm 4,0,0,0,0,2; $ min 4 antennas; print closures soltype 'L1'; solmode 'A&P' $ true L1 minimization solcon 0 minamper 10; minphser 10 $ complain if >10%/10d off cparm 0,0,10,10,1 $ complain if avg > 10%/10d off snver 1 getn 15 $ *.NEWCH0 $ ***NOTE: must run this for all NEWCH0.1,2,3 in which this calibrator appears! --> SN/1 ^14b. Secondary (phase) calibrator --> SN/1 ***Check uv restrictions for secondary calibrators carefully. For 1227+365: no restrictions, no solar interference, so uvra= 0.0,0 default CALIB calsour '1227+365','' $ phase calibrator freqid -1 uvrange 0.0, 0 $ Some solar interference wtuv 0.0 $ normally 0.0, but may have to set wtuv 0.01 if solutions are $ crazy and uvrange is not 0,0 weightit 1 docal 1; gainuse 2; flagver 1 refant 22 $ Change this to your refant solint 0 aparm 4,0,0,0,0,2; $ min 4 antennas; print closures soltype 'L1'; solmode 'A&P' $ true L1 minimization solcon 0 minamper 10; minphser 10 $ complain if >10%/10d off cparm 0,0,10,10,1 $ complain if avg > 10%/10d off snver 1 getn 15 $ *.NEWCH0 $ ***NOTE: must run this for all NEWCH0.1,2,3 in which $ this calibrator appears! tortue> CALIB1: RPOL, IF= 1 The average gain over these antennas is 2.255E+00 tortue> CALIB1: LPOL, IF= 1 The average gain over these antennas is 2.172E+00 tortue> CALIB1: Found 132 good solutions tortue> CALIB1: Average closure rms = 0.0084 +- 0.0004 tortue> CALIB1: No data were found > 99.0 rms from solution x15a. TABED all SN tables to NEWCH0.1 --> SN/2,3 ***This step is only required if we have more than one FREQID (NEWCH0). We copy everything to NEWCH0.1 to match the FREQID=1 case. ***Skip this step if you only have one FREQID! default TABED inext 'sn' inver 1; outver 0 opty 'repl' aparm 0 aparm(1) 6 $ Changing column 3 = FREQID keyval= -1,0 $ ...which we change to FREQID= -1 getn 15 $ *.NEWCH0.2 getona 15 $ *.NEWCH0.1 --> NEWCH0.1, SN/2 default TABED inext 'sn' inver 1 ; outver 0 opty 'repl' aparm 0 aparm(1) 6 $ Changing column 3 = FREQID keyval= -1,0 $ ...which we change to FREQID= -1 getn 15 $ *.NEWCH0.3 getona 15 $ *.NEWCH0.1 --> NEWCH0.1, SN/3 ^15b. GETJY SN/1-3, SU/1 executed on 18jun09 ***Find flux density of secondary calibrator, and set SN table amplitude gains to reflect a common flux density scale. default GETJY sources '1227+365','' $ Secondary (phase) calibrators) calsour '1331+305','' $ Primary (flux) calibrators '0542+498','0137+331', freqid -1 snver 0 $ Use all SN tables getn 15 $ *.NEWCH0.1 tortue> GETJY1: Task GETJY (release of 31DEC08) begins tortue> GETJY1: Source:Qual CALCODE IF Flux (Jy) tortue> GETJY1: 1227+365 : 4 A 1 2.01057 +/- 0.01051 %%% (Pretty close to expected 2.10 Jy.) x15c. CLCAL/MERG to merge all SN tables -> SN/4 ***This step is only required if we have more than one FREQID (NEWCH0). Skip this step if you only have one FREQID! default CLCAL opcode 'MERG' $ Merge SN tables, for ease of plotting etc. refant 22 $ Change this to your refant getn 15 $ *.NEWCH0.1 --> SN/4 $ creates a merged SN table -- doesn't change CL tables at all. Must now copy this new SN table to all other NEWCH0: default TACOP inext 'SN' getn 15 $ *.NEWCH0.1 getona 15 $ *.NEWCH0.2 getona 15 $ *.NEWCH0.3 ^16. SN table checks ^16a. SNPLT last SN table executed on 18jun09 ^16a1. SNPLT phase: default SNPLT inext 'sn'; inver 0 pixrange 0; nplots 9; xinc 1 optype 'phas'; opcode 'alsi' do3col 1; symbol 5; factor 2 dotv 1 getn 15 $ *.NEWCH0.1 ===> Note any phase jumps (on the phase calibrator) for future flagging. The EVLA antennas, even after applying VLANT, still show quite a bit of phase drift. This is OK so long as a linear interpolation between the phases looks like it will work. %%% Note: displaying first primary, all 3 secondary observations, then second primary In general, few jumps (1-28) (besides the jump from primary to secondary which is ok) EXCEPT: Ants 1, 11, 21-> missing all 3 Secs (probably because of shadowing) (Note: Ref antenna 22 red triangles at values of 0 because everything relative to it.) %%% Grabbed each frame: D2SNPLT_16a1_PHS(a-c).tiff ^16a2. SNPLT amplitude: default SNPLT inext 'sn'; inver 0 pixrange 0; nplots 9; xinc 1 optype 'amp'; opcode 'alsi' do3col 1; symbol 5; factor 2 dotv 1 getn 15 $ *.NEWCH0.1 ===> Note whether the amp. is roughly constant for a given antenna/pol'n/IF. %%% In general, some small jumps (1-28) (besides the jump from primary to secondary which is ok) %%% Grabbed each frame: D2SNPLT_16a2_AMP(a-c).tiff ***We have seen a couple cases where the first phase cal scan has a significantly different amplitude gain for the EVLA antennas. The reason is not clear but the raw data do show this effect, so CALIB is doing the right thing. This area warrants further tests, to learn whether we should simply flag the EVLA antennas on the first phase calibrator scan. ^16b. LISTR/GAIN print SN table executed on 18jun09 default LISTR optype 'gain'; inext 'sn'; inver 1; freqid -1 antennas -3,16,28,29,0; $ may have to list missing antennas explicitly, to avoid $ column overrun. To list missing antennas, use the form $ANTENNAS -3,2,0 to have antennas 3 and 2 left out. dparm 5,0; $ Amp & phase factor 0; docrt -1 $ instead of docrt 132 outprint '/Users/herrmann/Desktop/Haro29-D2_16b.listr getn 15 $ *.NEWCH0.1 --> check for phase jumps and other inconsistencies. ***We have seen a couple cases where the first phase cal scan has a significantly different amplitude gain for the EVLA antennas. The reason is not clear but the raw data do show this effect, so CALIB is doing the right thing. This area warrants further tests, to learn whether we should simply flag the EVLA antennas on the first phase calibrator scan. tortue LISTR(31DEC08) 4 18-JUN-2009 14:51:36 Page 1 File = Haro29-D2 .NEWCH0. 1 Vol = 1 Userid = 4 IF = 1 Freq= 1.419032350 GHz Ncor= 2 No. vis= 79100 Polarization = R Subarray = 0 Listing SN table, version 1 SN table has not been applied to a CL table Gain amplitudes, 1000 = 10.000000 Stokes = R IF = 1 Freq = 1.419032350 GHz Time Source -1- -2- -4- -5- -6- -7- -8- -9--10--11--12--13--14--15--17--18--19--20--21--22--23--24--25--26--27- max % diff 0.6 1.8 1.9 1.4 0.3 3.7 0.4 1.2 0.2 0.2 1.2 0.2 0.6 0.8 0.8 0.2 0.6 1.2 0.2 0.7 1.8 0.4 Day # 0 03:51:55 1331+305 216 198 296 387 263 316 290 242 301 134 310 369 346 316 285 475 316 275 380 279 351 319 497 338 247 03:54:45 1227+365 208 304 406 258 313 291 239 310 309 364 346 314 295 458 321 273 278 357 319 487 335 243 04:13:35 1227+365 206 297 399 262 312 292 238 309 308 363 343 315 294 454 325 274 279 360 320 492 343 245 04:32:35 1227+365 208 295 391 265 314 308 240 304 309 364 351 315 297 451 321 274 276 365 319 492 345 244 04:38:35 1331+305 217 202 297 389 263 316 296 242 301 136 310 369 348 317 290 472 318 276 383 280 354 322 501 344 246 tortue LISTR(31DEC08) 4 18-JUN-2009 14:51:36 Page 2 File = Haro29-D2 .NEWCH0. 1 Vol = 1 Userid = 4 IF = 1 Freq= 1.419032350 GHz Ncor= 2 No. vis= 79100 Polarization = L Subarray = 0 Listing SN table, version 1 SN table has not been applied to a CL table Gain amplitudes, 1000 = 10.000000 Stokes = L IF = 1 Freq = 1.419032350 GHz Time Source -1- -2- -4- -5- -6- -7- -8- -9--10--11--12--13--14--15--17--18--19--20--21--22--23--24--25--26--27- max % diff 0.7 1.1 1.0 0.9 1.0 3.7 0.8 1.1 0.6 0.2 0.9 0.5 0.5 0.6 0.9 0.7 0.7 0.8 0.3 0.6 1.3 0.3 Day # 0 03:51:55 1331+305 266 229 287 397 289 308 249 217 315 137 290 338 348 263 238 403 342 282 413 246 355 383 430 311 240 03:54:45 1227+365 239 291 416 286 302 246 212 318 284 333 345 261 248 399 350 275 242 363 388 425 308 236 04:13:35 1227+365 236 293 416 284 303 250 211 316 286 333 339 261 246 396 354 277 243 367 386 429 316 236 04:32:35 1227+365 237 287 410 289 307 262 214 312 287 332 342 259 246 395 349 279 245 368 387 429 312 235 04:38:35 1331+305 269 232 292 403 289 309 254 217 314 139 290 338 347 263 240 404 345 282 420 246 359 390 427 313 239 tortue LISTR(31DEC08) 4 18-JUN-2009 14:51:36 Page 3 File = Haro29-D2 .NEWCH0. 1 Vol = 1 Userid = 4 IF = 1 Freq= 1.419032350 GHz Ncor= 2 No. vis= 79100 Polarization = R Subarray = 0 Listing SN table, version 1 SN table has not been applied to a CL table Gain phases in degrees Stokes = R IF = 1 Freq = 1.419032350 GHz Time Source -1- -2- *4* -5- -6- -7- -8- -9--10--11--12-*13*-14--15--17--18--19--20--21--22--23--24--25--26--27- max diff 5 15 5 9 8 7 7 3 5 10 1 1 5 7 5 1 0 3 8 2 5 5 Day # 0 03:51:55 1331+305 -50 66-123 24-138 79 140 68 120 128 16 79 -96-106 -60 -55 99 27 -98 0-178 142 55 139 123 03:54:45 1227+365 73-119 27-137 79 139 72 126 15 82 -89-106 -52 -52 99 29 0-173 142 60 144 124 04:13:35 1227+365 68-134 23-146 84 132 77 126 17 79 -90-106 -57 -54 101 28 0-176 134 60 146 128 04:32:35 1227+365 65-124 18-137 76 138 70 123 12 69 -91-107 -53 -61 106 27 0-177 128 58 141 123 04:38:35 1331+305 -51 63-125 17-139 79 135 72 126 138 14 70 -89-106 -59 -62 109 29 -82 0-173 128 57 140 125 tortue LISTR(31DEC08) 4 18-JUN-2009 14:51:36 Page 4 File = Haro29-D2 .NEWCH0. 1 Vol = 1 Userid = 4 IF = 1 Freq= 1.419032350 GHz Ncor= 2 No. vis= 79100 Polarization = L Subarray = 0 Listing SN table, version 1 SN table has not been applied to a CL table Gain phases in degrees Stokes = L IF = 1 Freq = 1.419032350 GHz Time Source -1- -2- *4* -5- *6* -7- -8- -9--10--11--12-*13*-14--15--17--18--19--20--21--22--23--24--25--26--27- max diff 5 15 4 10 8 9 8 3 5 10 2 1 5 6 5 2 0 3 7 3 5 4 Day # 0 03:51:55 1331+305 11-121 -72 71 20 54 98-122 30 -90 125-128-142-149 134-126 117 -46 110 0 66 -95 -30-128 123 03:54:45 1227+365 -115 -68 73 21 52 98-122 36 125-126-135-149 141-123 117 -45 0 70 -98 -27-123 124 04:13:35 1227+365 -120 -83 69 12 57 89-118 36 127-128-137-148 136-126 118 -46 0 67-105 -26-121 127 04:32:35 1227+365 -123 -72 65 22 49 95-126 33 122-138-138-148 141-132 123 -48 0 67-110 -29-126 123 04:38:35 1331+305 10-125 -73 64 20 53 94-122 36 -80 124-137-136-148 135-133 127 -45 126 0 71-110 -28-127 124 %%% Max Phase dips/jumps: 7 bounces by 10-15 degrees, otherwise everything <10 degrees, so leave as is %%% Amp changes: Everything <= 3.7% differences, so leave as is %%% Some flagging needed, however, since there are no Sec observations in Ant 1, 11, or 21, so flag those whole antennas ^17. UVFLG -> NEWCH0.1 FG/1 executed on 18jun09 ***If the SN table shows a phase jump on the phase calibrator, you should flag the data between the two phase cal scans which show the jump (since those cannot be calibrated). ***Note that we flag NEWCH0.1, *regardless* of whether the galaxy appears in this data set. This is because later on (step 20/TVFLG) we flag the NEWCH0 data in order from inseq 1 through inseq freqid_max, copying the FG table from one file to the next. UVFLG itself doesn't care whether the flags you enter actually do anything -- it just adds entries to the FG table, which are then applied (or ignored if irrelevant) by other tasks. ***This step may of course be skipped if there are no obvious phase jumps. Need to flag EVERYTHING in: Ants 1, 11, 21 FULL default UVFLG timer 0 0 $ the source scan between the offending ph.cal scans (everything here) antenna 1, 11, 21, 0 $ the antennas which "jumped" stokes '' outfgver 1 opcode 'FLAG' reason 'all secs shadowed' $ normally 'phase jump' getn 15 $ *.NEWCH0.1 --> NEWCH0.1 FG/1 ^18. CLCAL NEWCH0 --> CL/3 executed on 18jun09 ***For multi-FREQID data this becomes rather complicated, since we need a new CL table for every NEWCH0 file, to allow detailed checks and second-order flagging. ***Note that there is no need to work around any phase jumps, since the intervening data are flagged (see step 17 above [UVFLG]). ^18a. CLCAL for the primary calibrators -> CL/3 default CLCAL sour= '1331+305','' $ Primary (flux) calibrators '0542+498','0137+331', calsour= sour interpol 'SELF' dobtween -1 $ Don't interpolate entries for different sources snver 1 $ if single FREQID $ snver 4 $ if multiple FREQIDs gainver 2; gainuse 3 refant 22 $ Change this to your refant getn 15 $ *.NEWCH0.1 $ do this for all NEWCH0 with primary (flux) $ calibrator data ^18b. CLCAL for the phase calibrator and galaxy -> CL/3 default CLCAL sour= '1227+365','Haro29','' $ Secondary (phase) calibrator + galaxy calsour= '1227+365','' $ Secondary (phase) calibrator interpol 'SIMP' cutoff 120 $ Don't extrapolate/interpolate beyond 120 minutes dobtween -1 $ Don't interpolate entries for different sources snver 1 $ if single FREQID $ snver 4 $ if multiple FREQIDs gainver 2; gainuse 3 refant 22 $ Change this to your refant ***If your data set used +/- frequency switching for the phase calibrator (our observations did not, but some archival data may), you should use BPARM with SAMPTYPE='BOX' to select a smoothing time which covers both frequency settings. LISTR/SCAN on LINCOP will help you choose this; normally something like 12 minutes should be OK. bparm 12/60 ; samptype='BOX' getn 15 $ *.NEWCH0.1 $ do this for all NEWCH0 with secondary (phase) $ calibrator or galaxy data ***At this point we have a new CL table for all NEWCH0 files. ^19a. ANBPL executed on 18jun09 ***We use ANBPL to check the data weights. Data with very high weights (factor 5-10 or more above normal) should be flagged with UVFLG. ***Note: Red is RR and Blue is LL default ANBPL docalib 1; gainuse 3 flagver 1 do3col 1 $ ...using different colors opcode 'alsi' $ Plot all IFs together bparm 2,17,0 $ Plot antenna-based weight vs. time nplots 9; dotv 1 docrt -1 $ Print as well as plotting weights -- useful for $ finding exact times of bad weights $ Note you can also use outprint to send to a file. outprint '/Users/herrmann/Desktop/D2ANBPL_19a.txt getn 15 $ *.NEWCH0.1 $ Must do this separately for every NEWCH0 file %%% Grabbed each frame: D2ANBPL_19(a-c).tiff (MIDDLE times!) No problems! x19b. UVFLG to eliminate very high weights executed on [Not needed] ***Should UVFLG on NEWCH0.1, even if Evil Weights are seen in NEWCH0.2 or NEWCH0.3 -- we'll be copying FG/1 from NEWCH0.1 to NEWCH0.2 for subsequent second-order flagging. default UVFLG getn 15 $ *.NEWCH0 timerang 0 15 07 50 0 15 08 20 antennas 1, 0 stokes 'RR' outfgver 1 opcode 'FLAG' reason 'HIGH WEIGHT' timer 0 15 10 10 0 15 10 40 tget ANBPL; outprint '/Users/herrmann/Desktop/D2ANBPL_19a1.txt default prtmsg docrt -1 outprint '/Users/herrmann/Desktop/AIPSMSGSRV_D2_Steps1_19.log prtmsg clrmsg ^20. TVFLG FG/1 executed on 18jun09 ^20a. TVFLG on calibrators: NEWCH0.1 The calibrators should now have constant amplitude and zero phase...apart from source structure for the primary (flux) calibrators, and any uvrange for the secondary (phase) calibrators. If we see huge problems on the calibrators we may have to re-run CALIB etc. -- let's hope not!! default TVFLG docat -1 $ avoid saving temporary files dohist -1 $ avoid creation of history entries calcode '*' $ calibrators only docalib 1; gainuse 3 $ apply the new CL table flagver 1; outfgver 1 $ keep all flags in FG/1 dparm 0 dparm(3) 1 $ show baselines twice, to treat all antennas identically -- $ this displays baseline 27-1 as well as 1-27 dparm(6)=10 $ time resolution: should be set to the calibrators' $ integration time, in seconds getn 15 $ *.NEWCH0.1 ***Within TVFLG: ^ Set useful defaults: ^SMOOTH=1 to avoid averaging date before displays ^SCAN= 20 to use a long time for median filters (AMP/PH DIFF) xFLAG ALL CHANNELS ^FLAG STOKES FULL (usually -- sometimes you'll want NORR or NOLL) ***If individual Stokes need to be flagged, make sure you set the STOKES FLAG to correspond to the polarization that is displayed on the TV ^SWITCH SOURCE FLAG to ONE-SOURCE to avoid inadvertantly flagging your galaxy (though sometimes you'll want to of course) ^ Be sure to inspect BOTH polarizations! ***We suggest the following steps: ^ Set the above defaults ^ Check AMPLITUDE, AMP DIFF, PHS DIFF. Be wary of known source structure and uv-range limits!! %%% AMP RR: (1.40 - 15.90) Looks good (normally min is ~1.4) AMP LL: (1.45 - 15.97) Looks good (same as above) AMP DIFF RR: (0.0 - 820.9) Looks good-> high values in 2nd Pri, mostly AMP DIFF LL: (0.0 - 770.9) Looks good-> high values in 2nd Pri, mostly PHS DIFF RR: (0.0 - 15.67) Looks good PHS DIFF LL: (0.0 - 19.80) Looks good ***Note: occasionally, flagging using UVFLG can be more straightforward (e.g., deleting an antenna). %%% No flagging needed. =) x20b. If we have multiple NEWCH0s (FREQIDs): (1) Copy the FG table: default TABED opty 'repl' inext 'FG' ; inver 1 ; outver 2 bcount 1;ecount 0; aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...to FREQID= -1 getn 15 $ *.NEWCH0.1 getona 15 $ *.NEWCH0.2 Re-run TVFLG with same inputs as above, except: flagver 2 ; outfgver 2 getn 15 $ *.NEWCH0.2 (2) Assuming there are three FREQIDs, we do this yet again: Copy the FG table: default TABED opty 'repl' inext 'FG' ; inver 2 ;outver 2 bcount 1;ecount 0; aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...to FREQID= -1 getn 15 $ *.NEWCH0.2 getona 15 $ *.NEWCH0.3 Re-run TVFLG with same inputs as above, except: flagver 2 ; outfgver 2 getn 15 $ *.NEWCH0.3 ^21. Calibration/flagging checks: calibrators ^21a. UVPLT executed on 18jun09 ***Check the amp & phase vs. uv-distance for all calibrators. Amplitude should match the results of SETJY/GETJY. If there are obvious outliers which are not expected due to source structure, go back and flag those (and possibly re-run CALIB etc.). default UVPLT calcode '*' docal 1; gainuse 3 flagver 1 $ set this to the latest FG version -- may be >1 if $ there are multiple NEWCH0s (FREQIDs). do3col 1 dotv 1 getn 15 $ *.NEWCH0.1 $ do this for each NEWCH0 file bparm 0 $ amp. vs. uv-distance dotv -1; go -> PL version 1 same as grabbed D2UVPLT_21a_AMP.tiff -> Looks good! Primary generally ~14.7 +/- 0.7 Jy; supposed to be 15.0 Jy; pretty flat & clean Secondary generally ~2.0 +/- 0.3 Jy; supposed to be 2.10 Jy; quite clean Constant the whole way-> as expected because no limits on UVmax bparm 0, 2 $ phase vs. uv-distance dotv -1; go -> PL version 2 same as grabbed D2UVPLT_21a_PHS.tiff %%% Pretty clean! Looks like Pris are roughly 0 +/- 5 degrees and Secs are 0 +/- 10 degs All scatter within -25 to 20 degrees ^21b. IMAGR executed on 18jun09 [if desired -- this is not really necessary] ***Note: If uvwtfn is set to 'NA' it will override any value given to robust. default IMAGR sources '1227+365','' $ calibrator to image docalib 1; gainuse 3 $ apply latest calibration flagver 1 $ apply latest flags -- set this to the $ highest-numbered FG table outname 'Haro29D2sec $ cellsize 1 $ for B configuration $ cellsize 3.5 $ for C configuration cellsize 10 $ for D configuration $ imsize 1024 $ for B array imsize 512 $ for C and D array uvwtfn 'NA'; robust 0.5 niter 1000 $ nbox 1; clbox -1,5,512,513 $ calibrator should be in the center (for B) nbox 1; clbox -1,5,256,257 $ calibrator should be in the center (for C & D) minpa 121 dotv 1 getn 15 $ *.NEWCH0.xx $ whichever file has the calibrator you're imaging --> shouldn't see obvious calibration errors or striping. CLEANed flux density should roughly match SETJY/GETJY. %%% Looks clean, but the secondary is very elongated, with at least 1 other point source in the vicinity tortue> IMAGR1: Loading field 1 from -1.25E-02 to 2.01E+00 interp by 2 tortue> IMAGR1: Field 1 final Clean flux 1.977 Jy (Fairly close to expected 2.01 Jy from GETJY but a bit low wrt 2.10 Jy from catalog.) *** Note: If you have extended sources (instead of point sources), probably you just have poor uv-coverage. You can look at your uv-coverage using UVPLT with bparm 6, 7, 0 where good uv-coverage should result in a roughly circular pattern whereas bad uv-coverage may be more like a snowflake with outer gaps. The sources will not be extended when all the data sets are combined. %%% Plot of uv-coverage is not very circular (poor uv coverage) Grabbed D2UVPLT_uv_coverage.tiff (same as PL 3) ^22. TVFLG on the galaxy: NEWCH0.xx ***This is our first run of flagging on the galaxy. ^ Check the first scan carefully -- often the system isn't "organized" on this first scan x On-line flagging isn't as reliable as in the old days, so there are plenty of hot pixels and hiccups. x We are NOT quacking, because (1) FILLM's NX table isn't correct; (2) QUACK flags data from the beginning-of-scan, whereas we want to flag data from antennas-on-source. ^22a. If there's only one NEWCH0 (FREQID): default TVFLG docat -1 $ avoid saving temporary files dohist -1 $ avoid creation of history entries calcode '-CAL' $ non-calibrators only docalib 1; gainuse 3 $ apply the new CL table flagver 1; outfgver 1 $ keep all flags in FG/1 dparm 0 dparm(3) 1 $ show baselines twice, to treat all antennas identically -- $ this displays baseline 27-1 as well as 1-27 dparm(6)=10 $ time resolution: should be set to the sources' $ integration time, in seconds getn 15 $ *.NEWCH0.1 ***Within TVFLG: ^ Set useful defaults: ^SMOOTH=1 to avoid averaging date before displays ^SCAN= 20 to use a long time for median filters (AMP/PH DIFF) xFLAG ALL CHANNELS ^FLAG STOKES FULL (usually -- sometimes you'll want NORR or NOLL) ***If individual Stokes need to be flagged, make sure you set the STOKES FLAG to correspond to the polarization that is displayed on the TV ^SWITCH SOURCE FLAG to ONE-SOURCE to avoid inadvertantly flagging your galaxy (though sometimes you'll want to of course) ^ Be sure to inspect BOTH polarizations! ***We suggest the following steps: ^ Set the above defaults x Flag first integration in every scan (manual QUACK) -- this should be the first integration AFTER most antennas are on-source, which is why we can't use the usual QUACK. ^ Check AMPLITUDE, AMP DIFF, PHS DIFF. Be wary of known source structure and uv-range limits!! ***Note: occasionally, flagging using UVFLG can be more straightforward (e.g., deleting an antenna). AMPLITUDE RR: (1.0 - 778.3) Looks pretty clean AMPLITUDE LL: (0.3 - 775.6) Looks pretty clean AMPL DIFF RR: (0.0 - 549.4) Looks pretty good AMPL DIFF LL: (0.0 - 552.9) Looks pretty good PHAS DIFF RR: (0.0 - 179.9) Pretty random PHAS DIFF LL: (0.0 - 179.9) Pretty random No flagging needed! x22b. If there's more than one NEWCH0 (FREQID): ***I assume here that the galaxy is in NEWCH0.3 . If not, you should first TACOP FG/2 from NEWCH0.3 to the file with the galaxy in it. This will now be FG/3 . default TVFLG calcode '-CAL' $ non-calibrators only docat -1 $ avoid saving temporary files dohist -1 $ avoid creation of history entries docalib 1 ; gainuse 3 $ apply the new CL table flagver 2;outfgver 2 $ or flagver 3 ; outfgver 3 if you had to TACOP $ the FG table from another file dparm 0 dparm(3) 1 $ show baselines twice, to treat all antennas identically -- $ this displays baseline 27-1 as well as 1-27 dparm(6)=10 $ time resolution: should be set to the sources' $ integration time, in seconds getn 15 $ *.NEWCH0.xx $ This should be the file with the galaxy data ***Within TVFLG: - Set useful defaults: SMOOTH=1 to avoid averaging date before displays SCAN= 20 to use a long time for median filters (AMP/PH DIFF) FLAG ALL CHANNELS FLAG STOKES FULL (usually -- sometimes you'll want NORR or NOLL) ***If individual Stokes need to be flagged, make sure you set the STOKES FLAG to correspond to the polarization that is displayed on the TV SWITCH SOURCE FLAG to ONE-SOURCE to avoid inadvertantly flagging your galaxy (though sometimes you'll want to of course) - Be sure to inspect BOTH polarizations! ***We suggest the following steps: - Set the above defaults - Flag first integration in every scan (manual QUACK) -- this should be the first integration AFTER most antennas are on-source, which is why we can't use the usual QUACK. - Check AMPLITUDE (for missing data), AMP DIFF . PHS DIFF may occasionally be useful, but it's likely to be mostly random, unless you have a strong continuum source near your galaxy. ***Note: occasionally, flagging using UVFLG can be more straightforward (e.g., deleting an antenna). ^23. Calibration/flagging checks: sources ^23a. UVPLT executed on 18jun09 ***Check the amp vs. uv-distance for the galaxy. If there are obvious outliers which are not expected due to source structure or RFI (i.e., not mostly on short spacings), go back and flag those. Note any obvious short-spacing horrors, which may be due to solar or terrestrial RFI. default UVPLT source 'Haro29','' docal 1; gainuse 3 flagver 1 $ set this to the latest FG version -- may be >1 if $ there are multiple NEWCH0s (FREQIDs). do3col 1 dotv 1 getn 15 $ *.NEWCH0.1 $ whichever file holds the galaxy bparm 0 $ amp. vs. uv-distance Looks good- a little scatter Some structure; amplitude a bit higher at low kL dotv -1; go -> PL version 4 same as grabbed D2UVPLT_23a_AMP.tiff ^23b. IMAGR executed on 18jun09 *** Note: If uvwtfn is set to 'NA' it will override any value given to robust. default IMAGR sources 'Haro29','' $ the galaxy docalib 1; gainuse 3 $ apply latest calibration flagver 1 $ apply latest flags -- set this to the $ highest-numbered FG table outname 'Haro29D2_23b $ cellsize 1 $ for B configuration $ cellsize 3.5 $ for C configuration cellsize 10 $ for D configuration $ imsize 1024 $ for B configuration imsize 512 $ for C and D configurations uvwtfn 'NA'; robust 0.5 niter 1000 nbox 0 minpa 121 dotv 1 getn 15 $ *.NEWCH0.xx $ whichever file has the source you're imaging --> shouldn't see obvious calibration errors or striping. Note that this "channel 0" includes HI emission, so you may see some odd effects (e.g., very woofly noise in B configuration) -- don't panic! ### If you find a strong continuum source rippling your map even in a 512x512 imsize D array configuration channel zero image, then refer to Elias and Dana for further steps. %%% Faint galaxy smudge plus at least 9 elongated point sources. ^24. TASAV -> CH0SAV.1,2,3 executed on 18jun09 default TASAV getn 15 $ *.NEWCH0 $ loop over NEWCH0 files (= FREQIDs) outna 'Haro29D2MdTb outcla 'ch0sav' outse inseq outdi 2 $ Ideally set this to a different disk from indisk, $ in case of disk crashes ^25. TABED SN, FG tables to LINCOP executed on 18jun09 ***Use TABED to ensure FREQID=-1 for all tables (paranoia is your friend...) ^25a. NEWCH0.xx FG/yy -> LINCOP FG/2 default TABED inext 'fg' inver 1 $ if single FREQID $ inver 3 $ if multiple FREQIDs: set this to max. flag table number outver 2 opty 'repl' aparm 0 aparm(1) 3 $ Changing column 3 = FREQID keyval= -1,0 $ ...which we change to FREQID= -1 getn 15 $ *.NEWCH0.1 $ if single FREQID $ getn 15 $ *.NEWCH0.3 $ if multiple FREQIDs: set this to file you flagged $ on most recently (usually the file with the $ galaxy in it) getona 14 $ *.LINCOP --> LINCOP FG/2 ^25b. NEWCH0.xx SN/yy -> LINCOP SN/1 default TABED inext 'sn' inver 1 $ if single FREQID $ inver 4 $ if multiple FREQIDs outver 0 opty 'repl' aparm 0 aparm(1) 6 $ Changing column 3 = FREQID keyval= -1,0 $ ...which we change to FREQID= -1 getn 15 $ *.NEWCH0 $ if multiple FREQIDs: all should have same merged SN $ table so you can use whichever NEWCH0 file you want getona 14 $ *.LINCOP --> LINCOP SN/1 ^26. CLCAL LINCOP SN/1 --> CL/3 executed on 18jun09 ***We do CLCAL directly on LINCOP rather than copying, to avoid (even more) confusion in the multiple-FREQID case. ***Note that there is no need to work around any phase jumps, since the intervening data are flagged (see step 17 above [UVFLG]). ^26a. CLCAL for the primary calibrators -> CL/3 default CLCAL sour= '1331+305','' $ Primary (flux) calibrators '0542+498','0137+331', calsour= sour freqid= 1 $ You must run CLCAL once for each FREQID with $ the relevant calibators present interpol 'SELF' dobtween -1 $ Don't interpolate entries for different sources snver 1 gainver 2; gainuse 3 refant 22 $ Change this to your refant getn 14 $ *.LINCOP ^26b. CLCAL for the phase calibrator and galaxy -> CL/3 default CLCAL sour= '1227+365','Haro29','' $ Secondary (phase) calibrator + galaxy calsour= '1227+365','' $ Secondary (phase) calibrator freqid= 1 $ You must run CLCAL once for each FREQID with $ the phase calibrator or galaxy present interpol 'SIMP' cutoff 120 $ Don't extrapolate/interpolate beyond 120 minutes dobtween -1 $ Don't interpolate entries for different sources snver 1 gainver 2; gainuse 3 refant 22 $ Change this to your refant ***If your data set used +/- frequency switching for the phase calibrator (our observations did not, but some archival data may), you should use BPARM with SAMPTYPE='BOX' to select a smoothing time which covers both frequency settings. LISTR/SCAN on LINCOP will help you choose this; normally something like 12 minutes should be OK. bparm 12/60 ; samptype='BOX' getn 14 $ *.LINCOP ^27. Calibration/flagging checks: calibrators ^27a. WIPER executed on 18jun09 ###It shows a plot similar to the UVPLT output just quicker. It is also useful for identifying which antennas or baselines have calibration problems. ***Check the amp & phase vs. uv-distance for all calibrators. Amplitude should match the results of SETJY/GETJY, and phase should be zero, apart from known structure (reflected in source model for gain calibrators and uvrange for phase calibrators). If there are obvious, unexpected outliers, go back and flag those (and possibly re-run various tasks...). default WIPER calcode '*' freqid 1 $ set this to match the calibrator docal 1; gainuse 3 flagver 2 $ should be the latest FG table doband 1; bpver 1 $ for single-FREQID data sets $ doband 3; bpver 4 $ for multiple-FREQID data sets smooth 7, 215 $ boxcar average over all channels -- use $ smooth 7, 215 if you started with 255 channels & 7, 107 if you started with 127 channels bparm 0 imsize 512, 512 $ So it doesn't fill the whole screen! getn 14 $ *.LINCOP bparm(2) 1 $ amp. vs. uv-distance Grabbed as D2WIPER_27a_AMP.tiff-> looks pretty clean! Primary: ~15.0 +/- 4.0 Jy (15.0 Jy in catalog) (a little larger scatter, though) Secondary: ~2.5 +/- 2.5 Jy (2.10 Jy in catalog) (but some scatter...) No solar interference evident bparm(2) 2 $ phase vs. uv-distance %%% Probably as expected On Pris: D2WIPER_27a_PHS_Pri.tiff: Good- generally 0 +/- 15 with all scatter within -30 to 30 On all 12 Secs: D2WIPER_27a_PHS_Secs.tiff: full range -180 to 180 (because relatively faint) ^27b. POSSM executed on 18jun09 ***Check vector average of all data for each calibrator. Amplitude should match the results of SETJY/GETJY; phase should be flat, and consistent with zero (corresponding to a point source at the origin)...apart from known source structure and possibly HI absorption. default POSSM source='1227+365','' $ Secondary (phase) calibrator freqid 1 $ set this to match the calibrator uvrange= 0.0,0 $ should be set to eliminate known source structure, $ as in CALIB docal 1; gainuse 3 flagver 2 $ should be the latest FG table doband 1; bpver 1 $ for single-FREQID data sets $ doband 3; bpver 4 $ for multiple-FREQID data sets aparm 0 $ Plot data aparm(1) 1 $ vector average solint 0 $ average all time nplots 0 $ average all baselines dotv 1 getn 14 $ *.LINCOP tvinit %%% Grabbed D2POSSM_27b_RR.tiff & D2POSSM_27b_LL.tiff 1(RR): Around 2.01 +/- 0.03 Jy and nicely flat 1(RR): phase is pretty much 0 +/- 0.5 degree 1(LL): Fairly flat, ~2.01 +/- 0.03 Jy 1(LL): phase is pretty much 0 +/- 0.5 degree ^27c. IMAGR not necessary [if desired -- this is not really necessary] executed on 18jun09 *** Note: If uvwtfn is set to 'NA' it will override any value given to robust. default IMAGR source='1227+365','' $ Secondary (phase) calibrator freqid 1 $ set this to match the calibrator docal 1; gainuse 3 flagver 2 $ should be the latest FG table doband 1; bpver 1 $ for single-FREQID data sets $ doband 3; bpver 4 $ for multiple-FREQID data sets outname 'Haro29D2Sec2 $ cellsize 1 $ for B configuration $ cellsize 3.5 $ for C configuration cellsize 10 $ for D configuration $ imsize 1024 $ for B array imsize 512 $ for C and D array uvwtfn 'NA'; robust 0.5 niter 200 $ reasonable for a point source $ nbox 1; clbox -1,5,512,513 $ calibrator should be in the center minpa 121 dotv -1 $ so you can go eat lunch getn 14 $ *.LINCOP Started 17:39:10 and finished 17:42:18 ***You shouldn't see obvious calibration errors or striping. CLEANed flux density should roughly match SETJY/GETJY. If you _do_ have Evil Stuff, UVLSF will likely take care of it, so don't get too worked up. default tvlod; getn 21 tblc 0 0 108; ttrc 0 0 108 $ also tried 88 & 128: No real differences (as expected) default tvmovie; ltype 6; getn 21; tvinit; tvmovie Looks pretty constant & clean. ^28. Calibration/flagging checks: sources ^28a.1 WIPER executed on 18jun09 ###It shows a plot similar to the UVPLT output just quicker. It is also useful for identifying which antennas or baselines have calibration problems. If you do find things you want to flag, UVFLG is highly recommended. ***Check the amp vs. uv-distance for the galaxy. If there are obvious outliers which are not expected due to source structure or RFI (i.e., not mostly on short spacings), go back and flag those. Note any obvious short-spacing horrors, which may be due to solar or terrestrial RFI. default WIPER sources 'Haro29','' freqid 1 $ set this to match the galaxy docal 1; gainuse 3 flagver 2 $ should be the latest FG table doband 1; bpver 1 $ for single-FREQID data sets $ doband 3; bpver 4 $ for multiple-FREQID data sets smooth 7, 215 $ boxcar average over all channels -- use $ smooth 7, 215 if you started with 255 channels & 7, 107 if you started with 127 channels bparm 0 imsize 512, 512 $ So it doesn't fill the whole screen! getn 14 $ *.LINCOP bparm(2) 1 $ amp. vs. uv-distance Grabbed D2WIPER_28a.tiff: maximum is 8.9, so quite clean! bparm(2) 2 $ phase vs. uv-distance Range: full -180 to 180 in all columns but a few empty ones ^28a.2 Up to which level most of the values (leaving aside the very hot pixels) comfortably fit in? Answer= 7? (Could possibly clip a FEW high values...) ###This is the value that you will be using in CLIP when combining your data!!! ^28x. POSSM [Eliminated from the recipe] executed on 18jun09 anyways ***Check vector average of all data for the galaxy. You should see your HI line! default POSSM source='Haro29','' $ your galaxy freqid 1 $ set this to match the calibrator docal 1; gainuse 3 flagver 2 $ should be the latest FG table doband 1; bpver 1 $ for single-FREQID data sets $ doband 3; bpver 4 $ for multiple-FREQID data sets aparm 0 $ Plot data aparm(1) 1 $ vector average solint 0 $ average all time nplots 0 $ average all baselines dotv 1 getn 14 $ *.LINCOP tvinit %%% Results: Clearly there! 1 RR: phs: 0 +/- 150 on ends, except for ~90-140 where it's ~0 +/- 10 amp: about 15 mJy on ends, but peaks ~80 mJy D2POSSM_28_RR.tiff 1 LL: phs: 0 +/- 150 on ends, except for ~90-140 where it's ~0 +/- 10 amp: about 15 mJy on ends, but peaks ~80 mJy D2POSSM_28_LL.tiff ^28b. IMAGR executed on 18jun09 default IMAGR sources 'Haro29', '' freqid 1 $ set this to match the calibrator docal 1; gainuse 3 flagver 2 $ should be the latest FG table doband 1; bpver 1 $ for single-FREQID data sets $ doband 3; bpver 4 $ for multiple-FREQID data sets outname 'Haro29D2gal $ cellsize 1 $ for B configuration $ cellsize 3.5 $ for C configuration cellsize 10 $ for D configuration $ imsize 1024 $ for B configuration $ imsize 512 $ for C configuration imsize 256 $ for D configuration uvwtfn 'NA'; robust 0.5 niter 1000 $ a light clean, just to see what we've got. niter 0 $ would be ok too, esp. if you IMLIN afterwards nbox 0; clbox 0 minpa 121 dotv -1 $ so you can go eat lunch getn 14 $ *.LINCOP Started 17:51:40, and done by 17:55:21 ***You shouldn't see obvious calibration errors or striping. You should however see of order 100 mJy of continuum sources in the field, as well as some indication of your galaxy. The latter may be quite confusing for B configuration, which resolves out most of the structure. Don't fret until you've combined all the array configurations. ***Note: If uvwtfn is set to 'NA' it will override any value given to robust. ###If you find a strong continuum source rippling your map even after trying a 512x512 imsize D array configuration cube than refer to Elias and Dana for further steps. default tvlod; getn 23 tblc 0 0 108; ttrc 0 0 108 $ also tried 88 & 128: The faint galaxy blob moved. default tvmovie; ltype 6; getn 23; tvinit; tvmovie The galaxy is there, but not really rotating (channels ~84-132) and there are a few continuum sources. ?28c. Noise Estimations: calculated on 18jun09 ##The easiest way to calculate the expected sensitivity is to say 7 S(mJy) = ---------------------------- sqrt{ N (N-1) delta_nu t} where 7 is a constant that depends on the system temperature of the receivers(a quite conservative value) N = number of antennas in the array, delta_nu = channel resolution in MHz, and t = integration time in hours. You need to use for N the number of Antennas which have on average been giving good data during the run. The total time should be the actual time spent on source. No need to be super precise, of course. One simply wants to get a ballpark figure which is good to 10-20%. ###Note that for data which are Hanning smoothed (archive data) the channel spacing is equal to the resolution delta_nu. Without Hanning smoothing, the resolution is ~1.4 x delta_nu (note that after offline Hanning smoothing, if you preserve all channels, the resolution becomes 2 x delta_nu; it reverts to a new "double the old delta_nu" if you delete every other channel). ####Finally, if you want to know the noise in a single visibility, use N=2 and t = 1/360, and probably multiply by sqrt{2} because a visibility is a single polarisation as well. The Expected noise level is: 4.8 mJy x expected rms = K/SQRT[N(N-1)(N_IF*T_int*Delta_nu_BQ)] in mJy ^ expected rms = 4.8 mJy (here) where: K = 8.0 (for L band) N = # of Antennas (22 here) N_IF = 2 (for 2 polarizations) T_int = total on-source integration time in HOURS (0.483 hrs here = 29:00 mins) Delta_nu_BQ = effective continuum bandwidth or spectral-line channel in MHz (FREQ Coord incr in the header, but that number is in Hz) = 6.1035156e-03 (at least normally- check it) x measured rms: use TVSTAT (or IMSTAT) to measure the noise in a non-signal area ^ measured rms = 4.7 mJy x continuum channels are a good place, or just a clear off-galaxy area x can isolate main galaxy & continuum source area (TVWIN after TVLOD) & then use IMSTAT on outside area ^ TVWIN: blc = 88 113; trc = 205 168 default IMSTAT getn 23 $ Haro29D2gal movie blc 88 113 10 $ 10th channel, bottom left corner of box containing primary sources in the image trc 205 168 10 $ 10th channel, top right corner of box doinvers 1 $ full image except for box defined by blc & trc (afterwards, set doinvers -1) The rms Noise level in a line free channel is: 4.7 mJy ^29. TASAV -> EndTaB.LINSAV.1 executed on 18jun09 default TASAV outna 'Haro29D2EdTb outcla 'linsav' outdi 2 $ Ideally set this to a different disk from indisk, $ in case of disk crashes getn 14 $ *.LINCOP ^30. FITTP executed on 18jun09 dataout '/Users/herrmann/Desktop/D2-BeginTasav.FITS create: ^Haro29_D2_UV_CALIB_NEWCH0.FITS $ one per FREQID ^Haro29_D2_UV_CALIB_LINCOP.FITS ^Haro29_D2-BeginTasav.FITS ^Haro29_D2-MidTasav.FITS $ one per FREQID ^Haro29_D2-EndTasav.FITS ^Add the end date to the start of this file! ^PRTMSG & CLRMSG ^31. Send to DEIDRE 18jun09 See Little THINGS Web site for current instructions. Apart from the FITS data from step 30/FITTP (in calib), the following should be archived (via ftp): * Observing log (in obs) * This data reduction log (in notes) * LISTR/SCAN output (if saved to a file- works well if you just insert it into this log, though) E-mail to Deidre: (See example e-mail below.) * This data reduction log * Any notes about the data set * The names of the .FITS files being ftped * Total time on source (in minutes and also in hours (decimal)) * Expected rms and measured rms 32. Celebrate your victory with an appropriate beverage! ================================================================================ ================================================================================ Ater the data has been checked by an independent member of the team and changes/corrections have been suggested the log should continue here with the steps that have been reiterated and the values used in the reiteration. If you need to recreate tables it is best at this stage to not delete the already existing ones but rather to give the tables higher version numbers. Haro29 D2 (BQ) calibration Hi Deidre, The Haro29 D2 array (BQ) data is ready to be ftped, but I'll do the actual ftping once the NRAO system is all set up. Attached is the data reduction log/filled-in-recipe file. Here is the rest of the information that you requested: Several notes about the data: Ant 1, 11, 21 have no 2ndary observations- must be due to shadowing VERY little of first primary, but long obs of 2nd primary to make up for it The galaxy is there, but not really rotating (channels ~84-132) and there are a few continuum sources. Total Time on Source = 29:00 min (0.483 hrs) (No 10s scans were lost due to flagging straggly time scans.) The expected rms is 4.8 (?) mJy and the measured rms is 4.7 mJy, so 4.8 (?) [4.7]. The measured value is a tiny bit lower than the expected value, which is a little odd since 13 out of 22 antennas were EVLA. (Three antennas were lost because the secondaries were all shadowed.) N = 22 antennas, Tint = 0.483 hrs, delta_nu_BQ = 6.1035156e-3 MHz, N_IF = 2, K = 8.0 (for L band) The uv data files that I will eventually ftp to the NRAO site are: Haro29_D2_UV_CALIB_NEWCH0.FITS Haro29_D2_UV_CALIB_LINCOP.FITS Haro29_D2-BeginTasav.FITS Haro29_D2-MidTasav.FITS Haro29_D2-EndTasav.FITS In addition, I will create a figuresD2 subdirectory (in the calib directory) as usual and will upload all the .tiff and .ps files mentioned in the data reduction log. I'll also put the data reduction log and 2 log files from the AIPS_MSGSRV window in the notes directory. Lastly, the observation log should already be in the obs directory as an html file, so I probably won't need to add anything to the obs directory. I think that's it! Five more Haro29 data sets to go! Kim =)