| Graphic: | 
Prompted by Sean, I've determined that the ATI sonic signals were swapped
between the 3m and 6m sensors at stn1. My confirmation is a scatterplot of
T.6m with the signals called tc.3m and tc.6m, which I've shown in the attached
file for stn1 and stn3. It is obvious that T.6m is better related to the
signal currently labeled tc.3m. Sean also observes that the wind and
temperature profiles are better behaved using "swapped" data.
Thus, I'm about to change prep.config to reflect this situation. We'll have
to rerun covars soon.
32: LOG, Site all, Wed 23-Oct-2002 09:48:40 MDT, merging SDR data
Here are the scripts used in preparing and merging the SDR data with the RF
data. They are on $PAM/scripts unless noted otherwise. Passing the -4
option fixes the channel 4 length problem.
set_project NIWOT02
cd to_some_scratch_space
mkdir -p stn3/disk1
cd stn3/disk1
# read flash drive
cp /mnt/pccard/niwot* .
# this script creates directory new_names, containing symbolic
# links back to the actual SDR files. The symbolic links have names
# like 020815.00000 indicating the actual start date of the file
assign_date_sdr -4
setenv RAWDATADIR $PWD
cd new_names
# strip ETX from SDR files, pass data into ingestor, which does
# necessary sscanf's on ASCII channels based on channel_config, and
# generates samples that ASTER data system can handle. Script expects
# to read files called YYMMDD.HHMMSS so that it can determine the date.
# script runs archive, which connects to the ingestor and archives
# the files on $RAWDATADIR/all
convert_sdr -4 stn3 0208*
#
# Merge the sdr and rf data sets. This script assumes the sdr data is on
# /scr/isff/aster/projects/NIWOT02/raw_data/sdr
# the rf data is on
# /scr/isff/aster/projects/NIWOT02/raw_data
# It creates new merged files on
# /scr/isff/aster/projects/NIWOT02/raw_data/new
$PAM/projects/NIWOT02/scripts/merge_sdr_rf.csh
31: LOG, Site all, Wed 23-Oct-2002 09:27:37 MDT, SDR data
The SDR disks were not monitored closely during NIWOT02, since we had
RF communications.
However the SDR data will fill some holes:
1. Aug 9-14 at station 3 when the SDR was operating but
the RF was not.
2. At the beginning of the project EVE, was writing channel 4 data
(containing days since Jan 1, 1970 and station #) with a wrong
length value of 2, when it should have been 3. This caused
the RF ingest program to loose data
John gave me two SDR (IBM microdrives) disks from each station.
Disk2 from station 1 only contains July lab data. Disk5 from stn1
has data starting Aug 14.
The two disks from station 3 have useful August data. It appears that
the only disk swap was at stn3, on Aug 14.
Since the SDRs contain the early data, they must have quit writing
once they filled up, and (fortunately) did not delete old files.
Here are ls -l of each disk, followed by the time values provided by
$PAM/scripts/sdr_show_date -4
Stn1, disk #2
ls -l:
-rwxrwxr-x 1 maclean sssf 19370467 Jan 1 2018 niwot101.dat
-rwxrwxr-x 1 maclean sssf 19611939 Jan 2 2018 niwot102.dat
-rwxrwxr-x 1 maclean sssf 6307840 Jan 2 2018 niwot103.dat
file date
niwot101.dat 020725.221635 had chan 4 length problem (2 should be 3)
niwot102.dat 020726.061629 had chan 4 length problem (2 should be 3)
niwot102.dat 020726.141637 had chan 4 length problem (2 should be 3)
Since the dates are July, this disk is of lab data.
Stn1 disk #5
total 348072
-rwxrwxr-x 1 maclean sssf 55336649 Aug 5 1980 niwot102.dat
-rwxrwxr-x 1 maclean sssf 55223871 Aug 6 1980 niwot103.dat
-rwxrwxr-x 1 maclean sssf 55311905 Aug 7 1980 niwot104.dat
-rwxrwxr-x 1 maclean sssf 55262628 Aug 8 1980 niwot105.dat
-rwxrwxr-x 1 maclean sssf 55541780 Aug 9 1980 niwot106.dat
-rwxrwxr-x 1 maclean sssf 53141504 Aug 9 1980 niwot107.dat
-rwxrwxr-x 1 maclean sssf 26583040 Aug 11 1980 niwot108.dat
drwxrwxr-x 2 maclean sssf 8192 Aug 14 12:50 recycled
file date
niwot102.dat 020814.203341 had chan 4 length problem (2 should be 3)
niwot103.dat 020815.204005 had chan 4 length problem (2 should be 3)
niwot104.dat 020816.204015 had chan 4 length problem (2 should be 3)
niwot105.dat 020817.204011 had chan 4 length problem (2 should be 3)
niwot106.dat 020818.204022 had chan 4 length problem (2 should be 3)
niwot107.dat 020819.204023 had chan 4 length problem (2 should be 3)
niwot108.dat 020820.194505 didn't need fix
recycled/dd12.01z 020622.080124 IHOP data?
recycled/dd13.32z 020622.003231 IHOP data?
The RF archive contains data from 020814.212108. However it suffers
from the channel 4 problem so converting these files will gain some
data.
Stn3 disk #1
total 309760
-rwxrwxr-x 1 maclean sssf 41435136 Jan 1 2021 niwot10g.dat
-rwxrwxr-x 1 maclean sssf 57344 Dec 21 1914 niwot10h.dat
-rwxrwxr-x 1 maclean sssf 55762860 Jan 2 2010 niwot301.dat
-rwxrwxr-x 1 maclean sssf 55782410 Jan 3 2010 niwot302.dat
-rwxrwxr-x 1 maclean sssf 55777648 Jan 4 2010 niwot303.dat
-rwxrwxr-x 1 maclean sssf 55774014 Jan 5 2010 niwot304.dat
-rwxrwxr-x 1 maclean sssf 52591448 Jan 6 2010 niwot305.dat
file date
niwot10g.dat 020730.232109 had chan 4 length problem (2 should be 3)
niwot10h.dat 020731.173038 had chan 4 length problem (2 should be 3)
niwot301.dat 020809.205547 had chan 4 length problem (2 should be 3)
niwot302.dat 020810.205454 had chan 4 length problem (2 should be 3)
niwot303.dat 020811.205456 had chan 4 length problem (2 should be 3)
niwot304.dat 020812.205501 had chan 4 length problem (2 should be 3)
niwot305.dat 020813.205507 had chan 4 length problem (2 should be 3)
RF archive contains data from 020814.212236, so these files will help.
Stn3 disk #6
-rwxrwxr-x 1 maclean sssf 55546305 Jan 7 2010 niwot306.dat
-rwxrwxr-x 1 maclean sssf 55795404 Jan 8 2010 niwot307.dat
-rwxrwxr-x 1 maclean sssf 36233216 Jan 8 2010 niwot308.dat
-rwxrwxr-x 1 maclean sssf 98304 Jan 8 2010 niwot309.dat
-rwxrwxr-x 1 maclean sssf 55787828 Jan 9 2010 niwot30a.dat
-rwxrwxr-x 1 maclean sssf 55787385 Jan 10 2010 niwot30b.dat
-rwxrwxr-x 1 maclean sssf 55791484 Jan 11 2010 niwot30c.dat
-rwxrwxr-x 1 maclean sssf 15966208 Jan 12 2010 niwot30d.dat
file date
niwot306.dat 020814.193618 had chan 4 length problem (2 should be 3)
niwot307.dat 020815.193600 had chan 4 length problem (2 should be 3)
niwot308.dat 020816.193606 had chan 4 length problem (2 should be 3)
niwot309.dat 020817.111148 had chan 4 length problem (2 should be 3)
niwot30a.dat 020817.111449 had chan 4 length problem (2 should be 3)
niwot30b.dat 020818.111501 had chan 4 length problem (2 should be 3)
niwot30c.dat 020819.111505 had chan 4 length problem (2 should be 3)
niwot30d.dat 020820.111511 had chan 4 length problem (2 should be 3)
IO error reading niwot30d from microdrive
recycled/dd12.01z 020622.080124 IHOP data (we have these files on CD)
recycled/dd13.32z 020622.003231 IHOP data
30: LOG, Site all, Tue 22-Oct-2002 15:20:26 MDT, chronology
Here is a chronology based upon the data archive, system logs
(and anybody's notes or recollection?):
Aug 7 17:41 MDT Reboot of aster. No more reboots are seen in the system
log until Aug 24 stn1,3 ingest timeouts until Aug 14 15:18
Therefore aster must have been installed in the CUFF trailer
on Aug 7.
Aug 9 14:55 MDT Date of earliest station 3 (east) SDR data
Aug 14 14:33 MDT Date of earliest station 1 (west) SDR data
Aug 14 11:54 MDT First cosmos message in system log: first archive file
cos020814.175426
Aug 14 15:18 MDT last select timeouts for stn1 and 3, receiving RF data
24: LOG, Site , Tue 17-Sep-2002 15:40:22 MDT, Site visit
On 16 Sept Sean and Britt visited the Niwot site.
Here are Seans comments:
9/16/02 INTERCOMPARISON SYSTEM FIELD NOTES
Sean Burns and Britt Stephens took these data.
Cylinder Init. P (before opening valves) Pressure (valves open)
A 0 1400
B 1310 1500
C 1400 1400
D 1405 1800
System Time Event ICS Gas Line
NCAR-A 15:04:00 Connect to LiCorA -- Hydra was on S3
NCAR-A 15:04:20 step 4-way A
NCAR-A 15:07:23 step 4-way B
NCAR-A 15:09:43 step 4-way C
NCAR-A 15:11:53 step 4-way D
NCAR-A ---Hydra Cal started at about 3:11:58 and went till 15:24:30.
NCAR-A 15:24:40 stayed on D D
NCAR-A 15:28:55 step 4-way A (went back to A for 3-min cal gas)
NCAR-A 15:32:03 3-way back to hydra hydra on S6.
NCAR-B 15:35:55 3-way to ICS A hydra on S1 or S9.
NCAR-B 15:38:55 step 4-way B
NCAR-B 15:41:55 step 4-way C
NCAR-B 15:44:59 step 4-way D
NCAR-B 15:48:35 3-way back hydra on S1
USGS 16:10:11 run start A on L7, USGS Time~= 15:01:24
USGS 16:13:02 step 4-way B
USGS 16:15:52 step 4-way C
USGS 16:18:50 step 4-way D
USGS ---checked LiCor response by switching from D to A...in about 5-10sec
LiCor readout went from 455 to 430.
USGS 16:24:00 3-way back on L13 (?), USGS Time= 15:17:30
USGS note: time check, Licor USGS=15:14:00 when my watch= 16:20:30
CU 16:40:08 to man, C2 on L6
CU 16:47:45 3-way to ICS A
CU 16:51:05 step 4-way B
CU 16:54:05 step 4-way C
CU 16:57:05 step 4-way D
CU 17:01:40 C2 on, to auto L2
*the times shown are from my watch which i know is about 5 minutes
fast (i should have corrected for this). a comparison of my watch
time and GPS time is: GPS Time=16:12:00, My Watch=16:16:29
next time i will adjust my watch to GPS time before doing the
comparisons....
--------------------------------
1: LOG, Site none, Fri 28-Jun-2002 13:22:14 MDT, Logbook created
initial log file /net/aster/projects/NIWOT02/logbook/tklog.log created by USER maclean
|