Project #1999-803 MAP

Mesoscale Alpine Programme

Kuettner, et al.

NSF/NCAR L-188 Electra (N308D)


Data Quality Report

by Allen Schanot & Krista Laursen

This summary has been written to outline basic instrumentation problems affecting the data set and is not intended to point out every bit of questionable data. It is hoped that this information will facilitate use of the data as the research concentrates on specific flights and times.

The following report covers only the RAF-supplied instrumentation and is organized into two sections. Section I lists recurring problems, general limitations and systematic biases in the standard RAF measurements. Section II lists isolated problems occurring on a flight-by-flight basis.

Section I: General Discussion

  1. Moderate to heavy icing levels were encountered on several flights. Incidents of aircraft icing can be easily detected by examining the output of the Rosemount Icing Detector (RICE). Although many of the instruments on the aircraft are deiced, moderate icing of the instruments will significantly alter the performance characteristics of all of the available instruments. Care should be used when examining data from these intervals.

  2. A Trimble Global Positioning System (GPS) was used as a more accurate position reference during the program. The system generally performed well, and the GPS position values are normally used for all research efforts. However, sharp turns do occasionally interrupt the reception from some satellites. These cases are characterized by a small, instantaneous shift in position. Once the aircraft has come out of the turn, the track will typically shift back. For a smooth transition across these position shifts, RAF recommends that the XLATC/XLONC position data be used. These values are derived from a combination of the GPS and Inertial Reference Unit (IRU) position data. (See separate item below.)

    Note: A lightning strike to the aircraft during flight RF21 resulted in some damage to the GPS. Data from subsequent flights exhibit some significant dropouts in GPS data collection. Specific occurrences are noted in the flight-by-flight summary provided below.
  3. The wind data for this project were derived from measurements taken with the radome wind gust package. As is the case with all wind gust systems, the ambient wind calculations can be adversely affected by either sharp changes in the aircraft's flight attitude or excessive drift in the onboard Inertial Reference Unit (IRU). Turns, and more importantly climbing turns, are particularly disruptive to this type of measurement technique. Wind data reported for these conditions should be used with caution.

    As an additional enhancement to this data set, a second-pass correction was applied to the wind data using position and ground speed updates provided by the GPS. Both the GPS-corrected and uncorrected values are included in the final data set. RAF strongly recommends that the GPS-corrected winds be used for all research efforts.

    The RAF uses the on-board GPS measurements to correct the position and ground speed errors that are inherent in the IRU measurements. When the GPS is working properly, it can be used as a reference with accuracy of better than 100 meters in position and 1 meter/sec in ground speed. The GPS provides a good absolute measurement, best for long-term averages, while the IRU provides a good relative measurement and is good for short term measurements. Furthermore, the IRU provides an almost noise-free and continuous signal while the GPS provides an intermittent signal sometimes characterized by noise. The simplest way to take advantage of the relative strengths of these two measurements (when both are present) is to apply a low-pass filter to the GPS measurements and a complementary high-pass filter to the IRU measurements and then add the two. RAF's algorithm accomplishes this with the addition of some tests and corrections for when the GPS signal is not present. Typically the GPS dropouts occur when the aircraft is maneuvering (a roll angle > 20°); they are short in duration and can be easily dealt with. During a few flights in MAP, the GPS signal dropped out for up to 20 minutes for reasons that are not clear. They can be determined by noting spikes and level shifts in the GPS variables (GLAT, GLON, GVNS, GVEW) accompanied by changes in the GPS status flags (GMODE, GSTAT).

    An alternate set of variables that incorporates the GPS/IRU blending should be considered the best of both. These variables are: corrected position and ground speed (XLATC, XLONC, XVNSC, XVEWC) and winds (XWSC, XWDC, XUIC, XVIC, XVXC, XVYC). In the case of a long-term GPS dropout (> 20 minutes), the blended solution will revert to an all-IRU calculation with all of its associated drift errors. Many flights have short-duration GPS dropouts lasting from several seconds to several minutes (< 3 minutes) caused by aircraft maneuvering or unexplained GPS reception errors. The correction algorithm handles these short dropouts without loss of GPS accuracy.

    In summary, the algorithm using the blended GPS/IRU measurements should produce the best results in terms of accuracy in position, ground speed and winds. These are the 'X' variables listed above. If the GPS has lost reception longer than 20 minutes, the accuracy of these variables will be no better than the raw IRU variables. The GPS condition can be monitored by looking at the GPS status flags, GSTAT and GMODE. A condition with GMODE = 4 and GSTAT = 0 is the best. Flights with longer-duration dropouts are: RF18, RF19, RF20, RF24, RF25, RF28 and RF29.

  4. RAF flies redundant sensors to assure data quality. Performance characteristics differ from sensor to sensor with certain units being more susceptible to various thermal and dynamic effects than others. Good comparisons were typically obtained between the two standard temperatures (ATRL, ATFH), three dynamic pressures (QCRC, QCFC, QCWC), two liquid water sensors (PLWCC, PLWCC1), the two dew pointers (DPT, DPB), and in the three static pressures (PSFDC, PSFC, PSWC). The reference pressure used in all of the derived measurements (PSFDC) was obtained with a Rosemount Model 1501 unit. The two remote surface temperature sensors (RSTB, RSTB1) generally functioned well, but there were times when the two measurements differ significantly. Various derived measurements require input from one or more of these standard sensors. Reference sensors are selected for each project, depending on a review of their performance. Reference sensor designations can be found in the project's Aircraft Variable List.

  5. One of the key inputs to most of the derived measurements is aircraft true airspeed (TASX) which is calculated using dynamic pressure. Normally the radome dynamic pressure (QCR, QCRC) would be used as the reference input, because the high-rate characteristics (10 Hz) from the radome gust probe system are better than the other options. Due to occasional problems with icing of the radome, however, the decision was made to use the fuselage dynamic pressure (QCF, QCFC) as the reference sensor in the standard low-rate data set. The two systems are well matched, so this change will not affect the overall accuracy of the data.

  6. Temperature measurements were made using the standard heated (ATFH) and unheated (ATRL) Rosemount temperature sensors along with the OPHIR-III (OAT) radiometric temperature sensor. All of the standard temperature sensors performed reasonably well, encountering the usual problems with sensor wetting and icing during cloud passes. A comparison of the data sets yielded good correlation in instrument signatures and only small differences in absolute value (±0.2 °C) throughout the program. A comparison of pre- and post-program calibrations indicated that all units maintained stable and independent calibrations. Due to the unusually high incidence of icing, ATFH was selected as the reference value used in calculating the derived measurements.

    The OPHIR-III sensor was flown because it is not sensitive to interference from sensor wetting or icing. The unit performed well, and its output was well correlated to the in-situ sensors in clear air. It should be noted, however, that the OPHIR-III installation on the Electra is biased with a slight upward tilt. With its integrated sample volume extending 10-30 meters out from the aircraft, the unit's output provides a measurement of ambient temperature from a layer slightly higher in altitude than the in-situ sensors. Under normal conditions the difference in temperatures over this height scale is not noticeable. Some flight legs, however, were conducted in the presence of a very sharp thermal inversion. Under those conditions the OPHIR-III output can differ by as much as 2 °C.

  7. Humidity measurements were made using two collocated thermoelectric dew point sensors and two Lyman-alpha fast-response hygrometers. Generally speaking, the humidity sensors performed well. As is typically the case, the two dew point sensors (DPBC, DPTC) were set up differently to provide the best coverage under the widest range of ambient conditions. DPTC was set up for fast response, but its dynamic range was more limited, and it had a tendency to break into oscillation. DPBC was a little slower but had the capability of measuring greater dew point depressions. A comparison of the data sets yielded good correlation in instrument signatures during the largest portions of the flights when both instruments were functioning normally. DPBC was selected as the reference value used in calculating the derived measurements.

    There are two variations in sensor housings for the Lyman-alpha hygrometers: an exposed stub (VLA1, RHOLA1, MRLA1) and a cross-flow tube (VLA, RHOLA, MRLA). The stub has a faster response, but the sample volume is exposed to liquid water in the atmosphere and is very susceptible to wetting of the viewing windows. The cross-flow tube is somewhat slower, but the sample volume is protected from wetting and will provide better data during cloud passes. All Lyman-alpha hygrometers are susceptible to in-flight drift in the instrument's bias voltage. Due to this problem, RAF uses a special data-processing technique to remove the bias drift by referencing the long-term humidity values to one of the more stable thermoelectric dew point sensors. Measurements from the two systems remained well correlated for clear-air sampling but showed significant differences during cloud penetrations.

  8. A set of upward- and downward-looking radiometers was deployed on the Electra for the measurement of downwelling and upwelling ultraviolet (UV), short wave and infrared (IR) radiation. RAF recently implemented a processing algorithm that removes the effects of aircraft attitude from the upward-looking shortwave radiometer data. Users should note that the uncorrected upward-looking shortwave radiometer's variable name is SWT, while the correct, upward-looking shortwave variable name is XSWTC. A description of this correction process is provided in RAF Bulletin No. 25.

    The algorithm used to remove the effects of aircraft attitude from the upward-looking shortwave radiometer data requires estimates of the shortwave direct and diffuse radiation fractions. For the MAP data set, a simple radiative transfer model was used to estimate these direct and diffuse fractions, and it was determined during this analysis that the same average fraction values could be used for processing each of the 29 research flights. The direct and diffuse radiation fractions used during the processing of the data were 0.62 and 0.38, respectively.

    During processing and quality checking of the MAP hemispheric radiometer data, it was determined that small offsets (possibly attributable to inaccuracies in the sensor calibration data) existed in the downwelling and upwelling shortwave and UV radiometer data. The magnitude of the offset for each of the four affected sensors was determined and removed during the processing of the SWT, SWB, UVT, and UVB data.

  9. Thermal temperature chamber experiments have indicated that the Heimann sensors (RSTB, RSTB1), used to remotely measure the surface temperature, are sensitive to some thermal drift. In an attempt to deal with these problems, the units were equipped with a temperature-controlling heater system. In general, the heater system stabilized the signal fairly well. Some drift is still apparent in the data set. RSTB1 seemed to be the more stable of the two units and exhibited better accuracy in the regular, single-point, precision tests run prior to each flight. RSTB1 is therefore recommended as the reference system for this measurement.

    An additional Heimann (RSTT) was placed looking upward to monitor the presence of cloud decks above the altitude of the aircraft. When no upper-layer decks are present, RSTT will be pegged around -50 °C. During in-cloud passes or with upper-level cloud decks present, the output of the sensor will reflect either the near-field ambient temperature or the temperature of the cloud base, respectively.

  10. The altitude of the aircraft was measured in several ways. The primary measurement (PALT, PALTF) is derived from the static pressure using the hydrostatic equation and the U.S. Standard Atmosphere which assumes a constant surface pressure of 1013 mbar. The Inertial Reference Unit (IRU) outputs a similar measurement of altitude (ALT) by combining static pressure measurements with vertical accelerations. These outputs are well correlated, and either may be used. RAF recommends PALT as the reference value, however, as it is typically a cleaner signal and uses the research-grade static pressure sensor.

    Two radar altimeters were on board the aircraft for the project. The primary unit (HGME) functions at all altitudes but can be affected by surface signal reflections at altitudes below 50 meters AGL. The secondary unit (HGM) provides high-precision data from the surface to a maximum altitude of 800 meters AGL. Once the maximum limit on HGM has been exceeded, the signal becomes very noisy and will no longer be of use. Due to the errors in PALT & ALT introduced by using the standard atmosphere, HGME or HGM should be used as the low-altitude reference.

    The Trimble Global Positioning System also provides an altitude readout (GALT). The GALT signal has been "de-tuned" by the military and exhibits erratic oscillations of ±100 meters. These data have not been included in the final data set.

  11. Two hot-wire liquid-water sensors were used on the Electra during the program. The PMS King Probes (PLWCC, PLWCC1) worked reasonably well, and a comparison of the two units yielded a good correlation in most cases. Special note should be made that both of these instruments are calibrated for a specific range of aircraft speeds. Small changes in the baseline are apparent with speed changes as are small zero offsets. Each cloud penetration will require a baseline adjustment with the relative change providing the sampled liquid water content.

    Hot-wire units will provide an uncalibrated, positive response in the presence of significant concentrations of ice particles and, in this case, are not true measures of liquid water content. The two units were operated at significantly different wire temperatures. During intervals when predominantly ice particles are affecting sensor output, the signatures of the two systems will vary. At ambient temperatures less than 0°C, RAF recommends that the output of the icing rate indicator (RICE) be examined to confirm the presence of liquid water.

  12. The calculation of CN-sized aerosol particle concentrations (CONCN) is dependent upon total particle counts (CNTS) and the measurement of sample flow (FCN, FCNC). Sample flows are routinely corrected for altitude changes, but obstructions are possible. During this project the CN sample flow was drawn from a special moisture-separating inlet. This inlet avoids the false, order-of-magnitude jumps in in-cloud measurements resulting from droplet shattering.

  13. Penetration of convective systems can sometimes result in lightning strikes to the aircraft. During flight RF21, the Electra was struck by lightning two times. Several research systems, specifically the PMS 2D-C and 2D-P particle probes, were lost at the time of the strikes and remained out for the rest of the flight. It seems likely that several other systems were also affected, and it took several flights to correct some of these problems.

  14. Five PMS particle probes (FSSP-100, 260X, PCASP, 2D-C, 2D-P) were used on the project. Some specific details on each of the probes are summarized below:

    Special Note: During post-flight perusal of the 2D-C and 2D-P data, a problem with repeating 2D images was discovered. In the "Flight-by-Flight Summary" section below, notes are given for those specific flights for which this repeating image problem is known to exist. The problem itself consists of the first half of a displayed line of 2D data (both 2D-C and 2D-P) being repeated identically in the second half of the line. The RAF was unable to determine if the second (repeated) image section resulted in another section of data being overwritten (and hence lost). Thus, users are advised to carefully examine the 2D-C and 2D-P data for the noted problem flights. RAF has no reason to believe that the images themselves have been corrupted in any way.
  15. The RAF was responsible for the ozone measurements conducted on the Electra during the program. The variable TEO3C contains corrected data from the TECO Model 49 UV ozone analyzer. Two nearly identical instruments of this type were flown on the MAP project. Prior to this project, the sample cell windows of one of the instruments were modified with highly-polished, sapphire windows. This change was implemented in an effort to improve the performance of this sensor in rapidly-changing humidity environments. As a precautionary measure, an unmodified instrument was also deployed during this project. The raw signals of the unmodified and modified instruments were recorded as variables TEO3 and INTEO3, respectively. Comparison of the two raw signals led to the conclusion that this upgrade did not introduce new problems and significantly improved data coverage during high humidity encounters. Noise spikes and infrequent data dropouts were observed for both instruments but fortunately did not occur simultaneously. Except as noted below, the final data set was obtained using the upgraded instrument.

    The data have been corrected for pressure and temperature deviations from standard P and T using support measurements (variables TEP and TET, unless noted below). TET and TEP contained occasional noise spikes. These data were treated with a despiking filter to greatly reduce this noise contribution. This filter removed single-point noise spikes which exceeded a 5 mbar noise threshold. Some noise spikes remained in the output; many of these were removed manually from the final data set.

    Note: In areas of high aerosol content, the TECO instrument can have a positive interference. The dual-absorption cell instrument creates a blank by passing ambient air through an ozone destroyer. This component alters the aerosol number density in the absorption cell causing less scattering extinction in the blank measurement.
  16. Data recording typically begins well in advance of the actual aircraft takeoff time. Virtually all measurements made on the aircraft require some sort of airspeed correction, or the systems are simply not active while the aircraft remains on the ground. None of the data collected while the aircraft is on the ground should be considered valid.

Reference

Baumgardner, D., Korolev, A., 1997: Airpseed Corrections for Optical Array Probe Sample Volumes. J. Atmos. Oceanic Tech., 14, 1224-1229.

 

Section II: Flight-by-Flight Summary

Note: All times listed below are Coordinated Universal Time (UTC).

 

RF01

 

RF02

 

RF03

 

RF04

 

RF05

 

RF06

 

RF07

 

RF08

 

RF09

 

RF10

 

RF11

 

RF12

 

RF13

 

RF14

 

RF15

 

RF16

 

RF17

 

RF18

 

RF19

 

RF20

 

RF21
Note: Electra struck by lightning twice during this flight.

 

RF22

 

RF23

 

RF24

 

RF25

 

RF26

 

RF27

 

RF28

 

RF29
RAF's MAP Documentation Summary | RAF's MAP Home Page | RAF Home Page | EOL Home Page | NCAR Home Page

Last update: Thu Sep 20 12:24:55 MDT 2001