 Appendix V: Science Team Performance Measures
Performance measures are being established and evaluated for each of the
SOCD science teams. These performance measures are preliminary versions
and subject to revision.
Ocean Color
- Overarching Performance Measure: Develop and maintain the
capability to produce climate quality Ocean Color derived products.
- Task Performance Measures:
- MOBY has maintained a continuous, traceable, time series
calibration record of normalized water-leaving radiance (LWN)
for the past seven years. Performance will be tracked by the
continuous climate-quality calibration/validation data record of
spectral water-leaving radiances at the MOBY site. Additionally,
performance will be measured by meeting the IPO objective to
measure operational, ocean water-leaving radiance values with
a threshold precision of 5% and a goal of 2% and reprocessed
science quality data with a threshold of 2% and a goal of 1%.
- MOCE cruise performance will be tracked by the number of
validation match up points in the benchmark data set.
- This performance metric assesses the implementation of the
MODIS Quality Assurance Browse Imagery (MQABI) quality assurance
system by the end of FY05 and resulting operational validation of
the ocean color data stream products with in situ match-ups.
- Implement all SOCD bio-optical product algorithms into NOAA
operational production while meeting the IORD goals to measure
operational chlorophyll concentrations with accuracy of 20% and
operational inherent optical properties with an accuracy of 30%.
Another performance measurement will be to produce science quality
chlorophyll concentrations with an accuracy of 10% and science
quality inherent optical properties with an accuracy of 20%
- Complete and initial transition the NRL optical water mass
classification capability to NOAA by the end of FY06 and evaluate
its utility for NOAA requirements.
Sea Surface Height
- Overarching Performance Measure: To maximally utilize
satellite altimetry, complementary sea level, SST, and wind speed
measurements to advance our knowledge of climate variability, ocean
dynamics, gravity, and bathymetry.
- Task Performance Measures:
- Altimeter Data Sets. Improve GFO GDR sea surface height accuracy
from 5 cm in FY04 to 4 cm in FY06 using Topex/Poseidon and Jason-1
as the standard.
- Ocean Dynamics. Applications: Increase percentage of ocean area
covered by OSCAR analysis from ~20% (tropical Pacific) in FY04 to
~50% (all tropical oceans) by FY06, to ~80% (all mid to low latitude
oceans) by FY08. Operations: Decrease turn-around time for OSCAR
product from 10 days in FY04 to 1 week in FY06.
- Marine Gravity & Bathymetry. Decrease error in marine gravity
from 7 mGal in FY05 to 5 mGal in FY08. Applications: Improve global
G&B resolution from 30 km in FY05 to 20 km in FY08.
- Climate. Increase confidence in historical global sea level rise
value from +/- 0.5 mm/yr in FY04 to +/- 0.3 mm/yr in FY08
Ocean Surface Winds
- Overarching Performance Measure: To provide the highest
quality remotely-sensed wind products over all environmental conditions
in support of NOAA's operational mission
- Task Performance Measures:
- Full utilization of QuikSCAT scatterometer data by the operational
weather community. Implementation of an improved high wind speed model
function for QuikSCAT based on aircraft experiment data. Quantification
of rain impacts on scatterometer wind vector retrievals. Validation and
implementation of a reduced landmask to allow use of QuikSCAT winds
closer to the coast. Full readiness to support operational utilization
of ASCAT data, which is currently scheduled for a December 2005 launch.
- A full evaluation of the capabilities and limitations of ocean vector
wind retrievals from WindSat. A comparison of WindSat and QuikSCAT wind
vector retrievals.
- An operational demonstration of a global ocean upwelling index
product running in near-real time.
Sea Surface Roughness
- Overarching Performance Measure: Research, develop,
and demonstrate marine applications of SAR data, leading to
greater use and acceptance of these products in operational
offices of NOAA and/or other Government agencies.
- Task Performance Measures:
- Increase the number of synthetic aperture radar (SAR)
observation platforms which have been used in applications
demonstrations to meet user observation requirements from
1 to 3 by 2008.
- Increase the number of synthetic aperture radar user
observation requirements met within applications demonstrations
from 1 to 3 by 2008.
- Increase the number of new research findings and progress
toward their implementation in applications demonstrations by
completing at least two papers or technical reports per year on
research findings in SAR applications.
- Improve ship detection algorithm and data processing techniques
to yield a 60% or greater detection performance in FY 2006.
Sea Surface Temperature
- Overarching Performance Measure: Produce the best SST
products from individual satellite measurements and merged
satellite measurement.
- Task Performance Measures:
- Maximize algorithm performance for each instrument (not
instrument design or specifications) and apply to all project
task objectives. The indicator is satellite SST product algorithm
validation results.
- Accuracy and precision
- Target = 0.1K instantaneous
- Metric = systematic (mean) and random (std)
error relative to ground truth
- Indicator = statistics determined from ground
truth match-ups
- Baseline = 0.5K rms random; <0.1K systematic
- Stability
- Target = 100% up time
- Metric = up time / year
- Indicator = operational log history
- Baseline = 95% up time
Sea Ice
- Overarching Performance Measure:
Development or transition of at least one NIC sea ice product
or application that exploits the availability of unique NIC
time-series in support of climatological research.
- Task Performance Measures:
- Sea Ice Product and Research Development: Products are evaluated using
model, buoy data and observations using NOAA as well as other ships and
aircraft resources of opportunity. Product evaluation and feedback by
present and new users is sought. The number of new and updated experimental
products, transitioned products, and new users will be followed. In
addition, where appropriate skill scores will be developed to determine
product performance.
- Sea Ice Altimetry Research: For altimetry Cal/Val, decrease the
amplitude of error in estimated sea-ice freeboard from approximately
1.0 m to 15 cm by 2006 along CryoSat ground tracks and the wavelength of
freeboard error to 0.5 km. For altimetry climate, establish first year of
sea-ice mass time series (monthly intervals) by end 2007.
- National Ice Center Polar Research: Products are evaluated using model,
buoy data and observations using NOAA as well as other ships and aircraft
resources of opportunity. Product evaluation and feedback by present and
new users is sought after. The number of new and updated experimental
products, transitioned products, and new users will be followed. In
addition, where appropriate skill scores will be developed to determine
product performance.
Return to top
|
|
|
