A multi-sensor approach for the on-orbit validation of ocean color satellite data products

https://doi.org/10.1016/j.rse.2006.01.015Get rights and content

Abstract

The validation of satellite ocean color data products is a critical component in establishing their measurement uncertainties, assessing their scientific utility, and identifying conditions for which their reliability is suspect. Such efforts require a considerable amount of high quality in situ data, preferably consistently processed and spanning the satellite mission lifetime. This paper outlines the NASA Ocean Biology Processing Group's (OBPG) method for validating satellite data products using in situ measurements as ground truth. Currently, the OBPG uses the described method for validating several historical and operational ocean color missions. By way of a case study, results for the Sea-Viewing Wide Field-of-View Sensor (SeaWiFS) are shown. These results indicate that for the majority of the global ocean, SeaWiFS data approach the target uncertainties of ± 5% for clear water radiances as defined prior to launch. Our results add confidence in the use of these data for global climate studies, where a consistent, high quality data set covering a multi-year time span is essential.

Introduction

Estimating the rates and magnitudes of ocean primary productivity on regional and global scales is key to understanding the role of the ocean in the Earth's carbon cycles (Behrenfeld & Falkowski, 1997b, Longhurst et al., 1995, Kuring et al., 1990, Prasad & Haedrich, 1994). The synoptic views of the marine biosphere captured by satellite-based ocean color instruments provide valuable data at spatial and temporal scales unattainable with shipboard or moored instrumentation. This was aptly demonstrated by the proof-of-concept Coastal Zone Color Scanner (CZCS) (Gordon et al., 1983, Hovis et al., 1980). Drawing on its successful legacy, a number of advanced ocean color satellite instruments were launched in the past decade [e.g., the Ocean Color and Temperature Scanner–OCTS (Iwasaki et al., 1992), the Sea-viewing Wide Field-of-view Sensor–SeaWiFS (Hooker et al., 1992), the Moderate Resolution Imaging Spectroradiometer–MODIS (Salomonson et al., 1989), and the Medium Resolution Imaging Spectrometer–MERIS (Rast & Bezy, 1999)]. More are scheduled for launch in the near future [e.g., the Visible Infrared Imager/Radiometer Suite–VIIRS (Welsch et al., 2001)–on board the National Polar-orbiting Operational Environmental Satellite System].

Space-borne ocean color instruments measure the spectrum of sunlight reflected from ocean waters at selected visible and near-infrared wavebands. These radiance spectra are used to estimate geophysical parameters, such as the surface concentration of the phytoplankton pigment chlorophyll a, Ca, via the application of bio-optical algorithms (O'Reilly et al., 1998). These derived data products are subsequently input into secondary (i.e., higher order) geophysical algorithms, as is the case for marine primary production, PP (e.g., Behrenfeld and Falkowski, 1997a). The uncertainties in global estimates of Ca and PP are contingent on the uncertainties of their model input parameters (e.g., spectral reflectance and Ca). Predictably, uncertainty increases for secondary algorithms that require derived products as input (Behrenfeld & Falkowski, 1997b).

Global accuracy goals for spectral reflectance and Ca for modern sensors are commonly defined as 5% and 35%, respectively, in clear, natural waters (Hooker et al., 1992). As such, statistical validation of these products is prerequisite in verifying that such goals are being met. Following McClain et al. (2002), we define validation as “the process of determining the spatial and temporal error fields of a given biological or geophysical data product”. The NASA Ocean Biology Processing Group (OBPG) at the Goddard Space Flight Center executes satellite validation activities via the direct comparison of remotely sensed measurements with coincident in situ measurements. The OBPG maintains responsibility for the operational processing of ocean color data within NASA, as well as the post-launch calibration, validation, and subsequent distribution of the data products. A significant component of this responsibility is quantifying how well the satellite-retrieved products reflect true conditions. As will be highlighted in a subsequent section, a comprehensive in situ data set with measurements covering a wide range of oceanographic conditions is essential in this process (Werdell & Bailey, 2005).

Much recent refereed research on ocean color validation efforts focuses on comparisons of satellite-derived Ca retrievals with regional in situ data sets, many of which are based on specific, or single, field campaigns (e.g. Barbini et al., 2005, D'Ortenzio et al., 2002, Gohin et al., 2002, He et al., 2000, Smyth et al., 2002). While a necessary step towards a comprehensive understanding of the uncertainties in global primary production models, validation of satellite-retrieved Ca alone is insufficient, as uncertainties in the retrievals are strongly affected by the uncertainties in the Ca algorithm applied. Moreover, as many Ca algorithms make use of reflectance ratios (O'Reilly et al., 1998), underlying problems with radiometry are often masked. Since the primary measurement of satellite-based sensors is spectral radiance, the focus of the OBPG validation activity is on the retrieved water-leaving radiance (Lwn(λ)) estimates. Several other independent studies include validation of spectral reflectance (e.g., Froidefond et al., 2002, Gordon et al., 1983, Pinkerton & Aiken, 1999); however, these also suffer from the limitations imposed by short-term, regional or cruise-specific data sets.

In developing their calibration and validation program, the OBPG adopted the approach of globally validating satellite ocean color sensors throughout the life of their missions, particularly for data products to be used in long-term multi-sensor time series (Barnes et al., 2003, Donlon et al., 2002). Without continuous validation for monitoring the long-term stability of satellite instruments, such efforts are hindered as uncertainties in sensor calibration are not tracked, and potential instrument effects may, therefore, be misinterpreted as geophysical phenomena. This is particularly true for remotely sensed ocean color as the Lwn(λ) component accounts for only about 10% of the total reflectance signal received by the sensor at the top of the atmosphere in the visible wavelengths (Gordon, 1998).

Ultimately, experience has demonstrated that a number of benefits are realized with a rigorous validation activity, including: (i) the assignment of a measure of accuracy to satellite-derived products, which lends confidence to their scientific utility in higher-order derived products (Behrenfeld & Falkowski, 1997b); (ii) the verification of on-orbit satellite calibration (Barnes et al., 2001); (iii) the evaluation of the long-term stability of satellite measurements (Franz et al., 2005); and (iv) the identification of conditions, either oceanic, atmospheric or satellite specific, for which satellite-derived products are invalid. In this paper, we outline and define the NASA OBPG satellite validation approach. The method described may be applied to most sensors with few modifications, and in fact, the OBPG incorporates these methods in their current OCTS, SeaWiFS, and MODIS validation activities. Results for SeaWiFS are presented.

Section snippets

In situ data

The OBPG maintains a local repository of in situ bio-optical data, the SeaWiFS Bio-optical Archive and Storage System (SeaBASS) (Hooker et al., 1994, Werdell et al., 2003), with the purpose of acquiring a data set of sufficient size, quality, and diversity to support and sustain its regular scientific analyses. SeaBASS is populated with both voluntary and funded data contributions from investigators worldwide (Fargion et al., 2004). To develop consistency across multiple contributors and

Validation results: SeaWiFS

We acquired 4124 and 11 059 in situ radiometric and pigment observations, respectively, with spatial and temporal coincidence with SeaWiFS data. These resulted in a maximum of 629 radiance and 1293 Ca validation records after all exclusion criteria were applied (Fig. 2). The spectral radiance sample sizes vary with wavelength because of differences in field instrumentation. Approximately 58% of the potential validation points were eliminated due to lack of sufficient valid satellite retrievals

Discussion

Given the rate of return of approximately 15%, the task of validating ocean color sensors requires a dedicated in situ data collection effort to ensure that sufficient data are available to assess the satellite sensor performance on regional, global, and mission-long scales. The SeaWiFS Project Office (the precursor of the OBPG) understood this requirement early in mission planning (Hooker & McClain, 2000, Hooker et al., 1992), and initiated the development of SeaBASS to address this need. As a

Acknowledgments

This work was funded by the NASA Earth Observing System (EOS)/MODIS and NASA Ocean Biogeochemistry Programs. The authors are grateful to C. McClain, G. Feldman, G. Fargion, and all OBPG Staff members for their support and assistance in this effort. We also wish to thank all of the investigators who contributed their data to SeaBASS making such a comprehensive validation effort possible. The utility and success of SeaBASS and our validation activity relies on the tremendous efforts put forth by

References (69)

  • P.J. Werdell et al.

    An improved bio-optical data set for ocean color algorithm development and satellite data product validation

    Remote Sensing of Environment

    (2005)
  • D. Antoine et al.

    Oceanic primary production: 2. Estimation at global scale from satellite (CZCS) chlorophyll

    Global Biogeochemical Cycles

    (1996)
  • S.W. Bailey et al.

    Normalized water-leaving radiance and chlorophyll a match-up analyses

  • K. Baith et al.

    Data analysis system developed for ocean color satellite sensors

    EOS Transactions

    (2001)
  • R. Barbini et al.

    Comparison of SeaWiFS, MODIS-Terra and MODIS-Aqua in the Southern Ocean

    International Journal of Remote Sensing

    (2005)
  • R.A. Barnes et al.

    Stray light in the SeaWiFS radiometer

  • R.A. Barnes et al.

    Calibration of SeaWiFS: I. Direct techniques

    Applied Optics

    (2001)
  • R.A. Barnes et al.

    Development of a consistent multi-sensor global ocean color time series

    International Journal of Remote Sensing

    (2003)
  • M.J. Behrenfeld et al.

    A consumer's guide to phytoplankton primary productivity models

    Limnology and Oceanography

    (1997)
  • M.J. Behrenfeld et al.

    Photosynthetic rates derived from satellite-based chlorophyll concentration

    Limnology and Oceanography

    (1997)
  • K. Ding et al.

    Atmospheric correction of ocean color sensors: Effects of the Earth's curvature

    Applied Optics

    (1994)
  • C.J. Donlon et al.

    Toward improved validation of satellite sea surface skin temperature measurements for climate research

    Journal of Climate

    (2002)
  • G.S. Fargion et al.

    SIMBIOS program in support of ocean color missions: 1997–2003

  • Franz, B. A. (2005). Msl12 user's guide. URL...
  • B.A. Franz et al.

    The continuity of ocean color measurements from SeaWiFS to MODIS

  • J.-M. Froidefond et al.

    SeaWiFS data interpretation in a coastal area in the Bay of Biscay

    International Journal of Remote Sensing

    (2002)
  • R. Frouin et al.

    A simple analytical formula to compute clear sky total and photosynthetically available solar irradiance at the ocean surface

    Journal of Geophysical Research

    (1989)
  • F. Gohin et al.

    A five channel chlorophyll concentration algorithm applied to SeaWiFS data processed by SeaDAS in coastal waters

    International Journal of Remote Sensing

    (2002)
  • H.R. Gordon

    Normalized water-leaving radiance: Revisiting the influence of surface roughness

    Applied Optics

    (2005)
  • H.R. Gordon et al.

    Estimation of the depth of sunlight penetration in the sea for remote sensing

    Applied Optics

    (1975)
  • H.R. Gordon et al.

    Retrieval of water-leaving radiance and aerosol optical thickness over the oceans with SeaWiFS: A preliminary algorithm

    Applied Optics

    (1994)
  • H.R. Gordon et al.

    Phytoplankton pigment concentrations in the Middle Atlantic Bight: Comparison of ship determinations and CZCS estimates

    Applied Optics

    (1983)
  • H.R. Gordon et al.

    A semianalytic radiance model of ocean color

    Journal of Geophysical Research

    (1988)
  • M.-X. He et al.

    Retrieval of chlorophyll from remote-sensing reflectance in the China seas

    Applied Optics

    (2000)
  • Cited by (760)

    View all citing articles on Scopus
    View full text