18 February, 1999

ZMP Data Management Plan

Laure Devine, Doug Gregory, Bob Keeley, Savi Narayanan, Dave Senciall

 

Introduction

The data management plan for the Zonal Monitoring Programme, ZMP, builds on the general data management policy agreed to by the National Data Management Working Group. Key elements of this policy are the recognition that data should be available in a timely way with full and open access (unless otherwise specified), and that data management will be shared among regions and MEDS (see Annex 1 for the draft DFO Science Data Management Plan). This implies that there may be a centralized archive for some types of data, while other types will be distributed over more than one region. In cases of distributed data holdings, MEDS will act as the primary contact, and will refer clients to other DFO data centres as appropriate. For ZMP, there will be four regional data centres at BIO, NAFC, IML and MEDS with MEDS also acting as the national centre.

The observational component of ZMP provides funds for monitoring at a number of fixed stations and further supports additional observations on a ship-of–opportunity basis. The program also makes extensive use of existing programs to meet the overall objectives of the program. Since it is the full suite of measurements that will determine how well the ZMP can monitor climate variations, it is necessary for the ZMP data management plan to consider how all of the data will be handled.

In general, the ZMP encourages the rapid availability of data. It is expected that the exchange will use WWW sites. The speed of data availability depends on the type of data but it has been agreed that all data will be available within one year of collection. This is necessary in order to support the product generation schedules and yearly reporting agreed to by the ZMP. It is expected that most data will appear for exchange among participants of the ZMP first, and later will become publicly available. The mechanism for this has not yet been defined.

The data management plan is structured to discuss the general components of a data management system and then to document the present state of how the relevant data are managed. Associated with each product is a discussion of any changes that are required to support the goals of the ZMP. Because of the diversity of data, each variable in the ZMP proposal is treated separately below. The data management components discussed here must be kept in mind in order that the ZMP data, products and information are made available to clients within the required time periods.

Objectives

The objectives of the data management plan are threefold:

  • To ensure that all data collected by or of interest to the Zonal Monitoring Program are processed, archived and available to the monitoring program in a timely manner.
  • To ensure the maintenance of existing data products and the development of new data products required by the program.
  • To ensure that all data collected under the ZMP will be integrated into the national ocean data archive(s) for use in other DFO programs, and in particular in the Canadian Climate Change research.

Components of the Data Management Plan

There are a number of components supporting ZMP data management. All of the tasks required by each may be carried out at a single location, or the work may be spread over more than one. The choice will be driven by the product and the expertise available to manage the data. Since the ZMP will also draw on data collected outside the programme, existing data management operations will be used as much as possible.

Data Assembly

Many of the products contemplated by the ZMP will require the consolidation of data collected by more than one person. Data consolidation from various sources is the job of a data assembly centre. While the collectors will have done some QC, other problems may not be detected until the data from one collection are assembled and compared with other collections. This means the data assembly centre must carry out other checks of the data before they are used for product generation. If data are delivered in a timely way to the assembly centre, the risk of duplication is likely to be minimized. However, depending on circumstances and the data types contributing to a product, duplicate identification and flagging may be needed. Finally, participants of the ZMP will need access to the data prior to product generation. The data assembly function includes providing access to the data.

Product Generation

Data products may be generated at all sites, but each product will be the responsibility of a specific site. It is likely that this process will detect further problems in the data. These problems must be addressed, and solutions passed to the site providing the long-term archive. In addition, the product must be made available within the required time frame, and to a broad audience. Only a few products are presently foreseen for the ZMP. However, as the programme evolves, more are expected.

Archive

Data contributing to the products will be sent to a long-term archive centre. Generally, there will not be a one-to-one relationship between an archive and a product. The archive must keep the data with all of the problems detected and flagged or corrected. In addition, it will be an important task to ensure duplication does not occur. Data will arrive from some sources too late to contribute to a yearly product, but they may be used in longer term analyses. These data also must be included in the archives. It is desirable that they undergo the same level of QC as was carried out against data contributing to a product. In addition, data from the archives must be available to users.

Data Flow Monitoring

Initially, there will be a yearly report to the ZMP Steering Committee of what data were collected, when, and by which region. There will be a distinction made between collections funded by the ZMP and other funding sources. The report will indicate data that were collected but whose access is restricted to ZMP members, and those that are in the final archives and publicly available. The dates at which these stages are reached will be noted.

As the program develops, other data flow monitoring tools will be necessary. It is MEDS' experience that different tools will be required for the different types of data handled. These tools will be identified as the details of the data flow for each product are finalized. The steps to take when deficiencies are noted will vary with the product and will be identified with the tools needed.

Information and Coordination

Beyond the specific data products required by the ZMP, there is also a coordination and information requirement. All product generation and components of the data management system will not be carried out at a single location. It will be important that a client of the ZMP be able to locate both data and products of interest as well as information about the ZMP.

Information about the ZMP (project plans, meeting reports, data collection standards, etc.) as well as the location of the data and products will be handled through WWW interfaces. MEDS will provide the starting pages for the ZMP, giving information about the program, and providing links to other sites where data, products or further information may be found.

Variable by Variable Analysis

A key component of the plan is an analysis of the data management and flow for each measured variable. Although most of these measurements are used in conjunction with others, different groups may carry out the initial processing and analysis. Tracking each variable will ensure that all of the data are properly managed.

The results are detailed in Annex II as individual tables for each variable.

Initiatives / Products

The data management component of the ZMP is supporting and taking advantage of a number of new and existing initiatives. In many cases, existing products are being modified or extended to meet the ZMP requirements. A brief description and status for each project follows.

ZMP Data Inventory - new

As part of MEDS activities in the National Data Management Working Group, it is developing a simple web-based query system to help users identify data collections of interest. This activity will focus on supporting the ZMP. The inventory will be situated on the MEDS site but will require support for updates by the regions. This will be publicly available.

ZMP WWW site - new

The ZMP will produce a number of documents. These will include the project plan, meeting results, and similar administrative documents. In addition, a series of standards for data collection, processing and analysis will be developed or agreed to. Documents to describe these standards are expected by and should be available to clients. MEDS will establish a WWW site on the DFO web site for these documents, which will be publicly available. Documents will be prepared by participants of the ZMP and given to MEDS for posting.

The ZMP intends to produce a variety of analyses from the data available. These will be prepared in the region that assumes responsibility for the analysis. The MEDS WWW site will reference these analyses when they are available from a regional WWW site. Where such a regional site is not available, MEDS will post them on its site. All of these analyses will be publicly available.

The MEDS ZMP web site will also display and provide access to the most recently available data from the fixed stations based on BATHY or TESAC-type submissions from the regions and elsewhere.

Biological – Chemical Database -new

The development of a database to organize and manage the biological and chemical data in DFO has been undertaken. A significant portion of such data, especially from the Atlantic and the Gulf of St. Lawrence is crucial to the success of the ZMP. Consequently, the development of the Biological-Chemical database and the migration to it of ZMP data as well as the large amount of existing data from the Atlantic Zone is the single largest component of the ZMP data management program.

In addition to being an integral part of the ZMP, the database development is also supported nationally through the Ocean Climate Program and regionally through A-base and Y2K critical application funds.

A great deal of progress on this project has been made in 1998/99. Specific highlights are:

  • Working group meetings at BIO in August and Ottawa in September have established a database design that has been accepted by the biologists, data managers and database developers involved. The model has been accepted by all of the regions involved in the ZMP as well as by IOS.
  • Responsible data managers have been designated in each region
  • Revisions to the design and a test implementation are being undertaken by a development group of Science and Informatics personnel in Maritimes region.

All of the work to date has been on the database design. There has been no final decision made on the fundamental question of how the database will be maintained as a zonal system. A number of options are available and must be explored.

Monitoring Sites – new / ongoing

The fixed stations are a major component of the ZMP. Data products from these fall into two categories. The most recent data (delay of approximately 1 month) will be available as part of the MEDS web site. Climatological data for some of the same locations will be maintained on regional web sites as part of an existing program.

Climate Database - ongoing

Development of the Oracle web implementation of the Climate (AFAP) database has been funded jointly by PERD (Ocean Information) and as a Y2K issue. This project is scheduled for completion in the spring of 1999. A lot of work has been put into developing the infrastructure, which will be used in subsequent database developments including AVHRR sea surface temperature (SST), time series statistics database (Ocean Data Inventory, ODI) and the Biological-Chemical database. Access to the entire Climate database will be available on the DFO Maritimes web site.

SST Database - ongoing

The weekly AVHRR SST database is currently being updated twice a year. The move to Oracle and web access is being treated as a Y2K issue. Completion of this project will not be until April, 1999 at the earliest. The FoxPro system will be maintained and updated until the new system is available. Access to the SST database will be through the DFO Maritimes web site.

Ocean Color – new

The biweekly ocean color and SST composite images have been available on the DFO Maritimes web site since early fall, 1998. Daily images are also available since there was a requirement by Biological Oceanography for these products. The next step is to use geo-referenced point data from SeaWiFs and AVHRR and include them in the SST database. Some minor design changes to SST will be required.

 

Time Series Statistics Database (ODI) - ongoing

ODI is being treated as another Y2K issue. Only preliminary analysis of the Oracle web version has been completed. Final release will not likely be until well into 1999. The FoxPro system will be updated and maintained as necessary.

Climate Indices -ongoing

These indices consist of long time series of various parameters that include sea level, wind speed and direction, air temperature, NAO (North Atlantic Oscillation) index, and freshwater discharge. The series are updated annually and available as both time series plots and data that may be downloaded from the DFO Maritimes web site.

Work is underway to port the FoxPro tables into Access. The data are available in Access now. A user application is still required to simplify data extraction, computation of anomalies, seasonal statistics etc. There are also graphic libraries available in Access, which should simplify the production of the web products.

Implementation

The Permanent Management and Co-ordination Committee (PMCC) has designated the Data Management Subcommittee of the ZMP to assume full responsibility for co-ordinating and implementing standard procedures for quality control, processing, archiving, and dissemination of the ZMP’s data, and thus for the implementation of the data management plan once it is accepted by PMCC. As outlined under Initiatives & Products above, considerable progress has been made in 1998/99 on many aspects of the ZMP data management. In 1999, the key initiatives for the subcommittee will be:

  • Complete the development of the biological database and migrate at least three major data sets (Sameoto’s Oracle database, Strain’s nutrients data set, and Platt’s plankton data set. The three will constitute a significant portion of the biology data in the Maritimes Region that are relevant to ZMP.
  • Complete the web-based query system to help users identify data collections of interest.
  • Implementation of the ZMP WWW site for data, products, and documents.
  • Co-ordinate and implement standard procedures for quality control, processing, archiving, and dissemination of the ZMP’s data, and make the data available in a timely manner as required.

 

 

Annex I

Draft Data Management Policy

Preamble

The Department of Fisheries and Oceans, through its programs and exchanges with national and international organizations, has acquired a large volume of scientific data and information over the years. Since this is an extremely valuable and irreplaceable resource of the Department, it is essential to develop and implement a data management policy, to ensure the preservation and enhancement of the data, while facilitating efficient and appropriate utilization. It is recognized that the Department has many arrangements with external agencies that may influence the application of this policy.

Basic Principles

  • Fisheries and Oceans scientific data are a valuable national resource that have been acquired through decades of investment. They are irreplaceable, they must be protected and managed to ensure long-term availability.
  • Because of the complex and often unique nature of these data, it is essential that DFO Science maintain responsibility for the management, archiving and dissemination of these data.
  • To obtain maximum benefit to the Department and to the user community at large these data should be made available in a timely manner with full and open access, consistent with Departmental data dissemination policies.
  • To obtain access to international data and information that are pertinent to Canadian needs, Canadian data need to be exchanged with other world Data Centres.

Priorities Influencing Policy

This policy is based on the current priorities, which include:

  • Support scientific research projects that may be regional, zonal, national, or international in nature;
  • Provide scientific information and data on ocean, coastal and inland waters and ecosystems in support of integrated resource management, conservation of marine and anadromous fishery resources, and for the sustainable development of aquaculture;
  • Provide scientific information and data for the achievement of marine environmental and fish habitat protection and conservation through an integrated approach;
  • Support the information and data requirements for the marine services, transportation, defense and navigation;
  • Support the Departmental responsibility to review environmental impact statements and approve environmental design parameters for offshore and coastal zone development;
  • Support the implementation of national and international climate research programs;
  • Collaborate with Canada’s Natural Resources Departments to ensure greater flexibility in timely and cost-effective accessing of data and information;
  • Support Canada’s commitments to international organizations such as PSC, IOC, ICES and PICES.

Data Management Policies

Availability of Access:

DFO Science data are a public resource and subject to full and open access within two years of being acquired. It is the responsibility of science managers to ensure that data collectors under their management submit their data to the appropriate data centre in a timely fashion. Exception will be made to this policy in the event of one or more of the conditions below:

  • Investigators have written approval from the management to delay submission of data to the designated data centre; in such cases, the letter of approval will include the rationale for the delay, and an agreed-upon date for the release of the data not normally exceeding 2 years;
  • There are third party agreements, privacy concerns, or legal restrictions;
  • The data are of commercial benefit to DFO.

Where there is uncertainty or dispute over whether a data set meets any of the conditions, the Regional Science Director shall review the situation and make a decision based on the findings.

Data Centres

All DFO scientific data must be managed as part of an integrated system of divisional, regional, zonal and national data centres. In some cases there is a long history of coordinated data management and well-defined data centres already exist. In many other cases, the concept is a new one and the Science managers will be required to designate and support science staff positions as having data management responsibilities.

The responsibilities of the data centres will be to:

  • Serve as the official point of contact for internal and external data requests.
  • Maintain inventories and documentation for all data holdings for which they have designated responsibility, including references to data sets not stored at the data centre.
  • Provide basic data retrieval, integration and summarization capabilities to satisfy common requests.
  • Provide computerized networking linkages to operational systems not located at the data centre.
  • Perform, in concert with the data providers, data quality control, verification and removal of duplicate data.
  • Ensure long term accessibility and documentation in the event of organizational changes, retirements, etc.
  • Protect data against loss resulting from error, accident, technological change, degradation of media, etc.

The national centre can be used to provide this kind of service if requested by a region.

Inclusion of a Data Management Component in Science Project Plans

All new scientific proposals and plans must contain a comprehensive plan addressing the management of scientific data collected during the life of the project. This plan should include strategies and schedules for the transfer of the data to the responsible Data Centre. There should be a periodic review of data management activities to ensure they are in keeping with the plan.

National Inventory:

MEDS will maintain a national inventory of DFO Science data holdings. It will be the responsibility of each designated Data Centre to maintain and update the inventories of its holdings. MEDS will be responsible for maintaining national links to all zonal and regional data inventories and the infrastructure to ensure the inventories are nationally accessible.

Acquisition of data from Third Party Sources:

Science will pursue the acquisition of relevant scientific data from other national and international sources where these data contribute to the goals of the Department.

Data Submitted under Regulations or Having Legal Aspects

For scientific data that have legal aspects and are submitted by third parties a copy will be kept in its original form, and appropriately secured.

Data Rescue:

Science will develop a national data rescue program to locate and preserve scientific data that is of value to departmental programs but are in danger of being lost.

Application of technology:

Science Data Centres will manage their data and will service users in an efficient manner by taking full advantage of today's technology.

Access to Information:

Science will manage its data in a manner consistent with the Access to Information legislation and the requirement to document the location, status, and availability of the data consistent with good data management practice.

International data exchange:

Canada will actively pursue the acquisition by exchange of data important to Departmental Science programs, which is collected by foreign vessels operating in the Canadian area of interest. In order to facilitate this exchange. Canada will support the international exchange programs and information inventories, which bear directly on this data exchange.

Working mechanisms:

A permanent group, with representation from regions and sectors and a chairman from MEDS will be established, reporting to the ADM, Science. MEDS will also carry the secretariat function for that group. The group will meet annually to review the data management policy, define the implementation plan for the coming year, and assess last year performance against plans. Also, MEDS is charged with the responsibility of presenting a report on the status of data management in Science to this annual meeting. This group will make recommendations to correct any deficiencies between the policy and the operation of the system.

Implementation:

It will be the responsibility of the Regional Directors of Science to implement and ensure adherence to this policy. NDM will report to the ADM Science, the work plans for DFO Science data management, the implementation plan for the coming year, and an assessment of the performance during the previous year against plans.

 

 

Annex II

Variable by Variable Analysis

There has been some grouping of variables, such as for CPR, which reflects special sampling techniques. Otherwise variables are arranged alphabetically.

Variable: Chlorophyll a

Function Description
Collection information Data acquired, processed and QC’ed by regional data centers and archived within the region.
Data centre(s) / contact

BIO: Ocean Science / Mary Kennedy

IML: Ocean Sciences / Laure Devine

NWAFC: Oceanography / Dave Senciall

Archive / contact MEDS / Jean Gagnon
Time from collection to archive

MEDS: Some data are submitted to MEDS for archiving. Typically there is a two month delay to update after receipt. Simple range and duplicate checks are conducted at MEDS.

IML: These data are collected with bottle (rosette) samples and are available within a year of the cruise. We currently archive them in a standard format that includes other variables sampled with the rosette (nutrients, O2, temperature, salinity)

NWAFC: Six to eight months.

BIO: Analysis generally available within days. Archived in BIOCHEM within a year of cruise.

Product(s) Product:

Description:

Contact:

Frequency:

 

Additional Questions / Notes

1. No central archive for these data presently exists. Instead, each regional archive has data collected by their institute and perhaps others. There is likely to be some degree of duplication of data between sites.

 

Variable: CPR data

This type of data includes a phytoplankton colour index, species type, counts and other variables.

Function Description
Collection information

Samples are collected by the Hardy Institute (UK) every alternate 10 km along a ship's track. Analyses are made by scientists of the Institute and data are available approximately 2 years after collection.

Data centre(s) / contact

BIO: Ocean Science / Mary Kennedy

Archive / contact

BIO: Ocean Science / Mary Kennedy

Time from collection to archive

Delays of 2 to 3 years are typical.

Product(s) Product:

Description:

Contact:

Frequency:

 

Additional Questions / Notes

 

Variable: Dissolved oxygen

Function Description
Collection information

These data are often collected on CTD stations by an additional sensor attached to the CTD or by titration from water samples at discrete depths. Data are acquired, processed and QC’ed by regional data centers and archived within the region.

Some data are sent to MEDS archives.

Data centre(s) / contact

BIO: Ocean Science / Doug Gregory

IML: Ocean Sciences / Laure Devine.

NWAFC: Oceanography / Dave Senciall

Archive / contact

MEDS / Jean Gagnon

Time from collection to archive

MEDS: Some data are submitted to MEDS for archiving. Typically there is a 2 month delay to update after receipt. Simple range and duplicate checks are done.

IML: Oxygen measured by titration will be included in the Biological-Chemical database, oxygen from CTD profiles will be included in the CTD files. Titrated values are available within one year of the cruise. Presently, they are archived in a standard format that includes other variables sampled with the rosette (pigments, nutrients, temperature, salinity)

NWAFC: Submitted yearly to MEDS. Data can be available one month after a cruise. Currently CTD data are not calibrated against bottle samples. The bottle samples collected from survey cruises are generally what are used in products.

BIO: Oxygen measured by titration will be included in the Biological-Chemical database, oxygen from CTD profiles will be included in the CTD files and forwarded to MEDS annually.

Product(s) Product:

Description:

Contact:

Frequency:

Additional Questions / Notes

 

Variable: Fish and invertebrate species composition

Function Description
Collection information

IML: Groundfish/shrimp surveys are conducted yearly in August to estimate distribution and abundance of cod, redfish, halibut and shrimp. There are yearly abundance and distribution surveys for snow crab, scallop, lobster and mackerel. There are yearly acoustic surveys for capelin and herring.

Data centre(s) / contact IML / Dominique Gascon
Archive / contact IML / Dominique Gascon
Time from collection to archive  
Product(s) Product: Yearly stock assessments

Description:

Contact: IML

Frequency:

Additional Questions / Notes

1. The collection of these data is not funded by but are of interest to the ZMP.

 

Variable: Fluorescence

Function Description
Collection information These data are often collected on CTD stations with an additional probe attached to the CTD. All of the ZMP CTD casts are expected to have a fluorometer. Data are acquired, processed and QC’ed by regional data centers and archived within the region.
Data centre(s) / contact BIO: Ocean Science / Doug Gregory

IML: Ocean Sciences / Laure Devine

NWAFC: Oceanography / Dave Senciall
Archive / contact MEDS / Jean Gagnon
Time from collection to archive

MEDS: Some data are submitted to MEDS for archiving. Typically there is a 2 month delay to update after receipt. Simple range and duplicate checks are done.

IML: Fluorescence data will be included in the Biological-Chemical database

NWAFC: Submitted yearly to MEDS as uncalibrated data. They can also be available one month after a cruise. Calibration can be done 6-8 months after the cruise.

BIO: Submitted annually to MEDS as uncalibrated data.

Product(s) Product:

Description:

Contact:

Frequency:

 

Additional Questions / Notes

1. Typically, fluorescence data collected from profiling instruments is noisy and are not calibrated. Caution must be used when trying to interpret these data.

 

Variable: Ice volume and distribution

Function Description
Collection information

IML: Ice concentration and thickness categories are generated by RADATSAT and aircraft pilots.

BIO: Weekly ice concentration and type from digitized ice charts from DOE Ice Central for Gulf of St. Lawrence and Scotian Shelf on 0.5 latitude by 1.0 degree longitude.

Data centre(s) / contact

IML: Ocean Sciences / François Roy

BIO: Ocean Science / Doug Gregory

Archive / contact  
Time from collection to archive One year, data received from the Canadian Ice Service.
Product(s)

Product:

Description:

Contact:

Frequency:

Additional Questions / Notes

1. Digital ice charts are available at IML for the Gulf of St. Lawrence daily from 1997.

2. Lower resolution weekly charts are archived at BIO (1963-199? See Ken Drinkwater).

 

Variable: Nutrients (nitrates, phosphates, silicates)

Function Description
Collection information These data are often collected on CTD stations. Data are acquired, processed and QC’ed by regional data centers and archived within the region.
Data centre(s) / contact

BIO: Ocean Science / Peter Strain

IML: Ocean Sciences / Laure Devine

NWAFC: Oceanography / Dave Senciall

Archive / contact MEDS / Jean Gagnon
Time from collection to archive

MEDS: Some data are submitted to MEDS for archiving. Typically there is a 2 month delay to update after receipt. Simple range and duplicate checks are done.

IML: These data are collected with bottle (rosette) samples and are available within one year of the cruise. They are archived in a standard format that includes other variables measured with the rosette (pigments, O2, temperature and salinity).

NWAFC: Six to eight months after the cruise.

BIO: Data entered into BIOCHEM within 1 year of cruise.

Product(s)

Product:

Description:

Contact:

Frequency:

Additional Questions / Notes

1.Nutrient data will be held in the Biological-Chemical database in the regions. MEDS also has such data and so there is the possibility of duplication.

 

Variable: Remotely sensed ocean color from SeaWiFs

Function Description
Collection information

Data are available for analysis 2 weeks after the satellite pass.

BIO: passes are acquired for SeaWiFs, algorithms applied to derive chlorophyll

IML: 2-3 images per day are received. Level 0 images are archived.

Data centre(s) / contact

BIO / Linda Payzant

IML / Pierre Larouche

Archive / contact

BIO / Linda Payzant

IML / Pierre Larouche

Time from collection to archive

BIO: one month

IML: one month.

Product(s)

Product: Maps of bi-weekly averages of SST

Description: Maps of the biweekly analysis for both ocean colour are prepared as jpeg images and are available on the Maritimes DFO web site. Individual passes are also available.

Contact: Linda Payzant

Frequency: monthly

 

Additional Questions / Notes

 

Variable: Phytoplankton dominant species composition

Function Description
Collection information

Some data acquired from CPR (see above)

IML: Phytoplankton samples are collected by the toxic algae monitoring programme. Data are collected from coastal stations at regular intervals, at the ZMP fixed stations on a monthly schedule and during the ice forecast/monitoring cruise in November.

BIO: Samples are collected on research cruises and at ZMP fixed stations.

Data centre(s) / contact

IML: Ocean Sciences / Laure Devine

NWAFC: Groundfish Ecology / Pierre Pepin

BIO: Ocean Science / Mary Kennedy

Archive / contact

IML: Ocean Sciences / Laure Devine

NWAFC: Oceanography / Dave Senciall

BIO: Ocean Science / Mary Kennedy

Time from collection to archive

IML: Data will be archived in the Biological-Chemical database. It will take at least a year after collection before these data are archived.

NWAFC: Data will be archived in the Biological-Chemical database.

BIO: Data will be archived in the Biological-Chemical database. It will take at least a year after collection before these data are archived.

Product(s)

Product:

Description:

Contact:

Frequency:

Additional Questions / Notes

 

Variable: Runoff

Function Description
Collection information These data are collected by Environment Canada, also Ministère d'environnement et faune, Alcan, Hydro-Quebec and Hydro Ontario
Data centre(s) / contact IML: Ocean Sciences / Nathalie Roy
Archive / contact  
Time from collection to archive Real-time, daily for the St. Lawrence estuary, upstream of Saguenay.
Product(s)

Product:

Description:

Contact:

Frequency:

Additional Questions / Notes

1. Environment Canada produces a CD-ROM of these data called HYDAT updated roughly every five years.

2. Indirect calculation of runoff at Quebec City using tide gauge measurements (Denis Lefaivre)

3. Monthly runoff index at Quebec City.

 

Variable: Sea level

Function Description
Collection information

MEDS: Some data are collected by CHS and some under contract by Sineco.

Sineco data are from the St. Lawrence and are available approximately one month after the end of the month Other data are from the east coast and are available within days of collection.

Data centre(s) / contact MEDS / Jean Gagnon
Archive / contact MEDS / Jean Gagnon
Time from collection to archive

MEDS: Data from the St. Lawrence network are updated within 1 week of receipt. Data from the other gauges are updated daily at MEDS. All data are checked for spikes, datum shifts, timing problems and gaps.

Product(s)

Product:

Description:

Contact:

Frequency:

Additional Questions / Notes

 

Variable: Secchi disk

Function Description
Collection information At present, this type of data is not routinely acquired.
Data centre(s) / contact MEDS / Jean Gagnon
Archive / contact MEDS / Jean Gagnon
Time from collection to archive

MEDS: Some data are submitted to MEDS for archiving. Typically there is a 2 month delay to update after receipt.

IML: It is expected that this type of data will be archived in the Biological-Chemical database.

BIO: It is expected that this type of data will be archived in the Biological-Chemical database.

Product(s)

Product:

Description:

Contact:

Frequency:

Additional Questions / Notes

1. It is unlikely that secchi disk data would be used alone in the generation of a product.

2. NWAFC expects to collect these data in future and combine the information into the header of CTD records.

 

Variable: SST from AVHRR

Function Description
Collection information

BIO: SST data from NOAA satellites are processed by JPL and posted on their web site. Data are weekly averages on an 18km x 18km grid. Data are downloaded by BIO semiannually and converted from pixel to point data.

IML: Data are received by the IML image captor.

Data centre(s) / contact

BIO Ocean Science / Doug Gregory

IML: Ocean Sciences / Pierre Larouche

NWAFC: Oceanography / Jim Helbig

Archive / contact

BIO: Ocean Science / Doug Gregory

IML: Ocean Sciences / Pierre Larouche

Time from collection to archive

6 months

NWAFC: Acts as a back up to BIO

IML: 1 hour

Product(s)

Product: SST database

Description: Web access to 18km, weekly averages (June 99)

Contact: Doug Gregory, BIO

Frequency: Updated semi annually

Product: SST climatology

Description: Maps of monthly SST and anomaly

Contact: Brenda Topliss, BIO

Frequency: Indeterminate – annual target.

Product: JPEG quicklook of entire pass

Description: Web access, 4 km resolution

Contact: Pierre Larouche, IML.

Frequency: 8 images / day

Additional Questions / Notes

 

Variable: SST and SSS from in-situ instruments

Function Description
Collection information

There are various collections of opportunity in the 3 Atlantic regions. Data are collected with a variety of instruments including thermographs, drifting buoys, meteorological and wave buoys, and thermosalinographs.

Data are acquired, processed and QC’ed by regional centers and MEDS.

Processed data from fixed sites and thermographs are forwarded to BIO for archival at unspecified intervals.

Data on the GTS are acquired by MEDS. Data collection is carried out by other government departments and foreign agencies.

Data centre(s) / contact

BIO: Ocean Science / Doug Gregory

IML: Ocean Sciences / Bernard Pelchat

NWAFC: Oceanography / Dave Senciall

MEDS / Jean Gagnon

Archive / contact

BIO Ocean Science / Doug Gregory

MEDS / Jean Gagnon

IML / Bernard Pettigrew

Time from collection to archive

Maritimes region data updated annually.

Laurentian and Newfoundland data updated irregularly, but typically bi-annual.

MEDS: Data received from the GTS are updated monthly or more frequently. Simple range and duplicate checks are done.

NWAFC: All thermograph and current meter data are sent to BIO.

Product(s)

Product: Ocean Data Inventory (ODI)

Description: Web access to inventory of thermograph time series (June 99), with monthly statistics

Contact: BIO, Doug Gregory

Frequency: Annual updates

Product: Thermograph website: http://oceans.qc.dfo.ca/thermo

Description: Web access to inventory of thermograph time series (data from 1993)

Contact: IML, Bernard Pettigrew

Frequency: Updates are at least yearly. Some gauges operate only in ice-free conditions.

Additional Questions / Notes

 

Variable: Temperature and salinity profiles

Function Description
Collection information

Data are acquired, processed and QC’ed by regional data centers and archived within the region.

Low resolution data to be submitted to MEDS as IGOSS messages within 48 hours of cruise end.

High resolution data to be submitted to MEDS within 2 years of acquisition.

International data within the ZMP area acquired and archived by MEDS through international exchange.

Data centre(s) / contact

BIO: Ocean Science / Doug Gregory

IML: Ocean Sciences / Laure Devine

NWAFC: Oceanography / Dave Senciall

Archive / contact MEDS / Jean Gagnon
Time from collection to archive

MEDS: High resolution data in known formats generally are updated to MEDS archives within 2 months of receipt. Low resolution data are updated 3 times/week. Extensive QC and duplicate checks (see IOC M&G#22) are done.

NWAFC: BATHY and TESAC data are available 1 week after the cruise. Full resolution data are presently available 1 year after (but could be sooner if necessary).

BIO: BATHY and TESAC data are available 1 week after the cruise. Full resolution data are presently available 1 year after.

Product(s)

Product: Ocean Climate database

Description: Web access to TS data from NW Atlantic

Contact: BIO. Doug Gregory

Frequency: monthly updates from MEDS

Product: ZMP fixed station monitoring sites, real-time (proposed)

Description: near real time display and data access via web to low resolution profile data from Prince 5, Stn 2, Stn 27, Shediac Valley, Gaspé Current, Anticosti Gyre, Bedford Basin

Contact: MEDS, Jean Gagnon

Frequency: Nominally bi-weekly with 1 month delay

Product: ZMP fixed station monitoring sites, Climatology

Description: Long-term climatologies with display and data access via web for Prince 5, Stn 2, Stn 27, Shediac Valley, Gaspé Current, Anticosti Gyre, Bedford Basin

Contact: BIO, Doug Gregory

Frequency: Annual updates

Additional Questions / Notes

1. Additional QC and duplicates checking are done by BIO before data are included in the Ocean Climate database.

 

Variable: Temperature time series

Function Description
Collection information

There are various fixed sites and sites of opportunity in the 3 Atlantic region. Data are collected with a variety of thermographs.

Data are acquired, processed and QC’ed by respective regional centers.

Processed data are forwarded to BIO for archival at unspecified intervals.

Data centre(s) / contact

BIO: Ocean Science / Doug Gregory

IML: Ocean Sciences / Bernard Pelchat

NWAFC: Oceanography / Dave Senciall

Archive / contact

BIO: Ocean Science / Doug Gregory

IML / Bernard Pettigrew

Time from collection to archive

Maritimes region data updated annually. Laurentian and Newfoundland date irregularly, but typically bi-annual.

IML: These data are from the same instruments used for SST.

NWAFC: Data are provided to BIO yearly.

Product(s)

Product: Ocean Data Inventory (ODI)

Description: web access to inventory of thermograph time series (June 99), with monthly statistics

Contact: BIO / Doug Gregory

Frequency: annual updates

Product: Thermograph website: http://oceans.qc.dfo.ca/thermo

Description: Web access to inventory of thermograph time series (data from 1993)

Contact: IML, Bernard Pettigrew

Frequency: Updates are at least yearly. Some gauges operate only in ice-free conditions.

Additional Questions / Notes

 

Variable: Water transparency

A transmissometer is an extra sensor attached to the CTD and records percent light transmitted. Other light sensors are used to measure actual light levels (or Photosynthetically Active Radiation, PAR). These measurements can be used to calculate the percent of incident light that penetrates the water column.

Function Description
Collection information

Data are acquired, processed and QC’ed by regional data centers and archived within the region.

Data are reported to MEDS as transmissivity, percent light transmittance and PAR.

Data centre(s) / contact

BIO: Ocean Science / Mary Kennedy

IML: Ocean Sciences / Laure Devine

Archive / contact MEDS / Jean Gagnon
Time from collection to archive

MEDS: Some data are submitted to MEDS for archiving. Typically there is a 2 month delay to update after receipt. Simple range and duplicate checks are done.

IML: Transmissometer data will be archives in the Biological-Chemical database along with CTD profiles.

BIO: typical time to archival is 6 months

Product(s)

Product:

Description:

Contact:

Frequency:

Additional Questions / Notes

 

Variable: Winds (and other meteorological data)

Function Description
Collection information

In-situ data are collected by wave buoys. Typically the data are reported over the GTS.

MEDS acquires data from moored buoys operated by Environment Canada and by the US.

Data centre(s) / contact

MEDS / Jean Gagnon

IML / Simon Prinsenberg

BIO: Ocean Science / Doug Gregory

Archive / contact

MEDS / Jean Gagnon

Time from collection to archive

MEDS: Data are received daily from wave buoys and updated at least weekly.

BIO: acquires annual updates for selected sites from AES

Product(s)

Product: Monthly and seasonal winds and wind stress for Halifax, Sable Island and Yarmouth

Description: images and data download for selected products

Contact: BIO / Doug Gregory

Frequency: annual update

Additional Questions / Notes

1. Several model outputs and archives are used by modelers at IML. These include the CANSARP model (winds only) of AES, analyzed fields (winds, SLP, temperature, dew point, relative humidity, liquid and solid precipitation and short wave radiation) from CMC and the BESNER archive (winds, SLP, temperature, dew point, relative humidity, liquid and solid precipitation and short wave radiation every 6 hours from 1945-1997, contact Alain D'Astous at IML)

Variable: Zooplankton abundance, biomass, distribution, dominant species .

Function Description
Collection information

Some information provided in CPR data.

IML: Vertical bongo tows are made at monitoring stations nominally every two weeks. Mackerel egg surveys and zooplankton monitoring cruises are conducted in the southern Gulf annually in June. BIONESS tows are made on zooplankton monitoring cruises conducted in the St. Lawrence estuary annually in the fall. Data are collected from a zooplankton monitoring station off Rimouski every 2 weeks except in the late fall and winter. Vertical bongo tows are made at selected stations of the ice forecasting/monitoring cruise annually in November.

BIO: Vertical ring net tows and BIONESS tows. Data collected 3-4 times per year from cruises on the Scotian Shelf.

Data centre(s) / contact

IML Ocean Sciences / Laure Devine

NWAFC: Oceanography / Dave Senciall

BIO: Ocean Science / Mary Kennedy

Archive / contact

IML / Laure Devine

BIO: Ocean Science / Mary Kennedy

Time from collection to archive

IML: At least a year is required to carry out plankton identification.

NWAFC: The data will be archived in the Biological-Chemical database.

BIO: At least a year is required to carry out plankton identification. Archival in BIOCHEM.

Product(s)

Product:

Description:

Contact:

Frequency:

Additional Questions / Notes