Quality Control

Overall QC Workflow (half size image)

Overview

The Quality Control process is part of the CMIP5 (http://pcmdi-cmip.llnl.gov/cmip5/) data infrastructure.

Three levels are defined within the CMIP5 Quality Control (QC):

QC Level 0: Spot checks on selected data (informal)

_ QC Level 1 QC Level 2 QC Level 3 / DOI
Description CMOR2 and ESG publisher conformance checks Data consistency checks Double- and cross-checks of data and metadata
and data publication as DataCite DOI
Data preliminary;
no user notification about changes;
performed for all data;
metadata may not be complete
no user notification about changes;
performed for CMIP5 requested metadata and data
published and persistent data with version and unique DOI as persistent identifier;
user notification about changes;
performed for replicated data
Access constrained to CMIP5 modeling centers constrained to non-commercial research and educational purposes constrained to non-commercial research and educational purposes or open for unrestricted use (as specified by the modeling centers)
Access Control PCMDI on behalf of WMO/WGCM PCMDI, BADC, WDCC/DKRZ core data archives on behalf of WMO/WGCM IPCC-DDC on behalf of TGICA
Citation no citation reference informal citation reference (preliminary author and title)
recommendation: author:<modeling center>, title:<DRS experiment>, data identifier:<data node or gateway link>, date of download
formal citation reference
as displayed on the DOI landing page
Quality Flag "automated conformance checks passed" "subjective quality control passed" "approved by author"
(in case of newer DOI available:
"approved by author, but suspended")

Background information on the Quality Control for CMIP5 can be found in the documents in Description of CMIP5 Quality Control Procedures.

Quality Control of ESG Federation

Quality Control level 1 and 2 are performed by all ESGF partners. Quality Control level 3 / DOI data publication is accomplished by WDC Climate / DKRZ. The checks and criteria for the assignment and detailed QC workflows are described for the different QC levels:

The granularity of the QC, i.e. the level of aggregation of QC results in CMIP5 context is displayed in cmip5_qc_granularity.png.

Criteria for QC level assignment are found on the above pages and directly reached via:

The interface to the ESG gateways as well as available services are listed at

Status of QC checks within CMIP5

Tools

Tools used for the QC checks of level 2 and 3 are described, - in case of QC level 2 tools including requirements, installation and run instructions.

Meetings / Telcos

Quality Control outside ESGF

Outside the Quality Control of ESGF we offer the QC core tool to data nodes interested in quality checking their data before delivery to one of the ESGF partners (PCMDI, BADC, WDCC/DKRZ).

Note: There is an ongoing discussion about the direct use of these QC results of data nodes in CMIP5 and whether to use the QC Wrapper at data nodes.

QCflows01.png (66.6 kB) Frank Toussaint, 10/27/2010 04:17 pm

QCoverallWF_v1.png - Overall QC Workflow (23.5 kB) Martina Stockhause, 03/29/2011 10:05 am

QCoverallWF_half_v1.png - Overall QC Workflow (half size image) (48.1 kB) Martina Stockhause, 03/29/2011 10:05 am

cmip5_qc_granularity.png - Granularity of QC in CMIP5 context (33.7 kB) Martina Stockhause, 04/01/2011 11:25 am