Quality Checks¶
Technical Quality Control¶
The CMIP6 technical quality assurance includes 3 different checking blocks: the consistency check of the CMIP6 Citation Service content, the check of the use metadata (from the ESGF index), and the file metadata consistency and data download check. Citation and use metadata are checked against the information, given by the CMIP6 Citation Service and the ESGF index, while the LTA check includes the adjustment of the file based information with the DB based ones.
Citation metadata check (DOI level)¶
| subject | entry_type | details | error level |
| list of authors | EXP, DSG | as in CMIP6 Citation Service | error |
| scientific contact | EXP, DSG | as in CMIP6 Citation Service | error |
| EGF citation | EXP, DSG | title, authors, publisher, edition, DOI as in CMIP6 Citation Service | error |
| list of contributors | EXP, DSG | as in CMIP6 Citation Service | error |
Use metadata checks¶
| subject | entry_type | details | error level |
| spatial coverage | DSG, DS | longitude, latitude, altitude/depth/level as file coverage | error |
| temporal coverage | DSG | start and end date as file coverage | error |
| format | DS | format_extension = '.nc' | error |
| keywords | EXP, DSG, DS |
Expected keywords are (depending on entry_type): 'mip_era', '<activity_id>', '<institution_id>', '<source_id>', '<experiment_id>', '<target_mip>'. |
error |
File metadata checks¶
| subject | entry_type | details | error level |
| number and size | DS | number od datasets > 0, size of data > 0 | error |
| Hierarchy | EXP, DSG | Every EXP or DSG has to have at least a DS or a DSG as a child. There is no hidden dataset connected to this entry_id |
error |
| temporal coverage | DS | coverage as in data files | warning |
| spatial coverage | DS | coverage as in data files | warning |
| file name | DS | in external pointer | error |
| chunck size | DS | same in external_pointer as well as in cera_meta? | error |
| checksum | DS | same in external_pointer as well as in cera_meta? | error |
| tracking_id | DS | as in data file | error |
| data size | DS | as file size | error |
| DSG size | DSG | total amount of all file sizes per DSG | error |
| data access | DS | check download | error |