CMIP7 Data Request Software - v1.4 CMIP7 data request software

This software release follows the release of v1.2.2.3 of the CMIP7 Data Request.

Please see the README for guidance on using the software. User feedback is welcome - see the README for how to provide feedback.

Release notes:

• Support for time subsets

• Re-keyed split consolidated content files with improved readability

• Account for region case change (e.g. "GLB" to "glb") in compare_variables command-line utility

• get_variables_metadata output: include flag_values & flag_meanings where applicable

• Example output json files of DR variables metadata in scripts/examples are updated to v1.2.2.3 DR content. Branded names in this DR version were generated using version 0.13.1 of the CMIP branded variable mapper.

Climate Change - Climate Data Access and Visualization - Python
Published by JamesAnstey about 2 months ago

CMIP7 Data Request Software - v1.3 CMIP7 data request software

This software release follows the release of v1.2.2.2 of the CMIP7 Data Request.

Please see the README for guidance on using the software. User feedback is welcome - see the README for how to provide feedback.

Release notes:

• Versioning of the DR Software (i.e., tags in this repo) are no longer following DR Content release version identifiers, as they have previously. DR Software versions will follow standard 3-part semantic versioning starting at this release with v1.3. Since the software should work with multiple DR Content versions, and the DR Content is now mostly stable for the CMIP7 AFT, decoupling the DR software and content versioning makes it easier to manage future software updates that don't follow a DR Content release (or vice versa).

• Example output json files of DR variables metadata in scripts/examples are updated to v1.2.2.2 DR content. Branded names in this DR version were generated using version 0.12.0 of the CMIP branded variable mapper.

• Improved local caching of downloaded DR Content (#175)

Climate Change - Climate Data Access and Visualization - Python
Published by JamesAnstey 4 months ago

CMIP7 Data Request Software - v1.2.2 CMIP7 data request software

This software release follows the release of v1.2.2 of the CMIP7 Data Request.

Please see the README for guidance on using the software. User feedback is very welcome (see the README for how to provide feedback).

Added in this version:

• Most updates in are related to the inclusion of branded variable names in v1.2.2 of the data request, which are new in CMIP7 as described in the v1.2.2 release notes.

• Configuration option variable_name has been added, which specifies whether a CMIP6-era compound name (example: “Amon.tas”) or CMIP7-era compound name that includes the branded variable name (example: “atmos.tas.tavg-h2m-hxy-u.mon.GLB”) is used as a unique identifier for requested variables in software outputs.

  • variable_name can be set at the command line in the same way as other configuration parameters. Example: CMIP7_data_request_api_config variable_name "CMIP6 compound name".
  • The default setting of variable_name is "CMIP7 compound name".
  • Users should be aware that branded names will be used in the file and directory names for CMIP7 data produced by modelling centres. However the ability to also identify variables by their CMIP6-era names helps to maintain continuity with CMIP6 (e.g., these names are used in existing modelling centre workflows). CMIP6-era names are highly familiar to many users, while the CMIP7-era names are new.
  • variable_name currently affects output of the export_dreq_lists_json and get_variables_metadata command-line utilities and functionality in the dreq_query module. The next software release will apply the variable_name configuration option consistently across all software functionality.

• Updates to flat list (json file) of variables metadata in scripts/examples: separate example files are now given using CMIP6-era or CMIP7-era names.

Climate Change - Climate Data Access and Visualization - Python
Published by JamesAnstey 6 months ago

CMIP7 Data Request Software - v1.2.1 CMIP7 data request software

This software release follows the release of v1.2.1 of the CMIP7 Data Request.

See the README for guidance. Feedback is welcome - please see the README for further info. The software will be updated in response to feedback. An update will follow the next data request content release (v1.2.2 content, to occur during June 2025).

Added in this version:

• Binder / Google colab launcher for trying the software without installation
• User is warned if API version is not the latest one available on PyPI
• Updates to flat list (json file) of variables metadata in scripts/examples:
  • branded variable names now included (these names are provisional, pending finalization of the branding algorithm)
  • corrected errors in dimensions strings (naming of time dimensions, restored some missing dimensions)
• Improved test coverage

Climate Change - Climate Data Access and Visualization - Python
Published by JamesAnstey 9 months ago

CMIP7 Data Request Software - v1.2beta

This software release follows the release of v1.2 of the CMIP7 Data Request.

See the README for guidance. Another software update will follow the v1.2.1 data request release. Feedback is welcome - please see the README for further info.

Added in this version:

• jupyter notebooks with examples (tutorial) in notebooks/ folder
• Configuration file to control options (created automatically on first use), command-line utility CMIP7_data_request_api_config to set options
• Offline mode to use only cached dreq content (allows workflows that don't require internet access)
• Improved csv summaries of data request content
• Command-line utility compare_variables to compare CMOR variables metadata between different data request versions or against CMIP6 CMOR tables
• Command-line utility estimate_dreq_volume to estimate volume of request depending on supported data request Opportunities (estimate is a work in progress, use with caution)
• Improved test coverage
• Technical documentation (full documentation still in development)

Climate Change - Climate Data Access and Visualization - Python
Published by JamesAnstey 10 months ago

CMIP7 Data Request Software - Testing PyPi workflow

The aim of this release is to trigger a publication - which it has done sucessfully.

No code changes from v1.1

Climate Change - Climate Data Access and Visualization - Python
Published by wolfiex about 1 year ago

CMIP7 Data Request Software - v1.1 software release

This software release coincides with the release of v1.1 of the Data Request Content.

See the repo's README for guidance on using the software. Please note the software is a work in progress and will be updated for the v1.2 data request release. Feedback is welcome - please see the README for further info.

Brief synopsis of additions/improvements in this version:

• pip installer
• requirements.txt and guidance on running in a python virtualenv/venv (in case user prefers to avoid conda)
• improvements to command line tool export_dreq_lists_json
• csv (spreadsheet) outputs
• runs in python 3.8 or later
• improved test coverage (mainly relevant for developers)

While this release coincides with the timing of the v1.1 data request release, the software can also be used with previous versions of the data request content (v1.0, v1.0beta).

Climate Change - Climate Data Access and Visualization - Python
Published by JamesAnstey about 1 year ago