Data

Tools

Indexes

Applications

Experiments

Open Sustainable Technology

Recent Releases of IOOS Compliance Checker

IOOS Compliance Checker - v5.4.2

What's Changed

New Contributors

Full Changelog: https://github.com/ioos/compliance-checker/compare/v5.4.1...v5.4.2

Climate Change - Climate Data Standards - Python
Published by ocefpaf 7 months ago

IOOS Compliance Checker - v5.4.1

What's Changed

New Contributors

Full Changelog: https://github.com/ioos/compliance-checker/compare/v5.4.0...v5.4.1

Climate Change - Climate Data Standards - Python
Published by ocefpaf 8 months ago

IOOS Compliance Checker - v5.4.0

What's Changed

New Contributors

Full Changelog: https://github.com/ioos/compliance-checker/compare/v5.3.0...v5.4.0

Climate Change - Climate Data Standards - Python
Published by ocefpaf 8 months ago

IOOS Compliance Checker - v5.3.0

What's Changed

Full Changelog: https://github.com/ioos/compliance-checker/compare/v5.2.0...v5.3.0

Climate Change - Climate Data Standards - Python
Published by benjwadams 12 months ago

IOOS Compliance Checker - v5.2.0

What's Changed

Minor changes and bugfixes

Full Changelog: https://github.com/ioos/compliance-checker/compare/v5.1.2...v5.2.0

Climate Change - Climate Data Standards - Python
Published by benjwadams about 1 year ago

IOOS Compliance Checker - v5.1.2

Release synopsis: Mostly a bugfix release with some improvements to CI, domain variables, and NetCDF groups support

What's Changed

New Contributors

Full Changelog: https://github.com/ioos/compliance-checker/compare/v5.1.1...v5.1.2

Climate Change - Climate Data Standards - Python
Published by benjwadams about 1 year ago

IOOS Compliance Checker - v5.1.1

What's Changed

New Contributors

Checker bug fixes

  • Fixed a logic error in CF 1.6 checker with valid_range when valid_min or valid_max were present.

Full Changelog: https://github.com/ioos/compliance-checker/compare/v5.1.0...v5.1.1

Climate Change - Climate Data Standards - Python
Published by benjwadams almost 2 years ago

IOOS Compliance Checker - v5.1.0

Overview

  • Adds partial support for CF 1.9
  • Extensive improvements to CF conformance
  • Many CI/quality of life improvements for the codebase

What's Changed

New Contributors

Full Changelog: https://github.com/ioos/compliance-checker/compare/v5.0.2...v5.1.0

Climate Change - Climate Data Standards - Python
Published by benjwadams almost 3 years ago

IOOS Compliance Checker - v5.0.2

  • Numerous fixes to CF 1.6 conformance
  • Fixes handling of standard name modifiers
  • Fixes to calendar handling
  • Fixes to flag related attributes when only one flag is specified
  • Adds possible corrections when an invalid CF standard name is provided
  • Code cleanup, pre-commit and CI fixes, narrower exception handling

PRs list

Full Changelog: https://github.com/ioos/compliance-checker/compare/5.0.1...v5.0.2

Climate Change - Climate Data Standards - Python
Published by ocefpaf almost 4 years ago

IOOS Compliance Checker - scale_factor/add_offset fixes

Fixes a number of long-standing issues with scale_factor and odd_offset type comparison when comparing non-equivalent types.

Climate Change - Climate Data Standards - Python
Published by benjwadams about 4 years ago

IOOS Compliance Checker - CF 1.8 Support

  • Adds support for CF 1.8
  • Support to only run a subset of checks with -i/--include-checks option
  • Code coverage support added in GitHub Actions continuous integration
  • Fixed various issues in code base including unused variables and dead code paths

Climate Change - Climate Data Standards - Python
Published by benjwadams about 4 years ago

IOOS Compliance Checker - Bugfixes to geospatial representation, CI updates

  • Numerous updates to featureType representation to better fit the CF Conventions specifications

  • Updates for building via GitHub Actions, including pushing to PyPI.

  • Fixes handling of scale_factor and add_offset attributes.

Climate Change - Climate Data Standards - Python
Published by benjwadams over 4 years ago

IOOS Compliance Checker - IOOS Compliance Checker 4.3.3

Release for the IOOS Metadata Profile Version 1.2 Checker.

General

  • Enables fetching from remote, non-OPeNDAP NetCDF files which use a Content-Type header of application/x-netcdf
  • Enables fetching of datasets from ERDDAP TableDAP endpoints
  • Skips iterating Python setup requirements twice
  • Escape variable output in HTML format
  • Allow in-memory loading of remote NetCDF datasets

CI/Build

  • Adds pre-commit hooks in GitHub

IOOS Checker

  • Update GTS ingest logic
  • Correct platform detection
  • Add z variable logic
  • Various fixes/improvements to error messages

Climate Change - Climate Data Standards - Python
Published by benjwadams almost 6 years ago

IOOS Compliance Checker - Release Candidate 4.3.3rc2

Release candidate 2 for the IOOS Metadata Profile Version 1.2 Checker

  • change standard_name_uri to standard_name_url
  • add syntax checks for platform_id
  • add checks for flag_meanings and flag_values on QARTOD variables
  • streamline messaging for ioos_ingest, gts_ingest checks
  • ensure proper syntax for wmo_platform_code
  • separate checks for global gts_ingest flag and checking if the variables passed the GTS ingest requirements
  • improve messaging for qartod_variables:references check
  • add documentation for using ERDDAP datasets with the checker

Climate Change - Climate Data Standards - Python
Published by daltonkell about 6 years ago

IOOS Compliance Checker - Compliance Checker 4.3.3 Release Candidate 1

Release Candidate version 1 for IOOS Compliance Checker 4.3.3.

General

  • Adds a ValidationObject class in base.py for generic validation of global attributes. Current uses include email and URL validation, among others.
  • Updates attr_check function to accept variables for generic variable checks, e.g. aforementioned validators, set membership from known set of strings.

IOOS 1.2

Climate Change - Climate Data Standards - Python
Published by benjwadams about 6 years ago

IOOS Compliance Checker - Compliance Checker 4.3.2

General:

  • Adds a new --option/-O command line flag which can be used to alter desired checker behavior. This option can be specified multiple times for several options, although as of this release, there is only one supported option (see notes in CF section below).

Changes to CF checkers (all versions):

  • Corrects "coordinate data variable" finding routines to correspond with CF Section 1.3 "Overview". Coordinate data variables now find both NUG "coordinate variables", which are variables with one dimension where the dimension has the same name as the variable, and variables referred to by the contents of the coordinates attribute in other variables.
  • Improves readability of error message for attributes which are improperly placed according to CF Appendix A's "Use" column.
  • Disables checking of Appendix A by default and only checks Appendix A if cf:enable_appendix_a_checks is specified in aforementioned -O/--option flags via the CLI.

Climate Change - Climate Data Standards - Python
Published by benjwadams over 6 years ago

IOOS Compliance Checker - Compliance Checker 4.3.0

Compliance Checker 4.3.0: CF 1.7 Release

The latest major release for the IOOS Compliance Checker contains updated checks
to reflect CF-1.7, the most current stable CF Conventions document at the time of this release. The software includes
numerous changes, most notably:

  1. Dropped support for Python 2.7
  2. Updated list of Grid Mapping attributes in Table F1
    and checks for Well-Known Text (WKT) strings using the PROJ database
  3. Added new projections
  4. Check against computed_standard_name attribute
  5. Check against Appendix A attributes

For a comprehensive list of the issues addressed and changes made, see the milestone.

Climate Change - Climate Data Standards - Python
Published by daltonkell over 6 years ago

IOOS Compliance Checker - Compliance Checker 4.2.2

Patch release containing:

  • links to new IOOS Metadata Profile repo
  • an update to setup.py
  • a bug fix on the html reports

Climate Change - Climate Data Standards - Python
Published by Bobfrat about 7 years ago

IOOS Compliance Checker - Compliance Checker 4.2.1

Addresses comments on #628 (making the climatology checks more accurate) and re-formats the HTML output to go along with the new grouping routine adopted in the prior release.

Climate Change - Climate Data Standards - Python
Published by daltonkell about 7 years ago

IOOS Compliance Checker - Compliance Checker 4.2.0

Reformatted ACDD output to include more informative, less repetitive error messages. Functional changes from pull request #624 include enhanced grouping for "grouped checks" (e.g. Global Attributes), which condenses the results into fewer lines and more appropriate sections (other checks will also be able to leverage this new formatting improvement, not just the ACDD checks).

  • addresses issue #620
  • leverages existing sorting/grouping functionality
  • reduces repeated code
  • improves inline documentation

Climate Change - Climate Data Standards - Python
Published by daltonkell about 7 years ago

IOOS Compliance Checker - Compliance Checker 4.1.1

This release patches some issues in 4.1.0

  • Unify requirements file and remove cython
  • Show help when no operations requested on the command line
  • Use argparser choices for format validation

Climate Change - Climate Data Standards - Python
Published by Bobfrat over 7 years ago

IOOS Compliance Checker - Compliance Checker 4.1.0

Compliance Checker 4.1.0

Compliance Checker 4.1.0 includes performance enhancements for files with large amounts of variables, adds metadata reference URLs in the output reports, support for new type of plugin, the ability to specify a standard name table file from an environment variable and Bug Fixes

Pull Request #600 enhances compliance checker speed with the use of an lru-cache from functools. It also allows backwards-compatibility with the lru-cache for python2.7 via the functools32 backport module.

PR #599 updates the Climate and Forecasting integration tests.

PR #598 puts reference links to metadata schemas into the compliance-checker output.

Climate Change - Climate Data Standards - Python
Published by Bobfrat over 7 years ago

IOOS Compliance Checker - Compliance Checker 4.0.1

Bugfix Release

This release fixes a dependency issue with netCDF https://github.com/ioos/compliance-checker/issues/579.

Also adds versioneer for managing versions

Climate Change - Climate Data Standards - Python
Published by Bobfrat almost 8 years ago

IOOS Compliance Checker - Compliance Checker 4.0.0

Compliance Checker 4.0.0 release includes an overhaul of the output results and some bug fixes. For details of the scoring design discussions, please refer to this issue: https://github.com/ioos/compliance-checker/issues/37.

Compliance Checker Output Updates:

  • Removal of the scoring section for each output format. Left with only the corrective actions based on the criteria level passed in
  • High, Medium, Low Priority headers have been replaced with the terminology for each check (i.e. Highly Recommended, Recommended, and Suggested for ACDD)
  • Added ability to concatenate results from many input files into a single output file
  • Added ability to export multiple formats (html, text, json) in one run
  • Removed concept of score grouping which had unexpected scoring consequences

Development driven by the Version 4.0.0 Milestone

Bug Fixes:

Climate Change - Climate Data Standards - Python
Published by Bobfrat about 8 years ago

IOOS Compliance Checker - Compliance Checker 3.1.1

Compliance Checker 3.1.1 release includes:

  • Many bug fixes related to the CF checker
  • A new checker for the IOOS NetCDF v1.1 standard
  • Updated user-friendly README with more examples

Development driven by the Version 3.1 Milestone

Climate Change - Climate Data Standards - Python
Published by Bobfrat over 8 years ago

IOOS Compliance Checker - Compliance Checker 3.0.4: Bugfix Release

3.0.4 is a bugfix release including:

  • Relaxing requirements (@ocefpaf, #494)
  • Fixing CF cell_measures (@lukecampbell / @daf, #495 via #496/#499)
  • Print CF standard table usage/downloading messages to stderr (@daf, #497 via #498)

Climate Change - Climate Data Standards - Python
Published by daf almost 9 years ago

IOOS Compliance Checker - Compliance Checker support for ERDDAP and Hyrax

This is a patch release that improves the code's PEP8 Compliance. This patch also includes support for compliance checker to connect to more standard OPeNDAP interfaces like ERDDAP's GridDAP and Hyrax.

  • Added windows tests
  • Fixed a bug with loading CF standard name tables
  • Fixed bug in protocol handling that used to fail for Hyrax and ERDDAP Connections
  • Fixed linter checks

Climate Change - Climate Data Standards - Python
Published by lukecampbell almost 9 years ago

IOOS Compliance Checker - Bugfix release

Windows users had reported issues with floating point numbers raising exceptions at runtime. This patch release includes changes to improve the handling of floating point values and datetime semantics.

  • Improve floating point value handling
  • Remove unnecessary dependency
  • Fix issue with httpretty (Python3)

Climate Change - Climate Data Standards - Python
Published by lukecampbell about 9 years ago

IOOS Compliance Checker - Minor Release for Bug Fixes

This release includes:

  • Project documentation updates
  • Changes to spelling of acknowledgement in the IOOS checker IAW ACDD/UCDD
  • Fixes date-time ISO-8601 checkers
  • Removes cdm_data_type checks
  • ignore string variables in check_dimensions
  • ignore additional THREDDS-specific global attributes

Climate Change - Climate Data Standards - Python
Published by lukecampbell about 9 years ago

IOOS Compliance Checker - Major Release 3.0.0

Major refactor of the CF Checks

With the 3.0 major release we have reread and changed our interpretation of the
CF specification with the guidance from NCEI and members of NCEI's netCDF team.
Along with these changes we have integrated a much more advanced capability for
the checker to accurately determine feature types for datasets and make
accurate checks based on the type of dataset being checked.

To improve future development we incorporated integration tests from several
different types of datasets found through the IOOS catalog. This includes:

  • SWAN Output
  • ROMS
  • ADCIRC
  • FVCOM
  • GliderDAC Trajectory Profiles
  • Meteorology Station Timeseries
  • DEM Elevation Dataset

In addition to these, we will continue to add more integration datasets to
improve the quality of the compliance checker over time. We looked at each
dataset and compared the results with the specification and adjusted the
checker until we got results that were appropriate.

A perfect score is not only possible, it's the true norm for good data. If a
dataset doesn't have a perfect score there will be very clear guidance for how
to achieve a perfect score.

We also started to add recommendation checks. These checks don't penalize a
score but observe possible problems with the dataset and make recommendations
for how to improve the metadata. For example, if there is a variable that ends
with _bounds but is not referenced by any variable through the bounds
attribute, we will add a corrective action message letting the user know that
we recommend to add a bounds attribute, but no points are taken off.

Changes

  • Each section was refactored to include better feature detection
  • Corrected several major bugs that were related to mis-classification of data
  • Rewrote the scoring to be far more forgiving
  • We added much better grid support. In the past we weren't able to accurately
    recognize grid types, so now if a dataset is a gridded dataset, all of the
    correct chapter 4 and 5 checks will be performed.
  • Code readability and documentation improvements
  • Created a comprehensive suite to assist in working with CF compliant data
    • Feature Detection
    • Methods for getting coordinate systems
    • Methods for finding geophysical variables in an arbitrary dataset
  • Added integration tests which include several datasets from the IOOS Catalog
  • Refactored the checks to have consistent conventions with naming, how we
    iterate, and return types.
  • Added documentation to every single check in CF
  • Several sections were refactored completely in order to take a far simpler
    approach.
  • All grouping of results was removed.

Climate Change - Climate Data Standards - Python
Published by lukecampbell over 9 years ago

IOOS Compliance Checker -

Backports #331 and #334 onto 2.3.0 release to fix issues with flag_masks attribute.

Climate Change - Climate Data Standards - Python
Published by benjwadams over 9 years ago

IOOS Compliance Checker - 3.0 Release Candidate 1

  • Major refactor of CF Checks for Chapter 1 - 6
  • Inclusion of many more example datasets into unit tests
  • Tighter integration between CF checks and the feature detection introduced by NCEI's checked cfutil.py
  • Fixed several feature mis-identification issues with regards to coordinate checks and reduced-horizontal-grids.
  • Improved result titles and corrective action messages

Climate Change - Climate Data Standards - Python
Published by lukecampbell over 9 years ago

IOOS Compliance Checker - Minor Version 2.3

Compliance Checker release notes:

  • Include standard name table version in info string
  • Added description and links to help resources on ccweb
  • Fixed bug enable saving text output from command line
  • Remove unnecessary CF check - check_alternative_coordinates
  • Added support for metadata only checks via .cdl files
  • Removed lingering large netCDF files from the code base
  • Updated the CF Standard names table to v36
  • Wicken updated for IOOS Metadata checker
  • Created a RESTful endpoint for running cc on DAP endpoints in batch file mode
  • Added command line argument to skip a test
  • Added NODC sea names check to gliderDAC
  • Fixes bug that overwrites JSON output when multiple checks are performed

What's new in Compliance Checker 2.3.0:

New Features:
Run compliance checker on metadata files (*.cdl). Testing large NetCDF files
could take a long time. Now you can reduce that time by checking compliance
against a metadata text file representation of the data. Use the NetCDF Utility
ncdump to generate a .CDL file and use the compliance checker against the
metadata file to get your score.

CF standard names are checked against the standard name table version specified
in the global attribute :standard_name_vocabulary. If the version specified is
not the version packaged with compliance checker, that version will be
downloaded and used in the standard name check.

Are there checks that are taking too long to run? Now you can skip checks using
the command line. Use the -s flag and specify the name of the check function
you wish to skip. For example

compliance-checker -s check_high

Enhancements have also been made to the compliance checker web version
https://data.ioos.us/compliance/index.html.

Now you can batch process files hosted on an OPeNDAP server using the new
compliance checker web API. Refer to the wiki for details:
https://github.com/ioos/compliance-checker-web/wiki/API

Descriptions for each of the checkers and helpful resources are now available.

Bug Fixes:

  • Save text output to file from the command line
  • Remove unnecessary CF check - check_alternative_coordinates
  • Updated the packaged CF Standard names table to v36
  • Added NODC sea names check to gliderDAC.
  • Fixes bug that was overwriting JSON output when multiple checks are performed

Climate Change - Climate Data Standards - Python
Published by lukecampbell over 9 years ago

IOOS Compliance Checker - Minor Release for bug fixes

  • Added type checking to results returned from checkers
  • Added netCDF4 to explicit requirements
  • Default to utf-8 output if encoding is not explicitly set
  • Fixed issue where cf_role variables were being detected as geophysical variables
  • Cleaned up the CLI's parsing of command line arguments
  • Fixed python3 setup errors
  • Added code version information to checker
  • Removed alternate coordinates check
  • Added support for dynamically downloading standard name table
  • Added support for metadata only checks

Climate Change - Climate Data Standards - Python
Published by lukecampbell over 9 years ago

IOOS Compliance Checker - Release 2.2.0

  • ACDD 1.3 now supported.
  • A method of selecting checker version has been introduced.
  • Check Suite Name, Version, and other metadata can be defined in the checker class and shown in output.
  • Several outstanding checker bugs have been addressed.
  • Several new checks have been added per Git Hub issues.

Climate Change - Climate Data Standards - Python
Published by lukecampbell almost 10 years ago

IOOS Compliance Checker - Version 2.1

  • Python 3 support
  • Removal of deprecated dependencies
  • Better testing for CF features
  • PEP-8 Cleanup
  • Better messages for suggested actions in CF
  • Bug Fixes

Climate Change - Climate Data Standards - Python
Published by lukecampbell about 10 years ago

IOOS Compliance Checker - Major Release 2.0

  • Unicode support
  • New output formats:
    • HTML
    • JSON
    • Plain Text (not really new)
  • Rewrote CF reasoning statements and corrective actions to be more intuitive
  • Plugin Framework
    • CF, ACDD and IOOS comprise the core set of checkers
    • Additional checkers are now plugins and can be installed and managed independently of the main project
  • Better Travis CI support (and speed, thanks @ocefpaf)
  • Increase in test coverage and better CF case support

Climate Change - Climate Data Standards - Python
Published by lukecampbell over 10 years ago

IOOS Compliance Checker - 1.1.1 Windows Bug Fix

Fixes an issue with determining binary files on Windows.

Climate Change - Climate Data Standards - Python
Published by daf almost 11 years ago

IOOS Compliance Checker - Support for Windows through cf_units

  • CI Travis Fixes
  • Better GliderDAC compliance tests
  • Better skip control for QC variables, now relies on 'flag_meanings' attribute.
  • Fixes recursion bug
  • Fixes horizontal grid check bug

Climate Change - Climate Data Standards - Python
Published by lukecampbell almost 11 years ago

IOOS Compliance Checker - GliderDAC and Bug Fixes

  • Station Variable Support
  • Bug Fixes
  • Initial Conda help
  • Exit Code
  • Opens room for future CF conventions
  • GliderDAC Compliance Checker

Climate Change - Climate Data Standards - Python
Published by lukecampbell about 11 years ago

IOOS Compliance Checker - 1.0.1 bug fixes

small bug fixes

Climate Change - Climate Data Standards - Python
Published by rsignell-usgs about 11 years ago

IOOS Compliance Checker - 1.0.0 Initial Stable Release

pip install compliance-checker

Climate Change - Climate Data Standards - Python
Published by daf over 11 years ago