Releases | Open Sustainable Technology

Version 4.0.0 (in development)

Cate is now designed to work inside of Jupyter Lab and standalone.
For this reason, the Cate App UI is now bundled with the Cate server
and served via the endpoint "/app".

Current Cate App version is 4.0.0-dev.6.
Now using workspace identifiers instead of base directories in resource
URLs of the WebAPI. This way we no longer need to URL-encode workspace
directories in WebAPI URLs, which did not work with
jupyter-server-proxy.
The "local" data store is now configured to use a given
server root path.
Cached data is now written into a sub-folder cate-local/{data_store_id}
within Cate server's root path unless another folder is specified.
Removed the cate upd CLI command.

Full Changelog: https://github.com/CCI-Tools/cate/compare/v3.1.6...v4.0.0.dev6

Climate Change - Climate Data Access and Visualization - Python
Published by forman about 2 years ago

Changes in version 3.1.6

Fixed docker image
Use compatible library versions in software environments

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF about 2 years ago

Version 3.1.6 (in development)

Use compatible library versions in software environments

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF about 2 years ago

Changes in version 3.1.5

Feature Collections may be written as geojson also with latest fiona versions (>= 1.9). 1041)

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF about 2 years ago

Changes in version 3.1.4

Updated documentation:
- Updated links to Cate SaaS.
- Removed all references to Cate Desktop, which is no longer supported.
Zarr Datastore reads data ids from json file if provided, thereby gaining a
notable performance improvement (via updated version of xcube-cci)
Extended support of datasets. Previously, datasets which had a chunking of
the time dimension larger than one were not handled properly. This affected
OZONE in a monthly resolution, SEALEVEL in a monthly resolution, and several
ICESHEETS datasets. (via updated version of xcube-cci)
Extended operation no_op by parameter memory_alloc for container
stress testing. (#980)

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF about 2 years ago

Changes in version 3.1.4 (in development)

Updated documentation:
- Updated links to Cate SaaS.
- Removed all references to Cate Desktop, which is no longer supported.
Zarr Datastore reads data ids from json file if provided, thereby gaining a notable performance improvement (via updated version of xcube-cci)
Extended support of datasets. Previously, datasets which had a chunking of the time dimension larger than one were not handled properly. This affected OZONE in a monthly resolution, SEALEVEL in a monthly resolution, and several ICESHEETS datasets. (via updated version of xcube-cci)
Extended operation no_op by parameter memory_alloc for container stress testing. (#980)

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF over 2 years ago

Changes in version 3.1.4 (in development)

Zarr Datastore reads data ids from json file if provided, thereby gaining a notable
performance improvement (via updated version of xcube-cci)
Extended support of datasets. Previously, datasets which had a chunking of
the time dimension larger than one were not handled properly. This affected
OZONE in a monthly resolution, SEALEVEL in a monthly resolution, and several
ICESHEETS datasets. (via updated version of xcube-cci)

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF over 2 years ago

Changes in version 3.1.4 (in development)

Zarr Datastore reads data ids from json file if provided, thereby gaining a notable
performance improvement (via updated version of xcube-cci)
Extended support of datasets. Previously, datasets which had a chunking of
the time dimension larger than one were not handled properly. This affected
OZONE in a monthly resolution, SEALEVEL in a monthly resolution, and several
ICESHEETS datasets. (via updated version of xcube-cci)

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF over 2 years ago

Changes in version 3.1.4 (in development)

Updated documentation:
- Updated links to Cate SaaS.
- Removed all references to Cate Desktop, which is no longer supported.

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF almost 3 years ago

Changes in version 3.1.4 (in development)

Updated documentation:
- Updated links to Cate SaaS.
- Removed all references to Cate Desktop, which is no longer supported.

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF almost 3 years ago

Changes in version 3.1.3

Pinned Python version to < 3.10 to avoid ImportErrors caused by a third-party
library.
It is now possible to re-use identifiers to cache data (#1030).
Parts of documentation that reference API are populated with content (again)
(#1034).
Allow reading of datasets that do not specify chunk sizes, e.g., FIRE,
(via updated version of xcube-cci) (#1033).
Ensured compatibility with an announced CCI ODP API update.

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF about 3 years ago

Changes in version 3.1.2

Fixed bug which made it impossible to add data to a writable (local)
data store using the Web API (#1022)
The "keep_alive" WebSocket JSON RPC method of the cate-webapi-start
CLI tool will now return an object with auto-close info, if
cate-webapi-start is started with the --auto-stop-after option.
Otherwise, it returns null (#1026). The object comprises the fields:
- available_time - configured auto-stop time in seconds.
- inactivity_time - duration in seconds of service inactivity.
- remaining_time - duration in seconds remaining until service auto-stop.
Enhanced logging for cate-webapi-start CLI tool to ease error analysis:
- Added new option --logfile.
- Changed meaning of option --verbose. Using this flag now
  sets log level to DEBUG. Warning: this setting affects all
  loggers, so expect vast output.
- Cate now outputs extra debugging information, if
  environment variable CATE_DEBUG is set to 1.
  This affects WebSocket communication, image tile computations,
  and image tile caching. Output will always be streamed
  to stdout.
- On WebSocket close, now also outputting WS code and reason.
Changed behavior of option --auto-stop-after of cate-webapi-start
CLI tool:
- WebSocket messages will now reset the auto-stop timer too.
- Using time.time() instead of time.perf_counter() to compute
  idle time
- We now check every 10 seconds for the auto-stop condition.
  Previously, the value of --auto-stop-after was used.

Climate Change - Climate Data Access and Visualization - Python
Published by forman over 3 years ago

Version 3.1.2 (in development)

Enhanced logging for cate-webapi-start CLI tool to ease error analysis:
- Added new option --logfile.
- Changed meaning of option --verbose. Using this flag now
  sets log level to DEBUG. Warning: this setting affects all
  loggers, so expect vast output.
- Cate now outputs extra debugging information, if
  environment variable CATE_DEBUG is set to 1.
  This affects WebSocket communication, image tile computations,
  and image tile caching. Output will always be streamed
  to stdout.
Changed behavior of option --auto-stop-after of cate-webapi-start
CLI tool:
- WebSocket messages will now reset the auto-stop timer too.
- Using time.time() instead of time.perf_counter() to compute
  idle time

Climate Change - Climate Data Access and Visualization - Python
Published by forman over 3 years ago

Version 3.1.1

Use xcube-cci version 0.9.3 in docker files

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF over 3 years ago

Version 3.1.0

Increased version number to 3.1 because the Cate Web API changed in an
incompatible way. Dataset descriptors now have a data_type
field instead of a type_specifier field in 3.0.x.
The --auto-stop-after <seconds> option now works correctly with
Cate service CLI cate-webapi-start command. It will be used to
automatically stop inactivate Cate Cloud Service instances.
Fixed bug that would cause that data that was downloaded and cached locally
could not be opened.
Increased xcube and xcube-cci version to >=0.9.1 and fixed issues
that arose from that change:
- Type specifiers replaced with data types (DATASET_TYPE) and removed
  TYPE_SPECIFIER_CUBE and TYPE_SPECIFIER_DATASET
- get_type_specifiers_for_data replaced with get_data_types_for_data
- Changed xcube directory configurations to file.
Changed Dockerfile. Is now completely based on quay.io/bcdev/xcube.
Unpinned xarray version (now 0.19.0+), unpinned pandas version (now 1.3+)

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF over 3 years ago

Changes 3.1.0 (in development)

Set new versions of xcube and xcube-cci
do not create root if it does not exist

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF over 3 years ago

Version 3.1.0 (in development)

Increased version number to 3.1 because the Cate Web API changed in an
incompatible way. Dataset descriptors now have a data_type
field instead of a type_specifier field in 3.0.x.
The --auto-stop-after <seconds> option now works correctly with
Cate service CLI cate-webapi-start command. It will be used to
automatically stop inactivate Cate Cloud Service instances.
Increased xcube-cci version to >=0.9.1

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF over 3 years ago

Version 3.0.1 (in development)

Increased xcube >=0.9.1 and xcube-cci version to >=0.9.0 and fixed issues
that arose from that change:
- Type specifiers replaced with data types (DATASET_TYPE) and removed
  TYPE_SPECIFIER_CUBE and TYPE_SPECIFIER_DATASET
- get_type_specifiers_for_data replaced with get_data_types_for_data
- Changed xcube directory configurations to file.
Changed Dockerfile. Is now completely based on quay.io/bcdev/xcube.
Unpinned xarray version (now 0.19.0+), unpinned pandas version (now 1.3+)

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF over 3 years ago

Version 3.0.1 (in development)

Fixed bug that would cause that data that was downloaded and cached locally could not be opened.

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF over 3 years ago

Version 3.0.0

Cate's implementations of the CCI ODP data store and the local data store
have been replaced by xcube equivalents
which are faster and more robust.
Added a new experimental "Zarr data store" that provides fast
access to selected CCI datasets in JASMIN object storage.
Added a Web API function keep_alive that is periodically used by Cate App
to avoid loosing an open WebSocket connection. (#980)
Removed functions and parameters that have been deprecated in cate 2.x:
- Function cate.ops.utility.from_dataframe
- Function cate.ops.plot.plot_data_frame
- Parameter crs of function cate.ops.io.read_geo_data_frame
Fixed bug with user preferences not being saved correctly.
(#146)
Internal: the metadata format returned by the WebSocket JSON RPC operation
get_data_source_meta_info has changed:
- variables field has been renamed to data_vars;
- coords field has been added;
- the variable descriptors in data_vars and coords have
  now dtype and dims fields.
Fixed environment not building with matplotlib version <3.3.0. (#929)
Fixed the operation animate_map that stopped working with xarray version 0.18.0.
Other:
- The info handler of Cate Web API (at API root "/") now returns
  Cate's core package dependencies.
- Added a GitHub Actions workflow for running unittests.
- Changed Dockerfile to install xcube and xcube-cci
  from GitHub releases
- Added missing progress monitors to some backend methods.
Fixed memory leak introduced by dask version > 2021.3.1
(see https://github.com/dask/dask/issues/7583).
Pinned it to 2021.3.1.

Climate Change - Climate Data Access and Visualization - Python
Published by forman over 3 years ago

Version 3.0.0 (in development)

Cate's implementations of the CCI ODP data store and the local data store
have been replaced by xcube equivalents
which are faster and more robust.
Added a new experimental "Zarr data store" that provides fast
access to selected CCI datasets in JASMIN object storage.
Added a Web API function keep_alive that is periodically used by Cate App
to avoid loosing an open WebSocket connection. (#980)
Removed functions and parameters that have been deprecated in cate 2.x:
- Function cate.ops.utility.from_dataframe
- Function cate.ops.plot.plot_data_frame
- Parameter crs of function cate.ops.io.read_geo_data_frame
Fixed bug with user preferences not being saved correctly.
(#146)
Internal: the metadata format returned by the WebSocket JSON RPC operation
get_data_source_meta_info has changed:
- variables field has been renamed to data_vars;
- coords field has been added;
- the variable descriptors in data_vars and coords have
  now dtype and dims fields.
Fixed environment not building with matplotlib version <3.3.0. (#929)
Fixed the operation animate_map that stopped working with xarray version 0.18.0.
Other:
- The info handler of Cate Web API (at API root "/") now returns
  Cate's core package dependencies.
- Added a GitHub Actions workflow for running unittests.
- Changed Dockerfile to install xcube and xcube-cci
  from GitHub releases
- Added missing progress monitors to some backend methods.
Fixed memory leak introduced by dask version > 2021.3.1
(see https://github.com/dask/dask/issues/7583).
Pinned it to 2021.3.1.

Climate Change - Climate Data Access and Visualization - Python
Published by forman over 3 years ago

Cate - 3.0.0.dev11

Climate Change - Climate Data Access and Visualization - Python
Published by forman over 3 years ago

Version 3.0.0.dev9 (in development)

Dockerfile updates to allow fixing of Dask version
Fixed memory leak introduced by dask version > 2021.3.1
(see https://github.com/dask/dask/issues/7583).
Pinned it to 2021.3.1.

Climate Change - Climate Data Access and Visualization - Python
Published by forman over 3 years ago

Version 3.0.0 (in development)

Cate's implementations of the CCI ODP data store and the local data store
have been replaced by xcube equivalents which are faster and more
robust.
Added a new experimental "Zarr data store" that provides fast
access to selected CCI datasets in JASMIN object storage.
Added a Web API function keep_alive that is periodically used by Cate App
to avoid loosing an open WebSocket connection. (#980)
Removed functions and parameters that have been deprecated in cate 2.x:
- Function cate.ops.utility.from_dataframe
- Function cate.ops.plot.plot_data_frame
- Parameter crs of function cate.ops.io.read_geo_data_frame
Fixed bug with user preferences not being saved correctly.
(#146)
Internal: the metadata format returned by the WebSocket JSON RPC operation
get_data_source_meta_info has changed:
- variables field has been renamed to data_vars;
- coords field has been added;
- the variable descriptors in data_vars and coords have
  now dtype and dims fields.
Fixed environment not building with matplotlib version <3.3.0. (#929)
Fixed the operation animate_map that stopped working with xarray version 0.18.0.
Other:
- The info handler of Cate Web API (at API root "/") now returns
  Cate's core package dependencies.
- Added a GitHub Actions workflow for running unittests.
- Changed Dockerfile to install xcube and xcube-cci
  from GitHub releases
- Added missing progress monitors to some backend methods.
- Use new CciZarrStore from xcube-cci

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF over 3 years ago

Version 3.0.0 (in development)

Cate's implementations of the CCI ODP data store and the local data store
have been replaced by xcube equivalents which are faster and more
robust.
Added a new experimental "Zarr data store" that provides fast
access to selected CCI datasets in JASMIN object storage.
Added a Web API function keep_alive that is periodically used by Cate App
to avoid loosing an open WebSocket connection. (#980)
Removed functions and parameters that have been deprecated in cate 2.x:
- Function cate.ops.utility.from_dataframe
- Function cate.ops.plot.plot_data_frame
- Parameter crs of function cate.ops.io.read_geo_data_frame
Fixed bug with user preferences not being saved correctly.
(#146)
Internal: the metadata format returned by the WebSocket JSON RPC operation
get_data_source_meta_info has changed:
- variables field has been renamed to data_vars;
- coords field has been added;
- the variable descriptors in data_vars and coords have
  now dtype and dims fields.
Fixed environment not building with matplotlib version <3.3.0. (#929)
Fixed the operation animate_map that stopped working with xarray version 0.18.0.
Other:
- The info handler of Cate Web API (at API root "/") now returns
  Cate's core package dependencies.
- Added a GitHub Actions workflow for running unittests.
- Changed Dockerfile to install xcube and xcube-cci
  from GitHub releases
- Added missing progress monitors to some backend methods.
Updated xcube-cci to include user agent

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF almost 4 years ago

Version 3.0.0 (in development)

Cate's implementations of the CCI ODP data store and the local data store
have been replaced by xcube equivalents which are faster and more
robust.
Added a new experimental "Zarr data store" that provides fast
access to selected CCI datasets in JASMIN object storage.
Added a Web API function keep_alive that is periodically used by Cate App
to avoid loosing an open WebSocket connection. (#980)
Removed functions and parameters that have been deprecated in cate 2.x:
- Function cate.ops.utility.from_dataframe
- Function cate.ops.plot.plot_data_frame
- Parameter crs of function cate.ops.io.read_geo_data_frame
Fixed bug with user preferences not being saved correctly.
(#146)
Internal: the metadata format returned by the WebSocket JSON RPC operation
get_data_source_meta_info has changed:
- variables field has been renamed to data_vars;
- coords field has been added;
- the variable descriptors in data_vars and coords have
  now dtype and dims fields.
Fixed environment not building with matplotlib version <3.3.0. (#929)
Fixed the operation animate_map that stopped working with xarray version 0.18.0.
Other:
- The info handler of Cate Web API (at API root "/") now returns
  Cate's core package dependencies.
- Added a GitHub Actions workflow for running unittests.
- Changed Dockerfile to install xcube and xcube-cci
  from GitHub releases
- Added missing progress monitors to some backend methods.

Climate Change - Climate Data Access and Visualization - Python
Published by forman almost 4 years ago

Cate - 3.0.0-dev.5

Climate Change - Climate Data Access and Visualization - Python
Published by forman almost 4 years ago

Version 3.0.0 (in development)

Cate's implementations of the CCI ODP data store and the local data store
have been replaced by xcube equivalents which are faster and more
robust.
Added a new experimental "Zarr data store" that provides fast
access to selected CCI datasets in JASMIN object storage.
Added a Web API function keep_alive that is periodically used by Cate App
to avoid loosing an open WebSocket connection. (#980)
Removed functions and parameters that have been deprecated in cate 2.x:
- Function cate.ops.utility.from_dataframe
- Function cate.ops.plot.plot_data_frame
- Parameter crs of function cate.ops.io.read_geo_data_frame
Fixed bug with user preferences not being saved correctly.
(#146)
Internal: the metadata format returned by the WebSocket JSON RPC operation
get_data_source_meta_info has changed:
- variables field has been renamed to data_vars;
- coords field has been added;
- the variable descriptors in data_vars and coords have
  now dtype and dims fields.
Fixed environment not building with matplotlib version <3.3.0. (#929)
Fixed the operation animate_map that stopped working with xarray version 0.18.0.
Other:
- The info handler of Cate Web API (at API root "/") now returns
  Cate's core package dependencies.
- Added a GitHub Actions workflow for running unittests.
- Changed Dockerfile to install xcube and xcube-cci
  from GitHub releases

Climate Change - Climate Data Access and Visualization - Python
Published by forman almost 4 years ago

Version 3.0.0 (in development)

Cate's implementations of the CCI ODP data store and the local data store
have been replaced by xcube equivalents which are faster and more
robust.
Added a new experimental "Zarr data store" that provides fast
access to selected CCI datasets in JASMIN object storage.
Added a Web API function keep_alive that is periodically used by Cate App
to avoid loosing an open WebSocket connection. (#980)
Removed functions and parameters that have been deprecated in cate 2.x:
- Function cate.ops.utility.from_dataframe
- Function cate.ops.plot.plot_data_frame
- Parameter crs of function cate.ops.io.read_geo_data_frame
Fixed bug with user preferences not being saved correctly.
(#146)
Internal: the metadata format returned by the WebSocket JSON RPC operation
get_data_source_meta_info has changed:
- variables field has been renamed to data_vars;
- coords field has been added;
- the variable descriptors in data_vars and coords have
  now dtype and dims fields.
Fixed environment not building with matplotlib version <3.3.0. (#929)
Fixed the operation animate_map that stopped working with xarray version 0.18.0.
Other:
- The info handler of Cate Web API (at API root "/") now returns
  Cate's core package dependencies.
- Added a GitHub Actions workflow for running unittests.
- Changed Dockerfile to install xcube and xcube-cci
  from GitHub releases.

Climate Change - Climate Data Access and Visualization - Python
Published by forman almost 4 years ago

Version 3.0.0 (in development)

Cate's implementations of the CCI ODP data store and the local data store
have been replaced by xcube equivalents which are faster and more
robust.
Added a new experimental "Zarr data store" that provides fast
access to selected CCI datasets in JASMIN object storage.
Added a Web API function keep_alive that is periodically used by Cate App
to avoid loosing an open WebSocket connection. (#980)
Removed functions and parameters that have been deprecated in cate 2.x:
- Function cate.ops.utility.from_dataframe
- Function cate.ops.plot.plot_data_frame
- Parameter crs of function cate.ops.io.read_geo_data_frame
Fixed bug with user preferences not being saved correctly.
(#146)
Internal: the metadata format returned by the WebSocket JSON RPC operation
get_data_source_meta_info has changed:
- variables field has been renamed to data_vars;
- coords field has been added;
- the variable descriptors in data_vars and coords have
  now dtype and dims fields.
Fixed environment not building with matplotlib version <3.3.0. (#929)
Fixed the operation animate_map that stopped working with xarray version 0.18.0.

Climate Change - Climate Data Access and Visualization - Python
Published by forman almost 4 years ago

Version 3.0.0 (in development)

Fixed environment not building with matplotlib version <3.3.0. (#929)
Fixed the operation animate_map that stopped working with xarray version 0.18.0.

Climate Change - Climate Data Access and Visualization - Python
Published by dzelge almost 4 years ago

Version 3.0.0 (in development)

Cate's implementations of the CCI ODP data store and the local data store
have been replaced by xcube equivalents which are faster and more
robust.
Added a new experimental "Zarr data store" that provides fast
access to selected CCI datasets in JASMIN object storage.
Added a Web API function keep_alive that is periodically used by Cate App
to avoid loosing an open WebSocket connection. (#980)
Removed functions and parameters that have been deprecated in cate 2.x:
- Function cate.ops.utility.from_dataframe
- Function cate.ops.plot.plot_data_frame
- Parameter crs of function cate.ops.io.read_geo_data_frame
Fixed bug with user preferences not being saved correctly.
(#146)

Climate Change - Climate Data Access and Visualization - Python
Published by forman almost 4 years ago

Version 2.3.0 (in development)

Integration xcube into Cate in order to reuse the xcube Data Store Framework.
Exchanged existing data store "CCI Open Data Portal" by a faster one based on xcube.
Added new experimental data store "CCI Zarr Store" to Cate.

Internal fixes:

Apply subsetting after opening when subsetting is not provided by an xcube data store
Consider that data variables or attributes of a dataset descriptor may be none
Open Zarr dataset with flag consolidated=True if applicable
Fixed error when checking JSON Schema properties

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF about 4 years ago

Version 2.3.0 (in development)

Open data consolidated when possible

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF about 4 years ago

Version 2.3.0 (in development)

Fixed error when checking json schema properties

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF about 4 years ago

Version 2.3.0 (in development)

Apply subsetting after opening when subsetting is not provided by data store

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF about 4 years ago

Version 2.3.0 (in development)

xcube integration
new experimental Zarr store
Small fix where data store was not adressed correctly, preventing that data could be saved locally

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF about 4 years ago

Version 2.1.5

Fixed problem that prevented storing user preferences from Cate App if the
preferences file did not yet exist.
The parameters of operation temporal_aggregation have been changed. Both parameters
output_resolution and custom_resolution have been replaced by a single parameter
period whose value is a Pandas offset-alias / time frequency value.
Ensure User-Agent header is set in every HTTP request made to CCI ODP web APIs.
When caching a dataset to disk, cate now checks first if the needed attributes for geospatial information
are in the metadata of the remote dataset. If not, the information is retrieved from the data directly (#961).
This is relevant for dataset "esacci.SST.day.L4.SSTskin.Unspecified.Unspecified.GMPE.2-0.r1".
Now including ODP dataset verification information in data sources for use by Cate App.
Operation read_zarr() now uses the new password attribute for its key. secret,
and token parameters.
Now including ODP dataset verification information in data sources for use by Cate App.
No longer using Travis CI.

Climate Change - Climate Data Access and Visualization - Python
Published by forman about 4 years ago

Cate - 2.1.5.dev6

Another preferences fix

Climate Change - Climate Data Access and Visualization - Python
Published by forman about 4 years ago

Changes from 2.1.5.dev4 to 2.1.5.dev5

Fixed problem that prevented storing user preferences from Cate App if the
preferences file did not yet exist.

Climate Change - Climate Data Access and Visualization - Python
Published by forman about 4 years ago

Changes from 2.1.5.dev3 to 2.1.5.dev4

The parameters of operation temporal_aggregation have been changed. Both parameters
output_resolution and custom_resolution have been replaced by a single parameter
period whose value is a Pandas offset-alias / time frequency value.
Fixed parameter value type validation.

Climate Change - Climate Data Access and Visualization - Python
Published by forman about 4 years ago

Version 2.1.5 (in development)

Ensure User-Agent header is set in every HTTP request made to CCI ODP web APIs.
When caching a dataset to disk, cate now checks first if the needed attributes for geospatial information
are in the metadata of the remote dataset. If not, the information is retrieved from the data directly (#961).
This is relevant for esacci.SST.day.L4.SSTskin.Unspecified.Unspecified.GMPE.2-0.r1
Now including ODP dataset verification information in data sources for use by Cate App.
Operation read_zarr() now uses the new password attribute for its key. secret,
and token parameters.
Now including ODP dataset verification information in data sources for use by Cate App.
No longer using Travis CI.

Climate Change - Climate Data Access and Visualization - Python
Published by forman about 4 years ago

Version 2.1.5 (in development)

Now including ODP dataset verification information in data sources for use by Cate App.

Climate Change - Climate Data Access and Visualization - Python
Published by forman over 4 years ago

Version 2.1.4

Only show data sources of the ODP Data Store that can be opened in cate.
When using cate ds list from the command line, there is a new option -a to also include the other data sets.
Included normalization of a dataset's time coordinate variable in case it is called 't' instead of 'time' (#956).
This is the case for all datasets with IDs esacci.ICESHEETS.yr.Unspecified.GMB.GRACE-instrument.GRACE.UNSPECIFIED.1-*.greenland_gmb_mass_trends.

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF over 4 years ago

Cate 2.1.3

Changed CCI ODP url from test service to production service (archive.opensearch.ceda.ac.uk) (#951)
Removed the legacy CCI ODP data store.
The read_zarr() operation now accepts credentials. (#953)
Fixed broken Cate Web API logging.

Climate Change - Climate Data Access and Visualization - Python
Published by forman over 4 years ago

Version 2.1.2

Added package s3fs to Python environment as it is required to open Zarr datasets
from S3-compatible object store. #940
Fixed issue of harmonization of info field names of metadata (#949)
Fixed problem with unsupported time format for permafrost datasets below. They have a time_coverage_start and
time_coverage_end with a datetime format of 15 characters (#944):
- esacci.PERMAFROST.yr.L4.ALT.multi-sensor.multi-platform.MODIS.01-0.r1
- esacci.PERMAFROST.yr.L4.GTD.multi-sensor.multi-platform.MODIS.01-0.r1
- esacci.PERMAFROST.yr.L4.PFR.multi-sensor.multi-platform.MODIS.01-0.r1
Fixed problem of not handling timezone aware times from dataset metadata. Some datasets have their time information
stored in timezone aware timestamps e.g. '1997-09-03T00:00:00+00:00'. Cate now is able to get a datetime object of these
timezone aware strings, and removes the timezone awareness. (#942)

Climate Change - Climate Data Access and Visualization - Python
Published by forman over 4 years ago

Version 2.1.1

Prevent HTTP 500 errors when using the ODP Data Store. #937
Spatial points are now parsed from CSV files when using the read_csv()operation.
This is an option which can be disabled. #935
Fixed a problem that prevented opening GeoJSON files
in a workspace. #933
Fixed a problem that prevented reopening workspaces using
the Web API when they referenced external files. #930

Version 2.1.0

Fixed DataAccessError in ODP Legacy Store #924
Renamed legacy id's prefix from esacci to cciold
Exchanged Cate's countries GeoJSON, by three new maps from https://www.naturalearthdata.com
using 10m, 50m (default), and 110m resolutions. This fixes broken polyline and polygon
drawing in Cate Web UI #912. See also
https://github.com/CCI-Tools/cate-webui/issues/11.
Cate Web API is now handling user preferences
Added normalization method in order to handle datasets with zonal means
which have no longitude information.
Increased robustness when using netcdf library
Remodeled ODP Data Store to support newly designed CEDA OpenSearch Service.
The previous Data Store implementation is now available as "ESA CCI Open Data Portal Legacy".
Iteratively adapted CCI Data Store to support newly provided data sets.
Cate Web API at now allows changes to the root path using environment variable JUPYTERHUB_SERVICE_PREFIX. This is relevant to Catehub context where each user's cate service is mounted on /user/{username}/{cate-web-api-endpoint}.
Cate Web API at ${endpoint}/ now reports whether it is running with a "user root directory". In this case, the Web API uses relative workspace path only and users connot escape the given user root directory.
Cate Web API allows for Cross-Origin Resource Sharing (CORS), which is required
to run Cate UI in a browser.
Added option --traceback to cate-webapi-start and cate-webapi-stop CLI tools.
Added operation write_zarr() to write gridded datasets using the Zarr format.
Updated cate.core.wsmanag.WorkspaceManager to work only with workspace paths relative to a given
user root directory.
- added cate.core.pathmanag.PathManager to ensure users cannot escape root directory
- updated workspace handling: create/save/save_as/delete
Updated Python environment and fixed failing tests (#817
Updated Cate code base with respect to xarray version 0.15
- Changed minimum version requirement for xarray to 0.15 in environment.yml
- Changed xarray.Dataset.drop to xarray.Dataset.drop_vars
- Removed encoding keyword argument from xarray.DataArray constructor calls.
- No longer writing to xarray.DataArray.values property (e.g. Pearson's
  computation)
Downloading of remote data from ODP now handles redirect of URL from HTTP to HTTPS #919

Climate Change - Climate Data Access and Visualization - Python
Published by forman over 4 years ago

Changes in Cate 2.1.0

Fixed DataAccessError in ODP Legacy Store #924
Renamed legacy id's prefix from esacci to cciold
Exchanged Cate's countries GeoJSON, by three new maps from https://www.naturalearthdata.com
using 10m, 50m (default), and 110m resolutions. This fixes broken polyline and polygon
drawing in Cate Web UI #912. See also
https://github.com/CCI-Tools/cate-webui/issues/11.
Cate Web API is now handling user preferences
Added normalization method in order to handle datasets with zonal means
which have no longitude information.
Increased robustness when using netcdf library
Remodeled ODP Data Store to support newly designed CEDA OpenSearch Service.
The previous Data Store implementation is now available as "ESA CCI Open Data Portal Legacy".
Iteratively adapted CCI Data Store to support newly provided data sets.
Cate Web API at now allows changes to the root path using environment variable JUPYTERHUB_SERVICE_PREFIX. This is relevant to Catehub context where each user's cate service is mounted on /user/{username}/{cate-web-api-endpoint}.
Cate Web API at ${endpoint}/ now reports whether it is running with a "user root directory". In this case, the Web API uses relative workspace path only and users connot escape the given user root directory.
Cate Web API allows for Cross-Origin Resource Sharing (CORS), which is required
to run Cate UI in a browser.
Added option --traceback to cate-webapi-start and cate-webapi-stop CLI tools.
Added operation write_zarr() to write gridded datasets using the Zarr format.
Updated cate.core.wsmanag.WorkspaceManager to work only with workspace paths relative to a given
user root directory.
- added cate.core.pathmanag.PathManager to ensure users cannot escape root directory
- updated workspace handling: create/save/save_as/delete
Updated Python environment and fixed failing tests (#817
Updated Cate code base with respect to xarray version 0.15
- Changed minimum version requirement for xarray to 0.15 in environment.yml
- Changed xarray.Dataset.drop to xarray.Dataset.drop_vars
- Removed encoding keyword argument from xarray.DataArray constructor calls.
- No longer writing to xarray.DataArray.values property (e.g. Pearson's
  computation)
Downloading of remote data from ODP now handles redirect of URL from HTTP to HTTPS #919

Climate Change - Climate Data Access and Visualization - Python
Published by dzelge over 4 years ago

Changes in Cate 2.1.0.dev4

Cate Web API is now handling user preferences
Added normalization method in order to handle datasets with zonal means
which have no longitude information.
Increased robustness when using netcdf library
Remodeled ODP Data Store to support newly designed CEDA OpenSearch Service.
The previous Data Store implementation is now available as "ESA CCI Open Data Portal Legacy".
Iteratively adapted CCI Data Store to support newly provided data sets.

Climate Change - Climate Data Access and Visualization - Python
Published by TonioF almost 5 years ago

Changes in Cate 2.1.0.dev2

Cate Web API at now allows changes to the root path using environment variable JUPYTERHUB_SERVICE_PREFIX. This is relevant to Catehub context where each user's cate service is mounted on /user/{username}/{cate-web-api-endpoint}.
Cate Web API at ${endpoint}/ now reports whether it is running with a "user root directory". In this case, the Web API uses relative workspace path only and users connot escape the given user root directory.
Cate Web API allows for Cross-Origin Resource Sharing (CORS), which is required
to run Cate UI in a browser.
Added option --traceback to cate-webapi-start and cate-webapi-stop CLI tools.
Added operation write_zarr() to write gridded datasets using the Zarr format.
Updated cate.core.wsmanag.WorkspaceManager to work only with workspace paths relative to a given
user root directory.
- added cate.core.pathmanag.PathManager to ensure users cannot escape root directory
- updated workspace handling: create/save/save_as/delete
Updated Python environment and fixed failing tests (#817
Updated Cate code base with respect to xarray version 0.15
- Changed minimum version requirement for xarray to 0.15 in environment.yml
- Changed xarray.Dataset.drop to xarray.Dataset.drop_vars
- Removed encoding keyword argument from xarray.DataArray constructor calls.
- No longer writing to xarray.DataArray.values property (e.g. Pearson's
  computation)

Climate Change - Climate Data Access and Visualization - Python
Published by forman about 5 years ago

Cate - v2.0.0

This release is created from v2.0.0.dev26 after validation.

Climate Change - Climate Data Access and Visualization - Python
Published by forman almost 6 years ago

Changes in 2.0.0.dev26

Fixed a display problem where spatial subsets of datasets appeared shifted on the 3D globe view
#817
Cate now depends on gdal 2.3.3 and geos 3.7.1 to solve failed installation issue
#843 and possibly #842
Fixed a dependency issue caused by fiona by removing defaults channel (and consequently using only conda-forge channel)
#839

Climate Change - Climate Data Access and Visualization - Python
Published by hans-permana about 6 years ago

Changes in 2.0.0.dev25

Increased default time-out for data downloads from 10 to 90 seconds. Addresses (but not fixes)
#835
Fixed failing download of Sea-Ice CCI data (ValueError: The truth value
of an array with more than one element is ambiguous). Addresses (but not fixes)
#832 - we now display better error message
Fixed installation problem with latest Miniconda 4.5.12
#831

Climate Change - Climate Data Access and Visualization - Python
Published by forman over 6 years ago

Cate - 2.0.0.dev22

Fix dataset name can contain only letters, numbers underscore, dot and minus #811
Fix for SST data download error #798

Climate Change - Climate Data Access and Visualization - Python
Published by forman over 6 years ago

Cate - 2.0.0.dev21

Climate Change - Climate Data Access and Visualization - Python
Published by forman over 6 years ago

Cate - 2.0.0.dev20

This is a source code release for the Cate Python API, Web API, and CLI.

Corresponding installers for Cate Desktop including binaries for GUI, WebAPI, and the CLI can be found here.

Changes in 2.0.0.dev20

Changed order and names of new data_frame_subset operation inputs.
Improved scatter plot #763.
We can now plot N-D arrays. Plot types are "Point", "Hexbin", and "2D Histogram".
Fixed problem where workspace save-as sometimes fails on Windows #764

Climate Change - Climate Data Access and Visualization - Python
Published by forman over 6 years ago

Cate - 2.0.0.dev19

This is a source code release for the Cate Python API, Web API, and CLI.

Corresponding installers for Cate Desktop including binaries for GUI, WebAPI, and the CLI can be found here.

Changes in Cate 2.0.0.dev19

Must click twice to expand point to polygon #709
Added operation write_geo_data_frame() #758
Numbers displayed with too many digits #754
Improved error handling in operation `pearson_correlation_scalar()``, addresses #746
Fixed error in plot_xxx() operations "'NoneType' object is not iterable" #749
Fixed problem with coregister() operation on data subsets #747
Fixed operations data_frame_aggregate() and data_frame_subset() to let users select variables (columns) of selected data frame.
Added information about resources of type DataFrame and GeoDataFrame in the details section of the WORSPACE panel.
Updated default colour mappings and default variables for more Sea Level CCI products

Climate Change - Climate Data Access and Visualization - Python
Published by forman over 6 years ago

Cate - Cate 2.0.0.dev18

This is a source code release for the Cate Python API, Web API, and CLI.

Corresponding installers for Cate Desktop including binaries for GUI, WebAPI, and the CLI can be found here.

Changes in Cate 2.0.0.dev18

Added new operation data_frame_aggregate() #707
Values of scalar variables are now always shown in VARIABLES panel in Cate Desktop #702
Unfortunately, this feature did not find its way into 2.0.0.dev17, instead only its related bug #743.
Fixed "KeyError: 0" for one one-record data frames #743
Removed option to load GML files in Cate Desktop solving #734

Climate Change - Climate Data Access and Visualization - Python
Published by forman over 6 years ago

Cate - Cate 2.0.0.dev17

This is a source code release for the Cate Python API, Web API, and CLI.

Corresponding installers for Cate Desktop including binaries for GUI, WebAPI, and the CLI can be found here.

Changes in 2.0.0.dev17

Added information about resources of type GeoDataFrame (Shapefiles, GeoJSON) in the details section of the WORSPACE panel in Cate Desktop #705
Added new operation merge() #740
Added new operation data_frame_subset() #708
Fixed display of CCI Sea Level MSLAMPH data #722
Improve indexers to first do a validation with respect to the available dimensions and the selected remaining_dims #730
Improve plotting capabilities to allow multi-variable plotting and format specification #704
Fixed code signing issue during the installer build on MacOS and Windows #726
Fixed Cate Desktop failed to start (in Ubuntu 18) due to missing .so #729
Fixed Cate Desktop failed to start (in Windows) due to unable to find dll files #725
User-defined Setup fails with existing Miniconda/Anaconda installation #728

Climate Change - Climate Data Access and Visualization - Python
Published by forman over 6 years ago

Cate - Cate 2.0.0.dev16

This is a source code release for the Cate Python API, Web API, and CLI.

Corresponding installers for Cate Desktop including binaries for GUI, WebAPI, and the CLI can be found here.

Changes in 2.0.0.dev16

Added new operation data_frame_find_closest() #706
Added new operations compute_dataset() and compute_data_frame() #703.
Fixed division by zero error in RGB tile generation if data min and max were equal
Allow displaying and working with CCI Sea Level MSLAMPH data.
Addresses #531.
Improved chunking when opening local netCDF datasets, improved memory footprint of
subset_spatial operation when masking is enabled
Addresses #701
Fix a bug where correlation would fail with differing time dimensions
Addresses #700
Fix a bug where coregistration would fail in some cases when the grouped by dimension
is not squeezed out automatically.
Addresses #684
Fix a bug where coregistration would fail with some datasets on very fine grids due to
floating point calculation errors
Addresses #714

Climate Change - Climate Data Access and Visualization - Python
Published by hans-permana almost 7 years ago

Cate - Cate 2.0.0.dev15

This is a source code release for the Cate Python API, Web API, and CLI.

Corresponding installers for Cate Desktop including binaries for GUI, WebAPI, and the CLI can be found here.

Changes in 2.0.0.dev15

Fixed operation progress monitor which was broken due to an update of the Dask library.

Climate Change - Climate Data Access and Visualization - Python
Published by forman almost 7 years ago

Changes in 2.0.0.dev14

ESA sea-level data not correctly displayed #661
Added colour mapping defaults for CCI Sea Level data.
Extended max. table size to 10000 elements (workaround).
User Guide Improvements and Updates #409:
- Replaced references to Cate 1.0 to Cate 2.0 and updated most of figures
- Rewrote section about setup including installation and configuration
- Added a new section about the new STYLES panel
- Updated section about PLACES panel to include information on how to generate a polyline, polygon, and box
- Updated section about LAYERS panel to describe its new elements

Climate Change - Climate Data Access and Visualization - Python
Published by forman almost 7 years ago

Cate - Cate 2.0.0.dev12

No longer hide any ODP datasets in GUI #669
Added experimental support for Zarr data I/O format #659
The operation long_term_average now works with daily, monthly and seasonal datasets #471
Fixed problem in cate-webapi-start occurring on Linux when using address localhost (related to #627)
Updated anomaly_external to retain global attributes and do more input validation #666

Climate Change - Climate Data Access and Visualization - Python
Published by forman almost 7 years ago

Changes in version 2.0.0.dev11

Lacking cancelable progress monitor when opening large datasets #640
Wrong chunk size does not allow to import some dataset #631
Local dataset not recognised #557
Allow exporting any data as CSV #637
Using localhost instead of explicit IP to maybe target #627
The read_netcdf() operation uses Dask chunking so we can expand all variables by a 'time' dimension
without loading all data into memory.

Climate Change - Climate Data Access and Visualization - Python
Published by forman almost 7 years ago

What's new

Support datasets with 0,360 degree longitude ranges #620
Temporal aggregation operation can now aggregate to pre-defined seasons, as well as custom resolutions #472
We now use "MB" units instead of "MiB" (part of #325)
Fixed a bug with animation generation #585
Upgrade to using newer xarray version after an upstream bugfix #579
Fixed a bug of unable to do pixel values extraction if one of the workflow has an error #616
Add the capability to create Hovmoeller plots #503
Add a reduce operation that lets the user create arbitrary data reductions #618

Climate Change - Climate Data Access and Visualization - Python
Published by forman almost 7 years ago

What's new:

Representative default variables #590.
Tasks are no longer executed in parallel #606.
WebAPI service problem in CLI #600
Improve error messages and handling #393,
introduced new error type cate.core.types.ValidationError for special treatment in the GUI.
Make Cate HTTP User-Agent distinguishable #510.
Fixed broken WebAPI invocation from CLI.
Use only one variable (http_proxy) for proxy URL in conf.py. The value of this variable is then returned when
get_config() is called #544
Check local datasource name if it doesn't contain restricted/unsupported characters
#568

Climate Change - Climate Data Access and Visualization - Python
Published by forman about 7 years ago

Cate - Cate 2.0.0.dev8

Removed the cate-webapi command-line tool and replaced it by two others:
- cate-webapi-start to start the Cate WebAPI service.
- cate-webapi-stop to start the Cate WebAPI service. This script executes
  fast, as it will will not longer import any of the many packages Cate depends on.
Cate Desktop hangs when restarted after quit while running a task #578
SST temporal aggregation error #548
Scrambled time axis error #538

Climate Change - Climate Data Access and Visualization - Python
Published by forman about 7 years ago

Cate - Cate 2.0.0.dev7

Cate Desktop hangs after upgrading WebAPI to 2.0.0.dev6 #569, using Tornado 5 webserver now.

Climate Change - Climate Data Access and Visualization - Python
Published by forman about 7 years ago

Cate - Cate 2.0.0.dev6

Warning: cate-cli 2.0.0.dev6 is broken, do not install!

Fixes

Activate script missing after "cate-cli" package installation #569
Keep configuration of data stores path #439

Climate Change - Climate Data Access and Visualization - Python
Published by forman about 7 years ago

Cate - Cate 2.0.0.dev5

Select long rectangles with subset_spatial() #541
Improve performance of subset_spatial(), especially when masking complex polygons #508
Select all pixels that are crossed by the given polygon in subset_spatial() #560
Enable subset_spatial() to work with all valid polygons, including sub-pixel ones. #507
By default plot_map() and animate_map() now produce colormesh (pixel) plots. #559
Fix issues with progress writing.

Climate Change - Climate Data Access and Visualization - Python
Published by forman about 7 years ago

Cate - Cate 2.0.0.dev4

Perform progress writing from the correct thread

Climate Change - Climate Data Access and Visualization - Python
Published by forman about 7 years ago

Cate - Cate 2.0.0.dev3

Operation to perform arbitrary dataset math #556
New parameter interval for animate_map()

Climate Change - Climate Data Access and Visualization - Python
Published by forman about 7 years ago

Cate - Cate 2.0.0.dev2

CF valid_range not respected in data visualisation #537

Climate Change - Climate Data Access and Visualization - Python
Published by forman about 7 years ago

Installation

If you prefer using Cate's GUI, Cate Dektop, there is no longer a need to install this cate Python package beforehand. As of 2.0, the Cate Desktop installer will take care of this. Please find Cate Desktop 2.0 installers here.

If you just want the Cate 2.0 CLI or the cate Python package then please install the cate-clipackage into an existing Anaconda3/Miniconda3 environment or create a new environment as follows.

If your network prohibits accessing packages in the Anaconda Cloud, you might still want to use the installers provided here. Note, the installers are not signed so you might likely see a security warning on Mac and Windows 10.

Windows

Create a new Anaconda3/Miniconda3 environment for Cate

> conda env create --name cate-env python=3.6*

Install cate-cli package:

> activate.bat cate-env
> conda install -c ccitools -c conda-forge cate-cli=2.0.0.dev1

Linux / Mac

Create a new Anaconda3/Miniconda3 environment for Cate

$ conda env create --name cate-env python=3.6*

Install cate-cli package:

$ source activate cate-env
$ conda install -c ccitools -c conda-forge cate-cli=2.0.0.dev1

Changes

Improvements and new Features

Added data_frame_min(df) and data_frame_max(df) operations to select features by min/max
#492
Added data_frame_query(df, expr) operation to query features
#486.
If the data frame df contains a geometry column (a GeoDataFrame object),
then the query expression expr can also contain geometric relationship tests,
for example the expression
"population > 100000 and @within('-20, 40, 20, 80')"
could be used on a data frame to query for larger cities in Europe.
Removed operation read_geo_data_collection. The preferred operation to read
feature attribute tables ("data frames") with geometries from ESRI Shapefiles and GeoJSON files is
read_geo_data_frame.
CLI now launches a lot faster, e.g. try now cate -h
#58
Cate can now produce animated figures
#86

Fixes

Be tolerant of "invalid" geometries passed to operations expecting
polygon WKT values
#506
Cate wont work if installed on drive other than home drive
#466
Region constraint'-option for AEROSOL dataset returns 'code 20' error
#462
Address problems of a user working with Cloud and Aerosol
#478
Most projections not working in plot operations
#524
Resolve an index operation documentation issue
#496
Resolve a bug with wrong file open mode
#497

All Changes

Climate Change - Climate Data Access and Visualization - Python
Published by forman about 7 years ago

Cate - Cate 1.0

Before you install

Please, read and follow the Cate installation instructions.

Changes since Pre-Releases

Climate Change - Climate Data Access and Visualization - Python
Published by forman over 7 years ago

Cate - Cate 1.0.0.dev3

Before you install

For each supported operating system (Linux, Mac OS X, Windows) there are two installers:

cate-<version>-<platform>.exe/.sh: installers for Cate Core including the command-line interface and Python API;
Cate.Desktop.<version>.exe/.dmg/.AppImage: secondary installers for Cate Desktop, Cate's graphical user interface for Windows, OS X, and Linux,

To use Cate Desktop, users must first install Cate Core before installing Cate Desktop.

Linux and Mac users: the Cate Core installers are bash shell scripts which must be executed from a terminal:

$ bash cate-<version>-<platform>.sh

Cate Desktop changes since 1.0.0.dev2

Find complete change log here.

Cate Core changes since 1.0.0.dev2

Issues Fixed/Resolved

List only data sources tested by the champion users #435

Find complete change log here.

Climate Change - Climate Data Access and Visualization - Python
Published by mzuehlke over 7 years ago

Cate - Cate 1.0.0.dev2

Before you install

For each supported operating system (Linux, Mac OS X, Windows) there are two installers:

cate-<version>-<platform>.exe/.sh: installers for Cate Core including the command-line interface and Python API;
Cate.Desktop.<version>.exe/.dmg/.AppImage: secondary installers for Cate Desktop, Cate's graphical user interface for Windows, OS X, and Linux,

To use Cate Desktop, users must first install Cate Core before installing Cate Desktop.

Linux and Mac users: the Cate Core installers are bash shell scripts which must be executed from a terminal:

$ bash cate-<version>-<platform>.sh

Cate Desktop changes since 1.0.0.dev1

UX Improvements and new Features

Run in offline mode #405
Graceful degradation when WebGL fails #400

Fixes

3D globe error on OS X #408
Background map invisible on globe #448
Missing static background map #453

Find complete change log here.

Cate Core changes since 1.0.0.dev1

Issues Fixed/Resolved

Get rid of Python user warnings #446
Missing static background map #453

Find complete change log here.

Climate Change - Climate Data Access and Visualization - Python
Published by mzuehlke over 7 years ago

Cate - Cate 1.0.0.dev1

Before you install

For each supported operating system (Linux, Mac OS X, Windows) there are two installers:

cate-<version>-<platform>.exe/.sh: installers for Cate Core including the command-line interface and Python API;
Cate.Desktop.<version>.exe/.dmg/.AppImage: secondary installers for Cate Desktop, Cate's graphical user interface for Windows, OS X, and Linux,

To use Cate Desktop, users must first install Cate Core before installing Cate Desktop.

Linux and Mac users: the Cate Core installers are bash shell scripts which must be executed from a terminal:

$ bash cate-<version>-<platform>.sh

Cate Desktop changes since 0.9.0-dev.7

We decided to remove the 2D map view (OpenLayers), because we had too many issues keeping it in sync with the 3D globe view (Cesium). #390

UX Improvements and new Features

Ask before exit #424

Fixes

Generated resource names not always unique #391
Two Datasets opened in parallel via OPeNDAP are loaded into same resource #306
Prevent multiple concurrent attempts to load data sources #386
Time constraint is being ignored for data download if entered in wrong format #345
Illegal time range accepted and used in wrong way #374
Values persisted in "Download Data Source" window #307
Only allow valid python identifiers as resource names #436
Open Dataset dialogue keeps values from previous selection #417

Find complete change log here.

Cate Core changes since 0.9.0.dev7

Improvements and new Features

Global temporal attributes are adjusted automatically when opening new datasets
Global temporal attributes are adjusted automatically when converting from data frames
Normalization and subsetting operation implementation logic is refactored out to util so that it can be re-used throughout Cate

Issues Fixed/Resolved

Fixed displaying broken/incomplete/canceled data sources on local data sources list #375
Generated resource names not always unique #391
Multiple concurrent attempts to load the ODP index now always return the same result #386
Use global temporal attributes to determine temporal resolution in aggregation operations #340
Only allow valid python identifiers as resource names #436
OS X installation error #438

Find complete change log here.

Climate Change - Climate Data Access and Visualization - Python
Published by mzuehlke over 7 years ago

Cate - Cate 0.9.0.dev7

Before you install

For each supported operating system (Linux, Mac OS X, Windows) there are two installers:

cate-<version>-<platform>.exe/.sh: installers for Cate Core including the command-line interface and Python API;
Cate.Desktop.<version>.exe/.dmg/.AppImage: secondary installers for Cate Desktop, Cate's graphical user interface for Windows, OS X, and Linux,

To use Cate Desktop, users must first install Cate Core before installing Cate Desktop.

Linux and Mac users: the Cate Core installers are bash shell scripts which must be executed from a terminal:

$ bash cate-<version>-<platform>.sh

Cate Desktop changes since 0.9.0-dev.6

UX Improvements and new Features

The Download Data Source dialog opened from the DATA SOURCES panel has been simplified and now produces a new workflow step which calls operation open_dataset(..., force_local=True) #366. Like for any other operation step, users can be inspect and edit input values and re-invoke the operation any time later from the WORKSPACE panel #314.
On the Abstract tab of the DATA SOURCES panel show information about spatial and temporal coverage.
Enable the Show data in table action only for resources of type type DataFrame.

Fixes

"Window" sub-menu is empty #362
Splash screen must not stay on top #363
Make alpha blending work for all color maps #360
GUI-Preferences for data store files do not overwrite conf.py #350

Find complete change log here.

Cate Core changes since 0.9.0.dev6

Improvements and new Features

Added check if copying/downloading DS failed without any progress/complete files
if so, remove empty DS #375
Min/max computation should be monitored #384
Added API to annotate deprecated operations and operation input/outputs. Refer to op, op_input, op_output decorators in cate.op. #381
Configure default color maps #372
Hide problematic ODP data sources #368
Coregistration operation now works on n-dimensional datasets #36

Issues Fixed/Resolved

Fixed reading datasource temporal coverage from config file (obsolete format) #373
Merged (removed duplicated) meta information in datasource config file #301
Land Cover CCI display must use dedicated color map #364
Land Cover CCI data display wrongly positioned (temp. hack!) #361
Make alpha blending work for all color maps #360
CLI monitor not working #353
GUI-Preferences for data store files do not overwrite conf.py #350
Filter 't0' in the make_local step of SOILMOISTURE data sources to make the data usable #326
Updated information about temporal, spatial coverage and variables of copied from ODP data sources (constraint-aware) #315
Verify operations against the operation development checklist to ensure some quality baseline. #291
Use only tags from a predefined set (maybe module name && list in developers' guide) #280
Added option to use open_dataset in workflow with automatic copying remote data source and reusing/re-opening previusly copied data (constraint-aware) #287
Generate unique default ID for local copies of remote data sources (constraint-aware) #277
Coregistration works with n-dimensional datasets #36, #348

Find complete change log here.

Climate Change - Climate Data Access and Visualization - Python
Published by forman over 7 years ago

Cate - Cate 0.9.0.dev6

Before you install

For each supported operating system (Linux, Mac OS X, Windows) there are two installers:

cate-<version>-<platform>.exe/.sh: installers for Cate Core including the command-line interface and Python API;
Cate.Desktop.<version>.exe/.dmg/.AppImage: secondary installers for Cate Desktop, Cate's graphical user interface for Windows, OS X, and Linux,

To use Cate Desktop, users must first install Cate Core before installing Cate Desktop.

Linux and Mac users: the Cate Core installers are bash shell scripts which must be executed from a terminal:

$ bash cate-<version>-<platform>.sh

Cate Desktop changes since 0.9.0-dev.5

Fix date input components (for a single date and for date ranges). Now a simple text input filed is used. #303 and #335
Only persist the parameter values for the 'time' and 'geo' constraint in the 'Open Local Dataset' and 'Download Data Source' dialog. #307 and #308

Find complete change log here.

Cate Core changes since 0.9.0.dev5

Add use case 2 script #327 and #146
long_term_average, temporal_aggregation, detect_outliers, spatial_subset and plot now work with both - datasets and dataframes.
Date and time columns in CSV data are converted into datetime objects
Fix use case 6 script
Fix #320 (wrong file dialog for enso_nino34 operation in GUI)
Fix temporal coverage for ODP datasets that are listed as a single dataset in the CSW and as multiple in the ESGF

Find complete change log here.

Climate Change - Climate Data Access and Visualization - Python
Published by mzuehlke over 7 years ago

Cate - Cate 0.9.0.dev5

Before you install

For each supported operating system (Linux, Mac OS X, Windows) there are two installers:

cate-<version>-<platform>.exe/.sh: installers for Cate Core including the command-line interface and Python API;
Cate.Desktop.<version>.exe/.dmg/.AppImage: secondary installers for Cate Desktop, Cate's graphical user interface for Windows, OS X, and Linux,

To use Cate Desktop, users must first install Cate Core before installing Cate Desktop.

Linux and Mac users: the Cate Core installers are bash shell scripts which must be executed from a terminal:

$ bash cate-<version>-<platform>.sh

Cate Desktop changes since 0.9.0-dev.4

Fix handling and formatting of date ranges #313.
The resource switch in the OPERATION STEP dialog is only enabled
when the drop-down box would contain any compatible resource
#310.
Only show lat/lon values when the mouse is over the globe #312.
Prevent a 2nd (and 3rd) invocation of the variable statistics computation

Find complete change log here.

Cate Core changes since 0.9.0.dev4

Unified backend of CLI and GUI on WebSocket #120
As the GUI uses WebSocket, this removes a bit of duplicated code.
Fixed geo attribute filtering #309
Ensure that our tile size matches the expected tile size: resize and fill in background value.
Take tile size from dask, this should yield to better performance

Find complete change log here.

Climate Change - Climate Data Access and Visualization - Python
Published by mzuehlke over 7 years ago

Cate - Cate 0.9.0.dev4

Before you install

For each supported operating system (Linux, Mac OS X, Windows) there are two installers:

cate-<version>-<platform>.exe/.sh: installers for Cate Core including the command-line interface and Python API;
Cate.Desktop.<version>.exe/.dmg/.AppImage: secondary installers for Cate Desktop, Cate's graphical user interface for Windows, OS X, and Linux,

To use Cate Desktop, users must first install Cate Core before installing Cate Desktop.

Linux and Mac users: the Cate Core installers are bash shell scripts which must be executed from a terminal:

$ bash cate-<version>-<platform>.sh

Cate Desktop changes since 0.9.0-dev.3

To speed up loading of workspaces, workflow steps can now be persistent:
When a workspace is saved, all persistent steps that produce resources of type Dataset
write their current resources to a <workspace-dir>/.cate-workspace/<resource_name>.nc file.
When the workspace is reopened, such resource for persistent steps are read from file rather
than being computed by the step's operation.
To set the new persistence property of a step, click the Workflow Step Properties button
in the WORKSPACE panel.
Improved display of workflow step inputs in WORKSPACE panel:
- display the units of an operation input value, if any
- display the default value, if any, if an operation input is not given
Improved styling for the TASKS panel and the task section of the Status Bar:
- improve overall layout of task entries
- more padding to separate the individual entries
- prevent Close button from growing vertically
- add space between the progress bar and the cancel button
- replace too big spinner icon in Status Bar with a small progressbar
- add details action to failed tasks
The VIEW panel now has a checkbox Split selected image layer. If selected, the selected
image layer can be vertically split, where only the left side of the split remains visible.

Find complete change log here.

Cate Core changes since 0.9.0.dev3

The pearson_correlation operation has been split into two operations:
- pearson_correlation_simple that produces a single pair of a correlation
  coefficient and a probability value for the given timeseries.
- pearson_correlation produces a map of correlation coefficients and p-values
  and outputs this as a dataset that can be worked with further.
  Performance of pearson correlation has been radically improved. In addition, the operations can now
  accept both, a dataset and a dataframe and a map can be created also by
  performing correlation of a single timeseries against all spatial points in the
  other dataset.
A uniform way of handling spatiotemporal global attributes has been introduced
External executables such as the CCI Land Cover User Tool, the CCI SST Regridding Tool, or
the MPI Climate Data Operators can now be registered as operations.
Searching data sources from the CLI using cate ds list -n now matches against id and title

Find complete change log here.

Climate Change - Climate Data Access and Visualization - Python
Published by forman almost 8 years ago

Cate - Cate 0.9.0.dev3

Before you install

For each supported operating system (Linux, Mac OS X, Windows) there are two installers:

cate-<version>-<platform>.exe/.sh: installers for Cate Core including the command-line interface and Python API;
Cate.Desktop.<version>.exe/.dmg/.AppImage: secondary installers for Cate Desktop, Cate's graphical user interface for Windows, OS X, and Linux,

To use Cate Desktop, users must first install Cate Core before installing Cate Desktop.

Linux and Mac users: the Cate Core installers are bash shell scripts which must be executed from a terminal:

$ bash cate-<version>-<platform>.sh

Cate Desktop changes since 0.9.0-dev.2

Fixed in the WORKSPACE panel the details table for dataset attributes, table was always empty.
Fixed a problem with the Download Data Source dialog opened from DATA SOURCES panel.
It always used the last local data source name, although a different remote data source has been selected.
2D map / 3D globe layer containing country borders now works.
Included possible workaround for a problem on OS X displaying the 3D globe.

Cate Core changes since 0.9.0.dev2

Fixed packaging location of file countries.geojson so that Cate Desktop can display it

Climate Change - Climate Data Access and Visualization - Python
Published by forman almost 8 years ago

Cate - Cate 0.9.0.dev2

Before you install

For each supported operating system (Linux, Mac OS X, Windows) there are two installers:

An installer for Cate Core including the command-line interface and Python API (file cate-<version>-<platform>.*);
A second installer for Cate Desktop, Cate's graphical user interface (file Cate.Desktop.Setup.<version>.*).

To use Cate Desktop, users must first install Cate Core before installing Cate Desktop.

Cate Desktop changes since 0.9.0-dev.1

UX Improvements and new Features

Improvements for the DATA SOURCES panel:
- To simplify data access for new users, there is now only one primary action for both the
  local and the esa_cci_odp data stores: Open Local Dataset and Download Data Source.
  The latter can now also open the dataset after download or open from remote (using OPeNDAP).
- Edit fields for the constraints such as time range, region, variable names are now collapsible.
Plots can now have a title
Currently visible variable layers and their indexers are now shown as overlay in 3D Globe view.
The overlay can be turned off in the VIEWS panel.
Added an Copy to Clipboard action in WORKSPACE panel which is used to copy the workflow steps
to JSON, Python script, and shell script.
Figure views now have scrollbars.

Fixes

Fixed a severe bug where Cate Desktop was unable to find the matching ~/.cate/<version> directory.
(Problem was a bug in conversion from PEP440 to SemVer version strings.)
Fixed a problem with non-editable variable names field in Download Dataset and Open Dataset dialogs
opened from the DATA SOURCES panel.

Cate Core changes since 0.9.0.dev1

Improvements and new Features

Added plot_scatter and plot_contour operations (#278).
Most plot_ operations now have a new title parameter.

Fixes

Fixed #259
Fixed problem if the lon or lat coordinate variables were empty.
See comments in #276.

Climate Change - Climate Data Access and Visualization - Python
Published by forman almost 8 years ago

Cate - Cate 0.9.0.dev1

Before you install

For each supported operating system (Linux, Mac OS X, Windows) there are two installers:

An installer for Cate Core including the command-line interface and Python API (file cate-<version>-<platform>.*);
A second installer for Cate Desktop, Cate's graphical user interface (file Cate.Desktop.Setup.<version>.*).

To use Cate Desktop, users must first install Cate Core before installing Cate Desktop.

Cate Desktop changes since 0.8.0rc7

UX Improvements and new Features

Various improvements for the DATA SOURCES panel:
- Displaying human-readable data source titles
  retrieved from the data catalogue of the CCI ODP.
- New details view which shows the abstract and a button to open the related CCI ODP catalogue page
- Open Dataset Dialogs titles are now either "Open Local Dataset" or "Open Remote Dataset (via OPeNDAP)"
- Download button now always disabled for the "local" data store
- Open and download dialogs now use "Lon. from/to" and "Lat. from/to" rather than "W", "E", "S", "N"
Improved the default placeholder text for geometry fields
Operation dialog shows operation name in title
Double-click on list elements now invokes the primary action (the blue button).
Note, there is still an issue with double-clicks on already selected items.
Double-clicks should now work for DATA SOURCE panel, OPERATIONS panel,
and variable selection dialogs.
The details tables of the DATA SOURCES panel and WORKSPACE panel
now have a ... button to show long values in a pop-up window.
In VARIABLES panel, we now display all (meta-info) attributes of the selected variable.

Cate Core changes since 0.8.0rc7

A function annotated by one of the operator decorators (@op, @op_input, @op_return, @op_output)
will be turned into an operation registration which is also callable.
Calling the operation registration will validate all inputs and then pass arguments and
keyword-arguments to the actual, original function.
New FileLike type.
Changed the JSON object representation of a (xarray/NetCDF-CF) variable to include all variable
attributes. This changes the the response of various REST/WebSocket calls that return a workspace.

Climate Change - Climate Data Access and Visualization - Python
Published by forman almost 8 years ago

Cate - v0.8.0rc1

Changes from 0.7

The CCI data access has been fully revised. Users can now explicitly create local copies of remote ODP datasets, or they open datasets directly (using OPeNDAP transparently). Copying and opening of datasets can be constrained in time, region, and variables.

Various new operations have been added to support the new use cases School Seminar Climate and Weather, Teleconnection Explorer, and School Project on Arctic Climate Change.

This is the first release including an alpha preview Cate Desktop, Cate's graphical user interface (GUI).

Within the GUI, users can use all operations also available in the CLI and Python API. In addition, it allows for visualization of raster data as multiple layers displayed on a 3D globe and 2D map.

Important Note

For each platform there are 2 installers. One for the Cate Core including the CLI and Python API and a second one for the Cate Desktop. To use Cate Desktop, users must install the Cate Core installer first.

Climate Change - Climate Data Access and Visualization - Python
Published by mzuehlke about 8 years ago

Cate -

Changes from 0.5:

CLI has new protocol option: cate res open [-h] [-d DIR] NAME DS [START] [END] [PROTOCOL]
added new OPeNDAP protocol for ODP data access
added some new, preliminary operations supporting the new use case use case 6, Teleconnection Explorer, type cate op list to find them.

Climate Change - Climate Data Access and Visualization - Python
Published by mzuehlke over 8 years ago

Cate - Alpha Release 2

This second alpha release of the CCI Toolbox contains an initial version of the command-line interface (CLI) and Python API. Its functional range comprises the features required to perform our simple use case #9 using the CLI:

Read (netCDF) datasets from ESA CCI Open Data Portal
Spatial and temporal subsetting
Spatial resampling (up- and downsampling)
Spatial coregistration
Basic correlation analysis
Basic plotting
Writing to netCDF3 and -4

Climate Change - Climate Data Access and Visualization - Python
Published by forman over 8 years ago

Recent Releases of Cate

Cate - 4.0.0.dev6

Version 4.0.0 (in development)

Cate - 3.1.6

Changes in version 3.1.6

Cate - 3.1.6.dev0

Version 3.1.6 (in development)

Cate - 3.1.5

Changes in version 3.1.5

Cate - 3.1.4

Changes in version 3.1.4

Cate - 3.1.4.dev4

Changes in version 3.1.4 (in development)

Cate - 3.1.4.dev3

Changes in version 3.1.4 (in development)

Cate - 3.1.4.dev2

Changes in version 3.1.4 (in development)

Cate - 3.1.4.dev1

Changes in version 3.1.4 (in development)

Cate - 3.1.4.dev0

Changes in version 3.1.4 (in development)

Cate - 3.1.3

Changes in version 3.1.3

Cate - 3.1.2

Changes in version 3.1.2

Cate - 3.1.2.dev0

Version 3.1.2 (in development)

Cate - 3.1.1

Version 3.1.1

Cate - 3.1.0

Version 3.1.0

Cate - 3.1.0.dev1

Changes 3.1.0 (in development)

Cate - 3.1.0.dev0

Version 3.1.0 (in development)

Cate - 3.0.1.dev1

Version 3.0.1 (in development)

Cate - 3.0.1.dev0

Version 3.0.1 (in development)

Cate - 3.0.0

Version 3.0.0

Cate - 3.0.0.dev12

Version 3.0.0 (in development)

Cate - 3.0.0.dev11

Cate - 3.0.0.dev9

Version 3.0.0.dev9 (in development)

Cate - 3.0.0.dev7

Version 3.0.0 (in development)

Cate - 3.0.0.dev6

Version 3.0.0 (in development)

Cate - 3.0.0.dev5

Version 3.0.0 (in development)

Cate - 3.0.0-dev.5

Cate - 3.0.0.dev4

Version 3.0.0 (in development)

Cate - 3.0.0.dev3

Version 3.0.0 (in development)

Cate - 3.0.0.dev2

Version 3.0.0 (in development)

Cate - 3.0.0.dev1

Version 3.0.0 (in development)

Cate - 3.0.0.dev0

Version 3.0.0 (in development)

Cate - 2.3.0.xcube.dev6

Version 2.3.0 (in development)

Cate - 2.3.0.xcube.dev5

Version 2.3.0 (in development)

Cate - 2.3.0.xcube.dev4

Version 2.3.0 (in development)

Cate - 2.3.0.xcube.dev3

Version 2.3.0 (in development)

Cate - 2.3.0.xcube.dev2

Version 2.3.0 (in development)

Cate - 2.1.5

Version 2.1.5

Cate - 2.1.5.dev6

Cate - 2.1.5.dev5

Changes from 2.1.5.dev4 to 2.1.5.dev5

Cate - 2.1.5.dev4

Changes from 2.1.5.dev3 to 2.1.5.dev4