pytesmo - v0.18.0

• Fix bug which caused missing results in validation with "triple collocation" together with stability or instra-annual options (PR https://github.com/TUW-GEO/pytesmo/pull/314)
• pytesmo.interpolate module was added. This contains a python implementation of the DCT-PLS algorithm (Garcia, 2010). DCT-PLS docs and examples added (PR https://github.com/TUW-GEO/pytesmo/pull/315)

Full Changelog: https://github.com/TUW-GEO/pytesmo/compare/v0.17.0...v0.18.0

Natural Resources - Soil and Land - Python
Published by daberer about 2 months ago

pytesmo - v0.17.0 (re-release)

• THIS VERSION IS COMPATIBLE WITH NUMPY>=2, otherwise same content as v0.16.1 (readme file was updated)
• C files were recompiled for numpy>=2,<3, pyproject.toml updated.
• Wheels are now also provided for Linux and MacOS systems https://github.com/TUW-GEO/pytesmo/pull/311

Full Changelog: https://github.com/TUW-GEO/pytesmo/compare/v0.16.1...v0.17.0

Natural Resources - Soil and Land - Python
Published by wpreimes 5 months ago

pytesmo - v0.16.1

• THIS VERSION IS STILL COMPATIBLE WITH NUMPY<2.0, from v0.17 on pytesmo will require numpy>=2.0
• Old pytesmo.timeseries.plotting module was removed
• Fixed and filtered many warnings that were printed by tests until now
• Fixed an issue with the intra-annual metrics adapter when an empty time series is passed (PR https://github.com/TUW-GEO/pytesmo/pull/307)
• Metapackage updated (pyscaffold 4.5) (PR https://github.com/TUW-GEO/pytesmo/pull/307)
• C modules were outdated and could not be compiled, therefore rebuilt (PR https://github.com/TUW-GEO/pytesmo/pull/307)

What's Changed

• Fix failing test with ColumnCombine Adapter by @wpreimes in https://github.com/TUW-GEO/pytesmo/pull/303
• Fix seas val by @wpreimes in https://github.com/TUW-GEO/pytesmo/pull/307
• Prepare v0.16.1 (numpy<2) release by @wpreimes in https://github.com/TUW-GEO/pytesmo/pull/309

Full Changelog: https://github.com/TUW-GEO/pytesmo/compare/v0.16.0...v0.16.1

Natural Resources - Soil and Land - Python
Published by wpreimes 6 months ago

pytesmo - v0.16.0

• Adapters for metric calculators were introduced. The here implemented adapters compute metrics based on temporal subsets of the time series, which can be used for rolling window metrics, seasonal metrics or multiple arbitrary sub-periods. (PR https://github.com/TUW-GEO/pytesmo/pull/266)
• Fixed a bug where the status code of a successful Triple Collocation run was still set to -1 ("unknown error"). (PR https://github.com/TUW-GEO/pytesmo/pull/301)

Natural Resources - Soil and Land - Python
Published by wpreimes over 1 year ago

pytesmo - v0.15.2

Version 0.15.2, 2023-06-14

• Add kwarg to time_series.anomaly.calc_climatology to compute the standard deviation of the climatology (e.g. for anomaly z-scores)

Natural Resources - Soil and Land - Python
Published by wpreimes almost 2 years ago

pytesmo - v0.15.1

Adding scikit-learn as installation dependency.

Natural Resources - Soil and Land - Python
Published by s-scherrer about 2 years ago

pytesmo - v0.15.0

• fixing setting of status code for bootstrapped triple collocation (PR #285 <https://github.com/TUW-GEO/pytesmo/pull/285>_)
• Exclude netCDF4 at version 1.6.2 due to bug when writing strings with zlib compression (PR #288 <https://github.com/TUW-GEO/pytesmo/pull/288>_)
• added test for data_manager_failed (PR #287 <https://github.com/TUW-GEO/pytesmo/pull/287>_)
• read_ts is not longer used in pytesmo (PR #289 <https://github.com/TUW-GEO/pytesmo/pull/289>_)
• support for max_dist keyword in validation framework to limit comparisons to close data points (PR #291 <https://github.com/TUW-GEO/pytesmo/pull/291>_)
• Reimplementation of CDF matching (PR #259 <https://github.com/TUW-GEO/pytesmo/pull/259>_). This removed all other implementations, i.e. lin_cdf_match and cdf_beta_match. These now are either removed (lin_cdf_match), or point to the new implementation (cdf_beta_match)

Natural Resources - Soil and Land - Python
Published by wpreimes about 2 years ago

pytesmo - v0.14.4

Natural Resources - Soil and Land - Python
Published by s-scherrer about 2 years ago

pytesmo - v0.14.3

Natural Resources - Soil and Land - Python
Published by s-scherrer over 2 years ago

pytesmo - v0.14.2

Natural Resources - Soil and Land - Python
Published by s-scherrer over 2 years ago

pytesmo - v0.14.1

small bug fixes and documentation updates (PRs #272 <https://github.com/TUW-GEO/pytesmo/pull/272>, #271 <https://github.com/TUW-GEO/pytesmo/pull/271>, #270 <https://github.com/TUW-GEO/pytesmo/pull/270>_)

Natural Resources - Soil and Land - Python
Published by wpreimes over 2 years ago

pytesmo - v0.14.0

• fixed bugs in resample_mean (PR #262 <https://github.com/TUW-GEO/pytesmo/pull/262>_)
• Integration tests with new ISMN Interface (PR #263 <https://github.com/TUW-GEO/pytesmo/pull/263>_)
• Add option to Validation Framework to ignore errors in Validation.calc() (PR #263 <https://github.com/TUW-GEO/pytesmo/pull/263>_)
• ipynb files from docs/examples are now also used as (optional) tests (PR #263 <https://github.com/TUW-GEO/pytesmo/pull/263>_)
• yapf for code formatting (see developers guide) (Fix #248, PR #263 <https://github.com/TUW-GEO/pytesmo/pull/263>_)
• validation framework option to force dataset combinations that include reference dataset updated (PR #265 <https://github.com/TUW-GEO/pytesmo/pull/265>_)
• Added TimestampAdapter to the validation framework to deal with datasets that have different date/time specification fields (PR #268 <https://github.com/TUW-GEO/pytesmo/pull/268>_)

Natural Resources - Soil and Land - Python
Published by wpreimes almost 3 years ago

pytesmo - v0.13.4

• Fixes compatibility issue between numpy and and cython that could lead to error when calling pip install pytesmo

Natural Resources - Soil and Land - Python
Published by wpreimes over 3 years ago

pytesmo - v0.13.3

rollback to old C-files due to numpy compatibility issues

Natural Resources - Soil and Land - Python
Published by s-scherrer over 3 years ago

pytesmo - v0.13.2

Natural Resources - Soil and Land - Python
Published by s-scherrer over 3 years ago

pytesmo - v0.13.1

Natural Resources - Soil and Land - Python
Published by s-scherrer over 3 years ago

pytesmo - v0.13.0

• monthly climatologies
• wraparound=True is the new default in the climatology calculation
• better error handling in validation framework

Natural Resources - Soil and Land - Python
Published by s-scherrer over 3 years ago

pytesmo - v0.12.0

• Add option for custom reading method name to all reading adapters (PR #245)
• MonthMetricsAdapter for new PairwiseIntercomparisonMetrics and TripleCollocationMetrics calculators (PR #246)

Natural Resources - Soil and Land - Python
Published by wpreimes over 3 years ago

pytesmo -

bug fixes

Natural Resources - Soil and Land - Python
Published by s-scherrer almost 4 years ago

pytesmo -

Natural Resources - Soil and Land - Python
Published by s-scherrer almost 4 years ago

pytesmo -

more bugs fixed

Natural Resources - Soil and Land - Python
Published by s-scherrer almost 4 years ago

pytesmo -

bugfix in combined temporal matcher

Natural Resources - Soil and Land - Python
Published by s-scherrer almost 4 years ago

pytesmo - v0.11.0

• Analytical and bootstrapping confidence intervals for metrics (PR #206). This
  includes some changes to the existing implementations (all old
  implementations are still available, but deprecated)

  • all pairwise metric functions take two arrays as input and return a single value

  • the correlation metrics (pearsonr, spearmanr, kendalltau) have new
    versions pearson_r, spearman_r, and kendall_tau which only return the
    correlation value, but not the p-value. The old functions have been
    deprecated. For calculating correlation + p-value, it is advised to use
    scipy.stats.pearsonr, scipy.stats.spearmanr, and
    scipy.stats.kendalltau. Instead of p-values, confidence intervals for
    the correlation coefficients could be obtained with::

    r, lower, upper = with_analytical_ci(pearson_r, x, y)

  • pytesmo.metrics.tcol_error and pytesmo.metrics.tcol_snr have been
    deprecated. Use pytesmo.metrics.tcol_metrics instead (which is simply a
    renaming of tcol_snr).

  • pytesmo.metrics.mse has been deprecated. There is a new, much faster
    implementation available (pytesmo.metrics.mse_decomposition).
    Individual values of the components can be calculated with
    pytesmo.metrics.mse, pytesmo.metrics.mse_corr,
    pytesmo.metrics.mse_bias, pytesmo.metrics.mse_var.

• Removed dependency on deprecated Numpy API

• added mean resampling in temporal collocation

• updated to ascat version 2.0

Natural Resources - Soil and Land - Python
Published by wpreimes almost 4 years ago

pytesmo - v0.10.0

• Drop Travis CI and Appveyor CI, replaced by Github Actions ci.yml workflow
• New implementation of temporal collocation based on pd.reindex (PR #204)
• CDF matching function updated
• min_obs keyword added to MetricsCalculators

Natural Resources - Soil and Land - Python
Published by wpreimes about 4 years ago

pytesmo - v0.9.1

• Include more combinations in validation framework, raise error if n < n_datasets
• n_wise_apply now can handle (drop) nans in a passed data frame correctly.
• TC metrics calculator has now option to calculate metrics for reference
• Fix deprecation warnings in anomaly adapter (Issue #198)
• Change combinations created by val framework, catch cases where scaling ref not in combinations (Issue #187)

Natural Resources - Soil and Land - Python
Published by wpreimes over 4 years ago

pytesmo - v0.9

• Update pyscaffold v3.2.3
• Rolling Prearson's R and RMSD metrics calculator
• New results manager to handle rolling metrics
• Add deprecation warning for colormaps module
• Move timedate module to cadati, import from there
• Filter warnings in places where they are safe to ignore and not caused by pytesmo
• Update Docs and ipython notebooks

Natural Resources - Soil and Land - Python
Published by wpreimes almost 5 years ago

pytesmo - v0.8

• Update Triple Collocation metrics and metrics caluclator
• Update metrics apply function, use dictionaries instead of dataframe for results
• Remove io module and grids.grid.py and grids.netcdf.py modules
• Move resampling module to repurpose package (https://github.com/TUW-GEO/repurpose)
• Documentation updates

Natural Resources - Soil and Land - Python
Published by wpreimes over 5 years ago

pytesmo - v0.7.1

• Change naming convention for Intercomparison metrics calculator results
• Use kdtree from pykdtree instead of scipy (faster)
• Add MetadataMetrics to metrics calculator
• Remove pybufr-ecmwf, use generic test data for testing spatial resampling

Natural Resources - Soil and Land - Python
Published by tracyscanlon over 5 years ago

pytesmo - v0.7.0

• Add option for filling no data values to moving average
• Add option for minimum observations to moving average
• Default behavior of climatology calculation will now fill no_data values
  Nothing is changing if there are no no_data values in the time series

Natural Resources - Soil and Land - Python
Published by cpaulik almost 6 years ago

pytesmo - v0.6.11

• Add more metrics calculators
• Remove pytesmo.io.ismn module and move it to the ismn package
• Update tests for ascat v1.0 package
• Rename arguments for metrics functions to be more general
• Split linreg scaling function to determine and apply corrections separately
• Compatible with Python 3.7 on Windows

Natural Resources - Soil and Land - Python
Published by cpaulik almost 6 years ago

pytesmo - v0.6.10

• Update readme
• Fix bug in exponential filter when first value is a NaN value

Natural Resources - Soil and Land - Python
Published by cpaulik about 7 years ago

pytesmo - v0.6.9

• Add extendent collocation metric
• Fix initial value for exponential filter
• Fix #123

Natural Resources - Soil and Land - Python
Published by cpaulik about 7 years ago

pytesmo - v0.6.8

• Adapt validation framework examples to new ASCAT package version.
• Adapt ERS reader to new ASCAT package version.
• Make validation framework work with datasets that contain NaN
  columns.
• Make validation framework work with pygeobase.object_base.TS objects
  and subclasses.
• Add scaler classes to the validation framework making it possible to
  use e.g. stored CDF parameters during validation.
• ensure_iterable does no longer take a single string as an iterable.
  We want to keep the string as one object.

Natural Resources - Soil and Land - Python
Published by cpaulik over 7 years ago

pytesmo - v0.6.7

• Add respect leap years option for climatology calculation.

Natural Resources - Soil and Land - Python
Published by cpaulik almost 8 years ago

pytesmo - v0.6.6

• Compatible with Python 3.6
• Updated build process to also build wheels for Python 3.6

Natural Resources - Soil and Land - Python
Published by cpaulik almost 8 years ago

pytesmo - v0.6.5

• Add additonal functions for working with dekads.

Natural Resources - Soil and Land - Python
Published by cpaulik almost 8 years ago

pytesmo - v0.6.4

• Refactor resampling routine to be more modular and better usable outside of pytesmo.

Natural Resources - Soil and Land - Python
Published by cpaulik almost 8 years ago

pytesmo - v0.6.3

• temporal matching performance improvement of approx. 50%
• Add functions for handling dekadal dates. See pytesmo.timedate.dekad.

Natural Resources - Soil and Land - Python
Published by cpaulik almost 8 years ago

pytesmo -

• Fix metadata for new version of pypi.

Natural Resources - Soil and Land - Python
Published by cpaulik over 8 years ago

pytesmo -

v0.6.1, 2017-01-13

• Add return_clim keyword to anomaly calculation. Useful for getting both
  anomaly and climatology in one pandas.DataFrame. Also used in time series
  anomaly plot.
• Fix bug in julian2date which led to negative microseconds in some edge cases.

Natural Resources - Soil and Land - Python
Published by cpaulik over 8 years ago

pytesmo - Bye Bye ASCAT readers and small bugfixes.

• Moved the ASCAT readers to the ascat package. The functionality is the same, just replace
  import pytesmo.io.sat.ascat by import ascat and everything should work the same as before.
• The H07 reader now returns also ssm mean as a value between 0 and 100. Before
  it was between 0 and 1 and inconsistent with the other ssm values.
• Fix small bug in julian date calculation and add tests for it.
• Add hamming window to resample module

Natural Resources - Soil and Land - Python
Published by cpaulik over 8 years ago

pytesmo - Version 0.5.2 - Bugfix and performance improvements

• Fix bugs when the validation framework encountered empty datasets for various reasons.
• Add dataset adapters for masking and anomaly calculation.
• Improve performance of moving average calculation and ISMN readers.
• ISMN readers are approx. an order of magnitude faster now.

Natural Resources - Soil and Land - Python
Published by cpaulik about 9 years ago

pytesmo - Small Bugfixes, and refactoring

• Fix bug in jobs argument passing to Validation class.
• Add support to use a pre initialized DataManager instance in the Validation class.
• Add support for per dataset reading method names in the DataManager. This
  relaxes the assumption that every dataset has a read_ts method.

Natural Resources - Soil and Land - Python
Published by cpaulik about 9 years ago

pytesmo - Improved validation framework and scaling module

• Fix bug in temporal resampling if input was a pandas.Series

• Major refactoring of validation framwork. Please see updated documentation and
  example for detailed changes. The most important breaking changes are:

  • 'type' is no longer used in the dataset dictionary.
  • the temporal matcher does no longer need to be specified since a reasonable
    default was developed that should handle most cases
  • metrics calculators are now given as dictionaries of functions. Please see
    the docs for an explanation and an example.
  • cell_based_jobs keyword was removed in favor of a more general definition of jobs.

  New features are the possibility to use unrelated masking datasets and the
  possibility to temporally match any number of datasets and give them in sets
  of k datasets to multiple metric calculators.

• Changes in the scaling module, escpecially CDF matching. The new CDF scaling
  module is more modular and does not make any assumptions about how unique the
  percentiles for the CDF matching have to be. CDF matching now returns NaN
  values if non unique percentiles are in the data. There are new functions that
  rescale based on pre-calculated percentiles so these can be used if the user
  wants to make sure that the percentiles are unique before matching.

Natural Resources - Soil and Land - Python
Published by cpaulik about 9 years ago

pytesmo - Improvements and slight interface changes

• Fix bug in validation framework due to error prone string formatting in warnings.
• Remove grid functionality. Use pygeogrids from now on.
• Fix bug in moving average calculation when input had size 1.
• Add recursive calculation of Pearson correlation coefficent.
• Change H-SAF reading interface to use pygeobase consistently. This changes the
  interface slightly as the read_img method is now called just read
• H07 reader now returns more variables.
• Resampling interface now respects dtype of input data.
• Improvements in ISMN plotting interface make it possible to use the plot not
  only show it.

Natural Resources - Soil and Land - Python
Published by cpaulik about 9 years ago

pytesmo - Climatology calculation fixes

• make sure that climatologies are always 366 elements
• add new options to climatology calculation for filling NaN values
• add option to climatology calculation for wraparound before the smoothing

Natural Resources - Soil and Land - Python
Published by cpaulik about 9 years ago

pytesmo - v0.3.5

• fix bug in anomaly calculation that occurred when the climatology series had
  a name already
• add option in anomaly calculation to respect leap years during matching
• improve testing of scaling functions
• add linear CDF scaling based on stored percentiles
• add utility function for MATLAB like percentile calculation pytesmo.utils.ml_percentile
• add utility function for making sure elements in an array are unique by
  using iterative interpolation pytesmo.utils.interp_uniq

Natural Resources - Soil and Land - Python
Published by cpaulik over 9 years ago

pytesmo - v0.3.4

• fix #63 by moving data preparation before period checks
• fix bug in exponential and boxcar filter. Problem was that nan values were not ignored correctly

Natural Resources - Soil and Land - Python
Published by cpaulik over 9 years ago

pytesmo - v0.3.3

• add option to temporal resampling to exclude window boundaries
• fix #48 by reintroducting netcdf imports
• fix #60 by importing correctly from pygeogrids
• fix #56 by allowing read_bulk keyword for ASCAT_SSM
• fix #58 by using cKDTree keyword if available
• lookup table indexing fixed, see #59

Natural Resources - Soil and Land - Python
Published by cpaulik over 9 years ago

pytesmo -

• hotfix for temporal resampling problem when time series where of unequal lenghts

Natural Resources - Soil and Land - Python
Published by cpaulik over 9 years ago

pytesmo -

• added validation framework and example on how to use it
• fix bug (issue #51) in temporal matching
• added test data as git submodule

Natural Resources - Soil and Land - Python
Published by cpaulik over 9 years ago

pytesmo - v0.3.0

This release adds several new features, first among them Python 3 support.

Changelog

• added calculation of pearson R confidence intervals based on fisher z transform
• ISMN reader can now get the data coverage for stations and networks
• ISMN interface can now be restricted to a list of networks
• added Python3 support
• moved grid functionality to pygeogrids package, pytesmo grids are deprecated
  and will be removed in future releases
• include triple collocation example and improve documentation see issue #24

Natural Resources - Soil and Land - Python
Published by cpaulik almost 10 years ago