Data

Tools

Indexes

Applications

Experiments

Open Sustainable Technology

A curated list of open technology projects to sustain a stable climate, energy supply, biodiversity and natural resources.

Recent Releases of open-MaStR

open-MaStR - v0.14.5

What's Changed

Full Changelog: https://github.com/OpenEnergyPlatform/open-MaStR/compare/v0.14.4...v0.14.5

Energy Systems - Energy Data Accessibility and Integration - Python
Published by nesnoj 7 months ago

open-MaStR - v0.14.4

What's Changed

New Contributors

Special Thanks to our JOSS Reviewers

  • @cpschau
  • @rafmudaf

Full Changelog: https://github.com/OpenEnergyPlatform/open-MaStR/compare/v0.14.3...v0.14.4

Energy Systems - Energy Data Accessibility and Integration - Python
Published by FlorianK13 11 months ago

open-MaStR - v0.14.3

What's Changed

Full Changelog: https://github.com/OpenEnergyPlatform/open-MaStR/compare/v0.14.2...v0.14.3

Energy Systems - Energy Data Accessibility and Integration - Python
Published by chrwm about 1 year ago

open-MaStR - v0.14.2

Note: This release is not published on pypi as we have currently problems with our tests!

What's Changed

New Contributors

Full Changelog: https://github.com/OpenEnergyPlatform/open-MaStR/compare/v0.14.1...v0.14.2

Energy Systems - Energy Data Accessibility and Integration - Python
Published by chrwm about 1 year ago

open-MaStR - v0.14.1

[v0.14.1] Hotfix - 2023-01-17

What's Changed

Full Changelog: https://github.com/OpenEnergyPlatform/open-MaStR/compare/v0.14.0...v0.14.1

Energy Systems - Energy Data Accessibility and Integration - Python
Published by FlorianK13 over 1 year ago

open-MaStR - v0.14.0

[v0.14.0] Shiny New Documentation Page - 2023-11-22

What's Changed

New Contributors

Full Changelog: https://github.com/OpenEnergyPlatform/open-MaStR/compare/v0.13.2...v0.14.0

Energy Systems - Energy Data Accessibility and Integration - Python
Published by FlorianK13 over 1 year ago

open-MaStR - v0.13.2

[v0.13.2] Hotfix - 2023-08-07

Changed

  • Changed the name of the bulk tables for technology=gsgk #456

Compare versions: v0.13.1 - v0.13.2

Also see CHANGELOG.md

Energy Systems - Energy Data Accessibility and Integration - Python
Published by FlorianK13 over 1 year ago

open-MaStR - v0.13.1

Added

  • Add new table and new columns to the data model #440

Compare versions: v0.13.0 - v0.13.1

Also see CHANGELOG.md

Energy Systems - Energy Data Accessibility and Integration - Python
Published by chrwm about 2 years ago

open-MaStR - v0.13.0

[v0.13.0] Maintenance release - 2023-02-16

Added

  • Add a workflow_dispatch to run CI pipelines from a button click #389
  • Update version number with bump2version #407
  • Add usage examples to Readme #419
  • Check if the zipped file is corrupted #422
  • Add Issue and PR Templates #428

Changed

  • Repair the csv export #384
  • Refactor csv export for better maintainability #401
  • Replace numeric value in hydro_extended #392
  • Fix DB query errors when using SQLAlchemy v2.0 #405
  • New columns introduced #409
  • Replace numeric value in combustion #413
  • Filenames.yml is created everytime Mastr class is called #415
  • Omit connectionless DB query (SQLAlchemy v2.0 compatibility) #421

Removed

  • Option to filter & export by parameter StatistikFlag #401
  • Removed unused package pynodo from dependencies #424
  • Removed feature for dockered databases #426

New Contributors

Full Changelog: https://github.com/OpenEnergyPlatform/open-MaStR/compare/v0.12.1...v0.13.0

Energy Systems - Energy Data Accessibility and Integration - Python
Published by FlorianK13 about 2 years ago

open-MaStR - v0.12.1

[v0.12.1] Patch release - 2022-11-15

Added

  • Add workflows to release on PyPI and Test-PyPI #375

Changed

  • Change error handling for missing tables in postgres #370

Removed

Compare versions: v0.12.0...v0.12.1

Also see: CHANGELOG.md

Energy Systems - Energy Data Accessibility and Integration - Python
Published by FlorianK13 over 2 years ago

open-MaStR - v0.12.0

[v0.12.0] Minor release - 2022-11-07

Added

  • New table deleted_units #360
  • Constants.py for central hardcoded variables #345

Changed

  • Handle case for empty list #362
  • Fix bug occuring for permit and location download from the bulk download source #358
  • Update documentation for readthedocs #356
  • Update release procedure #355
  • Update README.md to README.rst #354
  • Technology parameter is renamed to data for better comprehension #337
  • Update ORM and documentation according to wsdl patch V1.2.87 #352
  • Date parameters are united into one parameter #353
  • Dataversion folder entails export date#347

Removed

  • Removed code artefacts #335

Compare versions: v0.11.7...v0.12.0

Also see: CHANGELOG.md

Energy Systems - Energy Data Accessibility and Integration - Python
Published by chrwm over 2 years ago

open-MaStR - v0.11.7

[v0.11.7] Patch - Repair package - 2022-08-25

Changed

Fix dependencies in setup.py https://github.com/OpenEnergyPlatform/open-MaStR/pull/341

Compare versions: v0.11.6 - v0.11.7
Also see CHANGELOG.md

Energy Systems - Energy Data Accessibility and Integration - Python
Published by Ludee over 2 years ago

open-MaStR - v0.11.6

Patch - Repair package - 2022-08-17
Combined changes from v0.11.5 and v0.11.6

What's Changed

  • Delete the MastrDownloadFactory class #292
  • Use exclusively sqlalchemy for dialect-free implementation #289
  • API Download: Linked units in table permit are written in comma seperated string #302
  • API Download: Repaired Location download #303
  • CSV export: Tables with mastr_data about power units are exported in chunks #306
  • API Download: User credentials are now tested before the download starts #309
  • Pre-commit hook for Black formatting #312
  • Repair technology paramter in API download #327

Full Changelog: https://github.com/OpenEnergyPlatform/open-MaStR/compare/v0.11.5...v0.11.6

Energy Systems - Energy Data Accessibility and Integration - Python
Published by FlorianK13 over 2 years ago

open-MaStR - v0.11.4

[v0.11.4] Patch - Hotfix - 2022-07-08

Changed

  • Move function cleaned_data to data_io #284

Full Changelog: https://github.com/OpenEnergyPlatform/open-MaStR/compare/v0.11.3...v0.11.4

Energy Systems - Energy Data Accessibility and Integration - Python
Published by FlorianK13 almost 3 years ago

open-MaStR - v0.11.3

[v0.11.3] Patch - A data release - 2022-07-07

Added

  • Add warning message if the bulk download speed falls below a certain limit #256
  • Add engine parameter for master class initialisation #270

Changed

  • Fix combustion mapping #253
  • Update bulk parsing order #257
  • Apply csv method to all tables #275

Energy Systems - Energy Data Accessibility and Integration - Python
Published by Ludee almost 3 years ago

open-MaStR - v0.11.2

[v0.11.2] Patch - Patch the package - 2022-05-17

Changed

  • Update readme.md to improve PyPi release #249
  • Rename branches dev -> develop and master -> production

Energy Systems - Energy Data Accessibility and Integration - Python
Published by Ludee almost 3 years ago

open-MaStR - v0.11.1

[v0.11.0] 2022-05-16

The code becomes a python package and will be available on pypi.org
Additionally, a new datasource was identified and can be used: the xml bulk download.
The API was updated to the newest version and the data model was adapted.

Added

  • The class :class:open_mastr.mastr.Matr
    was introduced as the entrypoint for users, the API download was included in this entrypoint
    #203
  • A method for downloading and parsing the xml dump from the MaStR website
    was implemented #202
  • New data classes and attributes were introduced to orm.py #209
  • The documentation page was updated
  • Unit tests were created #207
  • A CI pipeline was introduced #208
  • The metadata was updated #219

[v0.10.0] 2020-10-08 - unreleased

A complete refactoring took place! Downloading data was entirely changed; introducing layers of code and removing
duplicated code while more of less following DRY.
Moreover, post-processing was changed to be more accessible and easier to execute. For example, docker now helps to
spin up a database container.
The documention on RTD was extended, update and improved to be more helpful for new users.
Read more about the details:

Added

  • added more technologies

  • added documentation for ReadTheDocs

  • improved parallel download

  • merged all stale branches

  • The class :class:open_mastr.soap_api.mirror.MaStRMirror
    was introduced for mirroring MaStR data with latest updates #149

  • Introduce project home ~/.open-MaStR/config/ #120

  • Documentation of post-processing #117

  • Updated documentation of downloading data #124 which is harmonized with the other parts of docs
    and with GitHubs README #135

  • Local execution of post-processing now possible, optionally in dockered database #116

  • Post-processing adapted to CSV data from :class:open_mastr.soap_api.mirror.MaStRMirror #172

  • Tests for changed download code are added #131

  • Metadata added for raw data as frictionless data package #160

  • Suffix columns instead of deferring in database CSV export #157

  • Code examples added for :class:open_mastr.soap_api.mirror.MaStRMirror explaining basic use of
    mirroring database #164

  • CSV file reader for MaStR raw data added #181

  • Zenodo data upload #173
    and the missing LICENSE file for Zenodo is fixed in #186

  • Add postgres database service in CI job for interacting with database in tests #159

  • Tests for :class:open_mastr.soap_api.mirror.MaStRMirror #191

  • Download functionality for Lokationen (with focus on :class:open_mastr.soap_api.mirror.MaStRMirror) #162

  • The CHANGELOG is now included in the documentation

Changed

  • Download of raw data has entirely been refactored. A
    python wrapper for querying
    the MaStR API was introduced #83
  • Based on that, for bulk data download,
    MaStRDownload provides handy query
    functions for power unit data #86. See also #128
  • configuration through config filen in ~/.open-MaStR/config/ with less hard-coded parameters in source files #120, #112
  • move code into one package named open_mastr #123
  • Switch to GitHub Actions for CI instead of Travis #143
  • Fixed unexpected line breaks during CSV export that corrupted data #170
  • Filtering of duplicates in MaStR data (see
    MaStR help <https://www.marktstammdatenregister.de/MaStRHilfe/subpages/statistik.html>_) got changed to filter
    units by leading three characters and select only directly entered data #180
  • Generalize CSV reading function #188

Removed

  • Most of prior code for downloading data

Energy Systems - Energy Data Accessibility and Integration - Python
Published by Ludee almost 3 years ago

open-MaStR - v0.9.0

Added

  • docstrings for functions
  • tests
  • setup.py file
  • added update function (based on latest timestamp in powerunits csv)
  • added wind functions
    • only download power units for wind to avoid massive download
    • changed : process units wind ("one-click solution")
  • added loop to retry failed power unit downloads, currently one retry
  • write failed downloads to file

Changed

  • rename import-api soap_api
  • update README with instruction for tests
  • update README with instruction for setup

Removed

  • unused imports
  • obsolete comments

Fixed

  • power unit update
  • filter technologies from power units

Energy Systems - Energy Data Accessibility and Integration - Python
Published by Bachibouzouk over 5 years ago