Open Data Access Tools - v0.2.6

What's Changed?

• Added tracking the sun dataset 2024.

Energy Systems - Energy Data Accessibility and Integration - Python
Published by jgu2 2 months ago

Open Data Access Tools - v0.2.5

What's Changed

• Updated table prefixes for data lake automation.
• Upgrade package versions.
• Updated info related to year 2025.

Energy Systems - Energy Data Accessibility and Integration - Python
Published by jgu2 3 months ago

Open Data Access Tools - v0.2.4

What's New

• Added ATB Transportation datasets

What's Fixed

• Fixed unit tests by pinning moto version.

Energy Systems - Energy Data Accessibility and Integration - Python
Published by jgu2 about 1 year ago

Open Data Access Tools - v0.2.3

What's New

• Added NSO dataset, and Jupyter notebook example
• Added Tracking the Sun 2023 dataset

Energy Systems - Energy Data Accessibility and Integration - Python
Published by jgu2 over 1 year ago

Open Data Access Tools - v0.2.2

• Fix unit tests
• Bump version to v0.2.2

Energy Systems - Energy Data Accessibility and Integration - Python
Published by jgu2 over 1 year ago

Open Data Access Tools - v0.2.1

What's New?

• Add Tracking the Sun 2022
• Add ATB 2023

Energy Systems - Energy Data Accessibility and Integration - Python
Published by jgu2 over 2 years ago

Open Data Access Tools - v0.2.0

What's New?

• Migrate AWS CDK from version 1 to version 2.
• Fix test error after the migration.
• Upgrade docs and note the compatibility issue.

Energy Systems - Energy Data Accessibility and Integration - Python
Published by jgu2 almost 3 years ago

Open Data Access Tools - v0.1.6

What's New

• Replace base image from python by node, and then install Python 3.9
• Node 16.x
• NPM 8.x
• CDK@1.x

Energy Systems - Energy Data Accessibility and Integration - Python
Published by jgu2 almost 3 years ago

Open Data Access Tools - v0.1.5

What's New

1. Add Tacking the Sun 2021 Jupyter notebook
2. Bump version to 0.1.5

What're Changed

1. Update ATB Jupyter notebook.

What're Fixed

1. Fixed CDK to version 1 cdk@1.x
2. One unit test fix.

Energy Systems - Energy Data Accessibility and Integration - Python
Published by jgu2 almost 3 years ago

Open Data Access Tools - v0.1.4

What's New?

Improvements

• Crawler tagging, add Tags to AWS Glue crawler in CDK stack.

Datasets

• Update Res/Com-stack data sources
• Add tracking the sun 2021

Example

• Add notebook example for ATB dataset.

Energy Systems - Energy Data Accessibility and Integration - Python
Published by jgu2 almost 3 years ago

Open Data Access Tools - v0.1.3

Change logs

1. Update CICD pipeline for auto-publishing docker images to DockerHub
2. Update documentation of GitHub pages.

Energy Systems - Energy Data Accessibility and Integration - Python
Published by jgu2 almost 3 years ago

Open Data Access Tools - v0.1.2

Change logs

1. Update database deployment, each dataset has its own database in data lake;
2. Change config.yaml schema to support multiple database deploy and update;
3. Added ATB Electricity 2019, 2020, and 2021 datasets;
4. Added Jupyter notebook example for Tracking the Sun 2020;
5. Update units, documentation, and according util functions to support the changes.
6. Publish image to DockerHub - https://hub.docker.com/r/openenergydatainitiative/oedi

Energy Systems - Energy Data Accessibility and Integration - Python
Published by jgu2 almost 4 years ago

Open Data Access Tools - v0.1.1

Change logs

1. oedi CLI commands bug fix related to AWS region.
2. Datasets were migrated to one AWS S3 bucket oedi-data-lake.
3. Update Jupyter notebooks in examples due to the source change.
4. Other minor changes.
5. Docker image pushed to DockerHub - https://hub.docker.com/repository/docker/openenergydatainitiative/oedi

Energy Systems - Energy Data Accessibility and Integration - Python
Published by jgu2 about 4 years ago

Open Data Access Tools - v0.1.0

New Features

1. Build OEDI data lake on AWS by using AWS CDK in either local or docker environment.
2. Integrate open datasets on Registry of Open Data on AWS published through OEDI.
   • PV Rooftop, Aspects
   • PV Rooftop, Buildings
   • PV Rooftop, Developable Planes
   • PV Rooftop, RASD
   • Tracking the Sun, 2018
   • Tracking the Sun, 2019
3. Custom your data lake through configuration ~/.oedi/config.yaml
4. Deploy, update, and test OEDI data lake through cdk and oedi commands.
5. Query metadata and data through OEDIGlue and OEDIAthena interfaces.
6. Add Jupyter notebooks as examples of data access.
7. Online documentation - https://openedi.github.io/open-data-access-tools/

Energy Systems - Energy Data Accessibility and Integration - Python
Published by jgu2 over 4 years ago