Data

Tools

Indexes

Applications

Experiments

Open Sustainable Technology

OpenSynth

Contains 10 million synthetic load profiles of trained on over 300M smart meter readings from 20K Octopus Energy UK households sampled between 2021 and 2022.
https://github.com/opensynth-energy/opensynth

Category: Energy Systems
Sub Category: Energy Data Accessibility and Integration

Last synced: about 15 hours ago
JSON representation

Repository metadata

OpenSynth Model Repository

README.md

OpenSynth

OpenSynth Model Repository.

For the data repository:

Link to CNZ's Synthetic Dataset on Zenodo here

The data repository is still under construction. In the mean time, Centre for Net Zero has published a Faraday's output on Zenodo. This dataset contains 10 million synthetic load profiles of trained on over 300M smart meter readings from 20K Octopus Energy UK households sampled between 2021 and 2022, and is conditioned on labels such as the:

  • Property types: house, flat, terraced, detached, semi-detached etc
  • Energy performance certificate (EPC) rating: A/B/C, D/E, F/G etc
  • Low Carbon Technology (LCT) ownership: heat pumps, electric vehicles, solar PVs etc
  • Seasonality: days of the week and month of the year

You can find the dataset here on Zenodo. For more information about Faraday, please refer to the workshop paper that Centre for Net Zero presented at ICLR 2024. For more news and updates on OpenSynth, please subscribe to our mailing list here.

đŸ’ģ Development Set up

To set up environment for local development, you will need to set up PyEnv and Pipenv:

  • PyEnv for Python versioning.
  • Pipenv for dependency management.

Then clone this repo and run make setup. This will set up all dependencies and precommit hooks.

Precommit Tools:

Available CLI apps:

  • pipenv run python app/app.py for a list of Typer app commands
  • get-lcl-data: Downloads, Split, Preprocesses LCL dataset.

đŸ’Ŋ Downloading Low Carbon London dataset [1]

  • The compressed version of the data from data.london.gov.uk is ~ 700Mb. The full decompressed data is about 8Gb.
  • Note: LCL data was compressed with compression algorithm that doesn't work with Python's zipfile. You'll need to manually unzip it via command line with unzip on Linux systems, or other equivalent on Windows machine.
  • You can also download the low carbon london dataset using the typer app command pipenv run python app/app.py --download. This will use the subprocess module to unzip the file (for linux machines).
  • If you're on windows, you'll need to manually download and unzip to the folder: data/raw

ℹī¸ About Low Carbon London Dataset

  • Low Carbon London dataset was from a trial conducted by UK Power Networks on a representative sample of London households from 2011 to 2014.
  • The dataset contains half-hourly smart meter readings of 5,567 households.
  • All timestamps are given in UTC so there's no time-zone conversation needed (i.e. 48 half-hourly data a day per household)

☁ī¸ Preparing LCL Dataset for streaming

  • In order to prepare the LCL Dataset for streaming, follow the instrucitons in notebooks/streaming/streaming_data_preparation.ipynb

📕 Tutorials

For tutorials on algorithms in this repository, please refer to notebooks in the notebooks folder.

  • faraday: Train a synthetic data generative model using the Faraday algorithm
  • streaming: Train a synthetic data generative model using the Faraday algorithm by streaming the training data (useful for out of memory datasets)

Owner metadata

GitHub Events

Total
Last Year

Committers metadata

Last synced: 9 days ago

Total Commits: 64
Total Committers: 5
Avg Commits per committer: 12.8
Development Distribution Score (DDS): 0.063

Commits in past year: 64
Committers in past year: 5
Avg Commits per committer in past year: 12.8
Development Distribution Score (DDS) in past year: 0.063

Name Email Commits
Shengy s****0@g****m 60
Nan 8****t 1
Ianlmgoddard 4****d 1
Gus Chadney a****y@g****m 1
Alex Thornton a****n@g****m 1

Committer domains:

Issue and Pull Request metadata

Last synced: 1 day ago

Total issues: 10
Total pull requests: 126
Average time to close issues: 7 days
Average time to close pull requests: 6 days
Total issue authors: 2
Total pull request authors: 6
Average comments per issue: 0.0
Average comments per pull request: 0.21
Merged pull request: 114
Bot issues: 0
Bot pull requests: 0

Past year issues: 10
Past year pull requests: 126
Past year average time to close issues: 7 days
Past year average time to close pull requests: 6 days
Past year issue authors: 2
Past year pull request authors: 6
Past year average comments per issue: 0.0
Past year average comments per pull request: 0.21
Past year merged pull request: 114
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/opensynth-energy/opensynth

Top Issue Authors

  • shengy90 (8)
  • tchaton (2)

Top Pull Request Authors

  • shengy90 (88)
  • charlotte-avery (21)
  • Ianlmgoddard (9)
  • sentient-codebot (5)
  • anguschadney (2)
  • alexthornton (1)

Top Issue Labels

  • documentation (2)

Top Pull Request Labels

Score: 5.41610040220442