OpenSynth
Contains 10 million synthetic load profiles of trained on over 300M smart meter readings from 20K Octopus Energy UK households sampled between 2021 and 2022.
https://github.com/opensynth-energy/opensynth
Category: Energy Systems
Sub Category: Energy Data Accessibility and Integration
Last synced: about 13 hours ago
JSON representation
Repository metadata
OpenSynth Model Repository
- Host: GitHub
- URL: https://github.com/opensynth-energy/opensynth
- Owner: OpenSynth-energy
- License: apache-2.0
- Created: 2024-06-26T14:13:19.000Z (10 months ago)
- Default Branch: develop
- Last Pushed: 2025-03-25T11:00:03.000Z (about 1 month ago)
- Last Synced: 2025-04-20T00:40:19.303Z (10 days ago)
- Language: Jupyter Notebook
- Size: 11.6 MB
- Stars: 41
- Watchers: 3
- Forks: 7
- Open Issues: 4
- Releases: 7
-
Metadata Files:
- Readme: README.md
- License: LICENSE
README.md
OpenSynth
OpenSynth Model Repository.
For the data repository:
Link to CNZ's Synthetic Dataset on Zenodo here
The data repository is still under construction. In the mean time, Centre for Net Zero has published a Faraday's output on Zenodo. This dataset contains 10 million synthetic load profiles of trained on over 300M smart meter readings from 20K Octopus Energy UK households sampled between 2021 and 2022, and is conditioned on labels such as the:
- Property types: house, flat, terraced, detached, semi-detached etc
- Energy performance certificate (EPC) rating: A/B/C, D/E, F/G etc
- Low Carbon Technology (LCT) ownership: heat pumps, electric vehicles, solar PVs etc
- Seasonality: days of the week and month of the year
You can find the dataset here on Zenodo. For more information about Faraday, please refer to the workshop paper that Centre for Net Zero presented at ICLR 2024. For more news and updates on OpenSynth, please subscribe to our mailing list here.
đģ Development Set up
To set up environment for local development, you will need to set up PyEnv and Pipenv:
Then clone this repo and run make setup
. This will set up all dependencies and precommit hooks.
Precommit Tools:
- Pytest for testing
- Mypy for type checking
- Flake8 for linting
- isort for sorting imports
- black for formatting
Available CLI apps:
pipenv run python app/app.py
for a list of Typer app commandsget-lcl-data
: Downloads, Split, Preprocesses LCL dataset.
[1]
đŊ Downloading Low Carbon London dataset- The compressed version of the data from data.london.gov.uk is ~ 700Mb. The full decompressed data is about 8Gb.
- Note: LCL data was compressed with compression algorithm that doesn't work with Python's
zipfile
. You'll need to manually unzip it via command line withunzip
on Linux systems, or other equivalent on Windows machine. - You can also download the low carbon london dataset using the typer app command
pipenv run python app/app.py --download
. This will use the subprocess module to unzip the file (for linux machines). - If you're on windows, you'll need to manually download and unzip to the folder:
data/raw
âšī¸ About Low Carbon London Dataset
- Low Carbon London dataset was from a trial conducted by UK Power Networks on a representative sample of London households from 2011 to 2014.
- The dataset contains half-hourly smart meter readings of 5,567 households.
- All timestamps are given in UTC so there's no time-zone conversation needed (i.e. 48 half-hourly data a day per household)
âī¸ Preparing LCL Dataset for streaming
- In order to prepare the LCL Dataset for streaming, follow the instrucitons in
notebooks/streaming/streaming_data_preparation.ipynb
đ Tutorials
For tutorials on algorithms in this repository, please refer to notebooks in the notebooks
folder.
faraday
: Train a synthetic data generative model using the Faraday algorithmstreaming
: Train a synthetic data generative model using the Faraday algorithm by streaming the training data (useful for out of memory datasets)
Owner metadata
- Name: OpenSynth
- Login: OpenSynth-energy
- Email: [email protected]
- Kind: organization
- Description:
- Website: https://opensynth.energy
- Location:
- Twitter:
- Company:
- Icon url: https://avatars.githubusercontent.com/u/163300212?v=4
- Repositories: 1
- Last ynced at: 2024-06-26T18:06:31.086Z
- Profile URL: https://github.com/OpenSynth-energy
GitHub Events
Total
- Create event: 11
- Release event: 1
- Issues event: 2
- Watch event: 19
- Delete event: 9
- Issue comment event: 4
- Push event: 112
- Pull request review event: 94
- Pull request review comment event: 81
- Pull request event: 31
- Fork event: 4
Last Year
- Create event: 11
- Release event: 1
- Issues event: 2
- Watch event: 19
- Delete event: 9
- Issue comment event: 4
- Push event: 112
- Pull request review event: 94
- Pull request review comment event: 81
- Pull request event: 31
- Fork event: 4
Committers metadata
Last synced: 8 days ago
Total Commits: 64
Total Committers: 5
Avg Commits per committer: 12.8
Development Distribution Score (DDS): 0.063
Commits in past year: 64
Committers in past year: 5
Avg Commits per committer in past year: 12.8
Development Distribution Score (DDS) in past year: 0.063
Name | Commits | |
---|---|---|
Shengy | s****0@g****m | 60 |
Nan | 8****t | 1 |
Ianlmgoddard | 4****d | 1 |
Gus Chadney | a****y@g****m | 1 |
Alex Thornton | a****n@g****m | 1 |
Committer domains:
Issue and Pull Request metadata
Last synced: 1 day ago
Total issues: 10
Total pull requests: 126
Average time to close issues: 7 days
Average time to close pull requests: 6 days
Total issue authors: 2
Total pull request authors: 6
Average comments per issue: 0.0
Average comments per pull request: 0.21
Merged pull request: 114
Bot issues: 0
Bot pull requests: 0
Past year issues: 10
Past year pull requests: 126
Past year average time to close issues: 7 days
Past year average time to close pull requests: 6 days
Past year issue authors: 2
Past year pull request authors: 6
Past year average comments per issue: 0.0
Past year average comments per pull request: 0.21
Past year merged pull request: 114
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- shengy90 (8)
- tchaton (2)
Top Pull Request Authors
- shengy90 (88)
- charlotte-avery (21)
- Ianlmgoddard (9)
- sentient-codebot (5)
- anguschadney (2)
- alexthornton (1)
Top Issue Labels
- documentation (2)
Top Pull Request Labels
Score: 5.41610040220442