energy-data
Data on global energy consumption (primary energy, per capita, and growth rates), energy mix, electricity mix and other relevant metrics.
https://github.com/owid/energy-data
Category: Energy Systems
Sub Category: Energy Data Accessibility and Integration
Keywords
electricity energy
Keywords from Contributors
co2-emissions greenhouse-gas-emissions coronavirus covid covid-19 sars-cov-2
Last synced: about 21 hours ago
JSON representation
Repository metadata
Data on energy by Our World in Data
- Host: GitHub
- URL: https://github.com/owid/energy-data
- Owner: owid
- Created: 2020-09-08T15:21:25.000Z (over 4 years ago)
- Default Branch: master
- Last Pushed: 2024-09-05T12:52:09.000Z (8 months ago)
- Last Synced: 2025-04-25T12:05:22.633Z (2 days ago)
- Topics: electricity, energy
- Language: Python
- Homepage: https://ourworldindata.org/energy
- Size: 64 MB
- Stars: 324
- Watchers: 14
- Forks: 101
- Open Issues: 0
- Releases: 0
-
Metadata Files:
- Readme: README.md
README.md
Data on Energy by Our World in Data
Our complete Energy dataset is a collection of key metrics maintained by Our World in Data. It is updated regularly and includes data on energy consumption (primary energy, per capita, and growth rates), energy mix, electricity mix and other relevant metrics.
The complete Our World in Data Energy dataset
CSV | XLSX | JSON
🗂️ Download our complete Energy dataset :The CSV and XLSX files follow a format of 1 row per location and year. The JSON version is split by country, with an array of yearly records.
The indicators represent all of our main data related to energy consumption, energy mix, electricity mix as well as other indicators of potential interest.
We will continue to publish updated data on energy as it becomes available. Most metrics are published on an annual basis.
A full codebook is made available, with a description and source for each indicator in the dataset. This codebook is also included as an additional sheet in the XLSX file.
Our source data and code
The dataset is built upon a number of datasets and processing steps:
- Statistical review of world energy (Energy Institute, EI):
- International energy data (U.S. Energy Information Administration, EIA):
- Energy from fossil fuels (The Shift Dataportal):
- Yearly Electricity Data (Ember):
- Energy mix (Our World in Data based on EI's Statistical review of world energy):
- Fossil fuel production (Our World in Data based on EI's Statistical review of world energy & The Shift Dataportal's Energy from fossil fuels):
- Primary energy consumption (Our World in Data based on EI's Statistical review of world energy & EIA's International energy data):
- Electricity mix (Our World in Data based on EI's Statistical Review & Ember's Yearly Electricity Data):
- Energy dataset (Our World in Data based on all sources above):
Additionally, to construct region aggregates and indicators per capita and per GDP, we use the following datasets and processing steps:
- Regions (Our World in Data).
- Population (Our World in Data based on a number of different sources).
- Income groups (World Bank).
- GDP (University of Groningen GGDC's Maddison Project Database, Bolt and van Zanden, 2024).
Changelog
- On September 5, 2024:
- Added per capita electricity demand, from Ember's yearly electricity data.
- On August 30, 2024:
- Fixed coal electricity generation for Switzerland, which was missing in the original data, and should be zero instead.
- On June 20, 2024:
- Updated the Energy Institute Statistical Review of World Energy.
- Fixed issues on electricity data for aggregate regions.
- On May 8, 2024:
- Updated Ember's yearly electricity data, which includes data for 2023.
- Updated GDP data, now coming from Maddison Project Database 2023.
- On January 24, 2024:
- Improved codebook, to clarify whether indicators refer to electricity generation or primary energy consumption.
- Improved the calculation of the share of electricity in primary energy. Previously, electricity generation was calculated as a share of input-equivalent primary energy consumption. Now it is calculated as a share of direct primary energy consumption.
- On December 12, 2023:
- Updated Ember's yearly electricity data and EIA's International energy data.
- Enhanced codebook (improved descriptions, added units, updated sources).
- Fixed various minor issues.
- On July 7, 2023:
- Replaced BP's data by the new Energy Institute Statistical Review of World Energy 2023.
- Updated Ember's yearly electricity data.
- Updated all datasets accordingly.
- On June 1, 2023:
- Updated Ember's yearly electricity data.
- Renamed countries 'East Timor' and 'Faroe Islands', and added 'Middle East (Ember)'.
- Population and per capita indicators are now calculated using an updated version of our population dataset.
- On March 1, 2023:
- Updated Ember's yearly electricity data and fixed some minor issues.
- On December 30, 2022:
- Fixed some minor issues with BP's dataset. Regions like "Other North America (BP)" have been removed from the data, since, in the original Statistical Review of World Energy, these regions represented different sets of countries for different indicators.
- On December 16, 2022:
- The column
electricity_share_energy
(electricity as a share of primary energy) was added to the dataset. - Fixed some minor inconsistencies in electricity data between Ember and BP, by prioritizing data from Ember.
- Updated Ember's yearly electricity data.
- The column
- On August 9, 2022:
- All inconsistencies due to different definitions of regions among different datasets (especially Europe) have been fixed.
- Now all regions follow Our World in Data's definitions.
- We also include data for regions as defined in the original datasets; for example,
Europe (BP)
corresponds to Europe as defined by BP.
- All data processing now occurs outside this repository; the code has been migrated to be part of the etl repository.
- Indicator
fossil_cons_per_capita
has been renamedfossil_elec_per_capita
for consistency, since it corresponds to electricity generation. - The codebook has been updated following these changes.
- All inconsistencies due to different definitions of regions among different datasets (especially Europe) have been fixed.
- On April 8, 2022:
- Electricity data from Ember was updated (using the Global Electricity Review 2022).
- Data on greenhouse-gas emissions in electricity generation was added (
greenhouse_gas_emissions
). - Data on emissions intensity is now provided for most countries in the world.
- On March 25, 2022:
- Data on net electricity imports and electricity demand was added.
- BP data was updated (using the Statistical Review of the World Energy 2021).
- Maddison data on GDP was updated (using the Maddison Project Database 2020).
- EIA data on primary energy consumption was included in the dataset.
- Some issues in the dataset were corrected (for example some missing data in production by fossil fuels).
- On February 14, 2022:
- Some issues were corrected in the electricity data, and the energy dataset was updated accordingly.
- The json and xlsx dataset files were removed from GitHub in favor of an external storage service, to keep this repository at a reasonable size.
- The
carbon_intensity_elec
column was added back into the energy dataset.
- On February 3, 2022, we updated the Ember global electricity data, combined with the European Electricity Review from Ember.
- The
carbon_intensity_elec
column was removed from the energy dataset (since no updated data was available). - Columns for electricity from other renewable sources excluding bioenergy were added (namely
other_renewables_elec_per_capita_exc_biofuel
, andother_renewables_share_elec_exc_biofuel
). - Certain countries and regions have been removed from the dataset, because we identified significant inconsistencies in the original data.
- The
- On March 31, 2021, we updated 2020 electricity mix data.
- On September 9, 2020, the first version of this dataset was made available.
Data alterations
- We standardize names of countries and regions. Since the names of countries and regions are different in different data sources, we harmonize all names to the Our World in Data standard entity names.
- We create aggregate data for regions (e.g. Africa, Europe, etc.). Since regions are defined differently by our sources, we create our own aggregates following Our World in Data region definitions.
- We also include data for regions as defined in the original datasets; for example,
Europe (EI)
corresponds to Europe as defined by the Energy Institute.
- We also include data for regions as defined in the original datasets; for example,
- We recalculate primary energy in terawatt-hours. The primary data sources on energy—the Energy Institute Statistical review of world energy, for example—typically report consumption in terms of exajoules. We have recalculated these figures as terawatt-hours using a conversion factor of 277.8.
- Primary energy for renewable sources is reported using the 'substitution method'.
- We calculate per capita figures. All of our per capita figures are calculated from our
population
metric, which is included in the complete dataset.- We also calculate energy consumption per gdp, and include the corresponding
gdp
metric used in the calculation as part of the dataset.
- We also calculate energy consumption per gdp, and include the corresponding
- We remove inconsistent data. Certain data points have been removed because their original data presented anomalies. They may be included again in further data releases if the anomalies are amended.
License
All visualizations, data, and code produced by Our World in Data are completely open access under the Creative Commons BY license. You have the permission to use, distribute, and reproduce these in any medium, provided the source and authors are credited.
The data produced by third parties and made available by Our World in Data is subject to the license terms from the original third-party authors. We will always indicate the original source of the data in our database, and you should always check the license of any such third-party data before use.
Authors
This data has been collected, aggregated, and documented by Hannah Ritchie, Pablo Rosado, Edouard Mathieu, Max Roser.
Our World in Data makes data and research on the world’s largest problems understandable and accessible. Read more about our mission.
How to cite this data?
If you are using this dataset, please cite both Our World in Data and the underlying data source(s).
Please follow the guidelines in our FAQ on how to cite our work.
Owner metadata
- Name: Our World in Data
- Login: owid
- Email:
- Kind: organization
- Description: Research and data to make progress against the world’s largest problems
- Website: https://ourworldindata.org
- Location:
- Twitter: OurWorldInData
- Company:
- Icon url: https://avatars.githubusercontent.com/u/14187135?v=4
- Repositories: 45
- Last ynced at: 2024-04-20T00:04:54.367Z
- Profile URL: https://github.com/owid
GitHub Events
Total
- Watch event: 39
- Fork event: 5
Last Year
- Watch event: 39
- Fork event: 5
Committers metadata
Last synced: 5 days ago
Total Commits: 231
Total Committers: 7
Avg Commits per committer: 33.0
Development Distribution Score (DDS): 0.251
Commits in past year: 23
Committers in past year: 1
Avg Commits per committer in past year: 23.0
Development Distribution Score (DDS) in past year: 0.0
Name | Commits | |
---|---|---|
Pablo Rosado | p****o@g****m | 173 |
Edouard Mathieu | e****t@p****e | 42 |
Pablo Rosado | p****o@i****s | 6 |
Bobbie Macdonald | b****d@g****m | 6 |
Hannah Ritchie | 3****e | 2 |
Dominic White | d****4@g****m | 1 |
Marigold | m****r@g****m | 1 |
Committer domains:
- inetum.altia.es: 1
- pm.me: 1
Issue and Pull Request metadata
Last synced: 2 days ago
Total issues: 10
Total pull requests: 36
Average time to close issues: about 1 month
Average time to close pull requests: 9 days
Total issue authors: 10
Total pull request authors: 8
Average comments per issue: 1.4
Average comments per pull request: 0.39
Merged pull request: 32
Bot issues: 0
Bot pull requests: 0
Past year issues: 0
Past year pull requests: 7
Past year average time to close issues: N/A
Past year average time to close pull requests: 1 day
Past year issue authors: 0
Past year pull request authors: 2
Past year average comments per issue: 0
Past year average comments per pull request: 0.14
Past year merged pull request: 6
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- msgoussi (1)
- SamGreenwood1 (1)
- lyuba-marmotta (1)
- guggikofod (1)
- koonimaru (1)
- sichen1234 (1)
- Tobe2d (1)
- lpicci96 (1)
- nuno-andre (1)
- bnjmacdonald (1)
Top Pull Request Authors
- pabloarosado (29)
- dominicwhite (1)
- Marigold (1)
- bnjmacdonald (1)
- lucasrodes (1)
- sebaguro (1)
- udewmini (1)
- piotrek124-1 (1)
Top Issue Labels
- bug (1)
Top Pull Request Labels
- documentation (1)
- bug (1)
Dependencies
- kaleido ==0.2.1
- numpy ==1.22.1
- openpyxl ==3.0.9
- owid-catalog ==0.2.5
- owid.datautils v0.2.0-alpha
- pandas ==1.4.0
- plotly ==5.5.0
- pytest ==6.2.5
- tqdm ==4.62.3
- xlrd ==2.0.1
Score: 7.7266536648476425