Spruce

Enrichment pipeline for CUR / FOCUS reports which adds energy and carbon data allowing to report and reduce the impact of the your cloud usage.
https://github.com/digitalpebble/spruce

Category: Consumption
Sub Category: Computation and Communication

Keywords

apache-spark aws carbon-emissions climate cloud greenops greensoftware sustainability

Last synced: about 16 hours ago
JSON representation

Repository metadata

Enrichment pipeline for CUR reports which adds energy and carbon data allowing to report and reduce the impact of the your cloud usage.

README.md

SPRUCE

License
Build Status
CarbonRunner

SPRUCE helps estimate the environmental impact of your cloud usage. By leveraging open source models and data, it enriches
usage reports generated by cloud providers and allows you to build reports and visualisations. Having the GreenOps and FinOps data in the same
place makes it easier to expose your costs and impacts side by side.

Please note that SPRUCE handles only CUR reports from AWS and not all their services are covered. However, most of the cost from a typical usage already gets estimates.

SPRUCE uses Apache Spark® to read and write the usage reports (typically in Parquet format) in a scalable way and, thanks to its modular approach,
splits the enrichment of the data into configurable stages.

A typical sequence of stages would be:

  • estimation of embodied emissions from the hardware
  • estimation of energy used
  • application of PUE and other overheads
  • application of carbon intensity factors

Have a look at the methodology section of our documentation for more details.

Documentation

The documentation is at https://opensourcegreenops.cloud/. If you can't wait to try SPRUCE, have a look at the tutorial for Docker.

License

Licensed under the Apache License, Version 2.0: http://www.apache.org/licenses/LICENSE-2.0

Contributing

We welcome contributions to the project, see CONTRIBUTING.md for instructions on how to do so. Contributions are not only about code: by testing the project on your data, talking about it or asking questions, you will be contributing too!


Owner metadata


GitHub Events

Total
Last Year

Committers metadata

Last synced: about 24 hours ago

Total Commits: 189
Total Committers: 4
Avg Commits per committer: 47.25
Development Distribution Score (DDS): 0.058

Commits in past year: 189
Committers in past year: 4
Avg Commits per committer in past year: 47.25
Development Distribution Score (DDS) in past year: 0.058

Name Email Commits
Julien Nioche j****n@d****m 178
nikhiln64 n****4@g****m 6
copilot-swe-agent[bot] 1****t 3
dependabot[bot] 4****] 2

Committer domains:


Issue and Pull Request metadata

Last synced: 1 day ago

Total issues: 39
Total pull requests: 27
Average time to close issues: 18 days
Average time to close pull requests: about 17 hours
Total issue authors: 2
Total pull request authors: 4
Average comments per issue: 0.82
Average comments per pull request: 0.41
Merged pull request: 21
Bot issues: 0
Bot pull requests: 2

Past year issues: 39
Past year pull requests: 27
Past year average time to close issues: 18 days
Past year average time to close pull requests: about 17 hours
Past year issue authors: 2
Past year pull request authors: 4
Past year average comments per issue: 0.82
Past year average comments per pull request: 0.41
Past year merged pull request: 21
Past year bot issues: 0
Past year bot pull requests: 2

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/digitalpebble/spruce

Top Issue Authors

  • jnioche (38)
  • adamwirth (1)

Top Pull Request Authors

  • jnioche (22)
  • dependabot[bot] (2)
  • nikhiln64 (2)
  • de9uch1 (1)

Top Issue Labels

  • enhancement (16)
  • help wanted (5)
  • documentation (4)
  • good first issue (4)
  • bug (2)
  • dependencies (1)

Top Pull Request Labels

  • enhancement (13)
  • documentation (6)
  • dependencies (4)
  • github_actions (1)
  • java (1)

Dependencies

.github/workflows/maven.yml actions
  • actions/checkout v4 composite
  • actions/setup-java v4 composite
  • advanced-security/maven-dependency-submission-action 571e99aab1055c2e71a1e2309b9691de18d6b7d6 composite
Dockerfile docker
  • apache/spark 4.0.0-java21 build
  • maven 3.9.9-eclipse-temurin-21 build
pom.xml maven
  • org.apache.spark:spark-sql_2.13 4.0.0 provided
  • org.junit.jupiter:junit-jupiter-api 5.13.1 test
  • org.junit.jupiter:junit-jupiter-engine 5.13.1 test

Score: 4.430816798843313