Recent Releases of Green Metrics Tool
Green Metrics Tool - v2.6 Repository Relations and Critical Security Fix
GMT advances to v2.6 and brings powerful new features, a critical security fix and also many QoL and package updates.
- Repository relations have arrived. This feature allows you to check out repositories adjacent to the core repository GMT is working on.
- Typical use cases include for instance checking out the core repository and also a a test driver like k6 that you need to facilitate a test. Check out our Documentation how to use it in your usage_scenario
- This release also brings a critical security fix. Some files where not correctly guarded from manipulation and attackers with host access could get elevated permissions. The risk is only present on already compromised systems and thus not too big. Still upgrading is advised to every user. Please see https://github.com/green-coding-solutions/green-metrics-tool/pull/1529 for details
- GMT can now properly detect NVMe disks. Thanks @flyaruu for the ping on this (https://github.com/green-coding-solutions/green-metrics-tool/pull/1513)
- A lot of QoL updates and small UI fixes like a better visible navigation, saving of (power / energy / carbon) view in the details page and much more. See all changes below.
Happy Measuring :) 🚀
What's Changed
- Bump aiohttp from 3.13.2 to 3.13.3 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1512
- Repository relations by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1509
- Oom better error by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1514
- Expert compare mode simple by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1515
- Showing runs from other users also by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1517
- Encoding errors by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1519
- Email templates by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1518
- Bump pandas from 2.3.3 to 3.0.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1521
- Bump cachetools from 6.2.4 to 6.2.6 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1526
- Bump psutil from 7.2.1 to 7.2.2 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1527
- Added name as filter parameter and search is now case insensitive by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1530
- Webnrg scroll by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1531
- Streaming outputs by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1540
- Bump fastapi[standard] from 0.128.0 to 0.128.1 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1539
- Bump tqdm from 4.67.1 to 4.67.3 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1537
- Bump orjson from 3.11.5 to 3.11.7 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1536
- Bump gunicorn from 23.0.0 to 25.0.1 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1535
- Bump cachetools from 6.2.6 to 7.0.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1532
- Better disk detection by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1513
- Saves the unit tab and sets it on flow change by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1464
- Removed legacy custom key type by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1481
- Bump fastapi[standard] from 0.128.1 to 0.128.2 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1541
- Cache relations by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1542
- Added OS Package Update block in cluster mode by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1543
- Bump fastapi[standard] from 0.128.2 to 0.128.5 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1545
- Hardening the subit by making the file also unwriteable by group by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1546
- Bump gunicorn from 25.0.1 to 25.0.3 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1553
- Bump redis from 7.1.0 to 7.1.1 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1554
- Bump fastapi[standard] from 0.128.5 to 0.128.6 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1552
- Bump fastapi[standard] from 0.128.6 to 0.128.7 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1556
- Bump python from 3.14.2-slim-bookworm to 3.14.3-slim-bookworm in /docker by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1555
- (fix): Hardware Info Root Sudoers entry was possible to hijack by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1529
- Bump fastapi[standard] from 0.128.7 to 0.128.8 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1559
- Further hardening by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1561
- Adds a little arrow to the menu by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1558
- Carbondb timestamp fix by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1562
- Bump fastapi[standard] from 0.128.8 to 0.129.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1563
Full Changelog: https://github.com/green-coding-solutions/green-metrics-tool/compare/v2.5...v2.6
Consumption - Computation and Communication
- Python
Published by ArneTR 24 days ago
Green Metrics Tool - v2.5 - CarbonDB Open Source, Resource Limits on CPU & Memory, QoL Fiesta
Happy new year to you and and of course to the Green Metrics Tool! 🥳🎉🎊
The new year brings new features as we finally had some time during the holiday break to work on some long wanted QoL features as well as some bigger functionality changes and ... drumroll please ... more FOSS!!!
Feature Highlights
- CarbonDB and PowerHOG (API) is now fully open source!
- GMT now enforces CPU and memory limits
QoL Highlights
- Container name resolution & Refactor metric provider c includes
- No more cryptic errors like 7gn4uinf82hui2n3iufniuas failed
- It will now show the actual container name that failed
- Archive and Note functionality
- Thanks @davidkopp for the request
- Adds a resbmit button for broken runs to quickly trigger new run
- THanks @ribalba for the pro-active integration!
- Added remove functionality to entries in the watchlist
- Thanks @Evanlsmillan for your contribution ❤️
- GMT variables can now be transmitted through the submit form
- Show logged in user in frontend
- Thanks @davidkopp for the request
- Backfill carbon intensity for Eco CI, PowerHOG and CarbonDB
What's Changed
- Bump pylint from 4.0.2 to 4.0.3 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1436
- Bump cachetools from 6.2.1 to 6.2.2 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1435
- Bump pytest from 9.0.0 to 9.0.1 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1434
- Bump psycopg[binary] from 3.2.12 to 3.2.13 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1444
- Bump pytest-playwright from 0.7.1 to 0.7.2 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1446
- Bump psycopg-pool from 3.2.7 to 3.2.8 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1445
- Bump fastapi[standard] from 0.120.4 to 0.121.3 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1439
- Blocking access direct to IP also on Port 80; Introdcuing Redirect from Port 80 to 443 by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1443
- Bump actions/checkout from 5 to 6 in /.github/workflows by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1448
- Bump fastapi[standard] from 0.121.3 to 0.122.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1451
- Added running systemd services to hardwareinfo by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1453
- Bump pydantic from 2.12.4 to 2.12.5 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1452
- Show logged in user in frontend by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1454
- Bump pylint from 4.0.3 to 4.0.4 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1457
- Bump psycopg[binary] from 3.2.13 to 3.3.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1462
- Bump psycopg-pool from 3.2.8 to 3.3.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1461
- Bump fastapi[standard] from 0.122.0 to 0.123.2 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1460
- Bump psycopg[binary] from 3.3.0 to 3.3.1 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1465
- Checks test path by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1463
- Open Sourced CarbonDB and PowerHOG by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1441
- Bump fastapi[standard] from 0.123.2 to 0.123.5 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1466
- Adds variables to the submit form by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1459
- Add job_id, os_name and cpu_arch support to Eco CI API by @Lisi4ka59 in https://github.com/green-coding-solutions/green-metrics-tool/pull/1450
- Bump fastapi[standard] from 0.123.5 to 0.123.9 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1469
- Bump redis from 6.4.0 to 7.1.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1440
- Adding version to eco-ci v3 endpoint by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1470
- Backfill carbon intensity by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1471
- Added NOT NULL to all columns where it made sense by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1472
- CarbonDB merge window added by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1473
- Bump pytest from 9.0.1 to 9.0.2 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1474
- Bump fastapi[standard] from 0.123.9 to 0.124.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1479
- Bump python from 3.13.7-slim-bookworm to 3.14.1-slim-bookworm in /docker by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1476
- Bump orjson from 3.11.4 to 3.11.5 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1477
- Bump psycopg[binary] from 3.3.1 to 3.3.2 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1478
- Normalizing API to always return 202 for POST requests by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1480
- Added remove functionality to entries in the watchlist. Issue # 1224 by @Evanlsmillan in https://github.com/green-coding-solutions/green-metrics-tool/pull/1413
- Adds a resbmit button by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1482
- Archive and Note functionality added to GMT by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1467
- Hide broken badges by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1483
- Sending usage scenario variables as empty or null will include all combinations by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1484
- Bump fastapi[standard] from 0.124.0 to 0.124.2 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1486
- Container name resolution & Refactor metric provider c includes by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1485
- Enforcing CPU and memory limits by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1455
- Clearer container limit info by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1487
- No backfilling of usage scenario. Rather using internal copy and freezing original by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1488
- Reworked resource limits by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1489
- More containers info by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1496
- Bump python from 3.14.1-slim-bookworm to 3.14.2-slim-bookworm in /docker by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1499
- Bump uvicorn[standard] from 0.38.0 to 0.40.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1500
- Bump fastapi[standard] from 0.124.2 to 0.127.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1501
- (test-fix): Re-factored metric provider tests to reduce test flakyness by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1503
- Bump psutil from 7.1.3 to 7.2.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1502
- Bump cachetools from 6.2.2 to 6.2.4 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1497
- Geo and carbon backfill by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1504
- Bump fastapi[standard] from 0.127.0 to 0.128.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1507
- Bump psutil from 7.2.0 to 7.2.1 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1508
New Contributors
- @Evanlsmillan made their first contribution in https://github.com/green-coding-solutions/green-metrics-tool/pull/1413
Full Changelog: https://github.com/green-coding-solutions/green-metrics-tool/compare/v2.4...v2.5
Consumption - Computation and Communication
- Python
Published by ArneTR 2 months ago
Green Metrics Tool - v2.4 Playwright native Website testing, Hidden Phases, Container Dependency Collection
This release marks a UX highlight for the Green Metrics Tool (GMT).
For quite a while we have been using GMT as the working horse for many of our verticals:
Playwright native DSL
Especially for the latter the usage was always very clunky and needed a lot of boilerplate in the usage_scenario.yml.
With the newly merged PR https://github.com/green-coding-solutions/green-metrics-tool/pull/1400 we now have a mechanism that nicely integrates Playwright commands directly into the usage_scenario.yml.
You find some more detailed documentation how to get this up and running here: https://docs.green-coding.io/docs/measuring/measuring-websites/
Hidden Phases
This is complemented by the feature to hide certain steps from the total values in the Dashboard. Phases can be made hidden. So the values are visible, but not very prominent. See details in this PR: https://github.com/green-coding-solutions/green-metrics-tool/pull/1297
Container Dependency Collection
And third we have a BIG feature drop: Container Dependency Collection Thanks to @davidkopp
See details here: https://github.com/green-coding-solutions/green-metrics-tool/pull/1297
TLDR: All dependencies in a container are collected at runtime allowing you to understand which dependency might have influenced your energy consumption / carbon emissions when you develop a software.
Contributor Thanks
Thanks also to this months contributors: @Lisi4ka59 for adding timezones to our docker compose infrastructure setup. Very much appreciated ❤️
Misc
The rest is bugfixes, speed ups (dropping bloated indices in measurement tables) and some dependency updates
What's Changed
- Add debug outputs to investigate failing multi arch image test case by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1371
- Fix double escaping in JS [skip ci] by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1376
- Stdout and Stderr of subprocesses are now displayed better in logs by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1370
- Bump pandas from 2.3.2 to 2.3.3 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1378
- Bump fastapi[standard] from 0.117.1 to 0.118.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1377
- Add container dependency collection by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1297
- Added Docker Images and Docker Volume Info by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1375
- Full Docker Prune whitelist implemented by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1379
- Unique constraint of measurement values for time is now done in code instead of Index in DB by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1372
- Bump pydantic from 2.11.9 to 2.11.10 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1381
- Bump pylint from 3.3.8 to 3.3.9 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1380
- Bump pydantic from 2.11.10 to 2.12.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1385
- Bump energy-dependency-inspector from 0.2.0 to 0.2.1 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1382
- Bump scipy from 1.15.2 to 1.16.2 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1384
- Bump fastapi[standard] from 0.118.0 to 0.118.2 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1386
- Bump aiohttp from 3.12.15 to 3.13.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1383
- Bump schema from 0.7.7 to 0.7.8 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1392
- Bump cachetools from 6.2.0 to 6.2.1 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1389
- Bump pylint from 3.3.9 to 4.0.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1390
- Bump fastapi[standard] from 0.118.2 to 0.119.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1391
- Hidden phases feature by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1135
- Remove sampling rate configured by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1387
- Using errors replace whereever possible by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1399
- Bump pylint from 4.0.0 to 4.0.1 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1397
- Adds better error codes by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1345
- Playwright enhanced by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1400
- Fixes that variables where not subsituted in included files. by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1393
- Remove dependencies from runs dto by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1403
- Bump fastapi[standard] from 0.119.0 to 0.119.1 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1409
- Bump fastapi[standard] from 0.119.1 to 0.120.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1414
- Bump pylint from 4.0.1 to 4.0.2 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1410
- Bump hiredis from 3.2.1 to 3.3.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1398
- Bump aiohttp from 3.13.0 to 3.13.1 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1405
- Bump psutil from 7.1.0 to 7.1.1 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1406
- Bump pydantic from 2.12.0 to 2.12.3 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1404
- Bump psycopg[binary] from 3.2.10 to 3.2.11 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1407
- Bump uvicorn[standard] from 0.37.0 to 0.38.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1408
- Bump psutil from 7.1.1 to 7.1.2 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1416
- Bump orjson from 3.11.3 to 3.11.4 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1415
- Bump psycopg-pool from 3.2.6 to 3.2.7 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1417
- Bump psycopg[binary] from 3.2.11 to 3.2.12 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1418
- Add option to set timezone by @Lisi4ka59 in https://github.com/green-coding-solutions/green-metrics-tool/pull/1364
- Bump fastapi[standard] from 0.120.0 to 0.120.1 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1419
- Bump fastapi[standard] from 0.120.1 to 0.120.2 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1423
- Bump scipy from 1.16.2 to 1.16.3 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1422
- Bump aiohttp from 3.13.1 to 3.13.2 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1421
- Fix encoding of repo paths in URLs in frontend by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1425
- Bump psutil from 7.1.2 to 7.1.3 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1427
- Timeline usage scenario variables by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1428
- Bump fastapi[standard] from 0.120.2 to 0.120.4 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1426
- Bump pydantic from 2.12.3 to 2.12.4 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1430
- Bump pytest from 8.4.2 to 9.0.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1431
New Contributors
- @Lisi4ka59 made their first contribution in https://github.com/green-coding-solutions/green-metrics-tool/pull/1364
Full Changelog: https://github.com/green-coding-solutions/green-metrics-tool/compare/v2.3...v2.4
Consumption - Computation and Communication
- Python
Published by ArneTR 4 months ago
Green Metrics Tool - v2.3 - QoL and styling updates; Fance new Playwright website testing mode
A slightly unspectacular release with a lot of QoL features, style changes and also on critical security fix.
The update is recommended for all users as soon as possible. Please also cycle your database credentials after updating.
Highlights of the update:
-
New metric boxes design - See it live on https://metrics.green-coding.io and screenshots on https://github.com/green-coding-solutions/green-metrics-tool/pull/1279
-
Playwright command for flows. You can now natively test browser workflows!
-
Remove network from sci - We deemed it as not an actual emission metric. See https://github.com/green-coding-solutions/green-metrics-tool/pull/1352 for details
What's Changed
- Document the usage of cgroup system metric providers by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1273
- Fix NetworkIoCgroupSystemProvider doesn't create a value column by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1274
- Bump redis from 6.2.0 to 6.3.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1275
- Detect systemd cgroup path using cgroup name (instead of container id) by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1270
- Bump redis from 6.3.0 to 6.4.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1281
- Log parsing on full data by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1276
- Bump deepdiff from 8.5.0 to 8.6.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1283
- Bump python from 3.13.5-slim-bookworm to 3.13.6-slim-bookworm in /docker by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1286
- Updated echarts to v.6.0 by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1282
- Bump pylint from 3.3.7 to 3.3.8 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1285
- Bump actions/create-github-app-token from 2.0.6 to 2.1.0 in /.github/workflows by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1284
- Bump orjson from 3.11.1 to 3.11.2 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1288
- Bump actions/create-github-app-token from 2.0.6 to 2.1.1 in /.github/workflows by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1294
- Bump python from 3.13.6-slim-bookworm to 3.13.7-slim-bookworm in /docker by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1293
- Bump actions/checkout from 4 to 5 in /.github/workflows by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1295
- Fix output of container logs ("print-logs" flag) + Reuse ScenarioRunner object for all files/iterations by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1290
- Bump requests from 2.32.4 to 2.32.5 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1298
- Make scripts more portable by changing the shebang by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1299
- Improve Time Traveling - Fix mode 2, remove mode 3 and cleanup 'cleanup' method by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1300
- Bump pandas from 2.3.1 to 2.3.2 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1301
- Added UTF-8 replace for read user streams by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1303
- Bump orjson from 3.11.2 to 3.11.3 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1306
- Bump cachetools from 6.1.0 to 6.2.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1305
- Bare metal tests sysbox by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1308
- Bump playwright/python from v1.54.0-noble to v1.55.0-noble in /docker/auxiliary-containers/gcb_playwright by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1309
- New metric boxes by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1279
- Moving away from hostnamectl as we see dbus timeouts in restricted envs by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1307
- Fixes the website tester on Fedora by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1304
- Bump pytest from 8.4.1 to 8.4.2 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1316
- Blocking joining or creating pre-defined networks by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1317
- Bump deepdiff from 8.6.0 to 8.6.1 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1314
- Bump actions/github-script from 7.0.1 to 8.0.0 in /.github/workflows by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1321
- Bump pytest-playwright from 0.7.0 to 0.7.1 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1324
- Bump psycopg[binary] from 3.2.9 to 3.2.10 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1323
- Bump pytest-randomly from 3.16.0 to 4.0.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1327
- Fix folder-destination with build by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1326
- Implement database reconnection with automatic retry logic by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1315
- Explicit container registry by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1319
- Remove html escape by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1318
- Add check if container image architecture is compatible by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1289
- Playwright command by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1334
- Bump actions/create-github-app-token from 2.1.1 to 2.1.4 in /.github/workflows by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1337
- Bump actions/github-script from 7.0.1 to 8.0.0 in /.github/workflows by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1338
- Bump pytest-randomly from 4.0.0 to 4.0.1 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1339
- Bump pydantic from 2.11.7 to 2.11.9 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1340
- Fixes sudo bug when creating test env by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1310
- Saves the existing config files on install by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1311
- Bump fastapi[standard] from 0.116.1 to 0.116.2 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1342
- fixes the problem with updates not being installed by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1346
- Refactor logs structure to json by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1341
- Bump psutil from 7.0.0 to 7.1.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1349
- Remove network from sci by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1352
- Allow to stream stdout connected output by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1353
- Fix note 'pulling image' in charts by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1356
- Revert docker container registry by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1357
- Added cluster status message, changelog and status history by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1358
- Bump fastapi[standard] from 0.116.2 to 0.117.1 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1362
- Bump uvicorn[standard] from 0.35.0 to 0.36.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1363
- Bump uvicorn-worker from 0.3.0 to 0.4.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1361
- Bump pyyaml from 6.0.2 to 6.0.3 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1368
- Showing name and ID instead of only obfuscated info for user token by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1369
- Bump uvicorn[standard] from 0.36.0 to 0.37.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1365
- Fix null byte handling in logs to prevent PostgreSQL errors by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1359
- Fix checkboxes reset in user settings by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1366
- Cluster status is now also on request page [skip ci] by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1374
Full Changelog: https://github.com/green-coding-solutions/green-metrics-tool/compare/v2.2...v2.3
Consumption - Computation and Communication
- Python
Published by ArneTR 5 months ago
Green Metrics Tool - v2.2 User Configuration Feature Drop
GMT has received another big feature drop making it more flexible and accessible for complex measurements.
A lot of the settings previously only available in the config.yml are now accessible through the frontend.
Other notable changes are now a configurable network carbon intensity (I paramter in the config.yml) and a migration to the new updated carbon intensity values from Coroamă (2021) (See https://github.com/green-coding-solutions/website/pull/111 for details)
Also GMT features now a more granular warning systems improving visual cues when something was off with a run to make human processing a breeze :)
Big thanks to @thiloettelt and @davidkopp for contributing to v2.1 ❤️
What's Changed
- Sleep time cluster by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1217
- Notes sent by Eco Ci now shown in frontend by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1218
- Bump requests from 2.32.3 to 2.32.4 in /docker by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1222
- Bump aiohttp from 3.11.18 to 3.12.12 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1221
- Bump python from 3.13.3-slim-bookworm to 3.13.4-slim-bookworm in /docker by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1220
- Bump pytest from 8.3.5 to 8.4.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1211
- Bump uvicorn[standard] from 0.34.2 to 0.34.3 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1210
- Bump cachetools from 5.5.2 to 6.0.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1202
- Bump redis from 6.1.0 to 6.2.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1204
- Cluster Cleanup Rework by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1155
- openSUSE & Rancher Desktop support (rootless) by @thiloettelt in https://github.com/green-coding-solutions/green-metrics-tool/pull/1163
- Fix script prune_db.py by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1223
- Install script refactor by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1233
- Bump python from 3.13.4-slim-bookworm to 3.13.5-slim-bookworm in /docker by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1225
- Bump pytest from 8.4.0 to 8.4.1 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1230
- Bump fastapi[standard] from 0.115.12 to 0.115.14 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1235
- Bump cachetools from 6.0.0 to 6.1.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1228
- Bump aiohttp from 3.12.12 to 3.12.13 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1226
- Bump pydantic from 2.11.5 to 2.11.7 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1227
- Fix error handling for clipboard API is unavailable by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1236
- Bump playwright/python from v1.52.0-noble to v1.53.0-noble in /docker/auxiliary-containers/gcb_playwright by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1238
- Adds labels and network aliases by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1214
- Schema checker refactor by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1240
- Bump aiohttp from 3.12.13 to 3.12.14 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1249
- Bump fastapi[standard] from 0.115.14 to 0.116.1 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1245
- 204 special handling by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1247
- Bump pandas from 2.3.0 to 2.3.1 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1242
- Bump uvicorn[standard] from 0.34.3 to 0.35.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1237
- Bump orjson from 3.10.18 to 3.11.0 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1250
- Allow overwrite of str in usage scenario by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1248
- Skips the git commands when dev-no-save is specified by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1251
- Cpu throttling by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1256
- Add tests for labels and network alias functionality by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1253
- Made network carbon data intensity dynamic by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1200
- Dynamic network carbon data energy with tests by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1257
- Bump aiohttp from 3.12.14 to 3.12.15 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1260
- Bump playwright/python from v1.53.0-noble to v1.54.0-noble in /docker/auxiliary-containers/gcb_playwright by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1259
- Bump orjson from 3.11.0 to 3.11.1 by @dependabot[bot] in https://github.com/green-coding-solutions/green-metrics-tool/pull/1258
- Implement warnings table and frontend display by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1255
- Fix test execution of runner.py by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1262
- More user measurement configurations by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1263
- Guards against timeout configuration error by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1232
- Adds the * functionality for filenames, multiple filenames and --iterations by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1176
- Restructure runner unit tests by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1265
- Suspend check by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1269
New Contributors
- @thiloettelt made their first contribution in https://github.com/green-coding-solutions/green-metrics-tool/pull/1163
Full Changelog: https://github.com/green-coding-solutions/green-metrics-tool/compare/v2.1...v2.2
Consumption - Computation and Communication
- Python
Published by ArneTR 7 months ago
Green Metrics Tool - v2.1 AI/ML measurement features, Important Bugfix, Phase-Cut off mitigations
The new feature drops for Q2 in 2025 are coming to GMT. We know you could not wait any second longer :)
- AI/ML Models are now a first class citizen in GMT for measurement. Check out our easy AI prompt measurement
- See the documentation
- Also see our demo service on https://green-coding.ai
- Important Bugfix in the frontend where some values where shown as 0.0 See PR
- Phase cut-offs with sampling are now easier to mitigate by pushing the phase end into the next sample
- Too complicated? Read up on it in this PR - There are pictures, we promise!
- AI Measurements and NVIDIA power is now done via our new C provider for less overhead
What's Changed
- Removing ee visibility by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1180
- Added --dev-no-save flag by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1179
- Bump hiredis from 3.1.0 to 3.1.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1182
- Bump psycopg[binary] from 3.2.7 to 3.2.8 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1183
- Bump playwright/python from v1.51.0-noble to v1.52.0-noble in /docker/auxiliary-containers/gcb_playwright by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1174
- Shm size by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1184
- Adding dev-no-sleeps and dev-no-optimization to the cluster by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1185
- Bump pylint from 3.3.6 to 3.3.7 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1175
- Bump deepdiff from 8.4.2 to 8.5.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1181
- Added statistical significance schedule mode [skip ci] by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1186
- Bump redis from 5.2.1 to 6.1.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1187
- Bump psycopg[binary] from 3.2.8 to 3.2.9 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1188
- Phase end cutoff mitigation by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1161
- AI Optimisations Frontend added to FOSS version as appetizer by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1192
- Phase padding can now be turned on and off by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1193
- Sampling rate rework by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1194
- Hotfix: Compare values were 3 orders of magnitude to low due to double division by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1191
- Splits the diskio provider into reads and writes by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1189
- Checking outside symlinks when cloning from URL by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1195
- Bump hiredis from 3.1.1 to 3.2.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1197
- Bump pydantic from 2.11.4 to 2.11.5 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1196
- Proper detached feature log parsing and process handling for setup-commands by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1198
- Previous exception rework by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1199
- RE-Implemented NVIDIA Energy capture via C by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1167
- Bump hiredis from 3.2.0 to 3.2.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1201
- Jobs can now be cancelled via API and Dashboard by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1205
- (feature): Added logout button by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1208
Full Changelog: https://github.com/green-coding-solutions/green-metrics-tool/compare/v2.0...v2.1
Consumption - Computation and Communication
- Python
Published by ArneTR 9 months ago
Green Metrics Tool - v2.0 Variables in usage_scenarios, API changes and developer QoL
The Green Metrics Tool has reached version 2.0! 🎉
This is because we have a major new functionality and also some breaking changes to API endpoints.
New functionalities:
- Variables in Usage Scenario. You can use variables like
__GMT_VAR_XXX__in yourusage_scenario.ymland supply them when you start a run. Either via CLI or handed in to the cluster. The scenario will then run with the respective replaced variable.
Since comparing scenarios is a key feature of the Green Metrics Tool the usage_scenario variables are first class citizens and are a compare category. In short: same usage scenarios but different variables will create a separate category for comparison- Adding these also via the Web Frontend will come in v2.1
- Badges have now selectable units between joules and watt-hours
- Return data for watt-hours moved to milliwatt-hours
- Added note column to be sent to Eco ci in case an error happens in the CI/CD pipeline
- Eco CI now has a carbon badge in the repo overview. See example:
Breaking changes:
- Badge endpoint does not accept general parameters like 'AC' anymore, but the concrete metric must be supplied. e.g. psu_carbon_ac_mcp_machine
- runs endpoint migrated to v2 due to different return
- run endpoint migrated to v2 due to different return
- Usage scenario
setup-commandskey is now a list of dicts. See https://docs.green-coding.io/docs/measuring/usage-scenario/ - Ignore unsupported docker compose keys. Can be turned off with
ignore-unsupported-compose: true
What's Changed
- Badges with selectable unit by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1073
- Bump scipy from 1.15.1 to 1.15.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1075
- Bump psutil from 6.1.1 to 7.0.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1074
- Adds-ping-on-install by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1067
- Eco-CI now has a carbon badge in the repo overview [skip ci] by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1079
- Bump cachetools from 5.5.1 to 5.5.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1076
- Bump psycopg[binary] from 3.2.4 to 3.2.5 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1077
- Bump aiohttp from 3.11.12 to 3.11.13 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1080
- Bump playwright/python from v1.49.1-jammy to v1.50.0-jammy in /docker/auxiliary-containers/gcb_playwright by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1072
- Bump psycopg-pool from 3.2.4 to 3.2.5 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1078
- Bump fastapi[standard] from 0.115.8 to 0.115.11 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1083
- Bump pytest from 8.3.4 to 8.3.5 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1084
- Bump psycopg-pool from 3.2.5 to 3.2.6 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1081
- Bump deepdiff from 8.2.0 to 8.3.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1087
- Checking int fields for params and limiting retrieval amount by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1089
- Optimizations can get data without HTTP by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1090
- Bump psycopg[binary] from 3.2.5 to 3.2.6 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1095
- Add compose stack name + allow test stack to run in parallel by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1093
- Add support for entrypoint attribute by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/1088
- Logs previous exception if present by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1097
- HealthCheck JSON errors are now scraped by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1103
- Bump deepdiff from 8.3.0 to 8.4.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1102
- Bump aiohttp from 3.11.13 to 3.11.14 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1098
- Bump pylint from 3.3.4 to 3.3.6 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1105
- (Frontend): Clearer split between modular frontend and "Runner" by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1053
- Project to watchlist by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1110
- Bump fastapi[standard] from 0.115.11 to 0.115.12 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1113
- Bump playwright/python from v1.50.0-noble to v1.51.0-noble in /docker/auxiliary-containers/gcb_playwright by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1114
- More sleak card display in Watchlist by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1116
- Timeline badges are now for 30 days by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1117
- Bump orjson from 3.10.15 to 3.10.16 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1118
- Adds monotonic clocks by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1106
- Installer negate by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1122
- Force compare mode by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1111
- User settings via dashboard by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1112
- User settings are now also stored in DB by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1125
- Add option to print stats to CLI by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1130
- Badges all metrics by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1131
- Introduces phase to badge by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1134
- Redirecting port 80 to SSL by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1141
- Adds the runner arguments as 'Switches' menu item to the stats.html by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1144
- Added note column to be sent to eco-ci by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1145
- Moving to milli-watt hours by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1133
- Guard clause against too old python version by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1153
- Charts now display absolute StdDev by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1154
- Fix invalid run markers by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1157
- Bump uvicorn[standard] from 0.34.0 to 0.34.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1147
- Bump pydantic from 2.10.6 to 2.11.3 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1143
- Machine names have now nice names in Dashboard and some QoL by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1142
- Bump aiohttp from 3.11.14 to 3.11.16 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1139
- Adds the option to use --ee-branch as parameter. by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1123
- Timeline badges rework by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1158
- Entrypoint as list functionality by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1127
- Added init support by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1160
- Bump uvicorn[standard] from 0.34.1 to 0.34.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1159
- Bump python from 3.13.2-slim-bookworm to 3.13.3-slim-bookworm in /docker by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1146
- Bump aiohttp from 3.11.16 to 3.11.18 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1162
- Ignore unsupported docker compose keys by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1165
- Software add now returns job_id on insert; Jobs API now allows filter for job_id by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1170
- Usage Scenario Variables and ScenarioRunner templates by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1172
- Resource limits now also from services key; Added tests by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1173
- Bump psycopg[binary] from 3.2.6 to 3.2.7 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1171
- Bump pydantic from 2.11.3 to 2.11.4 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1169
- Bump orjson from 3.10.16 to 3.10.18 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1168
Full Changelog: https://github.com/green-coding-solutions/green-metrics-tool/compare/v1.4.0...v2.0
Consumption - Computation and Communication
- Python
Published by ArneTR 10 months ago
Green Metrics Tool - v1.4.0 - WattHours default + QoL + depedency updates
If you look at the release logs for this month you might be thinking that only dependency updates have happened. But don't be fooled, a lot of long wanted and interesting features have made it to this months release:
- WattHours are now the default display (instead of Joules) as the unit of energy. You can still switch back to Joules in the settings
- QoL features in the dashboard:
- Unselect button when comparing runs
- href removed for non links for screen readers
- Badges now have average function
- GMT can now isolate containers from network by setting --internal
- GMT is now microjoules under the hood to allow higher resolutions
- Averages are now weighted averages for CPU utilization and others
- Sample resolution is now shown in Dashboard and you can compare if you can actually sample at the target rate
What's Changed
- Added unselect button [skip ci] by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1022
- Noise reduced run start by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1023
- Bump deepdiff from 8.0.1 to 8.1.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1020
- Bump pydantic from 2.10.3 to 2.10.4 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1024
- Bump aiohttp from 3.11.10 to 3.11.11 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1025
- Badges for CI now include carbon and also Totals by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/998
- Removing href for non actual links [skip ci] by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1026
- Bump psutil from 6.1.0 to 6.1.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1028
- Added average function to badges by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1029
- Adding saving for image and volume sizes by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1027
- User Zero / Super Admin by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1021
- Internal network by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1030
- Refactorings and performance by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1032
- Bump pylint from 3.3.2 to 3.3.3 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1031
- Bump uvicorn-worker from 0.2.0 to 0.3.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1034
- (improvement): Added ICMP, Ehterframe, QUIC and TCP-Streams to TCPDum… by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1036
- Metric importer refactor by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1035
- Bump anybadge from 1.14.0 to 1.15.6 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1038
- Bump orjson from 3.10.12 to 3.10.13 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1037
- Measurement table split by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1039
- Moving GMT to microjoules by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/932
- Bump scipy from 1.14.1 to 1.15.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1041
- (Feature): Check if swap is active; Drop VM caches and sync disk by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1042
- Weighted Average for Phase Stats by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1040
- Alternative cpu utilization reporting by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1002
- (Feature): Sampling rate can be NULL by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1045
- Bump orjson from 3.10.13 to 3.10.14 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1043
- Bump pydantic from 2.10.4 to 2.10.5 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1044
- Bump anybadge from 1.15.6 to 1.16.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1046
- Bump scipy from 1.15.0 to 1.15.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1047
- Bump psycopg[binary] from 3.2.3 to 3.2.4 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1048
- Memcpy for dynamic buffer by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1050
- Metric provider edge cases by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1049
- Target Sampling resolution if avg sampling resolution is not available by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1051
- (Feature): Frontend now remembers when description texts are closed by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1054
- Timeline and badge value transform by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1060
- I think we should not include the original by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1062
- Bump pylint from 3.3.3 to 3.3.4 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1063
- Github gives you the url for the repo with a .git at the end by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1059
- Bump orjson from 3.10.14 to 3.10.15 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1055
- Bump fastapi[standard] from 0.115.6 to 0.115.7 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1057
- Bump cachetools from 5.5.0 to 5.5.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1056
- Bump pydantic from 2.10.5 to 2.10.6 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1058
- Bump aiohttp from 3.11.11 to 3.11.12 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1070
- Bump deepdiff from 8.1.1 to 8.2.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1069
- Bump pytest-playwright from 0.6.2 to 0.7.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1068
- Bump fastapi[standard] from 0.115.7 to 0.115.8 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1066
- Makes the installer more robust by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1065
- Adds the option to add args to the docker call string by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/1064
- (Feature): Disk IO providers now block more virtual devices and stand multiple partitions by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1052
- Bump python from 3.13.1-slim-bookworm to 3.13.2-slim-bookworm in /docker by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1071
Full Changelog: https://github.com/green-coding-solutions/green-metrics-tool/compare/v1.3.0...v1.4.0
Consumption - Computation and Communication
- Python
Published by ArneTR about 1 year ago
Green Metrics Tool - v1.3.0 Codespaces + CarbonDB 2.0 + QoL / Tests / Package updates
Whoo, what a christmas release!!
GMT comes along for the holidays with an unusual packed feature release and also some more extensive test coverage now even including the frontend.
The higlights are:
- We now have a default Codespaces setup to try at your convenience. Just click on the Codespaces button in the Readme and try out GMT pre-installed and pre-configured with our trusty Cloud Energy reporter active for cloud measurements
- The integrated Cloud Energy now accounts vor vhost ratio of your machine so you can get reliable GMT values even in VMs
- Phase Stats are now also saved if runs fails. So no data gets lost if you want to account for the carbon consumption of your measurement cluster
- CarbonDB 2.0 is now ready for use. (Please note that this is an enterprise only feature and distributed in a separate repository - See https://www.green-coding.io/products/carbondb/)
- Clickable Comparsion Charts + Display Missing Values by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1017 So nice!!!!!
Thanks again to our contributors this month:
- @davidkopp ❤️
What's Changed
- Remove Apex Charts by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/955
- Bump uvicorn[standard] from 0.31.1 to 0.32.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/956
- Added frontend tests by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/945
- Fixes wrong o vs. O parameter by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/958
- Bump psutil from 6.0.0 to 6.1.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/959
- Bump orjson from 3.10.7 to 3.10.9 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/961
- --dev-no-build -> --dev-cache-build by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/963
- Carbondb 2.0 - New by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/957
- Adding tag and commit mode to Timeline Projects scheduling by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/960
- Cleaned up GitHub Workflows and using CarbonDB 2.0 by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/964
- Bump playwright/python from v1.46.0-jammy to v1.48.0-jammy in /docker/auxiliary-containers/gcb_playwright by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/965
- Bump fastapi[standard] from 0.115.2 to 0.115.3 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/967
- Bump orjson from 3.10.9 to 3.10.10 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/966
- Bump redis from 5.1.1 to 5.2.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/968
- Bump tqdm from 4.66.5 to 4.66.6 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/971
- Bump fastapi[standard] from 0.115.3 to 0.115.4 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/969
- Bump pytest-randomly from 3.15.0 to 3.16.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/970
- Bump orjson from 3.10.10 to 3.10.11 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/974
- Bump tqdm from 4.66.6 to 4.67.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/975
- Bump fastapi[standard] from 0.115.4 to 0.115.5 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/978
- Bump aiohttp from 3.10.10 to 3.11.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/980
- Bump aiohttp from 3.11.0 to 3.11.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/981
- Bump aiohttp from 3.11.2 to 3.11.4 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/984
- Bump psycopg-pool from 3.2.3 to 3.2.4 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/982
- fixes the GCC warnings by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/985
- RAPL energy filtering moved to provider by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/979
- Phase Stats are now also saved if runs fails by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/972
- Monotonic and low value check by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/973
- Container energy idle by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/992
- Codespaces merge into main by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/993
- Vhost ratio for XGBoost provider by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/994
- Gitignore improvements by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/995
- Adding enterprise submodule for custom additional components by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/996
- Bump aiohttp from 3.11.4 to 3.11.7 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/991
- Bump uvicorn[standard] from 0.32.0 to 0.32.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/988
- Bump pydantic from 2.9.2 to 2.10.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/990
- Bump pydantic from 2.10.1 to 2.10.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1005
- Bump pytest-playwright from 0.5.2 to 0.6.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1004
- Bump orjson from 3.10.11 to 3.10.12 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1001
- Bump playwright/python from v1.48.0-jammy to v1.49.0-jammy in /docker/auxiliary-containers/gcb_playwright by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/999
- Bump tqdm from 4.67.0 to 4.67.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1000
- Bump aiohttp from 3.11.7 to 3.11.9 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1009
- Bump pytest from 8.3.3 to 8.3.4 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1007
- Bump pylint from 3.3.1 to 3.3.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1008
- Bump hiredis from 3.0.0 to 3.1.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1012
- Bump python from 3.12.7-slim-bookworm to 3.13.0-slim-bookworm in /docker by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/949
- Bump redis from 5.2.0 to 5.2.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1014
- Bump aiohttp from 3.11.9 to 3.11.10 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1013
- Bump fastapi[standard] from 0.115.5 to 0.115.6 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1011
- Bump pydantic from 2.10.2 to 2.10.3 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1010
- Bump python from 3.13.0-slim-bookworm to 3.13.1-slim-bookworm in /docker by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1015
- Allowing Deeplinks to specific phases [skip ci] by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1016
- Tcp dump by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/919
- Bump playwright/python from v1.49.0-jammy to v1.49.1-jammy in /docker/auxiliary-containers/gcb_playwright by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1018
- Bump uvicorn[standard] from 0.32.1 to 0.34.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/1019
- Clickable Comparsion Charts + Display Missing Values by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/1017
Full Changelog: https://github.com/green-coding-solutions/green-metrics-tool/compare/v1.2.0...v1.3.0
Consumption - Computation and Communication
- Python
Published by ArneTR about 1 year ago
Green Metrics Tool - v1.2.0 STDDEV changes and display tweaks
STDDEV in GMT is now exclusively calculated as SAMPLE-STDDEV and not POP-STDDEV anymore.
This is for two reasons:
- It is required by certifications like the Blue Angel for Software
- We got many debates that in cases where the average is only estimated through measurements and is not absolute one MUST use the sample STDDEV. Still one could argue that one does not want to characterize the measured software but rather the measurement setup it is safer to use the sample STDDEV as it is always higher
Furthermore some display changed where made to have the AVG bar optional and quick-access for the timeline was added on overview
What's Changed
- Toggle for AVG in Timeline Charts by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/940
- Sample stddev by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/941
- (feature): Print CSS styles for frontend [skip ci] by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/942
- Test fixes by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/943
- Bump uvicorn[standard] from 0.31.0 to 0.31.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/944
- Bump aiohttp from 3.10.9 to 3.10.10 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/946
- Quick Access for timeline added by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/947
- Making Workload Validation also accept absolute values by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/948
- Bump fastapi[standard] from 0.115.0 to 0.115.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/950
Full Changelog: https://github.com/green-coding-solutions/green-metrics-tool/compare/v1.1.1...v1.1.2
Consumption - Computation and Communication
- Python
Published by ArneTR over 1 year ago
Green Metrics Tool - v1.1.1 SCI / Embodied Carbon Patch & dependencies update
- (fix) SCI values were not correctly reported anymore.
- (update) Using the release to also update some depedencies
What's Changed
- Bump python from 3.12.6-slim-bookworm to 3.12.7-slim-bookworm in /docker by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/938
- Bump redis from 5.1.0 to 5.1.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/936
- Bump aiohttp from 3.10.8 to 3.10.9 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/937
- Missing embodied carbon values by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/939
Full Changelog: https://github.com/green-coding-solutions/green-metrics-tool/compare/v1.1...v1.1.1
Consumption - Computation and Communication
- Python
Published by ArneTR over 1 year ago
Green Metrics Tool - v.1.1.0 - Patch Release / Feature Release
v1.0 is just a week out, and here it is: The first patch / feature release :)
We encourage everybody to update as one reporter was reporting broken data.
Fixes
- Some API calls in the HOG are now optional as we have seen machines without disks
- GMT uses for reporiting the SI norms. That means that 1 KB is 1000 Bytes, not 1024 (as this would be kiB). We fixed one occurence where this was not correctly reported but should be negligeable to most users.
- network_io_cgroup_container reporter was reporting grossly false high values. Here an accumulation instead of an assign was happening. (Note that this was introduced in v1.0 and was fine in versions before. Blast radius should thus be small)
Features addons
- SSL is now possible in the installation process. It should be pretty straight forward but documentation is to follow.
- Cron dir is now refactored and all cron jobs have error handling
- Added a backup script to import backups to the database (Can handle 100 GB+ imports !)
Important info
CarbonDB 2.0 is actually not part of this release. Due to some branch merging it looks this way on GitHub. It will be released later next week with v1.2
What's Changed
- Bump redis from 5.0.8 to 5.1.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/922
- Bump uvicorn[standard] from 0.30.6 to 0.31.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/923
- Bump psycopg[binary] from 3.2.2 to 3.2.3 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/924
- Bump aiohttp from 3.10.6 to 3.10.8 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/925
- Makes the disk optional by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/926
- Refactor reporters and install script by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/920
- Ssl by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/928
- Cron dir refactoring by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/929
- pip timeouts and retries increased by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/930
- Added Backup script [skip ci] by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/931
- Timeline has now bookmark functionality [skip ci] by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/933
- Byte normalization - SI Units by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/934
- Fix: metric providers for IO where accumulating instead of echoing by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/935
Full Changelog: https://github.com/green-coding-solutions/green-metrics-tool/compare/v1.0...v1.0.1
Consumption - Computation and Communication
- Python
Published by ArneTR over 1 year ago
Green Metrics Tool - v1.0
The 1.0 release !!!! 🎉
While this release mostly contains updates and tests to asset the stability of the measurements it has two main perks:
- GMT now has an authentication so it can be used with multiple users to implement ACLs and data retention
- GMT is now fully compliant with the measurement requirements for the new Blue Angel for Software
We opted for the 1.0 release now as we have used it to capture more than 1 TB of measurement data of 100+ users.
GMT has been featured on many conferences and papers
We believe it is now ready for 1.0. Enjoy!
What's Changed
- Bump playwright/python from v1.45.0-jammy to v1.45.1-jammy in /docker/auxiliary-containers/gcb_playwright by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/844
- Bump pytest from 8.3.1 to 8.3.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/843
- Bump aiohttp from 3.9.5 to 3.10.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/845
- Bump redis from 5.0.7 to 5.0.8 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/846
- Bump uvicorn[standard] from 0.30.3 to 0.30.4 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/847
- Bump fastapi from 0.111.1 to 0.112.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/848
- Adds the new fastapi include by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/849
- Bump tqdm from 4.66.4 to 4.66.5 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/852
- Bump aiohttp from 3.10.0 to 3.10.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/850
- Bump uvicorn[standard] from 0.30.4 to 0.30.5 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/851
- Bump pyyaml from 6.0.1 to 6.0.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/853
- Bump aiohttp from 3.10.1 to 3.10.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/854
- Bump orjson from 3.10.6 to 3.10.7 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/855
- Bump aiohttp from 3.10.2 to 3.10.3 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/858
- Bump gunicorn from 22.0.0 to 23.0.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/857
- Bump python from 3.12.4-slim-bookworm to 3.12.5-slim-bookworm in /docker by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/856
- Bump uvicorn[standard] from 0.30.5 to 0.30.6 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/861
- Fix using depends_on in conjunction with container_name by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/860
- Bump fastapi[standard] from 0.112.0 to 0.112.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/863
- Bump aiohttp from 3.10.3 to 3.10.4 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/864
- Bump playwright/python from v1.45.1-jammy to v1.46.0-jammy in /docker/auxiliary-containers/gcb_playwright by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/865
- RAPL check shall only run on linux systems by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/862
- Bump aiohttp from 3.10.4 to 3.10.5 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/866
- head -1 could lead to SIGPIPE 124 by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/867
- Bump scipy from 1.14.0 to 1.14.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/868
- Make the debug messages better by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/870
- Checks for duplicate flow names by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/869
- Trims values from requests submit and allows value addition through url by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/873
- Checks if when read-sci-stdout is specified that also log-stdout is True by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/875
- Bump fastapi[standard] from 0.112.1 to 0.112.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/876
- CORS allowed origins now dynamic by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/878
- Bump deepdiff from 7.0.1 to 8.0.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/879
- Bump deepdiff from 8.0.0 to 8.0.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/880
- Bump pylint from 3.2.6 to 3.2.7 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/881
- Bump fastapi[standard] from 0.112.2 to 0.113.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/884
- Bump pydantic from 2.8.2 to 2.9.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/883
- Guard clause when non-git root supplied in CLI by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/874
- Fetch mode named digestable by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/885
- Bump fastapi[standard] from 0.113.0 to 0.114.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/887
- Adds checks to the install scripts by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/886
- Bump pydantic from 2.9.0 to 2.9.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/889
- Bump pytest from 8.3.2 to 8.3.3 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/890
- Added new demo data [skip ci] by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/892
- Bump fastapi[standard] from 0.114.0 to 0.114.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/899
- Bump psycopg[binary] from 3.2.1 to 3.2.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/900
- Bump python from 3.12.5-slim-bookworm to 3.12.6-slim-bookworm in /docker by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/898
- Measurement importer by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/908
- Bump fastapi[standard] from 0.114.2 to 0.115.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/905
- Bump pydantic from 2.9.1 to 2.9.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/904
- Bump psycopg-pool from 3.2.2 to 3.2.3 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/901
- Bump pylint from 3.2.7 to 3.3.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/911
- Bump plotext from 5.2.8 to 5.3.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/909
- Bump pandas from 2.2.2 to 2.2.3 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/910
- Bump plotext from 5.3.1 to 5.3.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/914
- Bump aiohttp from 3.10.5 to 3.10.6 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/912
- Bump pylint from 3.3.0 to 3.3.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/913
- Added DiskIO Reporter by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/825
- Carbondb unique by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/877
- Phase name check by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/893
- Authentication in GMT by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/872
- Blue angel for Software reporters by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/916
Full Changelog: https://github.com/green-coding-solutions/green-metrics-tool/compare/v0.25...v1.0
Consumption - Computation and Communication
- Python
Published by ArneTR over 1 year ago
Green Metrics Tool - v0.25 Security Release! + Feature drop
Security
When install GMT in an unsecured multi-user environment a malicious actor that has already penetrated the system could replace a binary in an allowed sudoers path to get root access rights.
This security vulnerability is to be seen as relatively low, as the system is not open from the outside. It is a local privilege escalation.
We recommend updating to this release as soon as possible. Fix can be applied by just running the install script (install_linux.sh / install_mac.sh) again.
Features
- Power per Container is now displayed in the dashboard. This feature is based on a linear estimation of the container CPU usage and the total machine power
- Multi-Stage-Build Docker Images Support
- Global Timeout to abort measurement when a timer is expired
- Weekly projects for the timeline projects to run a project only once a week
- RAPL energy filtering guard clause is now checked
What's Changed
- Bump green-coding-solutions/eco-ci-energy-estimation from 2 to 3 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/754
- Bump fastapi from 0.110.2 to 0.110.3 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/758
- Bump orjson from 3.10.1 to 3.10.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/759
- Bump tqdm from 4.66.2 to 4.66.4 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/760
- Added more sanity checks for duplicate and wrong container names; Add… by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/762
- Bump schema from 0.7.5 to 0.7.7 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/765
- Bump orjson from 3.10.2 to 3.10.3 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/764
- Bump redis from 5.0.3 to 5.0.4 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/756
- Bump psycopg-pool from 3.2.1 to 3.2.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/771
- Bump pylint from 3.1.0 to 3.2.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/772
- Bump pytest from 8.1.1 to 8.2.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/757
- Bump pydantic from 2.7.0 to 2.7.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/755
- Contexts and volume included can now happen in parent directories by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/767
- Trying to force keyword args by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/766
- Bump psycopg[binary] from 3.1.18 to 3.1.19 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/770
- Bump pytest from 8.2.0 to 8.2.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/775
- Bump playwright/python from v1.43.0-jammy to v1.44.0-jammy in /docker/auxiliary-containers/gcb_playwright by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/774
- Bump pylint from 3.2.0 to 3.2.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/776
- Allow local URI to be a symbolic link by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/779
- Bump requests from 2.31.0 to 2.32.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/782
- Bump scipy from 1.13.0 to 1.13.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/784
- Proposal: Increase default wait time for dependencies by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/781
- Bump docker from 7.0.0 to 7.1.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/786
- Moving int to str by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/785
- Bump uvicorn[standard] from 0.29.0 to 0.30.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/787
- Uvicorn worker by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/788
- Improve Healthcheck with start-interval parameter by @davidkopp in https://github.com/green-coding-solutions/green-metrics-tool/pull/783
- Bump pydantic from 2.7.1 to 2.7.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/789
- Added sorting by date and unified ci and measurement runs frontend by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/769
- Bump requests from 2.32.2 to 2.32.3 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/791
- Adding network to SCI and clarifications by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/793
- Moving our workflows to Ubuntu 24.04 because Docker Engine is too old… by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/794
- Reducing workflow permissions by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/797
- Power per container by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/795
- Bump uvicorn[standard] from 0.30.0 to 0.30.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/801
- Adds a script to remove carbonDB duplicates by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/799
- Bump pydantic from 2.7.2 to 2.7.3 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/802
- Bump pytest from 8.2.1 to 8.2.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/804
- Bump python from 3.12.3-slim-bookworm to 3.12.4-slim-bookworm in /docker by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/807
- Bump redis from 5.0.4 to 5.0.5 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/805
- Bump pylint from 3.2.2 to 3.2.3 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/806
- Bump orjson from 3.10.3 to 3.10.4 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/808
- Bump pydantic from 2.7.3 to 2.7.4 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/809
- Bump redis from 5.0.5 to 5.0.6 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/810
- Bump orjson from 3.10.4 to 3.10.5 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/811
- Bump psutil from 5.9.8 to 6.0.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/816
- Added randomly by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/818
- Warmup for machines added if too cool by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/817
- Local images support by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/813
- Global timeout by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/814
- Kaniko enable multi-stage builds by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/819
- Bump scipy from 1.13.1 to 1.14.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/820
- Co2eq totals and Co2i totals by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/823
- Calling fixture by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/826
- Bump redis from 5.0.6 to 5.0.7 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/822
- Bump psycopg[binary] from 3.1.19 to 3.2.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/827
- Bump pylint from 3.2.3 to 3.2.5 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/828
- Bump pydantic from 2.7.4 to 2.8.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/829
- Bump orjson from 3.10.5 to 3.10.6 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/830
- Weekly projects added by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/834
- Bump pydantic from 2.8.0 to 2.8.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/831
- Expires header added to email by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/824
- Bump docker/build-push-action from 5 to 6 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/815
- Bump playwright/python from v1.44.0-jammy to v1.45.0-jammy in /docker/auxiliary-containers/gcb_playwright by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/832
- Bump fastapi from 0.110.3 to 0.111.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/837
- Bump pytest from 8.2.2 to 8.3.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/840
- Bump hiredis from 2.3.2 to 3.0.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/841
- Bump uvicorn[standard] from 0.30.1 to 0.30.3 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/839
- Bump pylint from 3.2.5 to 3.2.6 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/838
- Security fix for python interpreter replacement by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/835
- Rapl energy filtering check by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/836
Full Changelog: https://github.com/green-coding-solutions/green-metrics-tool/compare/v0.24...v0.24.1
Consumption - Computation and Communication
- Python
Published by ArneTR over 1 year ago
Green Metrics Tool - v0.24 - Optimizations, Diffing, Intel PSYS, Performance, CarbonDB & QoL
Oh my, what a release!
The most important: Green Metrics Tool now has optimizations!
When you do a run you will be informed about what to tweak and optimize in order to make your software greener. We are releasing a first bunch of battle tested optimizations into open source. More to follow!
See details on the bottom of the GMT page here: https://www.green-coding.io/projects/green-metrics-tool/
Other very prominent changes are:
- Introducing heavy caching with Redis for API Requests, badges and internal calculations
- Error handling is now modular and will use a Queuing system if wanted. Blocking email errors are gone!
- CarbonDB added. You can now find out how much carbon your total cluster is using!
- Diffing has been implemented! See details here: https://github.com/green-coding-solutions/green-metrics-tool/pull/693
- PSYS domain can now be captured to get the whole energy of your Notebook: https://docs.green-coding.io/docs/measuring/metric-providers/psu-energy-dc-rapl-msr-machine/
- Many checks for measurement stability, taskset in order to reduce overhead, docker builds have now layer caching for faster GMT updates, DB reconnects and much more. Read the detailes under What's changed
What's Changed
- Adds support for cpu utilization on mac with resolution of under 100ms by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/681
- Added uptime command to hardware info by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/697
- date parsing cannot handle 29 feb without pre-set year by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/699
- Dynanmic system checks by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/700
- Initial version of the carbonDB by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/676
- Added no_python flag and ported flags to mac by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/698
- Adds optimisation functionality by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/702
- Fixes some issues with CarbonDB by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/708
- Quickfix for the hog not to create so much data by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/710
- Timestamping was not working; Order of magnitude off [skip ci] by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/712
- Added additional AMD family for AMD Ryzen 5 by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/711
- Added failed run visiblity by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/714
- DB Auto Reconnect on connection drop by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/716
- Small fixes by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/717
- Caching pip packages betweeen docker builds by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/721
- Eco CI performance fix by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/720
- Fixes the tests on main by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/722
- Adds more tests by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/723
- orjson requirement added by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/725
- tiny changes by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/729
- Turbo boost legacy by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/731
- Mcp energy fix by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/732
- Psys by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/730
- Adds co2 values to eco-ci by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/726
- Normalized -i switch to always be ms by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/733
- Added taskset directive by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/734
- Added missing eco-ci migration and optimizations tester by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/736
- Diffing with artifacts by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/693
- Error handling modular by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/743
- Block requests without hostname by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/744
- Basic optimizations by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/752
Full Changelog: https://github.com/green-coding-solutions/green-metrics-tool/compare/v0.23...v0.24
Consumption - Computation and Communication
- Python
Published by ArneTR almost 2 years ago
Green Metrics Tool - v0.23 Cluster, DEV & Accuracy Tooling
Key additions
- Updated our values for the average grid intensity and the embodied carbon values.
- If you are running on our Cluster you will see now different CO2 values.
- Cluster status page greatly updated. Give it a try on our status page
- DEV mode tooling greatly improved. Faster usage scenario development and testing runs!
- See docs page for details
--dev-no-sleeps--dev-flow-timetravel--dev-no-build
- See docs page for details
calibrate.pyscript to calculate the measurement overhead- See docs page for details
- Package updates and small visual updates and fixes.
Thank you @alexzurbonsen for your contributions! ❤️
What's Changed
- Bump psycopg[binary] from 3.1.16 to 3.1.17 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/646
- Euo pipefail by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/620
- Migrated from .berlin to .io by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/647
- Bump fastapi from 0.108.0 to 0.109.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/649
- Machine configuration status by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/652
- New sidebar by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/654
- Tests and better handling for detached process by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/655
- chore: add info about forking workflow for contributors by @alexzurbonsen in https://github.com/green-coding-solutions/green-metrics-tool/pull/656
- 618 check systems test rewrite by @dan-mm in https://github.com/green-coding-solutions/green-metrics-tool/pull/653
- Bump uvicorn[standard] from 0.25.0 to 0.26.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/657
- Bump docker/login-action from 2 to 3 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/551
- Bump docker/build-push-action from 2 to 5 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/552
- Bump orjson from 3.9.10 to 3.9.12 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/658
- standardized test-config by @dan-mm in https://github.com/green-coding-solutions/green-metrics-tool/pull/650
- Bump psutil from 5.9.7 to 5.9.8 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/662
- Bump pandas from 2.1.4 to 2.2.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/660
- Bump scipy from 1.11.4 to 1.12.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/661
- Bump uvicorn[standard] from 0.26.0 to 0.27.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/663
- Dev mode timetravel by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/638
- Bump playwright/python from v1.40.0-jammy to v1.41.1-jammy in /docker/auxiliary-containers/gcb_playwright by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/665
- Bump pytest from 7.4.4 to 8.0.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/666
- Bump pydantic from 2.5.3 to 2.6.0 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/669
- Bump uvicorn[standard] from 0.27.0 to 0.27.0.post1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/668
- 581 metric reporters checks by @dan-mm in https://github.com/green-coding-solutions/green-metrics-tool/pull/588
- Bump fastapi from 0.109.0 to 0.109.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/674
- Bump fastapi from 0.109.0 to 0.109.1 in /docker by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/673
- Bump orjson from 3.9.12 to 3.9.13 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/672
- Bump fastapi from 0.109.0 to 0.109.2 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/670
- Bump psycopg[binary] from 3.1.17 to 3.1.18 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/671
- Bump playwright/python from v1.41.1-jammy to v1.41.2-jammy in /docker/auxiliary-containers/gcb_playwright by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/679
- Bump python from 3.12.1-slim-bookworm to 3.12.2-slim-bookworm in /docker by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/677
- Bump uvicorn[standard] from 0.27.0.post1 to 0.27.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/678
- Bump pydantic from 2.6.0 to 2.6.1 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/675
- Bump orjson from 3.9.13 to 3.9.14 by @dependabot in https://github.com/green-coding-solutions/green-metrics-tool/pull/680
- Updated Ember Climate and Boavizta values by @ArneTR in https://github.com/green-coding-solutions/green-metrics-tool/pull/682
- Calibrate by @ribalba in https://github.com/green-coding-solutions/green-metrics-tool/pull/516
New Contributors
- @alexzurbonsen made their first contribution in https://github.com/green-coding-solutions/green-metrics-tool/pull/656
Full Changelog: https://github.com/green-coding-solutions/green-metrics-tool/compare/v0.22.1...v0.23
Consumption - Computation and Communication
- Python
Published by ArneTR about 2 years ago
Green Metrics Tool - v0.22.1 - Massive Feature Drop 2024 - Hotfix #1
- Fix for validate time calculation not respecting machine_id
Consumption - Computation and Communication
- Python
Published by ArneTR about 2 years ago
Green Metrics Tool - v0.22 - Massive Feature Drop 2024
The year starts very welcoming with a massive feature release for the Green Metrics Tool :)
- New Dev switches added for faster usage scenario development.
- Cluster is now temperature controlled and has control workloads. Documentation
- Frontend display improvements
- Energy Timeline now shows Standard Deviation
- Lockstep sampling added
- Faster container boots / shutdowns for GMT
- Faster unit test runs (2x-6x !)
- Improved status page
- GMT color via own commit hash
- Various improvements and refactorings
Big Thanks to @davidkopp for many contributions! <3
What's Changed
- Bump playwright/python from 1.39.0-jammy to v1.40.0-jammy in /docker/auxiliary-containers/gcb_playwright by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/561
- Fix for Intel macs for GMT by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/563
- Env vars numbers tests by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/546
- system checks was not in correct position by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/564
- Document tests dependencies by @davidkopp in https://github.com/green-coding-berlin/green-metrics-tool/pull/565
- Updated DataTables to newest version by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/572
- Hovering over a unit to see raw value by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/575
- Guard clause for not mapped metric provider by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/578
- Refactor env var checks and tests by @davidkopp in https://github.com/green-coding-berlin/green-metrics-tool/pull/577
- Make Docker image tags lowercase by @davidkopp in https://github.com/green-coding-berlin/green-metrics-tool/pull/571
- Bump psycopg[binary] from 3.1.13 to 3.1.14 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/579
- Moving to 99 Hertz to avoid lockstep sampling by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/583
- Bump pandas from 2.1.3 to 2.1.4 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/585
- Bump python from 3.12.0-slim-bookworm to 3.12.1-slim-bookworm in /docker by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/586
- Bump fastapi from 0.104.1 to 0.105.0 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/592
- Bump pylint from 3.0.2 to 3.0.3 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/591
- Cleanup security guard by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/597
- Make loading of detailed measurements optional by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/598
- Bump psycopg[binary] from 3.1.14 to 3.1.15 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/596
- Disable Docker CLI hints by @davidkopp in https://github.com/green-coding-berlin/green-metrics-tool/pull/555
- Bump psutil from 5.9.6 to 5.9.7 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/603
- Fix frontend flow menu to wrap automatically by @davidkopp in https://github.com/green-coding-berlin/green-metrics-tool/pull/584
- Added SIGQUIT to nginx and initi to gunicorn, as we are using bash sc… by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/605
- Changed wording for network infrastructure box by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/608
- Added powercap info to hardware_info by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/609
- Bump psycopg[binary] from 3.1.15 to 3.1.16 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/610
- Use depends_on for container startup order (refactored) by @davidkopp in https://github.com/green-coding-berlin/green-metrics-tool/pull/593
- fix for issue where tests on external PR's will fail when attempting to write to cache by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/576
- Support reading notes from services by @davidkopp in https://github.com/green-coding-berlin/green-metrics-tool/pull/590
- Branch and filename are now always not null by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/602
- Bump uvicorn[standard] from 0.24.0.post1 to 0.25.0 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/612
- Fix check if stderr is empty by @davidkopp in https://github.com/green-coding-berlin/green-metrics-tool/pull/613
- Tests run_until must be guard-claused with cleanup routine by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/616
- Switched from cmd to command by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/615
- Run ID is now accessible even after fail and thus can be sent via ema… by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/601
- Status has now a waiting time by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/599
- Disable tinyproxy systemd service by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/623
- Added stddev to timeline by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/627
- Bump pydantic from 2.5.2 to 2.5.3 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/628
- Bump fastapi from 0.105.0 to 0.108.0 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/632
- Non-Blocking starlette body read by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/633
- GMT color via own commit hash by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/634
- Refactoring for error messages and security fix for path echoing by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/636
- Refactored kill/killpg mechanism to be unified and actually fail on n… by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/625
- Stderr is now by default UTF-8 by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/624
- System check providers running by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/619
- Bump pytest from 7.4.3 to 7.4.4 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/639
- Adds skip_checks to providers by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/566
- Dev mode by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/637
- Validate.py script to check stddev of energy measurements for cluster by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/600
- Status page improvements by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/641
- Temperature Baseline cooldown in client.py by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/643
Full Changelog: https://github.com/green-coding-berlin/green-metrics-tool/compare/v0.21...v0.22
Consumption - Computation and Communication
- Python
Published by ArneTR about 2 years ago
Green Metrics Tool - v0.21 PSU AC Power MCP39F511N, QoL & Security upgrades
In this release we finally brought the support for our new high resolution AC PSU provider the MCP39F511N.
Also we have some QoL updates like showing the run link directly after a run, refactorings and a security upgrade (a file that we set in the sudoers file is now put to read only by all).
Also we welcome a new contributor: @davidkopp ❤️
Happy measuring y'all :)
What's Changed
- turn on NetworkConnectionsProxyContainerProvider in the VM by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/498
- Bump pylint from 2.17.6 to 3.0.1 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/500
- Bump scipy from 1.11.2 to 1.11.3 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/496
- Examples directory fix by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/501
- extends the install script to have a random password option by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/504
- Bump psutil from 5.9.5 to 5.9.6 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/508
- Refactors the system checkers by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/507
- Added BCC functionality for email sending by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/510
- Bump fastapi from 0.103.2 to 0.104.0 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/511
- Bump orjson from 3.9.7 to 3.9.9 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/506
- Bump actions/checkout from 3 to 4 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/450
- Bump python from 3.11.5-slim-bookworm to 3.12.0-slim-bookworm in /docker by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/502
- MCP39F511N metrics provider by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/429
- Bump pylint from 3.0.1 to 3.0.2 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/512
- Tag dockerhub containers by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/518
- Added lshw to hardware_info_root by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/514
- Bump pytest from 7.4.2 to 7.4.3 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/515
- Bump playwright/python from 1.35.0-jammy to v1.39.0-jammy in /docker/auxiliary-containers/gcb_playwright by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/513
- Qol Updates by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/521
- Bump fastapi from 0.104.0 to 0.104.1 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/522
- Update Dockerfile - Removed playwright version pinning by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/523
- Bump pandas from 2.1.1 to 2.1.2 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/520
- Bump orjson from 3.9.9 to 3.9.10 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/519
- Adding current clocksource in linux by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/524
- Bump uvicorn[standard] from 0.23.2 to 0.24.0.post1 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/526
- Makes error optional except if there is data we need by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/530
- Adding report url instead of just ID by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/531
- Hog API Fix for broken payload by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/532
- Uses /env to run python file by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/444
- Bump pandas from 2.1.2 to 2.1.3 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/534
- Bump pydantic from 2.4.2 to 2.5.0 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/538
- Adds the citation file by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/537
- Bump pydantic from 2.5.0 to 2.5.1 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/539
- Hardware info root mac by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/544
- Allow digits in env var keys by @davidkopp in https://github.com/green-coding-berlin/green-metrics-tool/pull/541
- Fomantic update to 2.9.3 by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/547
- Bump psycopg[binary] from 3.1.12 to 3.1.13 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/549
- Bump scipy from 1.11.3 to 1.11.4 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/548
- Bump pydantic from 2.5.1 to 2.5.2 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/557
- Fix printing of container logs by @davidkopp in https://github.com/green-coding-berlin/green-metrics-tool/pull/559
New Contributors
- @davidkopp made their first contribution in https://github.com/green-coding-berlin/green-metrics-tool/pull/541
Full Changelog: https://github.com/green-coding-berlin/green-metrics-tool/compare/v0.20.2...v0.21
Consumption - Computation and Communication
- Python
Published by ArneTR over 2 years ago
Green Metrics Tool - v0.20.2 (Bugfix) HOG Support 🐷 + Docker Root support + QoL + Code Quality Latest
- NetworkIoCgroupContainerProvider had a segementation error when using multiple container IDs
Consumption - Computation and Communication
- Python
Published by ArneTR over 2 years ago
Green Metrics Tool - v0.20 - HOG Support 🐷 + Docker Root support + QoL + Code Quality
HOG Suport!!1 ❤️ 🐷
- You can now track your development energy cost on Mac in our first developer preview
- Details: https://github.com/green-coding-berlin/hog
QoL:
venvis now mandatory and keeps your Python system packages clean- Docker root is now supported! We still recommend it for production, but for dev you now do not need to modify your docker client anymore 🥳
- Warnings have been added for many providers when they actually cannot run. No more (well ... less :) ) cryptic errors!
- Docker build logs are now shown in the Logs pane in the Dashboard
What's Changed
- Client has now two distinguished sleep times by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/468
- Adding email blocking for requests to non-configured domain by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/469
- Activate all 400 errors in API by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/474
- Docker error now appear in logs in more detail by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/475
- Bump psycopg[binary] from 3.1.10 to 3.1.11 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/478
- Bump pandas from 2.1.0 to 2.1.1 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/471
- Bump pylint from 2.17.5 to 2.17.6 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/481
- Bump python from 3.11.4-slim-bookworm to 3.11.5-slim-bookworm in /docker by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/480
- Bump scipy from 1.11.2 to 1.11.3 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/486
- Bump pydantic from 2.3.0 to 2.4.2 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/485
- 446 ci page UI ux overhauls by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/467
- Bump psycopg[binary] from 3.1.11 to 3.1.12 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/484
- Bump fastapi from 0.103.1 to 0.103.2 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/489
- initial hog database backend by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/470
- Removing CpuFrequencySysfsCoreProvider from default providers by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/487
- Import refactoring by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/476
- Docker root mode + venv QOL by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/488
Full Changelog: https://github.com/green-coding-berlin/green-metrics-tool/compare/v0.19.1...v0.20
Consumption - Computation and Communication
- Python
Published by ArneTR over 2 years ago
Green Metrics Tool - v0.19.1 Timeline View & Visual Improvements in Dashboard & macOS providers
Versin v0.19 adds the Timeline View!
Example for Overview: https://metrics.green-coding.berlin/energy-timeline.html
Example for concrete Timeline: https://metrics.green-coding.berlin/timeline.html?uri=https://github.com/green-coding-berlin/bakerydemo-gold-benchmark&filename=usage_scenario_warm.yml&branch=&machine_id=7
Timeline View is our first step to create a historic view of a software product over many commits. Here you can see how a software changes over time given a certain use case and potentially find when a energy hungry feature was introduced and optimize on it!
Main Features
- Timeline View added
- macOS improvements for powermetrics. The provider is now gracefully waited for and measurements do not fail with plain error.
- Eco-CI statistical data added to dashboard
- More infos about the running cluster machine added like installed packages, docker daemon stats, etc.
- Frontend has been greatly refactored to handle differences for machines better, display more warnings in case of inconsistency and rework how graphs are created
What's Changed
- Bump fastapi from 0.101.0 to 0.101.1 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/425
- Eco ci run stats by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/419
- Timeline comparison by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/420
- Bump orjson from 3.9.4 to 3.9.5 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/431
- Bump scipy from 1.11.1 to 1.11.2 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/433
- Bump pydantic from 2.1.1 to 2.3.0 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/436
- Bump fastapi from 0.101.1 to 0.103.0 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/437
- Network-proxy by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/340
- Bump scipy from 1.11.1 to 1.11.2 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/441
- Bump orjson from 3.9.2 to 3.9.5 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/442
- Adds the stdbuf to disable buffering by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/440
- Bump pandas from 2.0.3 to 2.1.0 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/443
- added workflow for building and pushing containers from docker/auxili… by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/394
- Added python and system packages listing by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/430
- Bump pytest from 7.4.0 to 7.4.1 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/449
- Bump fastapi from 0.103.0 to 0.103.1 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/448
- Schema checker improvements by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/395
- Frontend refactor by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/447
- Bump orjson from 3.9.5 to 3.9.6 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/456
- Bump orjson from 3.9.6 to 3.9.7 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/458
- Bump pytest from 7.4.1 to 7.4.2 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/455
- Runner now adds arguments to run by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/457
- added backwards compatability for cpu_util_avg stat, if its missing by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/428
- Bump docker/login-action from 2 to 3 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/459
- Bump docker/setup-qemu-action from 2 to 3 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/461
- Bump docker/setup-buildx-action from 2 to 3 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/460
- Powermetrics is now checked if it runs already on the system by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/452
Full Changelog: https://github.com/green-coding-berlin/green-metrics-tool/compare/v0.18...v0.19
Consumption - Computation and Communication
- Python
Published by ArneTR over 2 years ago
Green Metrics Tool - v0.18 SCI preview & PR energy for Eco-CI
In version 18 we are introducing the capability to output the Green Software Foundation's SCI with our tool
Please read up how to leverage that functionality in the docs
The other major upgrade is that Dashboard has been revamped and is now fully customizable. You can see any chart at any position you want by specifying which metrics shall be included.
Also if you are comparing different machines with different reporters you will get a warning if no matching reporter was found and no comparison can be made for a specific metric. Documentation for customization
Read the full changelog will all QoL, Bugfixes and Style improvements below.
What's Changed
- Dashboard customized charts by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/376
- Gmt commit hash by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/377
- Added min value by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/378
- Warnings in dashboard by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/379
- Warnings by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/380
- No notify admin for own project add by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/381
- eco-ci start measurement now also referencing v2 by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/389
- Bump pyyaml from 6.0 to 6.0.1 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/386
- Bump uvicorn[standard] from 0.22.0 to 0.23.0 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/383
- Bump orjson from 3.9.1 to 3.9.2 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/371
- Bump uvicorn[standard] from 0.23.0 to 0.23.1 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/391
- Postgres 15 by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/387
- Bump pydantic from 1.10.9 to 2.0 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/360
- Bump pydantic from 2.0 to 2.0.3 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/396
- Print name of service that had an issues with creating volumes by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/392
- Bump pydantic from 2.0.3 to 2.1.1 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/398
- Bump pylint from 2.17.4 to 2.17.5 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/400
- Safer docker prune for daily use by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/401
- Network interfaces hardware info by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/402
- Multi commit comparison by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/335
- Bump fastapi from 0.100.0 to 0.100.1 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/404
- Bump uvicorn[standard] from 0.23.1 to 0.23.2 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/405
- Gunicorn now logs access to stdout by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/406
- Index.js now can filter by repo and filename by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/408
- Fixes the metric output file becoming corrupted by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/393
- Fixes the error on mac on which /tmp is a symlink to /private/tmp by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/410
- Enables empty services in the usage_scenario by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/409
- Fixes the github security errors by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/411
- SCI metric by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/412
- eco-ci will now post the energy reading in the PR conversation by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/397
- Bump orjson from 3.9.2 to 3.9.3 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/415
- Bump fastapi from 0.100.1 to 0.101.0 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/414
- Bump psycopg[binary] from 3.1.9 to 3.1.10 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/413
- Bump orjson from 3.9.3 to 3.9.4 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/416
- Unit is now inside charts by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/417
Full Changelog: https://github.com/green-coding-berlin/green-metrics-tool/compare/v0.17.1...v0.18
Consumption - Computation and Communication
- Python
Published by ArneTR over 2 years ago
Green Metrics Tool - v0.17.1 Small Bugfix in Network-IO Display
The data for the network-IO were correctly measured, but displayed wrongly for the [Remove] phase.
For any new measurement with the tool the data will now show correctly. If you also want to bring your already stored measurements up to the correct display please:
- Run the migration
python3 tools/import_data.py migrations/2023_07_10_indices.sql. - Rebuild the phase_stats with the command:
python3 tools/rebuild_phase_stats.py
Happy measuring with now correct Network-IO in the Remove phase :)
Consumption - Computation and Communication
- Python
Published by ArneTR over 2 years ago
Green Metrics Tool - v0.17 Performance-, QoL-Updates and Bugfixes
This release changed the port-number of the Postgres DB and also some loading code for the OS filesystem mounts.
Please re-run the install script to bring these changes into effect.
Also some indices have been changed, so please run the migration 2023_07_08_indices.sql
For details see: https://docs.green-coding.berlin/docs/installation/updating/
What's Changed
- Bump fastapi from 0.97.0 to 0.98.0 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/341
- Bump scipy from 1.10.1 to 1.11.0 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/345
- Bump pytest from 7.3.2 to 7.4.0 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/346
- Bump pandas from 2.0.2 to 2.0.3 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/349
- Bump scipy from 1.11.0 to 1.11.1 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/350
- Port swap by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/357
- Bump fastapi from 0.98.0 to 0.99.1 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/359
- Removing version requirement by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/352
- First draft for fix regarding docker context subdir fix by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/353
- Errors are now all logged and excepted ony by one; Stderr does not fa… by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/358
- Docker version info by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/364
- Prune db by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/365
- Non blocking buffer reads by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/368
- No default shell by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/367
- added test cases for subdirectory volume loading by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/366
- Index page loads faster due to async DataTables and only on request by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/372
- Refactored notes to class by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/373
- tmpfs can now be set in install script by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/356
Full Changelog: https://github.com/green-coding-berlin/green-metrics-tool/compare/v0.16...v0.17
Consumption - Computation and Communication
- Python
Published by ArneTR over 2 years ago
Green Metrics Tool - v0.16 Eco-CI better stats & Gitlab integration & NOP Linux Measurement Cluster + many small updates
Eco-CI has gotten some major updates and a Gitlab integration and also our NOP Linux measurement cluster is now ready!
- NOP Linux Measurement Cluster installation added
- Performance has been greatly increased by using
copy_fromto insert phase_stats - Schema of
usage_scenariois now checked before run for bette errors and reproducibility - API now uses HTTP 204 Status codes to allow proper caching
- Eco-CI frontend allows now for greater drilldown in metrics
- Stdout Logs display in Dashboard
- Runtime phase now supports sub-phases through multiple flows
- Various minor bugfixes
What's Changed
- Adds number of runs selected for comparison by @saiteja13427 in https://github.com/green-coding-berlin/green-metrics-tool/pull/295
- Rework check configuration for Machine energy by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/300
- Bump requests from 2.30.0 to 2.31.0 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/302
- Bump pandas from 2.0.1 to 2.0.2 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/309
- Bump requests from 2.30.0 to 2.31.0 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/307
- Bump pydantic from 1.10.7 to 1.10.8 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/308
- Move gunicorn Docker image dependencies to requirements.txt by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/305
- Refactor phase state to use
copy_fromby @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/282 - Multi image fix by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/310
- removal of ghost folders in install script by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/312
- Refactor API to use proper HTTP status codes by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/311
- Eco ci frontend changes by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/296
- 184 schema checker by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/256
- Refactor how form data is sanitized by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/306
stats.htmldetailed metrics table headings reorder by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/301- Relative path for usage scenario by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/303
- Bump pandas from 2.0.1 to 2.0.2 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/317
- Bump orjson from 3.8.12 to 3.9.0 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/316
- Bump pydantic from 1.10.8 to 1.10.9 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/320
- Bump fastapi from 0.95.2 to 0.96.0 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/315
- Bump orjson from 3.9.0 to 3.9.1 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/321
- Bump pytest from 7.3.1 to 7.3.2 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/322
- Bump fastapi from 0.96.0 to 0.97.0 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/323
- Escape single and double quotes by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/324
- Hotfix for NULL values in SDIA reporter and enforcing in DB by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/331
- Default network creation by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/328
- Stdout Logs display in Dashboard by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/314
- First draft of the runtime-sub-phases by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/319
- Hotfix image creation by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/334
- Eco ci gitlab by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/332
- Check configuration will raise
ValueErroron fail by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/336 - Data tables for dashboard by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/343
- Hotfix ipmi by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/333
- Adds support for a distributed cluster setup. by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/210
Full Changelog: https://github.com/green-coding-berlin/green-metrics-tool/compare/v0.15...v0.16
Consumption - Computation and Communication
- Python
Published by ArneTR over 2 years ago
Green Metrics Tool - v0.15 🔥 Compare Feature & Eco-CI Upgrades
This is a BIG release for the Green Metrics Tool 🔥
We have adapted the measurement workflow to incorporate phases (Baseline, Idle, Installation, Boot, Runtime, Remove) which makes our tool compatible with the requirements specified by the Blue Angel for Software.
Also it is our first step towards a tooling for Software Lifecycle Analysis.
See the comparison in action here, where we compare the influence of changing the database in a Nextcloud installation (swapping MariaDB for SQLite)
-
Also our Eco-CI Tooling has been greatly upgraded and allows now for drilldown towards different CPUs, Labels and timeframes. Check out our Eco-CI feature demo.
-
Contributors
Big thx also to @saiteja13427 and @shekhar-chauhan for making contributions to the Green Metrics Tool ❤️
What's Changed
- Dev by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/179
- Bugfix: copying of the badge by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/181
- Adds include functinality to usage_scenario.yml by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/157
- 160 cli tests by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/183
- 161 eco ci badges by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/177
- Graph for badges by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/186
- Refactoring ipmi reporter by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/194
- Success message at the end of the install script by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/200
- added config options test for start idle, end idle, and process time;… by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/201
- 127 ci caching by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/195
- Change domain to .internal by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/206
- Raise value error on invalid note timestamp by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/199
- Usage scenario now displayed as yaml by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/196
- Commit URL by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/198
- Changes volume mounts from -v to --mount bind by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/216
- Bump pylint from 2.15.10 to 2.17.1 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/225
- Bump pydantic from 1.10.2 to 1.10.7 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/224
- 207 eco ci rewrite by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/226
- Adds docker build capabilities by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/234
- Move psycopg2 to psycopg3 by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/231
- Create dependabot PRs on dev branch by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/232
- Bump requests from 2.25.1 to 2.28.2 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/222
- Bump pytest from 7.2.0 to 7.2.2 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/223
- added tests and fixtures for volume loading; refactored test function… by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/197
- Bump pylint from 2.17.1 to 2.17.2 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/237
- Adds the = notatio for env vars by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/236
- Convert IPMI reporter to Joules by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/246
- Stacked bar charts by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/227
- 242 sql for eco ci by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/247
- Bump pytest from 7.2.2 to 7.3.1 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/248
- Bump pandas from 1.5.3 to 2.0.0 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/238
- Rewrite how we create folders by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/251
- Added description field to usage scenarios by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/254
- Compare Functionality by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/241
- Configuration check by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/253
- Adds option to change units to metric by @saiteja13427 in https://github.com/green-coding-berlin/green-metrics-tool/pull/263
- XSS in frontend by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/214
- Blue angel test fixes by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/275
- Extend the error helper to log to file by @saiteja13427 in https://github.com/green-coding-berlin/green-metrics-tool/pull/264
- Bump pylint from 2.17.2 to 2.17.4 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/285
- Bump requests from 2.28.2 to 2.30.0 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/283
- Bump psycopg[binary] from 3.1.8 to 3.1.9 by @dependabot in https://github.com/green-coding-berlin/green-metrics-tool/pull/284
- Shift click to select multiple projects to compare by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/293
- Project info for compare runs by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/297
New Contributors
- @saiteja13427 made their first contribution in https://github.com/green-coding-berlin/green-metrics-tool/pull/263
Consumption - Computation and Communication
- Python
Published by ArneTR almost 3 years ago
Green Metrics Tool - v0.14 macOS support + IPMI + configurable Domain + QOL
- macOS (darwin) as an architecture is now natively supported (Silicon Macs and Intel Macs)
- Domain is now configurable. Was fixed to be https://metrics.green-coding.berlin before
- Fedora support added
- QOL: Charts can now be moved and expanded in width
- More unit-tests
- Bugfixes & Refactoring
What's Changed
- Usage scenario testing 114 by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/154
- Implement IPMI power sensor by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/148
- 146 port the gmt to mac by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/152
- 164 tests update for refactor by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/167
- Configurable domain by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/168
- 163 jobs update and tests by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/170
- Do not write to /etc/hosts if domain is not local by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/174
- Charts icons rework by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/172
Full Changelog: https://github.com/green-coding-berlin/green-metrics-tool/compare/v0.13...v0.14
Consumption - Computation and Communication
- Python
Published by ArneTR about 3 years ago
Green Metrics Tool - v0.13 OpenEnergyBadge & Eco-CI + QOL improvements
What has Changed?
- OpenEnergyBadge
- All energy based metric-providers now report in mJ
- Newest XGBoost Model integrated which uses HardwareAvailability and CPUThreads as input variables for more accuarcy
- API now reports referrer if available
- Tests use Eco CI energy estimation in VMs and als eco-ci activity checker Eco CI
- Removed unused fonts and IE icons
- GMT can now ignore errors from processes if specified
- Filename can now be changed from usage_scenario.yml
- GMT can now clone only the branch if requested
- New tests integrated
- Non-Compliant measurements can now be marked
- UI can now move charts and also expand them to full-width
- All python libraries are now installed via the requirements.txt file(s)
Bugfixes
- CO2 calculation contained an error Commit
- Process listing in hardware_info contained only user processes.
- API now dumps request object correctly in error mail
- LmSensors metric provider had typo in class name
- Powerspy2 was not calculating energy correctly in certain cases
Auto Release Notes
- :flame: Forgot the not when refactoring by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/113
- Tests minor cleanups by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/119
- -added test output to github summary step by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/129
- Dev by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/130
- 126 - Domain and port changes by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/131
- Specify branch by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/135
- added second service and network to connect them; - this tests the ne… by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/133
- Makes the hardware_info script run certain parts as root by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/108
- DB tests, a little test re-organization by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/128
- Added branch to projects list by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/141
- Invalid project flag by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/132
- 123 invalid measurement by @ArneTR in https://github.com/green-coding-berlin/green-metrics-tool/pull/143
-
- give 'o' flag to grep so that only short test summary is displayed by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/144
- UI charts movement by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/145
- Changes the powerspy provider to return mJ by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/134
Full Changelog: https://github.com/green-coding-berlin/green-metrics-tool/compare/v0.12...v0.13
Consumption - Computation and Communication
- Python
Published by ArneTR about 3 years ago
Green Metrics Tool - v0.12 - Powerspy2, Liniting and Verbose Mode
What's Changed
- 72 boot providers one by one with notes displaying what was booted to see energy consumption overhead of reporters individually by @djesic in https://github.com/green-coding-berlin/green-metrics-tool/pull/89
- Powerspy2 - A new AC measurement provider using https://www.alciom.com/en/our-trades/products/powerspy2/ by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/57
- Python code linted and now enforced with pylint by @ribalba in https://github.com/green-coding-berlin/green-metrics-tool/pull/98
- Hardware Infos incl. SGX activation status are now tracked @ribalba
Full Changelog: https://github.com/green-coding-berlin/green-metrics-tool/compare/v0.11.1...v0.12
Consumption - Computation and Communication
- Python
Published by ArneTR about 3 years ago
Green Metrics Tool - v0.11.1 - Quality Release
- Text transform for SI-Units deactivated kg now shows not anymore as KG etc. @ArneTR
- Processes are now killed if SIGTERM does not work in 5s time @ribalba
- Requirements are now installed via requirements.txt @dan-mm
- Job mechanism now writes email in case of error to client. @ArneTR
- Testing now integrated in daily runs is triggered manually too. @dan-mm
Full Changelog: https://github.com/green-coding-berlin/green-metrics-tool/compare/v0.10.1...v0.11.1
Consumption - Computation and Communication
- Python
Published by ArneTR about 3 years ago
Green Metrics Tool - v0.10.1 - Temp & Fan Sensors, Dynamic Dashboard and more ...
This release is a big one!
- lm_sensors library added by @ribalba
- Dashboard now dynamically creates containers based on database entries, rather than having a fixed lookup table in the frontend. This allows for a stronger de-coupling and makes the Dashboard reusable in other open-source energy related projects
- XGBoost submodule updated to use new interpolating reporter
- Bugfixes
- Cronjobs could get stuck
- New SDIA Formula reporter
- Tests improved on Github VMs @dan-mm
config.ymlimproved markers for testing- Dashboard now displays at least basic data if test runs fail @djesic
- Dashboard can now show data in Watts and Joules
Full Changelog: https://github.com/green-coding-berlin/green-metrics-tool/compare/v0.9...v0.10.1
Consumption - Computation and Communication
- Python
Published by ArneTR about 3 years ago
Green Metrics Tool - v0.9 Integration Tests running
Integration Tests added by @dan-mm
What's Changed
- Integration tests initial by @dan-mm in https://github.com/green-coding-berlin/green-metrics-tool/pull/44
Full Changelog: https://github.com/green-coding-berlin/green-metrics-tool/compare/v0.8.1...v0.9
Consumption - Computation and Communication
- Python
Published by ArneTR over 3 years ago
Green Metrics Tool - DC Reporter released (incl. bugfix)
- DC Reporter added
- When job has no data a flame icon is shown in overview 🔥
Full Changelog: https://github.com/green-coding-berlin/green-metrics-tool/compare/v0.8...v0.8.1
Consumption - Computation and Communication
- Python
Published by ArneTR over 3 years ago
Green Metrics Tool - v0.7 - XGBoost Reporter
- XGBoost reporter included for estimation of AC power
Full Changelog: https://github.com/green-coding-berlin/green-metrics-tool/compare/v0.6...v0.7
Consumption - Computation and Communication
- Python
Published by ArneTR over 3 years ago
Green Metrics Tool - v0.6
- AC Power from PSU as reporter added
- Currently only GUDE 1202 Power meter supported, which is the reference device of the Blue Angel for Software
- AC Power reporting now in Dashboard as single and compound metric
Full Changelog: https://github.com/green-coding-berlin/green-metrics-tool/compare/v0.5...v0.6
Consumption - Computation and Communication
- Python
Published by ArneTR over 3 years ago
Green Metrics Tool - v0.5 - Procfs Sytem Time Reporter + DC Update
- DC Measurements updated with 60ms sampling and Averaging instead of Last measurement
- No /etc/sudoers file needed anymore. Using setuid now
- Added cpu_utilization_procfs_system_provider
Full Changelog: https://github.com/green-coding-berlin/green-metrics-tool/compare/v0.4...v0.5
Consumption - Computation and Communication
- Python
Published by ArneTR over 3 years ago
Green Metrics Tool - v0.4 feat. DC Measurement
Our first release with a DC measurement!
- Network Reporter has been updated
- Carbon Budget introduced
- DC Measurement reporter
- Better UI in CLI with color coding
- Better UI in Dashboard with more metrics like Power and Component Power and also explanation links for Network metrics
Full Changelog: https://github.com/green-coding-berlin/green-metrics-tool/compare/v0.3.1...v0.4
Consumption - Computation and Communication
- Python
Published by ArneTR over 3 years ago
Green Metrics Tool - v0.3.1 - Quality Improvement Release
- Stderr is now checked on every boot of the metric providers stopping run early in case of errors
- Lingering static-binary processes are now properly closed in case of manual abort (CTRL+C) or error in measurement process
Consumption - Computation and Communication
- Python
Published by ArneTR over 3 years ago
Green Metrics Tool - Version 0.3
This is the first release version of the Green Metrics Tool.
We have officially passed the beta stage, as all the relevant reporters are now present in the tool.
Release notes:
- DRAM Metrics Reporter
- Network Metrics Reporter
- Time Reporter
- Documentation complete and online at https://docs.green-coding.org
- Docker compose format for usage_scenario.yml
Full Changelog: https://github.com/green-coding-berlin/green-metrics-tool/compare/v0.2.1-beta...v0.3
Consumption - Computation and Communication
- Python
Published by ArneTR over 3 years ago
Green Metrics Tool - v0.2.1-beta
- Co2 calculation is only CPU Package atm. Textual clarification for that
- Moved Showcases to Company Website and out of Green Metrics Tool
- Removed old CSS and some style polishing
Consumption - Computation and Communication
- Python
Published by ArneTR over 3 years ago
Green Metrics Tool - v0.2-beta
- new Charting Library that can handle +200k datapoints https://echarts.apache.org
- new Interface based in Fomantic-UI (https://www.fomantic-ui.com) to provide cleaner HTML
- CO2 figures in charts
- API endpoint for notes
- Install.sh script
- Docker containers now use memory filesystem for tmp directory
- New OO architecture for Metric reporters to make inheritance and extending easy
- Cronjob system through database queue (jobs.py)
Consumption - Computation and Communication
- Python
Published by ArneTR over 3 years ago
Green Metrics Tool - v0.1-beta
v0.1-beta is a pre-production and beta release.
Pre-Production means: The tool is not yet final in terms of its planned featureset, but is working stable in its current form.
Beta means:
- Metric Providers are currently only working on Ubuntu 22.04 as they are statically linked. If you need them working on your machine please run
makein their directory. - Metric providers are not yet falsified. This version is in particular release to give other open source communities to falsifiy our measurement accurary and reproduciblity
Consumption - Computation and Communication
- Python
Published by ArneTR over 3 years ago