{"id":194222,"name":"Scores","description":"A Python package of mathematical functions for the verification, evaluation and optimisation of forecasts, predictions or models, primarily supporting the meteorological, climatological and geoscientific communities.","url":"https://github.com/nci/scores","last_synced_at":"2026-04-16T06:30:35.301Z","repository":{"id":173782047,"uuid":"647971361","full_name":"nci/scores","owner":"nci","description":"scores: Metrics for the verification, evaluation and optimisation of forecasts, predictions or models.","archived":false,"fork":false,"pushed_at":"2025-10-14T10:22:55.000Z","size":19937,"stargazers_count":191,"open_issues_count":77,"forks_count":38,"subscribers_count":7,"default_branch":"develop","last_synced_at":"2025-10-28T19:39:38.569Z","etag":null,"topics":["climate","contingency-table","dask","forecast-evaluation","forecast-verification","forecasting","model-validation","oceanography","pandas","python","verification","weather","xarray"],"latest_commit_sha":null,"homepage":"https://scores.readthedocs.io/","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/nci.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"docs/contributing.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":"CITATION.cff","codeowners":null,"security":"docs/SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":".zenodo.json","notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2023-05-31T23:38:24.000Z","updated_at":"2025-10-28T05:52:06.000Z","dependencies_parsed_at":"2023-10-17T06:21:39.758Z","dependency_job_id":"ebad761c-3df9-4593-b673-ada1a87a8f67","html_url":"https://github.com/nci/scores","commit_stats":{"total_commits":538,"total_committers":22,"mean_commits":"24.454545454545453","dds":0.6561338289962826,"last_synced_commit":"3f73c494675cfc5da829ee62b71d3f2c60ce1d69"},"previous_names":["nci/scores"],"tags_count":31,"template":false,"template_full_name":null,"purl":"pkg:github/nci/scores","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/nci","download_url":"https://codeload.github.com/nci/scores/tar.gz/refs/heads/develop","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":281584993,"owners_count":26526173,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-29T02:00:06.901Z","response_time":59,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"owner":{"login":"nci","name":"NCI","uuid":"18274870","kind":"organization","description":"","email":null,"website":"http://nci.org.au/","location":"Australian National University, Canberra, Australia","twitter":null,"company":null,"icon_url":"https://avatars.githubusercontent.com/u/18274870?v=4","repositories_count":4,"last_synced_at":"2023-03-11T03:36:43.281Z","metadata":{"has_sponsors_listing":false},"html_url":"https://github.com/nci","funding_links":[],"total_stars":null,"followers":null,"following":null,"created_at":"2023-02-14T23:57:48.353Z","updated_at":"2023-03-11T03:36:43.282Z","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/nci","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/nci/repositories"},"packages":[{"id":5886127,"name":"scores","ecosystem":"pypi","description":"Scores is a Python package containing mathematical functions for the verification, evaluation and optimisation of forecasts, predictions or models.","homepage":null,"licenses":"Apache Software License","normalized_licenses":["Apache-2.0"],"repository_url":"https://github.com/nci/scores","keywords_array":[],"namespace":null,"versions_count":27,"first_release_published_at":"2023-01-16T02:00:31.000Z","latest_release_published_at":"2025-10-14T10:04:11.000Z","latest_release_number":"2.3.0","last_synced_at":"2025-10-29T20:09:45.541Z","created_at":"2023-01-16T02:07:40.352Z","updated_at":"2025-10-29T20:09:45.541Z","registry_url":"https://pypi.org/project/scores/","install_command":"pip install scores --index-url https://pypi.org/simple","documentation_url":"https://scores.readthedocs.io/en/stable/","metadata":{"funding":null,"documentation":"https://scores.readthedocs.io/en/stable/","classifiers":["License :: OSI Approved :: Apache Software License","Operating System :: OS Independent","Programming Language :: Python :: 3"],"normalized_name":"scores","project_status":null},"repo_metadata":{"id":173782047,"uuid":"647971361","full_name":"nci/scores","owner":"nci","description":"Metrics for the verification, evaluation and optimisation of forecasts, predictions or models.","archived":false,"fork":false,"pushed_at":"2024-10-29T02:06:39.000Z","size":19181,"stargazers_count":62,"open_issues_count":67,"forks_count":16,"subscribers_count":7,"default_branch":"develop","last_synced_at":"2024-10-29T22:32:27.408Z","etag":null,"topics":["climate","contingency-table","dask","forecast-evaluation","forecast-verification","forecasting","model-validation","oceanography","pandas","python","verification","weather","xarray"],"latest_commit_sha":null,"homepage":"https://scores.readthedocs.io/","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/nci.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"docs/contributing.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":"docs/SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-05-31T23:38:24.000Z","updated_at":"2024-10-28T19:21:07.000Z","dependencies_parsed_at":"2023-10-17T06:21:39.758Z","dependency_job_id":"ebad761c-3df9-4593-b673-ada1a87a8f67","html_url":"https://github.com/nci/scores","commit_stats":{"total_commits":333,"total_committers":21,"mean_commits":"15.857142857142858","dds":0.6906906906906907,"last_synced_commit":"039ee9dbadcc6d8effede3baf87bf25e49c12e1b"},"previous_names":["nci/scores"],"tags_count":17,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/nci","download_url":"https://codeload.github.com/nci/scores/tar.gz/refs/heads/develop","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":222155804,"owners_count":16940422,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"},"owner_record":{"login":"nci","name":"NCI","uuid":"18274870","kind":"organization","description":"","email":null,"website":"http://nci.org.au/","location":"Australian National University, Canberra, Australia","twitter":null,"company":null,"icon_url":"https://avatars.githubusercontent.com/u/18274870?v=4","repositories_count":4,"last_synced_at":"2023-03-11T03:36:43.281Z","metadata":{"has_sponsors_listing":false},"html_url":"https://github.com/nci","funding_links":[],"total_stars":null,"followers":null,"following":null,"created_at":"2023-02-14T23:57:48.353Z","updated_at":"2023-03-11T03:36:43.282Z","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/nci","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/nci/repositories"},"tags":[{"name":"0.9.0","sha":"c616ac99967666e56a629798025d38e3c030a511","kind":"commit","published_at":"2024-06-12T03:17:10.000Z","download_url":"https://codeload.github.com/nci/scores/tar.gz/0.9.0","html_url":"https://github.com/nci/scores/releases/tag/0.9.0","dependencies_parsed_at":null,"dependency_job_id":null,"tag_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.9.0","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.9.0/manifests"},{"name":"0.8.6","sha":"dc2b1c97048a6bff2602cb668f8953d3373b40aa","kind":"commit","published_at":"2024-06-11T05:06:07.000Z","download_url":"https://codeload.github.com/nci/scores/tar.gz/0.8.6","html_url":"https://github.com/nci/scores/releases/tag/0.8.6","dependencies_parsed_at":null,"dependency_job_id":null,"tag_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.8.6","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.8.6/manifests"},{"name":"0.8.5","sha":"cafdb8dbb3409dd4684726461aadd9b2ec713809","kind":"commit","published_at":"2024-06-09T01:35:55.000Z","download_url":"https://codeload.github.com/nci/scores/tar.gz/0.8.5","html_url":"https://github.com/nci/scores/releases/tag/0.8.5","dependencies_parsed_at":null,"dependency_job_id":null,"tag_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.8.5","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.8.5/manifests"},{"name":"0.8.4","sha":"564f88fc15aeb52afeaf22ef6ab3efb0922193c6","kind":"commit","published_at":"2024-06-03T08:04:50.000Z","download_url":"https://codeload.github.com/nci/scores/tar.gz/0.8.4","html_url":"https://github.com/nci/scores/releases/tag/0.8.4","dependencies_parsed_at":null,"dependency_job_id":null,"tag_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.8.4","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.8.4/manifests"},{"name":"0.8.3","sha":"5f7933724cd56b92a5c3594e067d697a8fc1754d","kind":"commit","published_at":"2024-06-02T07:21:12.000Z","download_url":"https://codeload.github.com/nci/scores/tar.gz/0.8.3","html_url":"https://github.com/nci/scores/releases/tag/0.8.3","dependencies_parsed_at":null,"dependency_job_id":null,"tag_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.8.3","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.8.3/manifests"},{"name":"0.8.2","sha":"5c8e4edfc967eb450b24f56fe85f1fa0ba588b54","kind":"commit","published_at":"2024-05-21T02:14:04.000Z","download_url":"https://codeload.github.com/nci/scores/tar.gz/0.8.2","html_url":"https://github.com/nci/scores/releases/tag/0.8.2","dependencies_parsed_at":null,"dependency_job_id":null,"tag_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.8.2","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.8.2/manifests"},{"name":"0.8.1","sha":"efb7a8f4a36940f6028473401a37aaa7bda5a470","kind":"commit","published_at":"2024-05-16T07:58:42.000Z","download_url":"https://codeload.github.com/nci/scores/tar.gz/0.8.1","html_url":"https://github.com/nci/scores/releases/tag/0.8.1","dependencies_parsed_at":null,"dependency_job_id":null,"tag_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.8.1","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.8.1/manifests"},{"name":"0.8","sha":"0c18a5c24be5aba9a0aadfeb60dcc5023a480331","kind":"commit","published_at":"2024-05-14T10:08:50.000Z","download_url":"https://codeload.github.com/nci/scores/tar.gz/0.8","html_url":"https://github.com/nci/scores/releases/tag/0.8","dependencies_parsed_at":null,"dependency_job_id":null,"tag_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.8","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.8/manifests"},{"name":"v0.72","sha":"46f3d3301787d0f675bf9be4dbb9b60d428c610f","kind":"commit","published_at":"2024-05-09T10:27:30.000Z","download_url":"https://codeload.github.com/nci/scores/tar.gz/v0.72","html_url":"https://github.com/nci/scores/releases/tag/v0.72","dependencies_parsed_at":null,"dependency_job_id":null,"tag_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/v0.72","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/v0.72/manifests"},{"name":"0.711","sha":"4c02e5afcd3c36a38f9423e81314c82a13754626","kind":"commit","published_at":"2024-05-09T10:19:48.000Z","download_url":"https://codeload.github.com/nci/scores/tar.gz/0.711","html_url":"https://github.com/nci/scores/releases/tag/0.711","dependencies_parsed_at":null,"dependency_job_id":null,"tag_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.711","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.711/manifests"},{"name":"0.71","sha":"90bdb9b3cd4910290a2d15c530c24cd41be0dcca","kind":"commit","published_at":"2024-05-09T10:03:32.000Z","download_url":"https://codeload.github.com/nci/scores/tar.gz/0.71","html_url":"https://github.com/nci/scores/releases/tag/0.71","dependencies_parsed_at":null,"dependency_job_id":null,"tag_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.71","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.71/manifests"},{"name":"0.7","sha":"98fa87081302b8e04db6f87b02d5eb091194b99d","kind":"commit","published_at":"2024-05-07T23:20:31.000Z","download_url":"https://codeload.github.com/nci/scores/tar.gz/0.7","html_url":"https://github.com/nci/scores/releases/tag/0.7","dependencies_parsed_at":null,"dependency_job_id":null,"tag_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.7","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.7/manifests"},{"name":"v0.6","sha":"06d83413f7e01e41edd70ec5fb011a30da0fe325","kind":"commit","published_at":"2024-04-06T02:58:57.000Z","download_url":"https://codeload.github.com/nci/scores/tar.gz/v0.6","html_url":"https://github.com/nci/scores/releases/tag/v0.6","dependencies_parsed_at":null,"dependency_job_id":null,"tag_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/v0.6","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/v0.6/manifests"},{"name":"0.6","sha":"06d83413f7e01e41edd70ec5fb011a30da0fe325","kind":"commit","published_at":"2024-04-06T02:58:57.000Z","download_url":"https://codeload.github.com/nci/scores/tar.gz/0.6","html_url":"https://github.com/nci/scores/releases/tag/0.6","dependencies_parsed_at":null,"dependency_job_id":null,"tag_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.6","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/0.6/manifests"},{"name":"v0.5","sha":"622fa5071e9e2314d2486a751477ba303477824a","kind":"commit","published_at":"2024-04-05T23:58:52.000Z","download_url":"https://codeload.github.com/nci/scores/tar.gz/v0.5","html_url":"https://github.com/nci/scores/releases/tag/v0.5","dependencies_parsed_at":null,"dependency_job_id":null,"tag_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/v0.5","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/v0.5/manifests"},{"name":"v0.4","sha":"bf32a82c03cd11866d0465258236ade69af73832","kind":"commit","published_at":"2023-09-15T06:33:21.000Z","download_url":"https://codeload.github.com/nci/scores/tar.gz/v0.4","html_url":"https://github.com/nci/scores/releases/tag/v0.4","dependencies_parsed_at":null,"dependency_job_id":null,"tag_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/v0.4","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/v0.4/manifests"},{"name":"v0.0.2","sha":"4cb375e0a2d817b9f4e54a6819743cd708aae36d","kind":"commit","published_at":"2023-06-09T01:57:02.000Z","download_url":"https://codeload.github.com/nci/scores/tar.gz/v0.0.2","html_url":"https://github.com/nci/scores/releases/tag/v0.0.2","dependencies_parsed_at":null,"dependency_job_id":null,"tag_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/v0.0.2","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/tags/v0.0.2/manifests"}]},"repo_metadata_updated_at":"2024-10-30T02:59:32.732Z","dependent_packages_count":0,"downloads":2028,"downloads_period":"last-month","dependent_repos_count":2,"rankings":{"downloads":11.702649043534416,"dependent_repos_count":11.63218903340259,"dependent_packages_count":9.972534495251677,"stargazers_count":null,"forks_count":null,"docker_downloads_count":null,"average":11.102457524062894},"purl":"pkg:pypi/scores","advisories":[],"docker_usage_url":"https://docker.ecosyste.ms/usage/pypi/scores","docker_dependents_count":null,"docker_downloads_count":null,"usage_url":"https://repos.ecosyste.ms/usage/pypi/scores","dependent_repositories_url":"https://repos.ecosyste.ms/api/v1/usage/pypi/scores/dependencies","status":null,"funding_links":[],"critical":null,"issue_metadata":{"last_synced_at":"2024-10-29T21:04:46.051Z","issues_count":282,"pull_requests_count":301,"avg_time_to_close_issue":3153422.57591623,"avg_time_to_close_pull_request":723001.2965517241,"issues_closed_count":191,"pull_requests_closed_count":290,"pull_request_authors_count":13,"issue_authors_count":15,"avg_comments_per_issue":1.3900709219858156,"avg_comments_per_pull_request":1.5747508305647842,"merged_pull_requests_count":248,"bot_issues_count":0,"bot_pull_requests_count":5,"past_year_issues_count":173,"past_year_pull_requests_count":197,"past_year_avg_time_to_close_issue":1777615.9886363635,"past_year_avg_time_to_close_pull_request":205827.70053475935,"past_year_issues_closed_count":88,"past_year_pull_requests_closed_count":187,"past_year_pull_request_authors_count":11,"past_year_issue_authors_count":12,"past_year_avg_comments_per_issue":1.606936416184971,"past_year_avg_comments_per_pull_request":1.6649746192893402,"past_year_bot_issues_count":0,"past_year_bot_pull_requests_count":5,"past_year_merged_pull_requests_count":168,"issues_url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/issues","maintainers":[{"login":"tennlee","count":197,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/tennlee"},{"login":"nicholasloveday","count":134,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/nicholasloveday"},{"login":"Steph-Chong","count":106,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/Steph-Chong"},{"login":"aidanjgriffiths","count":36,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/aidanjgriffiths"},{"login":"HCookie","count":24,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/HCookie"},{"login":"nikeethr","count":10,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/nikeethr"},{"login":"mareecarroll","count":9,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/mareecarroll"},{"login":"rob-taggart","count":9,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/rob-taggart"},{"login":"reza-armuei","count":7,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/reza-armuei"},{"login":"andrewdhicks","count":3,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/andrewdhicks"},{"login":"wuxx66","count":2,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/wuxx66"},{"login":"engrmahadi","count":1,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/engrmahadi"}],"active_maintainers":[{"login":"tennlee","count":135,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/tennlee"},{"login":"Steph-Chong","count":106,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/Steph-Chong"},{"login":"nicholasloveday","count":49,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/nicholasloveday"},{"login":"nikeethr","count":10,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/nikeethr"},{"login":"mareecarroll","count":9,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/mareecarroll"},{"login":"aidanjgriffiths","count":8,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/aidanjgriffiths"},{"login":"reza-armuei","count":7,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/reza-armuei"},{"login":"rob-taggart","count":7,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/rob-taggart"},{"login":"HCookie","count":5,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/HCookie"},{"login":"wuxx66","count":2,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/wuxx66"},{"login":"engrmahadi","count":1,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/engrmahadi"}]},"versions_url":"https://packages.ecosyste.ms/api/v1/registries/pypi.org/packages/scores/versions","version_numbers_url":"https://packages.ecosyste.ms/api/v1/registries/pypi.org/packages/scores/version_numbers","dependent_packages_url":"https://packages.ecosyste.ms/api/v1/registries/pypi.org/packages/scores/dependent_packages","related_packages_url":"https://packages.ecosyste.ms/api/v1/registries/pypi.org/packages/scores/related_packages","codemeta_url":"https://packages.ecosyste.ms/api/v1/registries/pypi.org/packages/scores/codemeta","maintainers":[{"uuid":"tleeuwenburg","login":"tleeuwenburg","name":null,"email":null,"url":null,"packages_count":8,"html_url":"https://pypi.org/user/tleeuwenburg/","role":null,"created_at":"2023-01-16T07:08:19.384Z","updated_at":"2023-01-16T07:08:19.384Z","packages_url":"https://packages.ecosyste.ms/api/v1/registries/pypi.org/maintainers/tleeuwenburg/packages"}],"registry":{"name":"pypi.org","url":"https://pypi.org","ecosystem":"pypi","default":true,"packages_count":745764,"maintainers_count":316549,"namespaces_count":0,"keywords_count":245871,"github":"pypi","metadata":{"funded_packages_count":52290},"icon_url":"https://github.com/pypi.png","created_at":"2022-04-04T15:19:23.364Z","updated_at":"2025-10-29T05:45:24.783Z","packages_url":"https://packages.ecosyste.ms/api/v1/registries/pypi.org/packages","maintainers_url":"https://packages.ecosyste.ms/api/v1/registries/pypi.org/maintainers","namespaces_url":"https://packages.ecosyste.ms/api/v1/registries/pypi.org/namespaces"}}],"commits":{"id":1556413,"full_name":"nci/scores","default_branch":"develop","total_commits":744,"total_committers":25,"total_bot_commits":8,"total_bot_committers":1,"mean_commits":29.76,"dds":0.5120967741935484,"past_year_total_commits":232,"past_year_total_committers":16,"past_year_total_bot_commits":0,"past_year_total_bot_committers":0,"past_year_mean_commits":14.5,"past_year_dds":0.6379310344827587,"last_synced_at":"2025-10-29T04:55:22.318Z","last_synced_commit":"618bb6b3f74070f4ccde2f91a80bcbe891d3edea","created_at":"2024-06-11T00:12:34.862Z","updated_at":"2025-10-29T04:53:54.535Z","committers":[{"name":"Tennessee Leeuwenburg","email":"tennessee.leeuwenburg@bom.gov.au","login":"tennlee","count":363},{"name":"Stephanie Chong","email":"168800785+Steph-Chong","login":"Steph-Chong","count":151},{"name":"Nicholas Loveday","email":"48701367+nicholasloveday","login":"nicholasloveday","count":104},{"name":"Nikeeth Ramanathan","email":"nikeeth.ramanathan@gmail.com","login":"nikeethr","count":17},{"name":"Aidan Griffiths","email":"aidan.griffiths@bom.gov.au","login":null,"count":13},{"name":"Harrison Cook","email":"harrison.cook@bom.gov.au","login":"HCookie","count":11},{"name":"reza-armuei","email":"144857501+reza-armuei","login":"reza-armuei","count":9},{"name":"Arshia Sharma","email":"arshia.sharma@autogeneral.com.au","login":null,"count":8},{"name":"dependabot[bot]","email":"49699333+dependabot[bot]","login":"dependabot[bot]","count":8},{"name":"Deryn","email":"150878481+DerynGriffiths","login":"DerynGriffiths","count":8},{"name":"John Sharples","email":"john.sharples@bom.gov.au","login":"John-Sharples","count":7},{"name":"Maree Carroll","email":"maree.carroll@gmail.com","login":"mareecarroll","count":6},{"name":"rob-taggart","email":"83570124+rob-taggart","login":"rob-taggart","count":6},{"name":"Aidan Griffiths","email":"58012338+aidanjgriffiths","login":"aidanjgriffiths","count":5},{"name":"Liam Bluett","email":"85853561+lbluett","login":"lbluett","count":5},{"name":"arshia","email":"69202571+arshiaar","login":"arshiaar","count":4},{"name":"Beth Ebert","email":"beth.ebert@bom.gov.au","login":"BethEbert","count":3},{"name":"Paul Smith","email":"prs247au@gmail.com","login":"prs247au","count":3},{"name":"durgals","email":"durgalal.shrestha@gmail.com","login":"durgals","count":2},{"name":"Samuel Bishop","email":"lucractius@me.com","login":"techdragon","count":2},{"name":"Justin Smallwood","email":"justin.d.smallwood@gmail.com","login":"jdgsmallwood","count":2},{"name":"JinghanFu","email":"133175676+JinghanFu","login":"JinghanFu","count":2},{"name":"Dougie Squire","email":"42455466+dougiesquire","login":"dougiesquire","count":2},{"name":"AJTheDataGuy","email":"140307900+AJTheDataGuy","login":"AJTheDataGuy","count":2},{"name":"thomaspagano","email":"tom.pagano@bom.gov.au","login":"thomaspagano","count":1}],"past_year_committers":[{"name":"Tennessee Leeuwenburg","email":"tennessee.leeuwenburg@bom.gov.au","login":"tennlee","count":84},{"name":"Nicholas Loveday","email":"48701367+nicholasloveday","login":"nicholasloveday","count":51},{"name":"Stephanie Chong","email":"168800785+Steph-Chong","login":"Steph-Chong","count":46},{"name":"Nikeeth Ramanathan","email":"nikeeth.ramanathan@gmail.com","login":"nikeethr","count":10},{"name":"Arshia Sharma","email":"arshia.sharma@autogeneral.com.au","login":null,"count":8},{"name":"reza-armuei","email":"144857501+reza-armuei","login":"reza-armuei","count":5},{"name":"rob-taggart","email":"83570124+rob-taggart","login":"rob-taggart","count":5},{"name":"Liam Bluett","email":"85853561+lbluett","login":"lbluett","count":5},{"name":"arshia","email":"69202571+arshiaar","login":"arshiaar","count":4},{"name":"Paul Smith","email":"prs247au@gmail.com","login":"prs247au","count":3},{"name":"Samuel Bishop","email":"lucractius@me.com","login":"techdragon","count":2},{"name":"Justin Smallwood","email":"justin.d.smallwood@gmail.com","login":"jdgsmallwood","count":2},{"name":"JinghanFu","email":"133175676+JinghanFu","login":"JinghanFu","count":2},{"name":"Dougie Squire","email":"42455466+dougiesquire","login":"dougiesquire","count":2},{"name":"AJTheDataGuy","email":"140307900+AJTheDataGuy","login":"AJTheDataGuy","count":2},{"name":"thomaspagano","email":"tom.pagano@bom.gov.au","login":"thomaspagano","count":1}],"commits_url":"https://commits.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/commits","host":{"name":"GitHub","url":"https://github.com","kind":"github","last_synced_at":"2025-10-29T00:00:18.766Z","repositories_count":6089584,"commits_count":922516440,"contributors_count":35983866,"owners_count":1109633,"icon_url":"https://github.com/github.png","host_url":"https://commits.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://commits.ecosyste.ms/api/v1/hosts/GitHub/repositories"}},"issues_stats":{"full_name":"nci/scores","html_url":"https://github.com/nci/scores","last_synced_at":"2025-10-30T03:02:32.658Z","status":"active","issues_count":376,"pull_requests_count":694,"avg_time_to_close_issue":2691884.950191571,"avg_time_to_close_pull_request":615571.3509615385,"issues_closed_count":261,"pull_requests_closed_count":624,"pull_request_authors_count":25,"issue_authors_count":24,"avg_comments_per_issue":1.2792553191489362,"avg_comments_per_pull_request":1.8328530259365994,"merged_pull_requests_count":557,"bot_issues_count":0,"bot_pull_requests_count":11,"past_year_issues_count":87,"past_year_pull_requests_count":185,"past_year_avg_time_to_close_issue":1243797.5142857144,"past_year_avg_time_to_close_pull_request":647152.4088050314,"past_year_issues_closed_count":35,"past_year_pull_requests_closed_count":159,"past_year_pull_request_authors_count":15,"past_year_issue_authors_count":14,"past_year_avg_comments_per_issue":1.3103448275862069,"past_year_avg_comments_per_pull_request":2.864864864864865,"past_year_bot_issues_count":0,"past_year_bot_pull_requests_count":0,"past_year_merged_pull_requests_count":151,"created_at":"2024-06-11T00:13:05.106Z","updated_at":"2025-10-30T03:02:32.658Z","repository_url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores","issues_url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/repositories/nci%2Fscores/issues","issue_labels_count":{"good first issue":19,"documentation":17,"enhancement":10,"refactoring":6,"advanced":4,"new metric":3,"intermediate":3,"investigation":2,"bug":2,"question":2,"coding":1},"pull_request_labels_count":{"dependencies":11,"enhancement":5,"documentation":4,"emerging":3,"wontfix":1,"experimental":1,"good first issue":1},"issue_author_associations_count":{"COLLABORATOR":336,"NONE":26,"CONTRIBUTOR":14},"pull_request_author_associations_count":{"COLLABORATOR":608,"CONTRIBUTOR":61,"NONE":25},"issue_authors":{"tennlee":133,"nicholasloveday":82,"Steph-Chong":75,"nikeethr":17,"rob-taggart":13,"mareecarroll":12,"aidanjgriffiths":8,"savente93":7,"calebweinreb":5,"HCookie":5,"durgals":4,"John-Sharples":2,"lluritu":2,"rbeucher":1,"jdgsmallwood":1,"Jostarndt":1,"jonasbhend":1,"MischaDy":1,"esteban-abellan":1,"BethEbert":1,"lucyleeow":1,"reza-armuei":1,"bomRob":1,"wuxx66":1},"pull_request_authors":{"tennlee":227,"Steph-Chong":225,"nicholasloveday":94,"nikeethr":19,"HCookie":19,"reza-armuei":14,"dependabot[bot]":11,"aidanjgriffiths":9,"mareecarroll":9,"rob-taggart":9,"arshiaar":8,"durgals":8,"JinghanFu":6,"DerynGriffiths":6,"lbluett":6,"jdgsmallwood":4,"dougiesquire":3,"prs247au":3,"engrmahadi":3,"John-Sharples":2,"esteban-abellan":2,"techdragon":2,"andrewdhicks":2,"AJTheDataGuy":2,"BethEbert":1},"host":{"name":"GitHub","url":"https://github.com","kind":"github","last_synced_at":"2025-10-30T00:00:25.546Z","repositories_count":11249090,"issues_count":34958822,"pull_requests_count":113443852,"authors_count":11042075,"icon_url":"https://github.com/github.png","host_url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/repositories","owners_url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/owners","authors_url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors"},"past_year_issue_labels_count":{"enhancement":5,"documentation":4,"advanced":4,"good first issue":3,"refactoring":3,"intermediate":3,"investigation":2,"question":2,"coding":1,"new metric":1,"bug":1},"past_year_pull_request_labels_count":{"documentation":2,"enhancement":2},"past_year_issue_author_associations_count":{"COLLABORATOR":77,"NONE":7,"CONTRIBUTOR":2},"past_year_pull_request_author_associations_count":{"COLLABORATOR":148,"CONTRIBUTOR":21,"NONE":14},"past_year_issue_authors":{"tennlee":24,"nicholasloveday":21,"Steph-Chong":16,"nikeethr":9,"rob-taggart":6,"lluritu":2,"durgals":1,"esteban-abellan":1,"jdgsmallwood":1,"jonasbhend":1,"Jostarndt":1,"lucyleeow":1,"MischaDy":1,"rbeucher":1},"past_year_pull_request_authors":{"Steph-Chong":52,"tennlee":39,"nicholasloveday":33,"rob-taggart":9,"reza-armuei":8,"arshiaar":8,"nikeethr":6,"JinghanFu":6,"lbluett":6,"jdgsmallwood":4,"prs247au":3,"dougiesquire":3,"esteban-abellan":2,"AJTheDataGuy":2,"techdragon":2},"maintainers":[{"login":"tennlee","count":360,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/tennlee"},{"login":"Steph-Chong","count":260,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/Steph-Chong"},{"login":"nicholasloveday","count":176,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/nicholasloveday"},{"login":"nikeethr","count":36,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/nikeethr"},{"login":"HCookie","count":24,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/HCookie"},{"login":"rob-taggart","count":22,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/rob-taggart"},{"login":"mareecarroll","count":20,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/mareecarroll"},{"login":"aidanjgriffiths","count":17,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/aidanjgriffiths"},{"login":"reza-armuei","count":15,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/reza-armuei"},{"login":"DerynGriffiths","count":6,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/DerynGriffiths"},{"login":"engrmahadi","count":3,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/engrmahadi"},{"login":"esteban-abellan","count":2,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/esteban-abellan"},{"login":"andrewdhicks","count":2,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/andrewdhicks"},{"login":"wuxx66","count":1,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/wuxx66"}],"active_maintainers":[{"login":"Steph-Chong","count":68,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/Steph-Chong"},{"login":"tennlee","count":63,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/tennlee"},{"login":"nicholasloveday","count":54,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/nicholasloveday"},{"login":"nikeethr","count":15,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/nikeethr"},{"login":"rob-taggart","count":15,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/rob-taggart"},{"login":"reza-armuei","count":8,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/reza-armuei"},{"login":"esteban-abellan","count":2,"url":"https://issues.ecosyste.ms/api/v1/hosts/GitHub/authors/esteban-abellan"}]},"events":{"total":{"CreateEvent":18,"ReleaseEvent":7,"IssuesEvent":144,"WatchEvent":116,"DeleteEvent":22,"MemberEvent":2,"IssueCommentEvent":568,"PushEvent":218,"PullRequestReviewEvent":647,"PullRequestReviewCommentEvent":736,"PullRequestEvent":207,"ForkEvent":21},"last_year":{"CreateEvent":17,"ReleaseEvent":7,"IssuesEvent":133,"WatchEvent":111,"DeleteEvent":20,"MemberEvent":2,"IssueCommentEvent":541,"PushEvent":208,"PullRequestReviewCommentEvent":726,"PullRequestReviewEvent":639,"PullRequestEvent":198,"ForkEvent":20}},"keywords":["climate","contingency-table","dask","forecast-evaluation","forecast-verification","forecasting","model-validation","oceanography","pandas","python","verification","weather","xarray"],"dependencies":[{"ecosystem":"conda","filepath":"environment.yml","sha":null,"kind":"manifest","created_at":"2023-10-17T06:21:39.437Z","updated_at":"2023-10-17T06:21:39.437Z","repository_link":"https://github.com/nci/scores/blob/develop/environment.yml","dependencies":[{"id":14255521884,"package_name":"pip","ecosystem":"conda","requirements":"","direct":true,"kind":"runtime","optional":false}]},{"ecosystem":"actions","filepath":".github/workflows/python-app.yml","sha":null,"kind":"manifest","created_at":"2023-09-22T10:22:24.291Z","updated_at":"2023-09-22T10:22:24.291Z","repository_link":"https://github.com/nci/scores/blob/develop/.github/workflows/python-app.yml","dependencies":[{"id":13871428261,"package_name":"actions/checkout","ecosystem":"actions","requirements":"v3","direct":true,"kind":"composite","optional":false},{"id":13871428262,"package_name":"actions/setup-python","ecosystem":"actions","requirements":"v3","direct":true,"kind":"composite","optional":false}]},{"ecosystem":"pypi","filepath":"docs/requirements.txt","sha":null,"kind":"manifest","created_at":"2023-09-22T10:22:25.218Z","updated_at":"2023-09-22T10:22:25.218Z","repository_link":"https://github.com/nci/scores/blob/develop/docs/requirements.txt","dependencies":[{"id":13871428292,"package_name":"sphinx","ecosystem":"pypi","requirements":"*","direct":true,"kind":"runtime","optional":false},{"id":13871428293,"package_name":"myst-parser","ecosystem":"pypi","requirements":"*","direct":true,"kind":"runtime","optional":false},{"id":13871428294,"package_name":"sphinx-book-theme","ecosystem":"pypi","requirements":"*","direct":true,"kind":"runtime","optional":false},{"id":13871428295,"package_name":"scores","ecosystem":"pypi","requirements":"*","direct":true,"kind":"runtime","optional":false},{"id":13871428296,"package_name":"xarray","ecosystem":"pypi","requirements":"*","direct":true,"kind":"runtime","optional":false},{"id":13871428297,"package_name":"pandas","ecosystem":"pypi","requirements":"*","direct":true,"kind":"runtime","optional":false},{"id":13871428298,"package_name":"scipy","ecosystem":"pypi","requirements":"*","direct":true,"kind":"runtime","optional":false},{"id":13871428299,"package_name":"bottleneck","ecosystem":"pypi","requirements":"*","direct":true,"kind":"runtime","optional":false}]}],"score":16.426146366959443,"created_at":"2024-06-11T00:12:27.523Z","updated_at":"2026-04-16T06:30:35.333Z","avatar_url":"https://github.com/nci.png","language":"Jupyter Notebook","category":"Climate Change","sub_category":"Earth and Climate Modeling","monthly_downloads":2028,"total_dependent_repos":2,"total_dependent_packages":0,"readme":"# scores: Verification and Evaluation for Forecasts and Models\n\n[![DOI](https://joss.theoj.org/papers/10.21105/joss.06889/status.svg)](https://doi.org/10.21105/joss.06889) [![CodeQL](https://github.com/nci/scores/actions/workflows/github-code-scanning/codeql/badge.svg)](https://github.com/nci/scores/actions/workflows/github-code-scanning/codeql) [![Coverage Status](https://coveralls.io/repos/github/nci/scores/badge.svg)](https://coveralls.io/github/nci/scores) [![Binder](https://mybinder.org/badge_logo.svg)](https://mybinder.org/v2/gh/nci/scores/main?labpath=tutorials%2FTutorial_Gallery.ipynb) [![PyPI Version](https://img.shields.io/pypi/v/scores.svg)](https://pypi.org/project/scores/) [![Conda Version](https://img.shields.io/conda/vn/conda-forge/scores.svg)](https://anaconda.org/conda-forge/scores)\n\n\u003e\n\u003e **A list of over 60 metrics, statistical techniques and data processing tools contained in `scores` is [available here](https://scores.readthedocs.io/en/stable/included.html).**\n\n`scores` is a Python package containing mathematical functions for the verification, evaluation and optimisation of forecasts, predictions or models. It supports labelled n-dimensional (multidimensional) data, which is used in many scientific fields and in machine learning. At present, `scores` primarily supports the geoscience communities; in particular, the meteorological, climatological and oceanographic communities.\n\nDocumentation: [scores.readthedocs.io](https://scores.readthedocs.io)  \nSource code: [github.com/nci/scores](https://github.com/nci/scores)  \nTutorial gallery: [available here](https://scores.readthedocs.io/en/stable/tutorials/Tutorial_Gallery.html)  \nJournal paper: [*scores: A Python package for verifying and evaluating models and predictions with xarray*](https://doi.org/10.21105/joss.06889)  \n\n**If you use `scores` for your work or a publication, [please cite](https://scores.readthedocs.io/en/stable/#acknowledging-or-citing-scores)\nour [paper](https://doi.org/10.21105/joss.06889).**\n\n## Overview\n\nBelow is a **curated selection** of the metrics, tools and statistical tests included in `scores`. [(Click here for the full list.)](https://scores.readthedocs.io/en/stable/included.html)\n\n|                       \t| **Description** \t| **Selection of Included Functions** \t|\n|-----------------------\t|-----------------\t|--------------\t|\n| **[Continuous](https://scores.readthedocs.io/en/stable/included.html#continuous)**        \t|Scores for evaluating single-valued continuous forecasts.                  \t|E.g. MAE, MSE, RMSE, Bias, Pearson's Correlation Coefficient, Kling-Gupta Efficiency, NSE, Flip-Flop Index, Quantile Loss, Quantile Interval Score, Interval Score, and threshold weighted scores for expectiles, quantiles and Huber Loss. [See all.](https://scores.readthedocs.io/en/stable/included.html#continuous)             \t|\n| **[Probability](https://scores.readthedocs.io/en/stable/included.html#probability)**        |Scores for evaluating forecasts that are expressed as predictive distributions, ensembles, and probabilities of binary events.                   |E.g. Brier Score, CRPS for CDFs and ensembles (including threshold weighted versions), and Isotonic Regression (reliability diagrams). [See all.](https://scores.readthedocs.io/en/stable/included.html#probability)               |\n| **[Categorical](https://scores.readthedocs.io/en/stable/included.html#categorical)**       \t|Scores for evaluating forecasts of categories.                \t|E.g. 18 binary contingency table (confusion matrix) metrics, the FIxed Risk Multicategorical (FIRM) Score, the SEEPS score and the Risk Matrix Score. [See all.](https://scores.readthedocs.io/en/stable/included.html#categorical)               \t|\n| **[Spatial](https://scores.readthedocs.io/en/stable/included.html#spatial)** \t|Scores that take into account spatial structure.                 \t|Fractions Skill Score. [See all.](https://scores.readthedocs.io/en/stable/included.html#spatial)              \t|\n| **[Statistical Tests](https://scores.readthedocs.io/en/stable/included.html#statistical-tests)** \t|Tools to conduct statistical tests and generate confidence intervals.                 \t|Diebold Mariano. [See all.](https://scores.readthedocs.io/en/stable/included.html#statistical-tests)             \t|\n| **[Processing Tools](https://scores.readthedocs.io/en/stable/included.html#processing-tools-for-preparing-data)**        \t|Tools to pre-process data.                 \t|E.g. Data matching, Discretisation, Block Bootstrapping, and Cumulative Density Function Manipulation. [See all.](https://scores.readthedocs.io/en/stable/included.html#processing-tools-for-preparing-data)              \t|\n| **[Plotting Data](https://scores.readthedocs.io/en/stable/included.html#plotting-data)**        \t|Tools to generate data for plotting.               \t|ROC curves, Murphy diagrams, and Q-Q plots. [See all.](https://scores.readthedocs.io/en/stable/included.html#plotting-data)             \t|\n| **[Emerging](https://scores.readthedocs.io/en/stable/included.html#emerging)**        \t|Emerging scores that are still undergoing mathematical peer review. They may change in line with the peer review process.                 \t| *Note - the Risk Matrix Score has recently been moved to 'categorical' following peer-reviewed publication*.            \t|\n\n`scores` not only includes common scores (e.g., MAE, RMSE), it also includes novel scores not commonly found elsewhere (e.g., FIRM, Flip-Flop Index), complex scores (e.g., threshold weighted CRPS), and statistical tests (e.g., the Diebold Mariano test). Additionally, it provides pre-processing tools for preparing data for scores in a variety of formats including cumulative distribution functions (CDF). `scores` provides its own implementations where relevant to avoid extensive dependencies.\n\n`scores` primarily supports xarray datatypes for Earth system data allowing it to work with NetCDF4, HDF5, Zarr and GRIB data formats among others. `scores` uses Dask for scaling and performance. Some metrics work with pandas and we aim to expand this capability.\n\nAll of the scores and metrics in this package have undergone a thorough scientific and software review. Every score has a companion Jupyter Notebook tutorial that demonstrates its use in practice.\n\n## Contributing\n\nContributions from the community are warmly welcomed. To find out more, see our [contributing guide](https://scores.readthedocs.io/en/stable/contributing.html).\n\nAll interactions in discussions, issues, emails and code (e.g., pull requests, code comments) will be managed according to the expectations outlined in the [ code of conduct ](https://github.com/nci/scores/blob/main/CODE_OF_CONDUCT.md) and in accordance with all relevant laws and obligations. This project is an inclusive, respectful and open project with high standards for respectful behaviour and language. The code of conduct is the Contributor Covenant, adopted by over 40,000 open source projects. Any concerns will be dealt with fairly and respectfully, with the processes described in the code of conduct.\n\n## Installation\n\nThe [installation guide](https://scores.readthedocs.io/en/stable/installation.html) describes four different use cases for installing, using and working with this package.\n\n**Most users currently want the *all* installation option.** This includes the mathematical functions (scores, metrics, statistical tests etc.), the tutorial dependencies and development libraries.\n\n```bash\n# From a local checkout of the Git repository\npip install -e \".[all]\"\n```\n**To install the mathematical functions ONLY** (no tutorial dependencies, no developer libraries), use the default *minimal* installation option. *minimal* is a stable version with limited dependencies. This can be installed from the [Python Package Index (PyPI)](https://pypi.org/project/scores/) or with [conda](https://anaconda.org/conda-forge/scores).\n\n```bash\n# From PyPI\npip install scores\n```\n```bash\n# From conda-forge\nconda install conda-forge::scores\n```\n(Note: at present, only the *minimal* installation option is available from conda. In time, we intend to add more installation options to conda.)\n\n## Using `scores`\n\nHere is a short example of the use of `scores`:\n\n```py\n\u003e import scores\n\u003e forecast = scores.sample_data.simple_forecast()\n\u003e observed = scores.sample_data.simple_observations()\n\u003e mean_absolute_error = scores.continuous.mae(forecast, observed)\n\u003e print(mean_absolute_error)\n\u003cxarray.DataArray ()\u003e\narray(2.)\n```\n[Jupyter Notebook tutorials](https://scores.readthedocs.io/en/stable/tutorials/Tutorial_Gallery.html) are provided for each metric and statistical test in `scores`, as well as for some of the key features of `scores` (e.g., [dimension handling](https://scores.readthedocs.io/en/stable/tutorials/Dimension_Handling.html) and [weighting results](https://scores.readthedocs.io/en/stable/tutorials/Weighting_Results.html)).\n\nTo watch a PyCon AU 2024 conference presentation about `scores` [click here](https://youtu.be/jyq2jOqtXe0?si=HYoW1cNiplbb3R0c).\n\n## Finding, Downloading and Working With Data\n\nAll metrics, statistical techniques and data processing tools in `scores` work with [xarray](https://xarray.dev). [Some metrics](https://scores.readthedocs.io/en/stable/included.html#pandas) work with [pandas](https://pandas.pydata.org/). As such, `scores` works with any data source for which xarray or pandas can be used. See the [data sources](https://scores.readthedocs.io/en/stable/data.html) page and [this tutorial](https://scores.readthedocs.io/en/stable/tutorials/First_Data_Fetching.html) for more information on finding, downloading and working with different sources of data.\n\n## Archives of `scores` on Zenodo\n\n`scores` is archived on Zenodo. [Click here](https://doi.org/10.5281/zenodo.12697241) to see the latest version on Zenodo.\n\n## Acknowledging or Citing `scores`\n\nIf you use `scores` for a published work, we would appreciate you citing our [paper](https://doi.org/10.21105/joss.06889):\n\nLeeuwenburg, T., Loveday, N., Ebert, E. E., Cook, H., Khanarmuei, M., Taggart, R. J., Ramanathan, N., Carroll, M., Chong, S., Griffiths, A., \u0026 Sharples, J. (2024). scores: A Python package for verifying and evaluating models and predictions with xarray. *Journal of Open Source Software, 9*(99), 6889. [https://doi.org/10.21105/joss.06889](https://doi.org/10.21105/joss.06889)\n\nBibTeX:\n```\n@article{Leeuwenburg_scores_A_Python_2024,\nauthor = {Leeuwenburg, Tennessee and Loveday, Nicholas and Ebert, Elizabeth E. and Cook, Harrison and Khanarmuei, Mohammadreza and Taggart, Robert J. and Ramanathan, Nikeeth and Carroll, Maree and Chong, Stephanie and Griffiths, Aidan and Sharples, John},\ndoi = {10.21105/joss.06889},\njournal = {Journal of Open Source Software},\nmonth = jul,\nnumber = {99},\npages = {6889},\ntitle = {{scores: A Python package for verifying and evaluating models and predictions with xarray}},\nurl = {https://joss.theoj.org/papers/10.21105/joss.06889},\nvolume = {9},\nyear = {2024}\n}\n```\n","funding_links":[],"readme_doi_urls":["https://doi.org/10.21105/joss.06889","https://doi.org/10.21105/joss.06889).","https://doi.org/10.5281/zenodo.12697241"],"works":{},"citation_counts":{},"total_citations":0,"keywords_from_contributors":["optimize","archiving","transforms","measur","generic","compose","animals","observation","projection","conversion"],"project_url":"https://ost.ecosyste.ms/api/v1/projects/194222","html_url":"https://ost.ecosyste.ms/projects/194222"}