A curated list of open technology projects to sustain a stable climate, energy supply, biodiversity and natural resources.

agweather-qaqc

Flexible, command-line-driven software to quality control daily weather data and then calculate reference evapotranspiration.
https://github.com/wswup/agweather-qaqc

Category: Atmosphere
Sub Category: Meteorological Observation and Forecast

Keywords

evapotranspiration python quality-assurance quality-control weather-data weather-station

Keywords from Contributors

climate

Last synced: about 20 hours ago
JSON representation

Repository metadata

Visualized QA/QC of weather station data

README.md

DOI

agweather-qaqc (Weather Data QAQC Script)

agweather-qaqc provides a flexible workflow for the visualization, review, and QAQC of daily weather data. This script is intended to be used as an early step in any analysis that might use daily sources of agricultural weather data, particularly for projects with an interest in reference evapotranspiration (ET) data, or where observational data are considered to be 'truth' when evaluating model predictions. agweather-qaqc is command-line interface driven, and provides reminders, prompts, and recommendations to assist users who may not be overly proficient with Python.

Functionalities include:

  • Importing data without having to convert it to a standardized format, with unit conversions based on a user-specified configuration file.
  • Converting multiple input formats from separate sources or networks into a single, uniform format for easier downstream analysis.
  • Visualizing data before and after processing with interactive plots, as daily time series and as mean monthly averages.
  • Filtering and removal of data, both manually and automatically, with statistics-based approaches to identify and correct issues such as sensor miscalibration.
  • Calculation of theoretical clear-sky solar radiation and Thornton-Running solar radiation.
  • Calculation of grass and alfalfa reference ET according to the American Society of Civil Engineers Standardized reference evapotranspiration equation via the RefET library.
  • Evaluating station aridity through the visualization of both relative humidity and dew point depression plots.
  • Optional gap-filling of data using station climatologies, empirical approaches (e.g. Thornton-Running solar), or random sampling.

Documentation

Github Page

Installation

  1. Clone the repository:

    git clone https://github.com/WSWUP/agweather-qaqc
    
  2. Navigate the command line/terminal into the repository root directory:

    cd path/to/agweather-qaqc
    
  3. Setting up and activating the environment can be done one of three ways:

    • Conda Environment:
      conda env create -f environment.yml
      
      conda activate agweatherqaqc
      
    • Pipenv Environment:
      pipenv install -r requirements.txt
      
      pipenv shell
      
    • PDM Environment:
      pdm install
      
      pdm shell
      
  4. Run the script via the file qaqc_single_station.py

    python qaqc_single_station.py <OPTIONAL ARGUMENTS>
    

See the documentation for more information.

Citation (CITATION.cff)

cff-version: "1.2.0"
authors:
- family-names: Dunkerly
  given-names: Christian
  orcid: "https://orcid.org/0000-0003-3592-4118"
- family-names: Huntington
  given-names: Justin L.
  orcid: "https://orcid.org/0009-0008-2006-2969"
- family-names: McEvoy
  given-names: Daniel
  orcid: "https://orcid.org/0000-0003-3800-718X"
- family-names: Morway
  given-names: Asa
- family-names: Allen
  given-names: Richard G.
contact:
- family-names: Dunkerly
  given-names: Christian
  orcid: "https://orcid.org/0000-0003-3592-4118"
doi: 10.5281/zenodo.11122799
message: If you use this software, please cite our article in the
  Journal of Open Source Software.
preferred-citation:
  authors:
  - family-names: Dunkerly
    given-names: Christian
    orcid: "https://orcid.org/0000-0003-3592-4118"
  - family-names: Huntington
    given-names: Justin L.
    orcid: "https://orcid.org/0009-0008-2006-2969"
  - family-names: McEvoy
    given-names: Daniel
    orcid: "https://orcid.org/0000-0003-3800-718X"
  - family-names: Morway
    given-names: Asa
  - family-names: Allen
    given-names: Richard G.
  date-published: 2024-05-24
  doi: 10.21105/joss.06368
  issn: 2475-9066
  issue: 97
  journal: Journal of Open Source Software
  publisher:
    name: Open Journals
  start: 6368
  title: "agweather-qaqc: An Interactive Python Package for Quality
    Assurance and Quality Control of Daily Agricultural Weather Data and
    Calculation of Reference Evapotranspiration"
  type: article
  url: "https://joss.theoj.org/papers/10.21105/joss.06368"
  volume: 9
title: "agweather-qaqc: An Interactive Python Package for Quality
  Assurance and Quality Control of Daily Agricultural Weather Data and
  Calculation of Reference Evapotranspiration"

Owner metadata


GitHub Events

Total
Last Year

Committers metadata

Last synced: 6 days ago

Total Commits: 152
Total Committers: 7
Avg Commits per committer: 21.714
Development Distribution Score (DDS): 0.434

Commits in past year: 20
Committers in past year: 1
Avg Commits per committer in past year: 20.0
Development Distribution Score (DDS) in past year: 0.0

Name Email Commits
Christian Dunkerly 2****y 86
Christian Dunkerly c****y@d****u 28
Christian Dunkerly c****y@g****m 27
Christian Dunkerly c****n@c****m 7
David LeBauer d****r@g****m 2
amorway a****y@g****m 1
Moritz Makowski m****z@d****v 1

Committer domains:


Issue and Pull Request metadata

Last synced: 2 days ago

Total issues: 20
Total pull requests: 5
Average time to close issues: 29 days
Average time to close pull requests: 10 days
Total issue authors: 5
Total pull request authors: 2
Average comments per issue: 2.0
Average comments per pull request: 0.0
Merged pull request: 5
Bot issues: 0
Bot pull requests: 0

Past year issues: 3
Past year pull requests: 0
Past year average time to close issues: about 1 month
Past year average time to close pull requests: N/A
Past year issue authors: 2
Past year pull request authors: 0
Past year average comments per issue: 1.0
Past year average comments per pull request: 0
Past year merged pull request: 0
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/wswup/agweather-qaqc

Top Issue Authors

  • dostuffthatmatters (7)
  • dlebauer (6)
  • cwdunkerly (4)
  • mikesasaki (2)
  • Gagarle (1)

Top Pull Request Authors

  • dlebauer (4)
  • dostuffthatmatters (1)

Top Issue Labels

  • enhancement (8)

Top Pull Request Labels


Dependencies

requirements.txt pypi
  • bokeh *
  • configparser *
  • datetime *
  • numpy *
  • openpyxl *
  • pandas *
  • pytest *
  • refet *
  • xlrd *

Score: 5.241747015059643