Recent Releases of GWHAT

GWHAT - GWHAT 0.5.2

Changelog

PR #427: Update h5py from 2.10.* to >=3
PR #428: Fix overwriting water level and weather datasets
PR #431: Fix evaluating recharge with old MRC data (gwhat <= 0.5.0)

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin over 2 years ago

GWHAT - GWHAT 0.5.1

Changelog

PR #349: Improve color management in GWHAT
PR #350: Remove the use of custom DialogWindow class
PR #352: pin pandas, numpy and h5py version
PR #351: Improve xticks and xtick labels plotting in hydrographs
PR #353: Improve grid appearance in hydrograph plots
PR #354: Drop Travis CI
PR #355: Fix save/get savedir in configs
PR #356: Pin xlrd to the 1.* serie
PR #359: Fix saving MRC data in project file (Fixed #358)
PR #360: Fix a bug when displaying monthly average budget in the recharge tool
PR #361: Auto adjust ground-water recharge plots margins
PR #362: Move mplFigViewer to the widgets module
PR #363: Package Gwhat with pyinstaller 4.2 from 3.6
PR #364: Fix some issues with ground-water recharge results plotting
PR #365: Prevent project corruption when setting last opened wldset and wxdset
PR #366: Reduce the size of the icons and rework toolbar's layout.
PR #367: Change how GLUE data are accessed
PR #369: Prevent bug if mrc fails to compute
PR #370: Complete rework of the tool to select recession periods for MRC calculation and a lot of code cleaning.
PR #371: Fix an issue when evaluating recharge if the observed water levels start with a nan value
PR #372: Add create_qapplication to qthelpers
PR #373: Add copy clipboard to gwrecharge plots
PR #374: don't add missing meteo data marker to legend if no missing data
PR #375: Improvement to the groundwater recharge tool GUI and documentation
PR #376: Add a RMSE cutoff criteria option in the groundwater recharge estimation tool
PR #321: Update README.md
PR #377: Correctly convert mrc periods from time indexes to xls dates
PR #378: Add a tool to put a copy of the hydrograph figure on the clipboard
PR #379: upgrade numpy and pyqt versions
PR #382: Add a dialog to report internal errors
PR #383: Save and fetch buttons state of the "Analyze hydrograph" tool in/from used configs
PR #384: Add copy to clipboard functionality in the "Analyze Hydrograph" toolbar
PR #387: remove dead code in HydroCalc2.py
PR #389: Fix error when estimating recharge with non-daily water level data that are older than the weather data
PR #388: Add "pt" suffixe to text sizes boxes in the groundwater recharge plots
PR #395: Fix CI setup
PR #397: Some improvements to the yearly recharge graph
PR #398: Fix export master recession curve results
PR #399: Use scipy.optimize.curve_fit to calculate the MRC and evaluate the uncertainty on the coefficients
PR #396: Upgrade numpy to 1.21.* and pandas to 1.3.*
PR #400: Add goodness-of-fit stats to MRC exported file and show MRC summary results on startup.
PR #401: Fix yearly average buget calculation
PR #402: Use mdi icons instead of custom icons in the MRC tool and improve the tooltips of the buttons.
PR #404: Rename WLDataFrame to WLDataset and WLDataset to WLDataFrame
PR #405: Make reading water level input files more robust
PR #403: Refactor hydrocalc and define a clear API for the tools (BRF, MRC, Recharge)
PR #406: Migrate code to calculate the MRC to the new calc tool api
PR #407: Update matplotlib from 3.1.* to 3.4.*
PR #408: Use a https link instead of a http link to download the KGS_BRF tool
PR #410: Rework how the Splash screen is initialized in GWHAT
PR #409: Make GWHAT message console an independent dialog window
PR #413: Remove "mrc2rechg" function and method from the base code
PR #418: Update pyinstaller version from 4.2 to 4.9
PR #419: update well name when importing a water level
PR #420: Improve suggested dataset name when importing water level and weather data
PR #423: Fix compute MRC when no recession period is selected
PR #424: Fix linear MRC calculation
PR #425: Update About GWHAT dialog content and improve the layout

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin almost 3 years ago

GWHAT - GWHAT 0.5.0

Changelog

PR #316: Save BRF graphs language in user configs
PR #319: Allow importing multiple water level and weather datasets from input data files
PR #320: Get and set BRF parameters using the user config system
PR #322: Fix hide/show BRF errorbars (Fixed #317)
PR #323: Set/Get from the user configs the visibility status of the BRF results viewer options panel
PR #324: Use user configs to set main window state and geometry
PR #325: Improvements to the BRF tool gui
PR #326: Rework GWHAT Plot and Analyze widget layout
PR #327: Remember the mainwindow and analyze tool configuration when restarting
PR #328: Add an option to link barometric pressure and earth tide lag values
PR #331: improve BRF plots (add parameters value used in the calculations)
PR #330: Add an option to imports the parameters used to compute the BRF currently shown in the viewer into the manager.
PR #334: Improvements to the BRF viewer gui
PR #335: Remove the needs for the StyleDB class
PR #336: Cleanup layout setup
PR #337: Improve the setup of the right panel width
PR #339: Improve read weather datafiles and fix reading file with no missing data (Fixed #338)
PR #341: Fix monthly and yearly PET calculations from daily values (Fixed #340)
PR #344: Improve weather normals graph (Fixed #343 and #342)
PR #345: Add copy to clipboard functionality for the weather normals viewer
PR #346: Remember language in weather normals viewer
PR #347: Add visual cue when selecting BRF period

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin over 4 years ago

GWHAT - GWHAT 0.4.2

Changelog

PR #305: Prevent key error when saving old recharge results to file
PR #306: Change bug report message and add a button to report issues
PR #308: Pin matplotlib and pyqt versions
PR #307: Improve project manager widget
PR #309: Expand tests for the project selector
PR #310: Add the possibility to save the models likelyhood measures that are used to compute groundwater recharge and water levels with GLUE
PR #312: Fix legend colors in water budget graphs.
PR #314: Fix packaging issues with PyInstaller
PR #315: Remove scipy dependencies

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin over 4 years ago

GWHAT - GWHAT 0.4.1

WHAT_banner_750px

OpenPGP key used to sign releases : 3DF2B35596EF4FB4B41AB3B5C73AE16957B7100D

New Features

  • PR #303: Add xls and xlsx option to import weather data

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin over 5 years ago

GWHAT - GWHAT 0.4.0

WHAT_banner_750px

OpenPGP key used to sign releases : 3DF2B35596EF4FB4B41AB3B5C73AE16957B7100D

New Features

PR #255 : Add a tool to select the water level data with the mouse
PR #259 : Add an option to delete selected water level data
PR #261 : Add a feature to make backup of the project file
PR #266 : Add a tool to best-fit the water level data along the x and y axis.
PR #270 : Add an undo feature when making changes to the water level data
PR #274 : Add a tool to copy BRF plot results to clipboard
PR #286 : Save Earth Tides Response Function
PR #287 : Add an option to export BRF results to a csv or Excel file.
PR #294: Add a user config system to GWHAT
PR #298: Add support for input weather data files in xls and xlsx formats

Removed Features

PR #293: Remove the tools to download and gapfill weather data
PR #299: Remove functions and tests to read CWEEDS files

Enhancements

PR #256 : Improve the rectangular selection tool icons
PR #257 : Change the icon of the tool to delete data in the water level and weather dataset manager.
PR #260 : Send message to console when deleting a dataset
PR #258 : Add an option to mute the confirmation dialog when deleting a dataset
PR #262 : Add the possibility to quickly check/uncheck the Earth tides correction option in the BRF tool
PR #264 : Improvements to the tool to select a period for the calculation of the BRF
PR #267 : Remember which water level and weather datasets were last opened when opening a new project
PR #271 : Improve toolbutton tooltips
PR #276 : Store water levels in a Pandas DataFrame and index time with datetime instead of Excel numerical date
PR #277 : Make accessing water level and weather data more efficient.
PR #283 : Improve wldsets and wxdsets dropdown menu response in the data manager.
PR #292: Avoid closing GWHAT whenever an error occurs.
PR #297: Use Pandas to store and manipulate weather data.

Bug fixes

PR #268 : Fix compute BRF if nan are present in the water level dataset
PR #275 : Make the button to delete peaks in the MRC tool working again
PR #279 : Force a redrawing of the water levels when clearing the selections.
PR #280 : Prevent GWHAT from crashing when trying to set weather data to the closest station from the well if no weather data are available.
PR #281 : Prevent crash when plotting BRF results in BRFFigure if ymin and ymax are inf.
PR #284 : Set wldset and wxdset to None when project change to avoid a crash.
PR #285 : Force a redraw of the hydrograph if wxdset is None after setting the wxdset to that of the closest station from the well.
PR #288 : Ensure backward compatibility with previously saved BRF results.
PR #290 : Fix saving project location when project is saved on another drive than that where GWHAT is installed
PR #292: Avoid closing GWHAT whenever an error occurs
PR #301: Fix exporting GLUE results to file

Maintenance

PR #250 : Fix tests for 2019 and make all test modules independent
PR #249 : Improvements to setup, build_ext and packaging with PyInstaller
PR #251 : Fix missing hidden imports for PyInstaller packaging
PR #252 : Fix numpy.linalg.lstsq warning about new default for rcond parameter
PR #253 : Add Cython compilation directive to pyx for language_level=3
PR #263 : Install req for packaging GWHAT in 'after_tests' step on AppVeyor
PR #273 : Rename "close_projet" methot of the "ProjetReader" class to "close"
PR #278 : Use a more efficient method to calculate horizontal distance and remove code duplication.
PR #282 : Remove logging of errors in GWHAT.
PR #291 : Fix matplotlib imports for version 3.1 and numpy load function

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin over 5 years ago

GWHAT - GWHAT 0.3.4

what_banner_750px

OpenPGP key used to sign releases : 3DF2B35596EF4FB4B41AB3B5C73AE16957B7100D

New Features

PR #237 : Add the water level value to the interactive graph.
PR #241 : Add the option to delete all BRF results at once for a given dataset.

Enhancements

PR #240 : Improve how the BRF period is set and plotted

Maintenance and documentation

PR #238 : Move icons module to utils and add support for QtAwesome
PR #242 : Package GWHAT on appveyor
PR #245 : Break some inter-dependences of tests across modules
PR #246 : Fix H5pyDeprecationWarning: dataset.value has been deprecated

Bug Fixed

Issue #204 : Select BRF period bug.
Issue #239 : The BRF period is reset when changing the water level dataset
Issue #243 : GWHAT.exe crash on startup (Fixed by PR#244)

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin over 6 years ago

GWHAT - GWHAT 0.3.3

what_banner_750px

OpenPGP key used to sign releases : 3DF2B35596EF4FB4B41AB3B5C73AE16957B7100D

New Features

PR #230 : Add the option to show or hide the water level measured manually in the well in the tool to visualize the water levels.
PR #223 : Add the option to show or hide the MRC in the tool to visualize the water levels.
PR #225 : Plot the recession in the hydrograph editor
PR #228 : Add an option to add a frame around the figure and control its thickness.

Enhancements

PR #219 : Use text instead of icons to label the tabs of the tab widget in which the tools to analyse the hydrograph are displayed and add tooltips.
PR #220 : Move normal weather toolbutton from the hydrograph editor toolbar to the weather data manager toolbar.
PR #224 : Add a toolbutton to change language in the Weather Normals tool and normalize how language is changed across the app.
PR #227 : Make hydrocalc more robust when the project or the water level dataset or the weather dataset is None.

Maintenance and documentation

PR #221 : Refactor the code to save the MRC results to file.
PR #222 : Remove unused code in common module.
PR #235 : Fix DeprecationWarning: invalid escape sequence

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin over 6 years ago

GWHAT - GWHAT 0.3.2

what_banner_750px

New Features

PR #200 : Improve the panning of the water level visualization tool and add a tool to zoom to rectangle.
PR #201 : Add the option to hide or show meteo data in the "Plot Hydrograph" tool
PR #202 : Plot GLUE water levels with the hydrograph editor
PR #205 : Add the possibility to show or hide GLUE water level results in the tool to visualize water level data.
PR #207 : Add the option to hide or show the weather data in the tool to visualize the water levels dynamically and improve the look of the plot.

Enhancements

PR #206 : Plot GLUE results only when needed and allow the window where the figures are displayed to be maximized.
PR #203 : Correct the calculation of GLUE by correcting the definition of the likelihood function.
PR #193 : Improve the handling of errors when importing a dataset and the data file is not formatted correctly.
PR #195 : Prevent the use of some special characters in the dataset names.
PR #208 : Show an error when importing a water level dataset and the data are not monotically increasing in time.

Maintenance and documentation

PR #194 : Refactor the update manager to lower the fail rates on the CI servers.
PR #210 : Refactoring of the tool to export weather dataset to a file.
DOC #217: Update the documentation for version 0.3.2

Bug Fixes

Issue #191 : GWHAT crash when importing a water level datafile with the wrong format
Issue #192 : GWHAT crash when importing a weather dataset if the dataset name have a "/" or "" in its name
Issue #199 : Remember "Time Scale" and "Weather Resampling" values when saving the hydrograph layout
Issue #130 : Crash when computing the BRF
Issue #209 : The export of daily weather data time series fails if nan.

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin almost 7 years ago

GWHAT - GWHAT 0.3.1

what_banner_750px

New Features

PR #184 : Save GLUE results to project HDF file.
PR #187 : Add graphs of average yearly and monthly water budget.
PR #188 : Add the capability to export recharge results to csv.

Bug Fixes

Issue #185 : GWHAT crash when clicking on a figure option if there is no figure already plotted.

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin about 7 years ago

GWHAT - GWHAT 0.3.0

what_banner_750px

New Features

PR #178 : Create a manager where all the results of the ground-water recharge evaluation will be plotted.
PR #181 : Add various improvements to the FigureStackManager and add a new figure that shows the yearly water budget.

TechDebt, Continuous Integration, and Maintenance

PR #175 : Refactoring of the plot_gamma_dist function in gapfill_weather_postprocess
PR #176 : Make GWHAT compatible with matplotlib>= 2.1

Bug Fixes

Issue #174 : About GWHAT button is not clickable with PyQt 5.6
Issue #177 : GWHAT crash when trying to save the hydrograph if there is no hydrograph already plotted. (Fixed by PR #179)
Issue #154 : Saving the weather station to file makes GWHAT crash (Fixed by PR #180)

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin about 7 years ago

GWHAT - GWHAT 0.2.5

what_banner_750px

New Features

PR #160 : Added an export weather data button in the data manager panel.
PR #161 : Read CWEEDS file (mainly for hourly global solar radiation)

TechDebt and Continuous Integration

PR #157 : Refactoring of the WXDataFrame and WXDataFrameHDF5 classes

Bug Fixes

Issue #162 : GWHAT crash when opening a project alone (that is not in a standard project folder)
Issue #153 : GWHAT crash when computing recharge and no behavioural model are found
Issue #167 : GWHAT crash when estimating recharge if deltaT is not zero
Issue #165 : GWHAT crash when the water level time series run outside the limits of the weather data time series
Issue #163 : GWHAT crash when trying to evaluate recharge before the MRC have been evaluated
Issue #171 : GWHAT crash when evaluating the BRF and there is no Patm in the wl dataset

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin about 7 years ago

GWHAT - GWHAT 0.2.4

what_banner_750px

Enhancements

PR #158 : Add more options to setup the x and y axis of the BRF graph.

Bug Fixes

PR #151 : Enable the saving of the brf figure from the GUI and add an option to change the language of the labels of the graph.
Issue #155 : The station browser layout does not look good when the window is maximized.

TechDebt and Continuous Integration

PR #156 : Add tests for the SmartSpinBox and RangeSpinBoxes

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin over 7 years ago

GWHAT - GWHAT 0.2.3

what_banner_750px

New Features

  • PR #142 : Added a year range option to the weather normals viewer.

Enhancements

  • PR #140 : Refactored the MainWindow startup routine so that GWHAT starts faster.

Bug Fixes

  • Issue #54 : Error messages when last gwhat project does not exist on GWHAT startup.
  • PR #141: Added proper support for saving in the xls (Excel 97/2000/XP/2003) format
  • Issue #144 : Min. Max Temperatures are inverted in the WeatherNormalsViewer in French.
  • PR #145: Fix a crash when weather stations have very long names.

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin over 7 years ago

GWHAT - GWHAT 0.2.2

what_banner_750px

Enhancements

PR #138: Made the initialization of the climate station browser more robust and efficient.

TechDebt and Continuous Integration

PR #132 : Refactored and added tests for the brf module
PR #134: Extended the tests for the HydroPrint module
PR #135: Added Codecov for test coverage on AppVeyor for Windows

Documentation

PR #104: Wrote the documentation for the "Plotting the hydrographs" and "Data management" sections

Bug Fixes

PR #136: Clear the hydrograph figure when either the water level or weather dataset becomes None.
PR #137: Add and test label language to hydrograph layout
Issue #133: GWHAT crashes and fails to open afterwards if it failed to fetch the climate station database the first time it is started.

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin over 7 years ago

GWHAT - GWHAT 0.2.1

what_banner_750px

New Features:

PR #123: Added a tool to check if updates are available for GWHAT.

Enhancements:

PR #122 : Reduced the duration of the AppVeyor tests and improved the performance of the gapfilling tool.
PR #124 : Added csv support for input water level datafiles and extended the header infos.
PR #125 : Refactoring of the tool to import water level and daily weather datasets.

Bug Fixes:

Issue #127 : In the weather_normals.pdf figure, the legend and y-axis labels stays in English when the Figure labels language is French.
Issue #128 : Incorrect proximity distance shown in Weather Stations Browser.

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin over 7 years ago

GWHAT - GWHAT 0.2.0

what_banner_750px

Distribution:

Commit https://github.com/jnsebgosselin/gwhat/commit/46d9f0a8d734d42d0a373d8f494b6ab5e45a389d : The copyright notice of all source files of the GWHAT project were changed, so that the copyright is now held by the GWHAT Project Contributors.

New Features:

PR #117: Added a tool to install KGS_BRF software automatically.
PR #115: Added an option in the gapfill weather tool to select the language and file type of the figures.

Enhancements:

PR #118: Refactoring of the icons module to reduce startup time.
PR #119: Major improvements of the tool to evaluate groundwater recharge.
PR #120: Update the "About GWHAT" window and reduce startup time.

Bug Fixes:

PR #116: Fixed the tool to select the brf period on the graph in the Analyse Hydrograph tab.
Issue #72: Matplotlib error when opening WHAT

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin over 7 years ago

GWHAT - GWHAT 0.1.0

what_banner_750px

As explained in Issue #75, a software for stream hydrograph analysis already existed with the name WHAT. To avoid confusion, we decided to rename our software to GWHAT. At the same time, it was decided to reset the version numbering of the software.

Distribution:

PR #79 : WHAT renamed to GWHAT

Documentation:

PR #86 : Ported and updated the documentation from Latex to Sphinx and published it on ReadTheDocs

Enhancements:

PR #83 : Added buttons to set "From Year" and "To Year" for all stations in the tool to download weather data.
PR #84 : Added support for coma separated text files for weather datafiles.
PR #96 : Added a button to delete input weather datafiles from the interface.
PR #82 : Improved the tool to search for climate stations in the ECCC database.
PR #104 : Small GUI improvements of the Page and Figure Setup Dialog window.

Bug Fixes:

Issue #92 : Fixed a bug that made GWHAT crash when changing the color scheme in Plot Hydrograph tab.
Issue #95 : Fixed a bug that made GWHAT crash when plotting results of groundwater recharge.
Issue #102 : GWHAT crash when trying to save the monthly weather average graph to disk.
Issue #40 : Adding ETP to file in the Gap-Fill Weather window crash the application.
PR #108 : Fix water_level_measurements file management and plotting
PR #109 : Fixed and improved the code to compute the water level trend line

Continuous Integration:

PR #101 : Added tests for gapfill_weather_gui.py, gapfill_weather_algorithm2.py, and manager_data.py
PR #107 : Fixed crash when trying to add PET to an existing file and added some tests.

More than 45% of the source code is now covered by tests.

TechDebt:

PR #100 : Changed project file extension to .gwt from .what

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin over 7 years ago

GWHAT - WHAT 4.2.0

TechDebt

  • Added continuous integration with Travis and AppVeyor
  • Made "StationFinder" usable outside of WHAT.
  • PR #28 : Moved from PySide to PyQt5.
  • PR #34 : Added tests for search weather data.
  • PR #42 : Added tests to assert the creation and loading of projects.
  • PR #43 : Added tests to assert the downloading of weather data.
  • PR #50 : Made the code that is used to read and concatenate raw weather datafiles usable outside of WHAT.
  • PR #62 : Made the code to read, write and manipulate weather station list usable outside of WHAT.

Bug Fixes:

  • Fixed a bug that prevented the button home to work properly when date format was in Excel Numeric.
  • PR #26 : Fixed a bug that caused WHAT to crash when weather series were not of equal length in "Gap-Fill Weather".
  • Fixed a bug that prevented the peak and MRC to be cleared when loading a new water level dataset with no previous MRC calculation done in "Analyze Hydrograph".
  • Fixed a bug that prevented the Home button to update correctly when switching water level dataset in "Analyze Hydrograph".
  • PR #29 : Improved the algorithm to search for weather station on the ECCC website.
  • PR #37 : Fix unresponsive UI when gapfilling data.
  • PR #58 : Make about what icon visible again.

GUI

  • The UI for plotting publication quality graph and the UI to analyze water level time series is now completely independent and located in distinct tabs in WHAT.
  • Revamp of the BRF module :
    • A new window to show current and previous BRF results
    • The BRFresults are now saved in project database
  • Added buttons to zoom in/out in toolbar of "Plot Hydrograph".
  • Made Pan/Zoom more intuitive in "Analyze Hydrograph": the buttons to activate/deactivate pan/zoom were completely removed. Instead, the pan/zoom mode is automatically activated when clicking on the graph and
    holding either the left or right mouse button. When the mode to add or delete peak for the MRC or to select a region for the BRF is activated, the pan/zoom option is not activated. This removed a lot of mouse clicking, while preserving the intended workflow.
  • Improved Search for Weather Station functionality:
    • Search for station is now run within its own thread and does not make the GUI hang anymore.
    • Added the capability in the thread to stop the search for weather stations.
    • A button has been added to the GUI which allows to save the results of the search either in xlsx, xls, or csv format.
    • PR #33 : Improved performance for refreshing table in the weather station finder.
    • PR #62 : Added a progress bar waitspinner when searching for weather stations.
    • PR #67 : Added Latitude, Longitude, and Elevation info to the weather station list.
    • PR #70: Added a method to format the content of a WeatherSationList into a HTML table
  • PR #32 : Added support for coma and tab separated value for the weather station list.

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin over 7 years ago

GWHAT -

New Features

  • Added an "export weather data"feature : from the "Weather normals" window, it is now possible to export weather dataset on a daily, monthly or yearly time frame in xlsx, xls or csv format. It is also possible to directly save the weather normals table to file in xlsx, xls or csv format.
  • Added a splash screen

UI Enhancement

  • A default name is proposed when loading a new dataset.
  • Added an OK button to close popup "About" window.
  • Removed all depencies to .wif file to store MRC infos
  • Reorganised the buttons of the hydrocalc toolbar
  • Widget altitude range set to -9999 to 9999 instead of 0 to 99
  • Increased maximum value of BP and ET lag widget to 9999

Bug Fix

  • Made estimation of recharge compatible with new project format
  • Fix a bug in gap-fill algorithm
  • non-ASCII in path when creating new project

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin almost 8 years ago

GWHAT - GW recharge, BRF and new project management interface

New features:

  • Added BRF calculation in WHAT
  • Allows xlsx water level datafiles (in addition to xls) to be loaded in WHAT
  • Project info are now saved in a database using the HDF5 format instead of a text file. Water level and weather datasets can now be imported in the project. Since data are not loaded from the source file anymore, this greatly improves the performance of the system. Moreover, it makes the saving of results easier.
  • Added GW recharge estimation in the GUI

GUI improvements:

  • Added mouse x coordinate at the bottom of the graph in computation mode
  • Removed About Tab and added an icon instead

Bug fixes and performance improvements:

  • Python 3.4 compatibility bug fixes
  • Important improvement of the plotting of the vertical guide for adding peak to the hydrograph.
  • Removed useless/annoying warning messages
  • Made the loading of weather data file faster in gapfillgui
  • Fixed a bug that made the calculation of the MRC fails when there was missing data in the water level time series.
  • Code was cleaned and repo was restructured
  • Solved a bug when space in Windows path
  • It is now possible to set whether data are removed from the dataset or not in the cross validation procedure. If not, the MLR model is not redefined each day and the memory buffer is used instead, which allow to greatly speed up the process.
  • water level measurement was not read when there was only one data in the waterlvl_manual_measurements.xls file
  • Solved clipping issue in EMF format for weather average
  • Added info about MRC units in the equation
  • Removed a lot of dependancies to pyplot
  • Added nan support for the calcul of ETP

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin almost 8 years ago

GWHAT - Environment Canada Update

Updated the software for compatibility to the new update of the Government of Canada website.

Weather Averages Graph Corrections and Improvements:

  • Corrected the ylabel for temperature in monthly averages graph ("Monthly Mean Air Temperature (°C)" for "Monthly Air Temperature (°C)").
  • The color scheme is now updated if it is changed in the color menu for the hydrograph in the weather averages graph.
  • Updated the sample image for weather averages.
  • Linked label language changes in HydroPrint to Weather Average graph labels.

Hydrograph Improvements

  • Weather re-sampling scale, date mode for x axis labels, Date labels display frequency, and label language are now saved when saving the layout of the graph.
  • Vertical padding between xlabels and axis is now done in absolute units.
  • Reduced bottom margin
  • Split axes for air temperature from water level. Allows to have an independent horizontal grid for temperature. This is going to make easier changing Air temperature grid scale and also to hide temperature from graph to only plot water levels.
  • Changed weather scale Max value from 50 to 100 mm.
  • Added the option to change the height of the graph in the UI.
  • Added the option in the UI to change the vertical height ratio between the top and bottom axes.
  • Number of grid interval option for the lower graph can now be changed from the UI. The option has been added to the water level scale panel. This layout parameter is also now saved in the graph layout file.
  • yticks for precipitation are now set dynamically to encompass the max value for total precipitation.
  • Added the option in the UI to change the display pattern of the date ticks label
  • Added more digits for lat/long for the weather station in data panel.

Recharge Estimation (Not yet available in the UI)

  • Finished implementing GLUE for recharge estimation
  • Effort in progress to plot synth. hydrograph in HydroCalc.

Bugs

  • Corrected WHAT banner logo
  • Corrected the code to plot only water levels without the weather.
  • Correction of gridlines when meteo is not plotted in hydrograph.
  • Solved a bug where water level and precipitation scale in the UI corresponded to half the scale on the graph.
  • Corrected Title positioning on the hydrograph to have a fixed point offset.
  • Corrected grid order to be below plots
  • Corrected a Bug with yticks labels placement in Hydrograph due to an error when setting grid to False on some axes.

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin almost 9 years ago

GWHAT - Bug Fix: water level datum

Bug Fix:

  • Changing the datum was not working properly due to changes made in the code v4.1.10 onward.

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin over 9 years ago

GWHAT - Interface for Color Palette Management

New Features:

  • Added an interface to manage the color of the artists in the Hydrographs.

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin over 9 years ago

GWHAT - Hydrograph Plotting Improvements

New Features:

  • Reworked the way the graph title was displayed and worked. Now, it contains the name of the well and of the weather station and is displayed at the top left corner of the graph. It is possible to enable or disable the legend and title in the graph from the page setup menu.
  • Added the legend to the hydrograph in the top right corner.
  • Added the option to activate the trend on the water level. A moving average is then done on the water level. The trend is shown as a continuous line, while each data points is shown in light blue.
  • Added a color class to manage the colors in the module hydrograph. Colors are now saved and loaded in a file named colors.db. It is then possible for the users to change the colors for the graph.

Bux Fixes:

  • Corrected an error in the ylabel for Precipitations in french.

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin over 9 years ago

GWHAT - Bugs Fix, UI enhancements, Groundwater Recharge Estimation

Here are some of the things that were added/fixed/changed since the last release:

New Features:

  • Completed the code to estimate automatically GW recharge from meteo and water level data.
  • Revamp of the “plot_monthly_normals” figure. Instead of plotting only the montlhly mean daily temperature and it's standard deviation for each months, it now compute the normals for min, max, and mean daily temperature and plot the three lines in the graph.
  • Added a checkbox under the menu “Advanced options” that when checked, will automatically add the estimated ETP to “.out” files when gapfilling weather data.
  • Added the possibility to put the timescale in years instead of months in the hydrographs.
  • The width of the hydrograph page can now be setup by the user.
  • Missing weather markers are now plotted on a day by day basis on the hydrographs, instead of have a marker per bin. Missing data are now represented with a line instead of a round marker. Thide new way of plotting show better when there is a lot of missing value for a period because it is then traced with a continuous red line.
  • Added the option in the Hydroprint to select the resampling window of weather data: day, week, month, and year.
  • Production of graphs for the cross-validation analysis is done automatically
  • A Weather Normals graph is automatically produced and saved at the end of the gapfilling procedure.
  • Added the option to display the time in date format. It's possible to switch back and forth between both display option (date or Excel numeric format), but this has not been linked to the UI yet.
  • Implemented the code to export weather normal in a csv.
  • Added the option to show the weather normals in a table in the Weather Normals subwindow.

Performance Improvements:

  • In the hydrographs, horizontal grid is now following the ticks. There is no grid at midle-length between the vertical ticks anymore.
  • Now, the xticks label are aligned automatically to the ticks. Before, the alignment was hardcoded to a fixed scaling number whose value was determined visually. This means that, if the font of the labels, or the size of the figure, or the margins sizes change, the labels will remains algined correctly.
  • Removed the multiple axes frames that were added for each figure. Now, there should only be one and only one frame for the entire figure.
  • Made the Hydroprint module compliant with Python-3
  • Huge improvement on the quality of the rendering of the image on-screen: instead of letting the QPainter do the rescaling, the QPixmap is prescaled with the 'scaledToWidth' method and store in memory, so the scaling is only done 1 time per view. The memory is cleared if a new image is loaded in the viewer.
  • Made the UI more responsive for the plotting of the hydrographs.
  • separated the gui from the algorithm for filling the gaps in the data. The code is now in two completely separated modules named gapfill_weather_algorithm and gapfill_weather_gui.
  • Cross-Validation procedure is now done only between the specified date instead of for the entire time-series.
  • In gapfill_weather_postprocess, rasterized the scatter plot because it was way to heavy to render in pdf.
  • In module hydrograph, change the way saving and loading layout is done. It is now a for loop over a list instead of using a numpy array.

UI and output improvements:

  • Improved the summary table look of concatenated raw data file
  • Moved the checkbox “Automatically save concatenated data” to the side-panel and renamed it "Automatically save formatted data".
  • In window "New Peoject", changed the 'W'and 'N' for 'West' and 'North'
  • Improved the display of the current html tables across the entire application.
  • Improved the display of weather station information in the “Hydrograph” tab when loading a new weather data file.
  • Now a warning is issued in the console window when the waterlvl datafile is not formatted correctly.
  • Now print the time elapsed during the gap-filling procedure.
  • Better formatting of the info in the “err” file. Added Information also and the original data.
  • Better formating of the data in “.out” file. Removed trailing zeros in the data and also formatted the date format as int instead of float.
  • Added info regarding the data used for the estimation of the data in the .err file.
  • In meteo/Output, output files and figure are now saved in a subfolder named after the name of the weather station instead of directly in the Output folder.
  • When a missing data is not estimated because all neighboring station are empty, RMSE is now nan instead of 0.
  • Added info regarding the RMSE of the MLR model and the number of data used to the .err file.

Bug Fixes:

  • The “Search for station” and "Weather Averages" windows now appear in the center of the WHAT window instead of the corner of the screen.
  • More robust way to load data from the “.out” files in “MeteoObj” based on condition instead of fixed position.
  • Solved a bug where the cleaning of ends of dataset in class “MeteoObj” was not done properly.
  • In “Hydrograph” tab, units in table for “Weather Data File” was not displaying correctly.
  • Progress Bar is now reseted correctly.
  • Solved an error that occurred when a search for weather station on the CDCD returned no station.
  • Soved a bug that prevented the .log file to be written when there was absolutely 0 missing data. Division by 0 issue.
  • In MRC calc, now the process is correctly handled if there is an error in the Min/Max sequence.
  • Solved a bug that prevented the weather data file to be loaded properly when a new projet was selected.
  • Corrected a bug that made the output folder incorrect when there was a “/” or “\” character in the target station name for the downloading of weather data and the gapfilling.
  • Corrected a bug where French labels in hydrograph were not displayed correctly due to a missing unicode decoration to a string. This was causing the application to crash in Windows.
  • Corrected a bug in the plotting of the histogram for the PDF of the precipitation.
  • Solved a bug that placed the yticks labels wrong when a new weather normals graph was generated after selecting a new weather data file (the first time it was generated was ok).
  • There was a bug everytime a project was loaded when the meteo Input folder was empty. The problem was that no weather_datasets_summary.log was created when the folder was empty, but the program still needed to read the file later on in the code. An empty file is now created when no weather data files are found instead.
  • There was an error in the Table 1 title of the Correllation Coefficient window. It was giving year/month/month.
  • When searching for weather station in the canadian database, the minimum number of year with data calculated was understimated by 1, example: 2010-2007= 3 years when it was supposed to be 4 years.
  • When the datum is changed to masl (meter above sea level), the altitude ofsett given to the y axis labels is rounded so that trailing zeros on the well altitude are not carried on to the y axis labels.
  • When the datum is changed, the UI Wlmin value in the spinbox widget is correctly updated.
  • There was a bug with the load/save functionality for graph layouts in Windows when there was unicode characters either in the path of the meteo data file, in the well name, or in the graph title.

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin over 9 years ago

GWHAT -

New features

  • Estimation of recharge from the Master Recession Curve is done automatically and the results are displayed in the UI.
  • Weather stations are now displayed within a Table instead of a drop-down menu. This allow a global view of the data that are available for download for a given study area. The weather station list can now be modified from the UI and the download of weather data can be done in batch for more than one selected weather station.
  • When searching for weather station on the CDCD, results are displayed in a table. Stations can be checked to be added to the current list of stations.
  • Added a new search criteria for the search of weather stations in the CDCD. Now possible to exclude station which have less than a certain number of years of data.
  • Added a browse functionality to the “display weather data info” window in the right panel that display missing data information about raw data that were downloaded or loaded manually in the UI. It is also possible to save previously concatenated file at any moment from the UI.
  • Changed the way the weather station list is managed. The list is not a class variable anymore. The information is all stocked within the QTableWidget and is being grabbed from it when needed. The list of weather station is not automatically and exclusively loaded from the file name “weather_stations.lst” anymore. When WHAT UI starts, the weather station list is empty and the user needs to load an already existing one or search for stations in the CDCD. The list is also not automatically saved. It needs to be explicitely done by the user.
  • Revamp of the "About" tab.

Performance improvements:

  • Datafile were not opened correctly in some places within the code. This could have cause some unecessary memory load in the past.

UI

  • New icon for MRC calculation
  • More feedback when searching for weather station on the online Canadian Daily Climatic Database.
  • New icon for removing station from the list.
  • New icons for “Fill” and “Fill All” button.
  • New interface for "Download Data" and "Fill Data" tabs.

Bug

  • Corrected wrong uses of "open" when opening file into memory.
  • Solved a bug when the button "save" in the right panel of "Download Data" tab was clicked if there was no data to save yet.
  • Corrected a bug when the WHAT project file path contained “\” (from a Windows machine) and was opened in the Unix like machine.
  • Corrected a bug when the charatec “/” or “\” in the station name may not have been replaced correctly in the filename by “_”. Replaced all three occurances of use of string.maketrans by “mystring”.replace()

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin almost 10 years ago

GWHAT - On the way to Groundwater Recharge Estimation

New Features:

  • Reorganized the code to be able to change the bin width of weather data in the hydrograph figure. This feature is now present in the code, but not yet linked in the UI.
  • Made the action to create a new project an explicit task independent from the opening of an already existing project. This is to prevent the creation of files and folders by mistake all over the place.
  • Added the option to show water level data as dots in the "computation" mode of the tab "Hydrograph".
  • Added an option to change the datum of the water level time-series from ground surface to sea level.
  • Possibility to load and plot soil stratigraphic layer in "computation mode" (Somewhat bugged for the moment).
  • Recharge Calculation from Master Recession Curve (Not linked to UI yet).
  • Improvement of the graph Weather Normals.

UI enhancements:

  • Added a new window for the creation of new project that allows the used to input various information about the project that are saved in a ".what" file. ".what" files are now required to open a project in WHAT.
  • Increased the heigh of the Menu Bar.
  • More flexibility in the "waterlvl" input files format. Headers can now have any numbers of row.

Performance improvements:

  • Improve the loading of waterlvl data file into memory. It is now around 8 times faster
  • Optimized the way weather data bin were calculated. 2 times more efficient and now allow for a bin with a variable width. Will soon add the option in the UI. This is a step towards being able to have tick marks on an other time scale than month.
  • Huge improvement for the computation of the MRC with a modified Gauss-Newton method.

Graph Design:

  • Added an option to disabled and change the type of gridlines used for the production of the hydrographs.
  • Added an option to plot the waterlvl without the weather.

Bug Fix:

  • Solved a bug that prevented the saving of the "weather normals" figure when an extension was explicitly added at the end of the file name before saving. This problem was more apparent for Windows user since Windows automatically add a file extension to the file name in its save file dialog window.
  • Solved a bug in “hydroprint” that prevented the water level to be plotted when “trend_line” option was set to 1 in the “graph_layout.lst” file.
  • Solved a bug when the “calculate MRC” button was clicked and not min-man were selected previously.

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin almost 10 years ago

GWHAT - Performance and UI improvements for Windows 7

(1) Used fixed font size and icon instead of system default.
(2) Significant performance improvement in the interactive plotting in "computation" mode.
(3) Various UI improvements, code cleaning and commenting.

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin about 10 years ago

GWHAT - MRC calculation (experimental) + Hydrograph dynamic display.

(1) UI Improvment in tab "hydrograph": Now displayed in bitmap and added ZoomIn and ZoomOut capability with CTRL-mouse_wheel, and Pan with mouse drag.
(2) Display of the hydrograph is now dynamic and there is no need to refresh manually the figure each time a modification is made.
(3) Bug Fix: Title placement in hydrograph.
(4) UI Improvement.
(5) Added the experimental feature to calculate the MRC from the water level time series.
(6) Improvement of the UI of the window weather yearly and monthly averages.
(7) Hide ProgressBar when it is not needed.
(8) Possible to adjust the Ptot scale in the hydrograph.
(9) In tab "Hydrograph", it is now possible to toggle a "layout" mode in order to produce a publication quality figure of an hydrograph and a "computation" mode to explore and make calculation with the data.

Known Issue: In mode "computation", which is a new experimental feature added with this version, graphic display is slow in Windows 7. Will be fixed in the next release.

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin about 10 years ago

GWHAT - Environment Canada Compatibility update, Bug Fixes, Worflow improvements.

(1) Updated the software to be compatible with new version of Gov. of Can. Website updated on 15/01/2015.
(2) Added new options for hydrograph plotting in the file "graph_layout.lst". Options are not linked in the UI yet.
(3) Water Level measurements can now be more easily imputed from a xls file instead of a csv file.
(4) Various Bug fixes and UI improvements.

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin over 10 years ago

GWHAT -

(1) New packaging with a larger size, but should improve significantly performance of the program.
(2) Bug fixes.
(3) UI Improvement.

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin over 10 years ago

GWHAT -

(1) Bugs correction and UI improvments.
(2) Improved the managements of input and output files.
(3) Won't download Raw data weather file if they already exists in the Raw directory.
(4) Now possible to search for stations with a Lat/Lon Coordinate and a Radius directly from WHAT.

Known Issue:
(1) The preview of the Well Hydrograph when the program is set full screen in Windows explorating system is not displayed correctly. To be fixed in the next release.

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin over 10 years ago

GWHAT - WHAT v4.0.5

v4.0.5

  • Weather data management and hydrograph analyses are now accessible within the same program.
  • Possible to plot mean monthly average for the weather data file selected.
  • Lot of bug fixes and UI improvement.
  • Workflow is handled by "projects", which makes it more user-friendly.

Natural Resources - Water Supply and Quality - Python
Published by jnsebgosselin over 10 years ago