GISWATER

This software connects different IT solutions and pre-existent databases allowing you to setup a high performance water management system in combination with hydraulic software.
https://github.com/giswater/plugin

Keywords

gis open-source water water-management water-models

Last synced: 2 days ago
JSON representation

Acceptance Criteria

Repository metadata

QGIS plugin for Giswater

README.md

Welcome to the Giswater Project - QGIS Plugin

Water management has traditionally been complex and costly, making it difficult to efficiently plan or control water supply networks without further investments. However, with the inception of Giswater in 2014, the first open-source software specifically designed for water supply and water management, this complexity is now manageable.

Giswater integrates various IT solutions and pre-existing databases, enabling high-performance management systems combined with hydraulic software such as EPANET and SWMM.

Giswater is the first open-source tool for integral water cycle management, created for city councils, municipal administrations, water and sewerage service providers, and hydraulic professionals. As a driver, it connects hydraulic analysis tools and spatial databases, allowing user access from any GIS. Compatible with EPANET, EPA SWMM, GIS, WMS, SCADA, and more, Giswater integrates seamlessly into water management entities’ ecosystems, amplifying their operational capabilities.

Additionally, Giswater can be connected with business management tools like ERP, CRM, Business Intelligence software, and corporate mobile devices.

Developed in Python (QGIS plugin) and PL/SQL (PostgreSQL database), the project is organized across three main repositories: QGIS-PLUGIN, DB-MODEL, and DOCS.


Table of Contents

  1. Requirements
  2. Install
  3. macOS + QGIS (Go2Epa / hydraulic_engine)
  4. Test
  5. Deployment
  6. Wiki
  7. FAQ
  8. Code Repositories
  9. Versioning
  10. Third-Party Libraries
  11. License
  12. Acknowledgments

Requirements

To work with Giswater, you will need:

  • PostgreSQL: Ensure to select the pgAdmin component (Database Manager) and PostGIS (Spatial Extension) during installation.
  • QGIS: Required geoprocessing software.

Install

Since Giswater functions as server-client software, installation is done across two environments.

Backend Environment

Compatible with Windows, Mac, and Linux OS.

  • Install PostgreSQL (versions 9.5 to 18).

  • Install PostGIS, pgRouting, and other required PostgreSQL extensions (database-level, once per database):

    CREATE EXTENSION IF NOT EXISTS postgis;
    CREATE EXTENSION IF NOT EXISTS pgrouting;
    CREATE EXTENSION IF NOT EXISTS tablefunc;
    CREATE EXTENSION IF NOT EXISTS unaccent;
    CREATE EXTENSION IF NOT EXISTS postgis_raster;
    CREATE EXTENSION IF NOT EXISTS fuzzystrmatch;
    

    postgis, pgrouting, tablefunc, and unaccent are also created automatically when you build a WS/UD schema (dbmodel/schemas/main/common/base/init.sql). Install the packages on the server first; the extension objects must exist at the OS level.

  • PostgreSQL roles — Giswater uses a fixed role hierarchy. You do not need to run separate corporate DDL scripts: roles are created idempotently during schema creation and permissions are applied by gw_fct_admin_role_permissions() at the end of lastprocess.

    Role Purpose Inherits
    role_basic Read-only base (SELECT on catalogued tables/views)
    role_om Operations & maintenance role_basic
    role_edit Network editing role_om
    role_epa EPA / SWMM modelling role_edit
    role_plan Planning (psectors, etc.) role_epa
    role_admin Schema administration (no superuser) role_plan
    role_system Owns schema objects; used for DDL during build role_admin
    role_crm CRM integration (standalone, no inheritance chain)

    Inheritance chain (each role is granted to the one below; higher roles inherit all lower permissions):

    role_system
      └── role_admin
            └── role_plan
                  └── role_epa
                        └── role_edit
                              └── role_om
                                    └── role_basic
    
    role_crm   (standalone)
    

    Installer requirements: gw db init must run as a PostgreSQL superuser (extensions, roles, GRANT CREATE ON DATABASE … TO role_system). After that, schema create/update/drop can run as that superuser or as a login granted role_system. init.sql creates the schema AUTHORIZATION role_system and SET ROLE role_system for base DDL; later phases (updates, sample) run as the installer login. Drop/rename still SET ROLE role_system because the schema is owned by that role. Restrictive object grants are applied by gw_fct_admin_role_permissions.

    Manual bootstrap (only if you must prepare roles before the first schema build, e.g. restricted DBA workflow):

    DO $$
    DECLARE
      v_role_exists boolean;
    BEGIN
      SELECT EXISTS (SELECT 1 FROM pg_roles WHERE rolname = 'role_basic') INTO v_role_exists;
      IF NOT v_role_exists THEN
        CREATE ROLE role_basic NOSUPERUSER INHERIT NOCREATEDB NOCREATEROLE NOREPLICATION;
      END IF;
    
      SELECT EXISTS (SELECT 1 FROM pg_roles WHERE rolname = 'role_om') INTO v_role_exists;
      IF NOT v_role_exists THEN
        CREATE ROLE role_om NOSUPERUSER INHERIT NOCREATEDB NOCREATEROLE NOREPLICATION;
      END IF;
    
      SELECT EXISTS (SELECT 1 FROM pg_roles WHERE rolname = 'role_edit') INTO v_role_exists;
      IF NOT v_role_exists THEN
        CREATE ROLE role_edit NOSUPERUSER INHERIT NOCREATEDB NOCREATEROLE NOREPLICATION;
      END IF;
    
      SELECT EXISTS (SELECT 1 FROM pg_roles WHERE rolname = 'role_epa') INTO v_role_exists;
      IF NOT v_role_exists THEN
        CREATE ROLE role_epa NOSUPERUSER INHERIT NOCREATEDB NOCREATEROLE NOREPLICATION;
      END IF;
    
      SELECT EXISTS (SELECT 1 FROM pg_roles WHERE rolname = 'role_plan') INTO v_role_exists;
      IF NOT v_role_exists THEN
        CREATE ROLE role_plan NOSUPERUSER INHERIT NOCREATEDB NOCREATEROLE NOREPLICATION;
      END IF;
    
      SELECT EXISTS (SELECT 1 FROM pg_roles WHERE rolname = 'role_admin') INTO v_role_exists;
      IF NOT v_role_exists THEN
        CREATE ROLE role_admin NOSUPERUSER INHERIT NOCREATEDB NOCREATEROLE NOREPLICATION;
      END IF;
    
      SELECT EXISTS (SELECT 1 FROM pg_roles WHERE rolname = 'role_system') INTO v_role_exists;
      IF NOT v_role_exists THEN
        CREATE ROLE role_system NOSUPERUSER INHERIT NOCREATEDB NOCREATEROLE NOREPLICATION;
      END IF;
    
      SELECT EXISTS (SELECT 1 FROM pg_roles WHERE rolname = 'role_crm') INTO v_role_exists;
      IF NOT v_role_exists THEN
        CREATE ROLE role_crm NOSUPERUSER INHERIT NOCREATEDB NOCREATEROLE NOREPLICATION;
      END IF;
    
      GRANT role_basic TO role_om;
      GRANT role_om TO role_edit;
      GRANT role_edit TO role_epa;
      GRANT role_epa TO role_plan;
      GRANT role_plan TO role_admin;
      GRANT role_admin TO role_system;
    
      IF NOT pg_has_role(current_user, 'role_system', 'member')
         AND (SELECT rolsuper FROM pg_roles WHERE rolname = current_user) IS TRUE THEN
        GRANT role_system TO current_user;
      END IF;
    END$$;
    

    Map QGIS/PostgreSQL logins to the appropriate role (e.g. GRANT role_edit TO gis_user). Object-level grants on each project schema are (re)applied by gw_fct_admin_role_permissions() during create and upgrade (lastprocess).

Frontend environment:

Compatible with Windows, Mac, and Linux.

  • Install the latest Long-Term Release (LTR) of QGIS (or QGIS 4.x).
  • Install the QPIP plugin dependency manager so Giswater can install Python packages from requirements.txt (including hydraulic_engine, WNTR, pyswmm).
  • Classic EPA desktop apps (SWMM 5.1 / EPANET 2.2) are mainly relevant on Windows. On macOS/Linux, Go2Epa Execute EPA uses hydraulic_engine when installed (see macOS note below).
  • On Linux systems, you may need to install the PostgreSQL Qt driver for database connectivity.
    • On Ubuntu:
    sudo apt install libqt5sql5-psql
    
    • On Fedora:
    sudo dnf install qt5-qtbase-postgresql
    

macOS + QGIS (Go2Epa / hydraulic_engine)

On macOS, QGIS runs with Hardened Runtime. Native libraries from QPIP wheels (wntr / EPANET, pyswmm / SWMM, etc.) often ship ad-hoc or unsigned. Loading them into QGIS can kill the app with:

EXC_BAD_ACCESS (SIGKILL) — CODESIGNING / Invalid Page

This is a packaging limitation of those PyPI wheels, not a Giswater bug. After installing or updating QPIP dependencies, re-sign them locally:

# QGIS 4 + Python 3.12 (default profile).
# QGIS 3: replace QGIS4 with QGIS3. Adjust 3.12 if your QGIS Python minor differs.
DEP="$HOME/Library/Application Support/QGIS/QGIS4/profiles/default/python/dependencies/3.12"

xattr -dr com.apple.quarantine "$DEP" 2>/dev/null
find "$DEP" \( -name "*.so" -o -name "*.dylib" \) \
  -exec codesign --force --sign - {} \;

Fully quit and reopen QGIS afterwards. Re-run this command after any QPIP / pip update that refreshes native wheels.

Test

Database model (pgTAP, Docker): dbmodel/README.md — Testing./dbmodel/test/run_tests.sh ws (PostgreSQL 16–18 via PG_MAJOR).

Schema CLI (no QGIS): giswater_admin/README.mdpipx install giswater-cli then gw create --kind ws …

Python unit tests: python3 -m pytest test/engine -v (from plugin repo root).

Use the provided example projects, pre-loaded with datasets for testing. Find setup videos below:

Deployment

Requirements

Ensure you have the permissions to connect to PostgreSQL. Database bootstrap (gw db init, extensions, roles) needs superuser rights. After that, schema administration can be done by a login that is a member of role_system.

Project Setup

  • Define catalogs with at least the mandatory categories ([materials, node, arc]) and create map zones ([macroexploitation, exploitation, municipality, sector, dma]).
  • To get started, refer to Start from Scratch for guidance.
  • Tip: Once map zones and catalogs are defined, you can begin adding network nodes and arcs.

For more configuration options, see the Giswater configuration guide.

Wiki

Explore additional documentation on the Giswater Wiki.

FAQs

Find answers to common questions in the Giswater FAQs.

QGIS on macOS crashes when running Go2Epa / EPANET? See macOS + QGIS (Go2Epa / hydraulic_engine).

Code Repositories

Other repositories may exist but are either deprecated or inactive.

Versioning

Giswater follows a three-level release system:

  • Major: New architecture with significant updates (no forward compatibility).
  • Minor: Bug fixes and new features (forward compatible).
  • Build: Minor fixes and updates (forward compatible).

Release frequency:

  • Build: Monthly (12 builds/year)
  • Minor: Annually
  • Major: No fixed schedule

Third-Party Libraries

Giswater uses the following third-party libraries:

  • WNTR: WNTR GitHub
    WNTR is an open-source Python package for analyzing water distribution systems using hydraulic and water quality models.
    The WNTR license can be found in the LICENSE file or in their repository.

  • swmm-api: swmm-api GitLab
    swmm-api provides a Pythonic interface to the EPA SWMM5 software, enabling advanced scripting, simulation control, and access to simulation results.
    The license and further details can be found in the LICENSE or in their repository.

  • tqdm: tqdm GitHub
    tqdm is a fast, extensible progress bar library for Python, supporting console, GUI, and notebook environments.
    The tqdm license can be viewed in the LICENSE or in their repository.

  • PyPDF2: PyPDF2 GitHub
    PyPDF2 is a Python library for working with PDF files, offering functionalities such as splitting, merging, and text extraction.
    The PyPDF2 license is available in the LICENSE or in their repository.

  • osmnx: OSMnx GitHub
    OSMnx is a Python package to easily download, model, analyze, and visualize street networks and other geospatial features from OpenStreetMap. You can download and model walking, driving, or biking networks with a single line of code then analyze and visualize them. You can just as easily work with urban amenities/points of interest, building footprints, transit stops, elevation data, street orientations, speed/travel time, and routing.
    The OSMnx license can be viewed in the LICENSE or in their repository

License

This program is free software, licensed under the GNU General Public License (GPL) version 3 or later. Refer to the LICENSE file for details.

Acknowledgments

Special thanks to our founding contributors:

  • GITS-BarcelonaTech University
  • Aigües de Mataró
  • Cicle de l'Aigua del Ter S.A
  • Aigües de Blanes
  • Aigües del Prat
  • Aigües de Vic
  • Aigües de Castellbisbal
  • Aigües de Banyoles
  • Figueres de Serveis, S.A
  • Prodaisa
  • Sabemsa
  • Consorci Aigües de Tarragona
  • BGEO OPEN GIS S.L.

Owner metadata


GitHub Events

Total
Last Year

Committers metadata

Last synced: 10 days ago

Total Commits: 28,266
Total Committers: 50
Avg Commits per committer: 565.32
Development Distribution Score (DDS): 0.78

Commits in past year: 3,680
Committers in past year: 19
Avg Commits per committer in past year: 193.684
Development Distribution Score (DDS) in past year: 0.717

Name Email Commits
Xavier Torret x****t@b****s 6213
Edgar Fuste e****e@b****s 2962
Barbara Rzepka b****a@b****s 2805
Néstor Ibáñez n****r@b****s 2697
Sergi Maspons s****s@b****s 2468
Daniel Marin d****n@b****s 2226
Albert Bofill a****l@b****s 1926
David Erill d****9@g****m 1455
arnauurgeles a****s@b****s 1053
Ferran f****z@b****s 895
mguzman14 m****n@b****s 764
claudia dragoste c****e@y****m 521
Arnau Torret a****t@b****s 406
Nico Pérez n****z@b****s 389
Barbara Rzepka b****k@b****s 206
opueyo o****o@b****s 190
natasa cica n****a@b****s 178
nullptr e****n@g****m 167
Arnau Torret a****7@g****m 135
Estela Torres e****s@b****s 65
Sergi Muñoz s****z@b****s 64
Marleen m****p@l****l 63
Pablo Marques p****o@g****m 61
tvdeelen t****n@b****s 55
jblanch 1****g 54
Vicente Medina v****a@g****s 53
Jordi B j****i@b****s 47
nkarki n****i@b****s 25
Arnau Torret a****t@g****m 24
Lex l****l@g****m 20
and 20 more...

Committer domains:


Issue and Pull Request metadata

Last synced: 4 days ago

Total issues: 1
Total pull requests: 22
Average time to close issues: 28 minutes
Average time to close pull requests: 5 days
Total issue authors: 1
Total pull request authors: 7
Average comments per issue: 1.0
Average comments per pull request: 0.23
Merged pull request: 21
Bot issues: 0
Bot pull requests: 0

Past year issues: 1
Past year pull requests: 21
Past year average time to close issues: 28 minutes
Past year average time to close pull requests: 5 days
Past year issue authors: 1
Past year pull request authors: 7
Past year average comments per issue: 1.0
Past year average comments per pull request: 0.24
Past year merged pull request: 20
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/giswater/plugin

Top Issue Authors

  • danimarinBG (1)

Top Pull Request Authors

  • danimarinBG (7)
  • atorret7 (6)
  • smaspons (3)
  • FerranMart (2)
  • opueyo-bgeo (2)
  • ArnauUrgeles (1)
  • NullSeile (1)

Top Issue Labels

  • Bug (1)

Top Pull Request Labels

  • feature (5)
  • refactor (4)
  • sql (3)
  • enhancement (2)
  • Refactor (2)
  • minor-bug (1)
  • python (1)

Package metadata

pypi.org: giswater-cli

Headless CLI for Giswater database schema lifecycle (create, update, drop)

  • Homepage: https://www.giswater.org
  • Documentation: https://github.com/giswater/plugin/blob/main/giswater_admin/README.md
  • Licenses: GPL-3.0-or-later
  • Latest release: 0.4.2 (published 6 days ago)
  • Last Synced: 2026-08-22T01:31:39.257Z (4 days ago)
  • Versions: 5
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 331 Last month
  • Rankings:
    • Dependent packages count: 7.004%
    • Downloads: 14.737%
    • Average: 20.454%
    • Dependent repos count: 39.621%
  • Maintainers (1)

Dependencies

.github/workflows/build-plugin.yml actions
  • actions/checkout v6 composite
  • actions/upload-artifact v7 composite
.github/workflows/e2e-giswater.yml actions
  • actions/checkout v6 composite
.github/workflows/i18n_generate.yml actions
  • actions/checkout v6 composite
  • actions/create-github-app-token v3 composite
.github/workflows/i18n_update.yml actions
  • actions/checkout v6 composite
  • actions/upload-artifact v7 composite
.github/workflows/release-cli.yml actions
  • actions/checkout v6 composite
  • actions/setup-python v5 composite
  • actions/upload-artifact v7 composite
  • pypa/gh-action-pypi-publish release/v1 composite
  • softprops/action-gh-release v2 composite
requirements.txt pypi
  • matplotlib >=2.0.0
  • osmnx >=1.0.0
  • pypdf2 >=1.26.0
  • pyproj >=3.0.0
  • shapely >=1.6.0
  • swmm-api >=0.4.0
  • tqdm >=4.0.0
  • wntr >=1.4.0
.github/workflows/release-plugin.yml actions
  • actions/checkout v6 composite
  • softprops/action-gh-release v2 composite
dbmodel/docker/gw-db/Dockerfile docker
  • postgis/postgis ${PG_MAJOR}-${POSTGIS_VERSION} build
.github/workflows/test-db.yml actions
  • actions/checkout v6 composite
  • actions/download-artifact v8 composite
  • actions/upload-artifact v7 composite
  • docker/build-push-action v6 composite
  • docker/login-action v3 composite
.github/workflows/test-network-e2e.yml actions
  • actions/checkout v6 composite
.github/workflows/thread-db-check.yml actions
  • actions/checkout v6 composite
  • actions/setup-python v6 composite
dbmodel/docker/test-runner/Dockerfile docker
  • python 3.11-slim-bookworm build
dbmodel/docker/gw-ci/Dockerfile docker
  • postgis/postgis ${PG_MAJOR}-${POSTGIS_VERSION} build
dbmodel/docker-compose.debug.yml docker
dbmodel/docker-compose.test.yml docker
  • gw-ci pg${PG_MAJOR
giswater_admin/requirements.txt pypi
  • PyYAML >=6.0
  • platformdirs >=4.0
  • psycopg2-binary >=2.9
pyproject.toml pypi
  • platformdirs >=4.0
  • psycopg2-binary >=2.9
  • pyyaml >=6.0
.github/workflows/lint-flake8.yml actions
  • actions/checkout v4 composite
  • actions/setup-python v5 composite
.github/workflows/lint-qt6.yml actions
  • actions/checkout v4 composite
  • actions/upload-artifact v4 composite
.github/workflows/test.yml actions
  • actions/checkout v4 composite

Score: 14.19449478882284