ACTRIS Cloudnet data portal

Provides a data processing and curation service for ground-based cloud remote sensing measurements.
https://github.com/actris-cloudnet/dataportal

Category: Atmosphere
Sub Category: Atmospheric Chemistry and Aerosol

Last synced: about 7 hours ago
JSON representation

Repository metadata

ACTRIS cloud remote sensing data portal

README.md

ACTRIS Cloudnet data portal

Lint and test

This repository contains the source code for ACTRIS Cloudnet data portal hosted at https://cloudnet.fmi.fi.

Install

The data portal is distributed as a docker container as a part of the Cloudnet development toolkit.
Refer to README of the dev-toolkit repository
on how to set up the CLU development environment.

Development dependencies

Install pre-commit to your machine and run pre-commit install to set up the hooks.

Running commands in the container

For running commands in the data portal containers, small wrapper scripts are provided at backend/run-dev, backend/run-test and frontend/run,
for running commands in the backend development, backend test, and frontend development containers, respectively.
Before using these scripts make sure the containers are up.

Populating the database

By default, there is no data in the portal's database. The following command will populate the development
database with test fixtures:

cd backend
./run-dev npm run reset-db

To load other data to the db, for instance the sites used in production, use:

cd backend
./run-dev npx ts-node -T src/fixtures.ts /dataportal-fixtures/1-site.json APPEND

Migrations

The dataportal uses TypeORM for automatic database schema manipulation. This repository provides wrapper scripts for TypeORM's own migration tool:

 cd backend
./run-dev npm run migration:show
./run-dev npm run migration:run
./run-dev npm run migration:revert
./run-dev npm run migration:generate -- src/migration/NewMigration
./run-dev npm run migration:create -- src/migration/NewMigration
./run-dev npm run typeorm -- --help

The migrations are stored in backend/src/migration. For more information on how to use TypeORM's migrations, see https://typeorm.io/migrations.

Running unit and integration tests

The backend unit and integration tests are run with the commands:

cd backend
./run-test npm test

Individual tests can be run as:

cd backend
./run-test sh -c "npm run reset-db && npx jest tests/integration/sequential/upload.test.ts"

To run backend e2e-tests, issue

cd backend
./run-test npm run e2e-test

The frontend unit and integration tests are run with:

cd frontend
./run npm run test:unit

Running code formatters

WRAPPER npx prettier --write FILENAME
WRAPPER npm run lint-fix

where WRAPPER is, depending on the backend or frontend, ./run-dev or ./run, respectively.

License

MIT


Owner metadata


GitHub Events

Total
Last Year

Committers metadata

Last synced: 8 days ago

Total Commits: 2,689
Total Committers: 7
Avg Commits per committer: 384.143
Development Distribution Score (DDS): 0.55

Commits in past year: 207
Committers in past year: 3
Avg Commits per committer in past year: 69.0
Development Distribution Score (DDS) in past year: 0.188

Name Email Commits
Lauri Kangassalo l****o@f****i 1209
Tuomas Siipola t****a@f****i 829
Simo Tukiainen s****n@f****i 557
Anniina Korpinen a****n@f****i 52
Niko Leskinen n****n@f****i 37
swr99ejo e****r@f****i 4
Lauri Kangassalo l****o@h****i 1

Committer domains:


Issue and Pull Request metadata

Last synced: 26 days ago

Total issues: 1
Total pull requests: 53
Average time to close issues: about 19 hours
Average time to close pull requests: 12 days
Total issue authors: 1
Total pull request authors: 3
Average comments per issue: 1.0
Average comments per pull request: 0.02
Merged pull request: 41
Bot issues: 0
Bot pull requests: 0

Past year issues: 0
Past year pull requests: 15
Past year average time to close issues: N/A
Past year average time to close pull requests: 11 days
Past year issue authors: 0
Past year pull request authors: 3
Past year average comments per issue: 0
Past year average comments per pull request: 0.07
Past year merged pull request: 10
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/actris-cloudnet/dataportal

Top Issue Authors

  • andrecastro0o (1)

Top Pull Request Authors

  • tukiains (28)
  • siiptuo (21)
  • nikoleskinen (4)

Top Issue Labels

Top Pull Request Labels


Dependencies

.github/workflows/test.yml actions
  • actions/checkout v3 composite
.github/docker-compose.yml docker
  • backend latest
  • backend-prod latest
  • frontend latest
  • postgres 13
  • selenium/standalone-firefox 4.0.0-beta-1-20210215
backend/Dockerfile docker
  • base latest build
  • dev latest build
  • node 15 build
backend/package-lock.json npm
  • 827 dependencies
backend/package.json npm
  • @types/adm-zip ^0.4.33 development
  • @types/archiver ^3.1.1 development
  • @types/express ^4.17.11 development
  • @types/express-xml-bodyparser ^0.3.2 development
  • @types/graceful-fs ^4.1.5 development
  • @types/jest ^25.2.3 development
  • @types/mock-aws-s3 ^2.6.1 development
  • @types/node ^13.13.47 development
  • @types/request-promise-native ^1.0.17 development
  • @types/selenium-webdriver ^4.0.11 development
  • @types/uuid ^8.3.0 development
  • @types/validator ^12.0.1 development
  • @types/xml2js ^0.4.8 development
  • @typescript-eslint/eslint-plugin ^2.34.0 development
  • @typescript-eslint/parser ^2.34.0 development
  • adm-zip ^0.4.16 development
  • eslint ^6.8.0 development
  • eslint-config-prettier ^8.5.0 development
  • jest ^26.6.3 development
  • prettier ^2.6.2 development
  • request ^2.88.2 development
  • request-promise-native ^1.0.9 development
  • selenium-webdriver ^4.0.0-beta.2 development
  • ts-jest ^26.5.4 development
  • ts-node ^9.1.1 development
  • typescript ^4.2.3 development
  • apache-md5 ^1.1.7
  • archiver ^4.0.2
  • aws-sdk ^2.869.0
  • axios ^0.21.4
  • basic-auth ^2.0.1
  • express ^4.17.1
  • maxmind ^4.3.5
  • mock-aws-s3 ^4.0.2
  • nodemon ^2.0.7
  • pg ^8.0.3
  • pg-query-stream ^4.0.0
  • reflect-metadata ^0.1.10
  • sass ^1.32.8
  • typeorm ^0.2.31
  • uuid ^8.3.2
  • validator ^13.7.0
  • xml2js ^0.4.23
frontend/Dockerfile docker
  • base latest build
  • nginxinc/nginx-unprivileged latest build
  • node 18 build
frontend/package-lock.json npm
  • 602 dependencies
frontend/package.json npm
  • @rushstack/eslint-patch ^1.1.4 development
  • @tsconfig/node18 ^18.2.1 development
  • @types/debounce ^1.2.1 development
  • @types/escape-html ^1.0.2 development
  • @types/jsdom ^21.1.2 development
  • @types/leaflet ^1.9.0 development
  • @types/leaflet-draw ^1.0.6 development
  • @types/node ^18.17.14 development
  • @vitejs/plugin-vue ^4.0.0 development
  • @vue/eslint-config-prettier ^8.0.0 development
  • @vue/eslint-config-typescript ^11.0.0 development
  • @vue/test-utils ^2.2.6 development
  • @vue/tsconfig ^0.4.0 development
  • cypress ^12.0.2 development
  • eslint ^8.22.0 development
  • eslint-plugin-cypress ^2.12.1 development
  • eslint-plugin-vue ^9.3.0 development
  • jsdom ^22.1.0 development
  • npm-run-all ^4.1.5 development
  • sass ^1.58.0 development
  • start-server-and-test ^2.0.0 development
  • the-new-css-reset ^1.9.0 development
  • typescript 5.1 development
  • vite ^4.0.0 development
  • vitest ^0.34.3 development
  • vue-tsc ^1.0.12 development
  • axios ^1.3.2
  • debounce ^1.2.1
  • escape-html ^1.0.3
  • inter-ui ^3.19.3
  • leaflet ^1.9.3
  • leaflet-draw ^1.0.4
  • v-calendar ^3.0.3
  • vue ^3.2.45
  • vue-multiselect ^3.0.0-beta.2
  • vue-router ^4.1.6
shared/package-lock.json npm
  • 120 dependencies
shared/package.json npm
  • @types/node ^15.0.14 development
  • @typescript-eslint/eslint-plugin ^3.5.0 development
  • @typescript-eslint/parser ^3.5.0 development
  • eslint ^7.3.1 development
  • tslib ^2.0.0 development
  • typescript ^3.9.5 development
pyproject.toml pypi
requirements_dev.txt pypi
  • release-version * development
.github/workflows/docker.yml actions
  • actions/attest-build-provenance v1 composite
  • actions/checkout v4 composite
  • docker/build-push-action v6 composite
  • docker/login-action v3 composite
  • docker/metadata-action v5 composite

Score: 3.737669618283368