Climate Data Rescue
This application seeks to aid in the digitization of paper records through the crowd-sourced transcription of scanned image files, particularly documents ill-suited for Optical Character Recognition.
https://github.com/open-data-rescue/climate-data-rescue
Category: Climate Change
Sub Category: Climate Data Processing and Analysis
Keywords
archives citizen-science climate community data-rescue digitization hacktoberfest science transcription
Keywords from Contributors
measur transforms compose observation reporting optimize animals annotation projection numerics
Last synced: about 13 hours ago
JSON representation
Repository metadata
Climate Data Rescue is an archival data rescue platform using Ruby on Rails.
- Host: GitHub
- URL: https://github.com/open-data-rescue/climate-data-rescue
- Owner: open-data-rescue
- License: mit
- Created: 2015-02-17T21:28:55.000Z (about 10 years ago)
- Default Branch: production
- Last Pushed: 2025-03-05T14:22:54.000Z (about 2 months ago)
- Last Synced: 2025-04-17T22:44:50.296Z (9 days ago)
- Topics: archives, citizen-science, climate, community, data-rescue, digitization, hacktoberfest, science, transcription
- Language: JavaScript
- Homepage: https://citsci.geog.mcgill.ca
- Size: 65.6 MB
- Stars: 16
- Watchers: 7
- Forks: 10
- Open Issues: 10
- Releases: 47
-
Metadata Files:
- Readme: README.md
- License: LICENSE
- Security: SECURITY.md
README.md
DRAW - Data Rescue: Archives and Weather
Contents
- Introduction
- Development Setup
- Environment Variables
- Starting and Stopping the application
- Attribution and Acknowlegements
Introduction
This application seeks to aid in the digitization of paper records through the crowd-sourced transcription of scanned image files, particularly documents ill-suited for Optical Character Recognition (OCR). It specializes in recovering data stored in a highly structured format. The app fully supports multilingual localization of the user interface and the data schema organization (field labels, help texts, etc).
Administrators are given an interface with which to define their data collection schemas, and users are provided a mechanism to transcribe data contained on the page and indicate its position.
Development Setup
Apart from GIT and whatever IDE/editor you prefer to use the minimum to run a dev env is docker desktop.
Environment Variables
You will need to create a .envrc file. The minimal content should have
export MYSQL_ROOT_PASSWORD=yourpassword
export MYSQL_PASSWORD=yourpassword
export SIDEKIQ_REDIS_URL=redis://localhost:6379/0
export SMTP_PORT=10025
export SMTP_SERVER=127.0.0.1
export HOSTNAME=localhost
export HOSTPORT=3000
export DEVISE_SECRET=
export SECRET_KEY_BASE=
For development set the MYSQL_ROOT_PASSWORD and MYSQL_PASSWORD to the same value
will be used by the docker scripts to create an instance of the database and set up the initial database.
Also by the Rails database.yml for the connection. In local dev their value is unimportant and can be used as-is.
DEVISE_SECRET, and SECRET_KEY_BASE will need values. You can generate values for them using the following commands:
docker-compose -p draw-dev -f docker-compose-dev.yml run draw bundle install
docker-compose -p draw-dev -f docker-compose-dev.yml run draw bundle exec rake secret
Starting and Stopping the application
The dev docker compose uses external volumes so that we can persist data between runs. These are created using the following:
docker volume create --name=draw-db-data
docker volume create --name=draw-redis-data
docker volume create --name=draw-node_modules
docker volume create --name=draw-node_modules_sidekiq
Then to start the dev docker instances use
docker-compose -p draw-dev -f docker-compose-dev.yml up
or
docker-compose -p draw-dev -f docker-compose-dev.yml up --build -d
The secound will detach the docker processes from your shell so it remains running.
You will be able to access the running server via http://localhost:3000
and a test user will available ([email protected] with password password)
Attribution and Acknowlegements
This application was created in 2015 by Robert Smith as an undergraduate independent study project in the Department of Geography at McGill University with Renee Sieber from the departments of Geography and Environmental Studies as the supervisor. It was developed in coordination with Victoria Slonosky in her efforts to recover data from thousands of pages of historical weather observations.
This project was inspired by the Scribe Framework.
Owner metadata
- Name: Open Data Rescue
- Login: open-data-rescue
- Email: [email protected]
- Kind: organization
- Description: Open source software to aid the digitization of archival data
- Website: https://citsci.geog.mcgill.ca/
- Location: Montreal, Quebec, Canada
- Twitter:
- Company:
- Icon url: https://avatars.githubusercontent.com/u/52838926?v=4
- Repositories: 1
- Last ynced at: 2023-02-28T07:55:25.795Z
- Profile URL: https://github.com/open-data-rescue
GitHub Events
Total
- Release event: 2
- Watch event: 2
- Delete event: 2
- Push event: 12
- Pull request event: 12
- Fork event: 1
- Create event: 3
Last Year
- Release event: 2
- Watch event: 2
- Delete event: 2
- Push event: 12
- Pull request event: 12
- Fork event: 1
- Create event: 3
Committers metadata
Last synced: 4 days ago
Total Commits: 1,540
Total Committers: 21
Avg Commits per committer: 73.333
Development Distribution Score (DDS): 0.598
Commits in past year: 15
Committers in past year: 1
Avg Commits per committer in past year: 15.0
Development Distribution Score (DDS) in past year: 0.0
| Name | Commits | |
|---|---|---|
| Robert | r****t@g****o | 619 |
| balen | h****n@g****m | 274 |
| Robert Smith | r****l@g****m | 249 |
| dependabot-preview[bot] | 2****] | 112 |
| Stuart Lynn | s****n@a****k | 63 |
| Tim | t****e@g****m | 39 |
| Arfon Smith | a****h@g****m | 38 |
| Stuart Lynn | s****n@g****m | 35 |
| dependabot[bot] | 4****] | 27 |
| Robert Smith | r****8@m****a | 21 |
| Yumeng | l****7@h****m | 18 |
| Melis Cagan | m****n@g****m | 18 |
| Victoria Slonosky | v****y@g****m | 8 |
| Robert Simpson | t****b@g****m | 7 |
| raakal | 4****l | 4 |
| jinxingster | j****r@g****m | 2 |
| Ben W. Brumfield | b****m@g****m | 2 |
| dhogg | d****g@p****m | 1 |
| Robert Smith | r****t@u****l | 1 |
| Ben Laurie | b****n@l****g | 1 |
| marw12 | 3****2 | 1 |
Committer domains:
- links.org: 1
- mail.mcgill.ca: 1
- astro.ox.ac.uk: 1
- grenadine.co: 1
Issue and Pull Request metadata
Last synced: 1 day ago
Total issues: 5
Total pull requests: 161
Average time to close issues: about 4 years
Average time to close pull requests: 9 days
Total issue authors: 3
Total pull request authors: 3
Average comments per issue: 1.8
Average comments per pull request: 0.64
Merged pull request: 55
Bot issues: 0
Bot pull requests: 107
Past year issues: 0
Past year pull requests: 20
Past year average time to close issues: N/A
Past year average time to close pull requests: about 2 hours
Past year issue authors: 0
Past year pull request authors: 1
Past year average comments per issue: 0
Past year average comments per pull request: 0.0
Past year merged pull request: 19
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- VickyS08 (2)
- raakal (2)
- Tiffanyhi (1)
Top Pull Request Authors
- dependabot[bot] (107)
- balen (52)
- rsmithlal (2)
Top Issue Labels
- bug (5)
Top Pull Request Labels
- dependencies (108)
- ruby (28)
- enhancement (1)
Dependencies
- @behance/jasmine-vue ^1.0.0 development
- add ^2.0.6 development
- babel-eslint ^10.0.1 development
- eslint ^5.0 development
- eslint-config-standard ^12.0.0 development
- eslint-loader ^2.1.1 development
- eslint-plugin-import ^2.16.0 development
- eslint-plugin-node ^8.0.1 development
- eslint-plugin-promise ^4.0.1 development
- eslint-plugin-standard ^4.0.0 development
- eslint-plugin-vue ^5.0 development
- webpack-dev-server 2.11.4 development
- yarn ^1.13.0 development
- @rails/ujs ^6.1.0
- @rails/webpacker 3.5
- axios ^0.21.2
- babel-plugin-module-resolver ^4.0.0
- bootstrap ^4.5.3
- bootstrap-vue ^2.2.1
- caniuse-lite ^1.0.30001171
- common-tags ^1.8.0
- css-loader 1.0
- node-polyglot ^2.4.0
- node-sass ^4.12.0
- sass-loader ^7.1.0
- vue ^2.6.12
- vue-confirmation-button ^1.0.0
- vue-loader ^14.0
- vue-material ^1.0.0-beta-10.2
- vue-multiselect ^2.1.6
- vue-router ^3.0
- vue-template-compiler ^2.5
- vuedraggable ^2.14
- vuex ^3.0
- webpack ^3.0
- 1150 dependencies
- better_errors >= 0 development
- binding_of_caller >= 0 development
- byebug >= 0 development
- capistrano >= 0 development
- capistrano-bundler >= 0 development
- capistrano-rails >= 0 development
- capistrano-rvm >= 0 development
- capistrano3-puma >= 0 development
- capybara >= 0 development
- coveralls >= 0 development
- database_cleaner >= 0 development
- execjs >= 0 development
- factory_bot_rails >= 0 development
- faker ~> 2.15.1 development
- fuubar >= 0 development
- listen >= 0 development
- pry >= 0 development
- rack-mini-profiler >= 0 development
- rails-erd >= 0 development
- rb-readline >= 0 development
- rbtrace >= 0 development
- rspec-rails >= 0 development
- rubocop >= 0 development
- rubocop-rspec >= 0 development
- shoulda-callback-matchers >= 0 development
- shoulda-matchers >= 0 development
- simplecov >= 0 development
- spring >= 0 development
- spring-watcher-listen ~> 2.0.0 development
- web-console >= 3.3.0 development
- activerecord-session_store >= 0
- aws-sdk-s3 ~> 1
- bootsnap >= 1.1.0
- bootstrap-sass >= 0
- devise >= 0
- figaro >= 0
- friendly_id ~> 5.4.2
- friendly_id-mobility ~> 1.0.3
- globalize >= 0
- globalize-accessors >= 0
- http_accept_language >= 0
- i18n-active_record >= 0
- jbuilder >= 0
- jquery-fileupload-rails >= 0
- jquery-rails >= 0
- jquery-ui-rails >= 0
- jsonapi-rails >= 0
- jsonapi-rspec >= 0
- log4r >= 0
- mime-types >= 0
- mini_racer >= 0
- mobility ~> 1.0.3
- modernizr-rails >= 0
- mysql2 >= 0
- newrelic_rpm >= 0
- paperclip >= 0
- puma ~> 5.5.2
- pundit >= 0
- rails ~> 5.2.6
- rails-i18n >= 0
- rails-observers >= 0
- ranked-model >= 0
- recaptcha >= 0
- routing-filter >= 0
- sass-rails >= 0
- select2-rails >= 0
- sentry-raven >= 0
- simple_form >= 0
- slim-rails >= 0
- uglifier >= 0
- webpacker ~> 3.5
- websocket-extensions ~> 0.1.5
- will_paginate >= 0
- 189 dependencies
- actions/checkout v2 composite
- github/codeql-action/upload-sarif v1 composite
- ruby/setup-ruby v1 composite
- actions/cache v2 composite
- actions/checkout v2 composite
- docker/build-push-action v2 composite
- docker/login-action v2 composite
- docker/metadata-action v4 composite
- docker/setup-buildx-action v2 composite
- easimon/maximize-build-space master composite
- mysql 5.7
- redis alpine
- schickling/mailcatcher latest
- ghcr.io/open-data-rescue/climate-data-rescue latest
- mysql 5.7
- redis alpine
Score: 6.302618975744905