Open Sustainable Technology

A curated list of open technology projects to sustain a stable climate, energy supply, biodiversity and natural resources.

Browse accepted projects | Review proposed projects | Propose new project | Open Issues

WildBook-ia

Builds open software and artificial intelligence for the conservation research community; pairs with the Wildbook project.
https://github.com/wildmeorg/wildbook-ia

Last synced: about 21 hours ago
JSON representation

Repository metadata

Wildbook's Image Analysis (WBIA) backend service supporting machine learning for wildlife conservation

README

        

==================
WBIA - WildBook IA
==================

|Build| |Documentation| |Downloads|

.. image:: http://i.imgur.com/TNCiEBe.png
:alt: "(Note: the rhino and wildebeest matches may be dubious. Other species do work well though")

WBIA program for the storage and management of images and derived data for use in computer vision algorithms. It aims to compute who an animal is, what species an animal is, and where an animal is with the ultimate goal being to ask important why biological questions.

This project is the Machine Learning (ML) / computer vision component of the WildBook project: See https://github.com/WildMeOrg/. This project is an actively maintained fork of the popular IBEIS (Image Based Ecological Information System) software suite for wildlife conservation. The original IBEIS project is maintained by Jon Crall (@Erotemic) at https://github.com/Erotemic/ibeis. The IBEIS toolkit originally was a wrapper around HotSpotter, which original binaries can be downloaded from: http://cs.rpi.edu/hotspotter/

Currently the system is build around a SQLite database, a web GUI, and matplotlib visualizations. Algorithms employed are: convolutional neural network detection and localization and classification, hessian-affine keypoint detection, SIFT keypoint description, LNBNN identification using approximate nearest neighbors.

Support
--------
While WBIA can be set up independently, the Wild Me team is not able to assist with independent model training. Support is limited to system setup in Docker at this time.

Requirements
------------

* Python 3.7+
* OpenCV 3.4.10
* Python dependencies listed in requirements.txt

Installation Instructions
-------------------------

.. code:: bash

git clone https://github.com/WildMeOrg/wildbook-ia.git
cd wildbook-ia/devops
sudo ./build.sh wbia-base wbia-provision wbia

If your build times out, run the command again. The previous run is cached and the build will advance. Note that you cannot tag this build.

Docker
~~~~~~

The WBIA software is built and deployed as a Docker image `wildme/wbia`. You can download and run the pre-configured instance from the command line using:

.. code:: bash

# Install Docker - https://docs.docker.com/engine/install/
docker pull wildme/wbia:latest
docker run -p 84:5000 wildme/wbia:latest bash

This image is built using the multi-stage Dockerfiles in `devops/`. Once the container is up and running, go to `localhost:84` to see the WBIA landing page.

Dependencies
~~~~~~

This project depends on an array of other repositories for functionality.

First Party Toolkits (Required)

* https://github.com/WildMeOrg/wbia-utool

* https://github.com/WildMeOrg/wbia-vtool

First Party Dependencies for Third Party Libraries (Required)

* https://github.com/WildMeOrg/wbia-tpl-pyhesaff

* https://github.com/WildMeOrg/wbia-tpl-pyflann

* https://github.com/WildMeOrg/wbia-tpl-pydarknet

* https://github.com/WildMeOrg/wbia-tpl-pyrf

First Party Plug-ins (Optional)

* https://github.com/WildMeOrg/wbia-plugin-cnn

* https://github.com/WildMeOrg/wbia-plugin-flukematch

* https://github.com/WildMeOrg/wbia-plugin-deepsense

* https://github.com/WildMeOrg/wbia-plugin-finfindr

* https://github.com/WildMeOrg/wbia-plugin-curvrank

+ https://github.com/WildMeOrg/wbia-tpl-curvrank

* https://github.com/WildMeOrg/wbia-plugin-kaggle7

+ https://github.com/WildMeOrg/wbia-tpl-kaggle7

* https://github.com/WildMeOrg/wbia-plugin-2d-orientation

+ https://github.com/WildMeOrg/wbia-tpl-2d-orientation

* https://github.com/WildMeOrg/wbia-plugin-lca

+ https://github.com/WildMeOrg/wbia-tpl-lca

Deprecated Toolkits (Deprecated)
* https://github.com/WildMeOrg/wbia-deprecate-ubelt

* https://github.com/WildMeOrg/wbia-deprecate-dtool

* https://github.com/WildMeOrg/wbia-deprecate-guitool

* https://github.com/WildMeOrg/wbia-deprecate-plottool

* https://github.com/WildMeOrg/wbia-deprecate-detecttools

* https://github.com/WildMeOrg/wbia-deprecate-plugin-humpbacktl

* https://github.com/WildMeOrg/wbia-deprecate-tpl-lightnet

* https://github.com/WildMeOrg/wbia-deprecate-tpl-brambox

Plug-in Templates (Reference)

* https://github.com/WildMeOrg/wbia-plugin-template

* https://github.com/WildMeOrg/wbia-plugin-id-example

Miscellaneous (Reference)

* https://github.com/WildMeOrg/wbia-pypkg-build

* https://github.com/WildMeOrg/wbia-project-website

* https://github.com/WildMeOrg/wbia-aws-codedeploy

Citation
--------

If you use this code or its models in your research, please cite:

.. code:: text

@inproceedings{crall2013hotspotter,
title={Hotspotter — patterned species instance recognition},
author={Crall, Jonathan P and Stewart, Charles V and Berger-Wolf, Tanya Y and Rubenstein, Daniel I and Sundaresan, Siva R},
booktitle={2013 IEEE workshop on applications of computer vision (WACV)},
pages={230--237},
year={2013},
organization={IEEE}
}

@inproceedings{parham2018animal,
title={An animal detection pipeline for identification},
author={Parham, Jason and Stewart, Charles and Crall, Jonathan and Rubenstein, Daniel and Holmberg, Jason and Berger-Wolf, Tanya},
booktitle={2018 IEEE Winter Conference on Applications of Computer Vision (WACV)},
pages={1075--1083},
year={2018},
organization={IEEE}
}

@inproceedings{berger2015ibeis,
title={IBEIS: Image-based ecological information system: From pixels to science and conservation},
author={Berger-Wolf, TY and Rubenstein, DI and Stewart, CV and Holmberg, J and Parham, J and Crall, J},
booktitle={Bloomberg Data for Good Exchange Conference, New York, NY, USA},
volume={2},
year={2015}
}

@article{berger2017wildbook,
title={Wildbook: Crowdsourcing, computer vision, and data science for conservation},
author={Berger-Wolf, Tanya Y and Rubenstein, Daniel I and Stewart, Charles V and Holmberg, Jason A and Parham, Jason and Menon, Sreejith and Crall, Jonathan and Van Oast, Jon and Kiciman, Emre and Joppa, Lucas},
journal={arXiv preprint arXiv:1710.08880},
year={2017}
}

Documentation
-------------------------

The documentation is built and available online at `wildmeorg.github.io/wildbook-ia/ `_. However, if you need to build a local copy of the source, the following instructions can be used.

.. code:: bash

# checkout the source code
# install the project in development mode
pip install -e .
# build the docs
scripts/build-docs.sh

Then open the html file at ``docs/build/html/index.html``.

Code Style and Development Guidelines
-------------------------------------

Contributing
~~~~~~~~~~~~

It's recommended that you use ``pre-commit`` to ensure linting procedures are run
on any commit you make. (See also `pre-commit.com `_)

Reference `pre-commit's installation instructions `_ for software installation on your OS/platform. After you have the software installed, run ``pre-commit install`` on the command line. Now every time you commit to this project's code base the linter procedures will automatically run over the changed files. To run pre-commit on files preemtively from the command line use:

.. code:: bash

git add .
pre-commit run

# or

pre-commit run --all-files

Brunette
~~~~~~~~

Our code base has been formatted by Brunette, which is a fork and more configurable version of Black (https://black.readthedocs.io/en/stable/).

Flake8
~~~~~~

Try to conform to PEP8. You should set up your preferred editor to use flake8 as its Python linter, but pre-commit will ensure compliance before a git commit is completed.

To run flake8 from the command line use:

.. code:: bash

flake8

This will use the flake8 configuration within ``setup.cfg``,
which ignores several errors and stylistic considerations.
See the ``setup.cfg`` file for a full and accurate listing of stylistic codes to ignore.

PyTest
~~~~~~

Our code uses Google-style documentation tests (doctests) that uses pytest and xdoctest to enable full support. To run the tests from the command line use:

.. code:: bash

pytest

To run doctests with `+REQUIRES(--web-tests)` do:

.. code:: bash

pytest --web-tests

.. |Build| image:: https://img.shields.io/github/workflow/status/WildMeOrg/wildbook-ia/Build%20and%20upload%20to%20PyPI/main
:target: https://github.com/WildMeOrg/wildbook-ia/actions?query=branch%3Amain+workflow%3A%22Build+and+upload+to+PyPI%22
:alt: Build and upload to PyPI

.. |Pypi| image:: https://img.shields.io/pypi/v/wildbook-ia.svg
:target: https://pypi.python.org/pypi/wildbook-ia
:alt: Latest PyPI version

.. |Documentation| image:: https://img.shields.io/github/workflow/status/WildMeOrg/wildbook-ia/Build%20documentation?label=documentation
:target: https://wildmeorg.github.io/wildbook-ia/
:alt: Documentation on GitHub Pages

.. |Downloads| image:: https://img.shields.io/pypi/dm/wildbook-ia.svg
:target: https://pypistats.org/packages/wildbook-ia


Owner metadata


GitHub Events

Total
Last Year

Committers metadata

Last synced: 2 days ago

Total Commits: 10,021
Total Committers: 37
Avg Commits per committer: 270.838
Development Distribution Score (DDS): 0.496

Commits in past year: 154
Committers in past year: 7
Avg Commits per committer in past year: 22.0
Development Distribution Score (DDS) in past year: 0.214

Name Email Commits
joncrall e****c@g****m 5046
Jason Parham b****e@g****m 2457
Jason Parham p****m@w****g 1021
Michael Mulich m****h@g****m 407
karen chan k****n@k****m 352
tsubramanian t****n@g****m 155
Jon Crall j****l@B****t 116
Zackary Rutfield r****z@r****u 105
Hendrik Weideman w****h@r****u 100
Avi Weinstock a****4@g****m 85
Drew Blount m****e@d****r 47
Zach Jablons z****z@g****m 33
LashaO o****a@g****m 23
eylor m****y@g****m 13
Daniel Lowe d****5@g****m 10
eddywine n****d@g****m 9
Zackary Rutfield z****d@g****m 8
crowmagnumb c****b@g****m 6
holmbergius h****s@g****m 4
Tanya t****e@w****g 3
Tamil t****l@s****o 2
LoweD2 l****2@u****) 2
Larry O'Brien l****n@k****t 2
Andrew b****a@r****u 2
= j****2@g****m 1
Chuck Stewart c****t@g****m 1
Jason Parham j****m@J****l 1
tsdev-we 9****e 1
dependabot[bot] 4****] 1
Tanya 6****2 1
and 7 more...

Committer domains:


Issue and Pull Request metadata

Last synced: 2 days ago

Total issues: 9
Total pull requests: 126
Average time to close issues: 4 days
Average time to close pull requests: about 1 month
Total issue authors: 9
Total pull request authors: 12
Average comments per issue: 1.22
Average comments per pull request: 0.62
Merged pull request: 95
Bot issues: 0
Bot pull requests: 12

Past year issues: 2
Past year pull requests: 34
Past year average time to close issues: N/A
Past year average time to close pull requests: 20 days
Past year issue authors: 2
Past year pull request authors: 4
Past year average comments per issue: 0.0
Past year average comments per pull request: 0.26
Past year merged pull request: 30
Past year bot issues: 0
Past year bot pull requests: 1

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/wildmeorg/wildbook-ia

Top Issue Authors

  • bluemellophone (1)
  • charlesincharge (1)
  • goddesswarship (1)
  • hugovdev (1)
  • lobrien (1)
  • michavardy (1)
  • simbamangu (1)
  • StormlancerX (1)
  • yuerout (1)

Top Pull Request Authors

  • tsubramanian (30)
  • mmulich (23)
  • karenc (23)
  • dependabot[bot] (12)
  • LashaO (11)
  • bluemellophone (10)
  • drewblount (6)
  • TanyaStere42 (4)
  • eddywine (3)
  • lobrien (2)
  • tsdev-we (1)
  • charlesincharge (1)

Top Issue Labels

  • bug (1)

Top Pull Request Labels

  • dependencies (12)
  • python (12)
  • project_support (1)

Package metadata

pypi.org: wildbook-ia

Wildbook IA (WBIA) - Machine learning service for the WildBook project

  • Homepage: https://github.com/WildMeOrg/wildbook-ia
  • Documentation: https://wildbook-ia.readthedocs.io/
  • Licenses: Apache License 2.0
  • Latest release: 4.0.4 (published about 1 year ago)
  • Last Synced: 2024-05-10T09:03:40.574Z (2 days ago)
  • Versions: 35
  • Dependent Packages: 1
  • Dependent Repositories: 9
  • Downloads: 437 Last month
  • Rankings:
    • Dependent repos count: 4.933%
    • Dependent packages count: 7.303%
    • Stargazers count: 8.753%
    • Average: 8.857%
    • Forks count: 8.923%
    • Downloads: 14.373%
  • Maintainers (2)
  • Funding:
    • https://www.wildme.org/donate/

Dependencies

.github/workflows/docker-publish-arm64.yaml actions
  • actions/checkout v2 composite
  • actions/setup-python v2 composite
  • docker/login-action v1 composite
  • docker/setup-buildx-action v1 composite
  • docker/setup-qemu-action v1 composite
  • rtCamp/action-slack-notify master composite
.github/workflows/docker-publish.yaml actions
  • actions/checkout v2 composite
  • actions/setup-python v2 composite
  • docker/login-action v1 composite
  • rtCamp/action-slack-notify master composite
.github/workflows/python-publish.yml actions
  • actions/checkout v2 composite
  • actions/download-artifact v2 composite
  • actions/setup-python v2 composite
  • actions/upload-artifact v2 composite
  • pypa/gh-action-pypi-publish master composite
.github/workflows/testing.yml actions
  • actions/checkout v2 composite
  • actions/setup-python v2 composite
  • postgres 10 docker

Score: 14.0061705862076