A curated list of open technology projects to sustain a stable climate, energy supply, biodiversity and natural resources.

rfishbase

An R interface to the fishbase.org database.
https://github.com/ropensci/rfishbase

Category: Biosphere
Sub Category: Marine Life and Fishery

Keywords

fish fishbase r r-package rstats taxonomy

Keywords from Contributors

ecology biodiversity genome occurrence biology darwincore taxize fisheries geocoding climate

Last synced: about 13 hours ago
JSON representation

Repository metadata

R interface to the fishbase.org database

README.Rmd

          ---
output: github_document
---

# rfishbase 



[![R-CMD-check](https://github.com/ropensci/rfishbase/actions/workflows/R-CMD-check.yaml/badge.svg)](https://github.com/ropensci/rfishbase/actions/workflows/R-CMD-check.yaml)
[![Coverage status](https://codecov.io/gh/ropensci/rfishbase/branch/master/graph/badge.svg)](https://app.codecov.io/github/ropensci/rfishbase?branch=master)
[![Onboarding](https://badges.ropensci.org/137_status.svg)](https://github.com/ropensci/software-review/issues/137)
[![CRAN status](https://www.r-pkg.org/badges/version/rfishbase)](https://cran.r-project.org/package=rfishbase)
[![Downloads](https://cranlogs.r-pkg.org/badges/grand-total/rfishbase)](https://github.com/r-hub/cranlogs.app)


Welcome to `rfishbase 5`! This is the fourth rewrite of the original `rfishbase` package described in [Boettiger et al. (2012)](https://doi.org/10.1111/j.1095-8649.2012.03464.x).   


Another streamlined re-design following new abilities for data hosting and access.
This release relies on a HuggingFace datasets hosting for data and metadata hosting
in parquet and schema.org.  

Data access is simplified to use the simple HuggingFace datasets API instead
of the previous contentid-based resolution. This allows metadata to be defined
with directly alongside the data platform independent of the R package.  

A simplified access protocol relies on `duckdbfs` for direct reads of tables.
Several functions previously used only to manage connections are now deprecated
or removed, along with a significant number of dependencies.

Core use still centers around the same package API using the `fb_tbl()` function,
with legacy helper functions for common tables like `species()` are still accessible and
can still optionally filter by species name where appropriate.  As before, loading the
full tables and sub-setting manually is still recommended.

Historic helper  functions like `load_taxa()` (combining the taxonomic classification from Species,
Genus, Family and Order tables), `validate_names()`, and `common_to_sci()` and 
`sci_to_common()` should be in working order, all using table-based outputs.


- `rfishbase 1.0` relied on parsing of XML pages served directly from Fishbase.org.  
- `rfishbase 2.0` relied on calls to a ruby-based API, `fishbaseapi`, that provided access to SQL snapshots of about 20 of the more popular tables in FishBase or SeaLifeBase.
- `rfishbase 3.0` side-stepped the API by making queries which directly downloaded compressed csv tables from a static web host. This substantially improved performance a reliability, particularly for large queries. The release largely remained backwards compatible with 2.0, and added more tables.
- `rfishbase 4.0` extends the static model and interface. Static tables are distributed in parquet and accessed through a provenance-based identifier. While old functions are retained, a new interface is introduced to provide easy access to all fishbase tables.

We welcome any feedback, issues or questions that users may encounter through our issues tracker on GitHub: 




```{r include=FALSE}
knitr::opts_chunk$set(warning=FALSE, comment=NA)
options("rfishbase_local_db" = FALSE)

```


## Installation



```{r message=FALSE, warning=FALSE, results="hide", eval=FALSE}
remotes::install_github("ropensci/rfishbase")
```


```{r message=FALSE, warning=FALSE, results="hide"}
library("rfishbase")
library("dplyr") # convenient but not required
```

## Getting started

## Generic table interface

All fishbase tables can be accessed by name using the `fb_tbl()` function:

```{r}
fb_tbl("ecosystem")
```


You can see all the tables using `fb_tables()` to see a list of all the table names (specify `sealifebase` if desired). Careful, there are a lot of them! The fishbase databases have grown a lot in the decades, and were not intended to be used directly by most end-users, so you may have considerable work to determine what's what. Keep in mind that many variables can be estimated in different ways (e.g. trophic level), and thus may report different values in different tables.  Also note that species is name (or SpecCode) is not always the primary key for a table -- many tables are specific to stocks or even individual samples, and some tables are reference lists that are not species focused at all, but meant to be joined to other tables (`faoareas`, etc).  Compare tables against what you see on fishbase.org, or ask on our issues forum for advice!


```{r}
fish <- c("Oreochromis niloticus", "Salmo trutta")

fb_tbl("species") %>% 
  mutate(sci_name = paste(Genus, Species)) %>%
  filter(sci_name %in% fish) %>% 
  select(sci_name, FBname, Length)

```

In most tables, species are identified by `SpecCode` (as per best practices) rather than scientific names.  Multiple tables can be joined on the `SpecCode` to more fully describe a species.  

To filter species by taxonomic names, use the taxa table from `load_taxa()`, which provides a joined table of taxonomy from subspecies up through Class, along with the corresponding FishBase taxon ids codes.  Here is an example workflow joining two of the spawning tables and filtering to the grouper family, _Epinephelidae_:

```{r  message=FALSE}
library(rfishbase)
library(dplyr)

## Get the whole spawning and spawn agg table, joined together:
spawn <- left_join(fb_tbl("spawning"),  
                   fb_tbl("spawnagg"), 
                   relationship = "many-to-many")

# Filter taxa down to the desired species
groupers <- load_taxa() |> filter(Family == "Epinephelidae")

## A "filtering join" (inner join) 
spawn |> inner_join(groupers)
```

## Species Names

Always keep in mind that taxonomy is a dynamic concept. Species can be split or lumped based on new evidence, and naming authorities can disagree over which name is an 'accepted name' or 'synonym' for any given species. When providing your own list of species names, consider first checking that those names are "valid" in the current taxonomy established by FishBase:

```{r message=FALSE}
validate_names("Abramites ternetzi")
```

`rfishbase` can also provide tables of `synonyms()`, a table of `common_names()` in multiple languages, and convert `common_to_sci()` or `sci_to_common()`

```{r message=FALSE}
common_to_sci(c("Bicolor cleaner wrasse", "humphead parrotfish"), Language="English")
```

Note that the results are returned as a table, potentially indicating other common names for the same species, as well as potentially different species that match the provided common name! Please always be careful with names, and use unique SpecCodes to refer to unique species.  


## SeaLifeBase

SeaLifeBase.org is maintained by the same organization and largely parallels the database structure of Fishbase. As such, almost all `rfishbase` functions can instead be instructed to address the 


```{r}
fb_tbl("species", "sealifebase")
```

## Versions and importing all tables

By default, tables are downloaded the first time they are used.  `rfishbase` defaults to download the latest available snapshot; be aware that the most recent snapshot may be months behind the latest data on fishbase.org. Check available releases:

```{r}
available_releases()
```


-----------

Please note that this package is released with a [Contributor Code of Conduct](https://ropensci.org/code-of-conduct/). By contributing to this project, you agree to abide by its terms.


[![ropensci_footer](https://ropensci.org/public_images/github_footer.png)](https://ropensci.org)



        

Owner metadata


GitHub Events

Total
Last Year

Committers metadata

Last synced: 4 days ago

Total Commits: 588
Total Committers: 18
Avg Commits per committer: 32.667
Development Distribution Score (DDS): 0.204

Commits in past year: 19
Committers in past year: 2
Avg Commits per committer in past year: 9.5
Development Distribution Score (DDS) in past year: 0.368

Name Email Commits
Carl Boettiger c****g@g****m 468
Scott Chamberlain m****s@g****m 47
Carl Boettiger c****g@g****m 19
Philipp Neubauer n****l@g****m 12
rstudio r****o@e****m 10
Carl Boettiger c****l@r****g 7
Guohuan Su 3****u 7
Tim Poisot t****t@u****a 4
Harry Ganz h****z@r****u 3
Karthik Ram k****m@g****m 2
Tim Poisot t****t@g****m 2
Cotton Rockwood c****d@g****m 1
Kevin Cazelles k****e@u****a 1
jsta j****k@u****u 1
rOpenSci Bot m****t@g****m 1
Harry Ganz h****z 1
Casey O'Hara c****a@g****m 1
Ben Raymond b****d@a****u 1

Committer domains:


Issue and Pull Request metadata

Last synced: 1 day ago

Total issues: 268
Total pull requests: 37
Average time to close issues: 9 months
Average time to close pull requests: about 2 months
Total issue authors: 165
Total pull request authors: 13
Average comments per issue: 3.91
Average comments per pull request: 1.32
Merged pull request: 32
Bot issues: 0
Bot pull requests: 0

Past year issues: 23
Past year pull requests: 5
Past year average time to close issues: 11 days
Past year average time to close pull requests: about 10 hours
Past year issue authors: 22
Past year pull request authors: 2
Past year average comments per issue: 2.39
Past year average comments per pull request: 0.6
Past year merged pull request: 3
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/ropensci/rfishbase

Top Issue Authors

  • cboettig (40)
  • sckott (20)
  • amroco (7)
  • jatalah (5)
  • andybeet (5)
  • melissaszy (4)
  • kairos35 (3)
  • CottonRockwood (3)
  • reginaldo-re (3)
  • jebyrnes (3)
  • nschiett (3)
  • tjquimpo (2)
  • ceri-w (2)
  • mlandis (2)
  • luozhisen (2)

Top Pull Request Authors

  • cboettig (14)
  • sckott (5)
  • Philipp-Neubauer (4)
  • guohuansu (3)
  • karthik (2)
  • tpoisot (2)
  • raymondben (1)
  • kant (1)
  • oharac (1)
  • jsta (1)
  • KevCaz (1)
  • CottonRockwood (1)
  • harryganz (1)

Top Issue Labels

  • bug (11)
  • Done in 2.0 (8)
  • feature request (6)
  • API-related (4)
  • Done in 3.0 (4)

Top Pull Request Labels


Package metadata

cran.r-project.org: rfishbase

R Interface to 'FishBase'

  • Homepage: https://docs.ropensci.org/rfishbase/
  • Documentation: http://cran.r-project.org/web/packages/rfishbase/rfishbase.pdf
  • Licenses: CC0
  • Latest release: 5.0.1 (published 4 months ago)
  • Last Synced: 2025-04-25T13:04:48.810Z (1 day ago)
  • Versions: 29
  • Dependent Packages: 7
  • Dependent Repositories: 24
  • Downloads: 979 Last month
  • Docker Downloads: 109,117
  • Rankings:
    • Docker downloads count: 0.045%
    • Forks count: 1.891%
    • Stargazers count: 3.888%
    • Average: 4.981%
    • Dependent repos count: 5.616%
    • Dependent packages count: 6.444%
    • Downloads: 12.002%
  • Maintainers (1)

Dependencies

DESCRIPTION cran
  • R >= 4.0 depends
  • DBI * imports
  • contentid >= 0.0.15 imports
  • dbplyr * imports
  • dplyr * imports
  • duckdb * imports
  • jsonlite * imports
  • magrittr * imports
  • memoise * imports
  • methods * imports
  • progress * imports
  • purrr * imports
  • readr >= 2.0.0 imports
  • rlang * imports
  • rstudioapi * imports
  • stringr * imports
  • tibble * imports
  • tools * imports
  • utils * imports
  • covr * suggests
  • knitr * suggests
  • rmarkdown * suggests
  • spelling * suggests
  • testthat * suggests
.github/workflows/R-CMD-check.yaml actions
  • actions/checkout v3 composite
  • r-lib/actions/check-r-package v2 composite
  • r-lib/actions/setup-pandoc v2 composite
  • r-lib/actions/setup-r v2 composite
  • r-lib/actions/setup-r-dependencies v2 composite

Score: 19.510441977342456