https://github.com/pytorch/rl

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.
https://github.com/pytorch/rl

Keywords

ai control decision-making distributed-computing machine-learning marl model-based-reinforcement-learning multi-agent-reinforcement-learning pytorch reinforcement-learning rl robotics torch

Keywords from Contributors

language-model transformers gym data-loader parallel jax ray pytorch-transformers seq2seq speech-recognition

Last synced: 11 months ago
JSON representation

Acceptance Criteria

Revelant topics? true
External users? true
Open source license? true
Active? true
Fork? false

Repository metadata

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.

Host: GitHub
URL: https://github.com/pytorch/rl
Owner: pytorch
License: mit
Created: 2022-02-01T17:17:36.000Z (over 3 years ago)
Default Branch: main
Last Pushed: 2024-04-11T16:10:13.000Z (about 1 year ago)
Last Synced: 2024-04-11T23:56:24.023Z (about 1 year ago)
Topics: ai, control, decision-making, distributed-computing, machine-learning, marl, model-based-reinforcement-learning, multi-agent-reinforcement-learning, pytorch, reinforcement-learning, rl, robotics, torch
Language: Python
Homepage: https://pytorch.org/rl
Size: 124 MB
Stars: 1,823
Watchers: 41
Forks: 245
Open Issues: 212
Releases: 0
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Citation: CITATION.cff

Owner metadata

Name: pytorch
Login: pytorch
Email:
Kind: organization
Description:
Website: https://pytorch.org
Location: where the eigens are valued
Twitter:
Company:
Icon url: https://avatars.githubusercontent.com/u/21003710?v=4
Repositories: 68
Last ynced at: 2023-04-09T07:16:05.242Z
Profile URL: https://github.com/pytorch

Committers metadata

Last synced: about 1 year ago

Total Commits: 1,349
Total Committers: 146
Avg Commits per committer: 9.24
Development Distribution Score (DDS): 0.612

Commits in past year: 643
Committers in past year: 48
Avg Commits per committer in past year: 13.396
Development Distribution Score (DDS) in past year: 0.454

Name	Email	Commits
Vincent Moens	v**s@g**m	523
Vincent Moens	v**s@m**m	351
Matteo Bettini	5****i	99
Albert Bou	a****2	54
nicolas-dufour	3****r	28
Sebastian Dittert	S**t@g**e	23
Omkar Salpekar	o**r@f**m	22
Tom Begley	t**y@g**m	17
Martin Marenz	m**z@m**m	16
Waris Radji	w**4@g**m	8
Skander Moalla	3****a	8
Shagun Sodhani	1****i	6
Xiaomeng Yang	b**m@g**m	5
Bo Liu	b**s@g**m	5
Danylo Baibak	b**k@m**m	4
Rob Anderson	r**x@g**m	4
D.L	5****s	4
Sergey Ordinskiy	1****y	4
Alessandro Pietro Bardelli	a****d	4
Honglong Tian	5****T	4
Yohann Benchetrit	y**t@g**m	3
Romain Julien	r**n@f**m	3
Almaz Zinollayev	3****e	3
Brian Vaughan	n****v	3
Sriram Krishna	s**9@g**m	2
khmigor	m**h@g**m	2
kovalevfm	k**m@g**m	2
yingchenlin	y**n@g**m	2
Alexander Lobov	t**n@g**m	2
DjImene	i**d@g**m	2
and 116 more...

Committer domains:

Issue and Pull Request metadata

Last synced: about 1 year ago

Total issues: 233
Total pull requests: 633
Average time to close issues: about 2 months
Average time to close pull requests: 11 days
Total issue authors: 100
Total pull request authors: 43
Average comments per issue: 3.72
Average comments per pull request: 2.27
Merged pull request: 484
Bot issues: 0
Bot pull requests: 1

Past year issues: 203
Past year pull requests: 568
Past year average time to close issues: 20 days
Past year average time to close pull requests: 7 days
Past year issue authors: 92
Past year pull request authors: 38
Past year average comments per issue: 3.55
Past year average comments per pull request: 2.29
Past year merged pull request: 437
Past year bot issues: 0
Past year bot pull requests: 1

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/pytorch/rl

Top Issue Authors

matteobettini (26)
vmoens (20)
smorad (16)
albertbou92 (14)
skandermoalla (8)
hyerra (8)
maxweissenbacher (6)
duburcqa (4)
ShaneFlandermeyer (4)
Sefank (4)
FrankTianTT (4)
Killpit (4)
EkaterinaAbramova (3)
diegochine (3)
ADebor (3)

Top Pull Request Authors

vmoens (347)
matteobettini (97)
albertbou92 (50)
osalpekar (28)
BY571 (18)
smorad (8)
Blonck (7)
skandermoalla (6)
DanilBaibak (6)
MateuszGuzek (6)
xmaples (5)
kushaangupta (4)
degensean (4)
FrankTianTT (4)
rohitnig (3)

Top Issue Labels

bug (134)
enhancement (80)
Good first issue (7)
new algo (3)

Top Pull Request Labels

CLA Signed (629)
bug (166)
enhancement (114)
CI (57)
documentation (48)
Refactoring (39)
Environments (28)
new algo (22)
Data (21)
performance (20)
Tests (19)
quality (14)
versioning (13)
bc breaking (7)
Benchmarks (6)
ciflow/docs (5)
ciflow/binaries/all (4)
formatting (2)
Release (2)
major (2)
dependencies (1)
setup (1)
tutorials (1)

Package metadata

Total packages: 2
Total downloads:
- pypi: 39,564 last-month
Total docker downloads: 745
Total dependent packages: 6 (may contain duplicates)
Total dependent repositories: 16 (may contain duplicates)
Total versions: 549
Total maintainers: 1

pypi.org: torchrl

Homepage: https://github.com/pytorch/rl
Documentation: https://torchrl.readthedocs.io/
Licenses: MIT
Latest release: 1.8.4 (published over 6 years ago)
Last Synced: 2024-05-25T20:20:24.216Z (12 months ago)
Versions: 39
Dependent Packages: 6
Dependent Repositories: 16
Downloads: 18,645 Last month
Docker Downloads: 697
Rankings:
- Stargazers count: 1.804%
- Dependent packages count: 2.377%
- Docker downloads count: 2.599%
- Downloads: 2.688%
- Average: 2.798%
- Dependent repos count: 3.608%
- Forks count: 3.715%
Maintainers (1)
- vincent.moens

pypi.org: torchrl-nightly

Homepage: https://github.com/pytorch/rl
Documentation: https://torchrl-nightly.readthedocs.io/
Licenses: MIT
Latest release: 2024.5.17 (published 12 months ago)
Last Synced: 2024-06-11T17:27:15.369Z (11 months ago)
Versions: 510
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 20,919 Last month
Docker Downloads: 48
Rankings:
- Stargazers count: 1.942%
- Downloads: 2.41%
- Forks count: 4.102%
- Dependent packages count: 6.633%
- Average: 9.14%
- Dependent repos count: 30.611%
Maintainers (1)
- vincent.moens

Dependencies

.github/workflows/benchmarks.yml actions

actions/checkout v3 composite
actions/setup-python v4 composite
benchmark-action/github-action-benchmark v1 composite

.github/workflows/benchmarks_pr.yml actions

actions/checkout v3 composite
actions/setup-python v4 composite
apbard/pytest-benchmark-commenter v3 composite

.github/workflows/docs.yml actions

JamesIves/github-pages-deploy-action releases/v4 composite
actions/checkout v3 composite
actions/upload-artifact v2 composite

.github/workflows/lint.yml actions

.github/workflows/nightly_build.yml actions

actions/checkout v2 composite
actions/download-artifact v2 composite
actions/setup-python v2 composite
actions/upload-artifact v2 composite

.github/workflows/test-linux-brax.yml actions

.github/workflows/test-linux-cpu.yml actions

.github/workflows/test-linux-d4rl.yml actions

.github/workflows/test-linux-envpool.yml actions

.github/workflows/test-linux-examples.yml actions

.github/workflows/test-linux-gpu.yml actions

.github/workflows/test-linux-gym.yml actions

.github/workflows/test-linux-habitat.yml actions

.github/workflows/test-linux-jumanji.yml actions

.github/workflows/test-linux-olddeps.yml actions

.github/workflows/test-linux-optdeps.yml actions

.github/workflows/test-linux-pettingzoo.yml actions

.github/workflows/test-linux-rlhf.yml actions

.github/workflows/test-linux-robohive.yml actions

.github/workflows/test-linux-sklearn.yml actions

.github/workflows/test-linux-smacv2.yml actions

.github/workflows/test-linux-stable-gpu.yml actions

.github/workflows/test-linux-vmas.yml actions

.github/workflows/test-macos-cpu.yml actions

.github/workflows/test-windows-optdepts-cpu.yml actions

.github/workflows/test-windows-optdepts-gpu.yml actions

.github/workflows/wheels.yml actions

actions/checkout v2 composite
actions/download-artifact v2 composite
actions/setup-python v2 composite
actions/upload-artifact v2 composite

benchmarks/requirements.txt pypi

pytest-benchmark *
tenacity *

docs/requirements.txt pypi

Jinja2 ==3.1.2
ale-py *
atari-py *
dm_control *
docutils *
gym *
imageio *
ipython *
matplotlib *
memory_profiler *
myst-parser *
numpy *
pygame *
pyrender *
pytest *
sphinx ===5.0.0
sphinx-autodoc-typehints *
sphinx-copybutton *
sphinx-gallery *
sphinx-serve ==1.0.1
sphinxcontrib-htmlhelp *
torchvision *
tqdm *
vmas ==1.2.11

pyproject.toml pypi

setup.py pypi

cloudpickle *
numpy *
packaging *
pytorch_package_dep ,
tensordict_dep ,

.github/workflows/build-wheels-m1.yml actions

.github/workflows/test-linux-minari.yml actions

.github/unittest/linux/scripts/environment.yml pypi

av *
cloudpickle *
coverage *
dm_control *
expecttest *
future *
hydra-core *
hypothesis *
imageio ==2.26.0
mlflow *
moviepy *
ninja *
pygame *
pytest *
pytest-cov *
pytest-instafail *
pytest-mock *
pytest-rerunfailures *
pytest-timeout *
pyyaml *
ray <2.8.0
scipy *
tensorboard *
tqdm *
transformers *
wandb *

.github/unittest/linux_distributed/scripts/environment.yml pypi

av *
cloudpickle *
coverage *
dm_control *
expecttest *
future *
hydra-core *
hypothesis *
imageio ==2.26.0
mlflow *
moviepy *
pygame *
pytest *
pytest-cov *
pytest-instafail *
pytest-mock *
pytest-rerunfailures *
pyyaml *
ray <2.8.0
scipy *
tensorboard *
tqdm *
virtualenv *
wandb *

.github/unittest/linux_examples/scripts/environment.yml pypi

av *
cloudpickle *
coverage *
dm_control *
expecttest *
future *
gym *
hydra-core *
hypothesis *
imageio ==2.26.0
mlflow *
moviepy *
pygame *
pytest *
pytest-cov *
pytest-instafail *
pytest-mock *
pytest-rerunfailures *
pyyaml *
scipy *
tqdm *
transformers *
vmas *

.github/unittest/linux_libs/scripts_brax/environment.yml pypi

brax *
cloudpickle *
expecttest *
future *
hydra-core *
hypothesis *
pytest *
pytest-cov *
pytest-error-for-skips *
pytest-instafail *
pytest-mock *
pytest-rerunfailures *
pyyaml *
scipy *

.github/unittest/linux_libs/scripts_d4rl/environment.yml pypi

cloudpickle *
cython <3
expecttest *
future *
hydra-core *
hypothesis *
pytest *
pytest-cov *
pytest-error-for-skips *
pytest-instafail *
pytest-mock *
pytest-rerunfailures *
pyyaml *
scipy *

.github/unittest/linux_libs/scripts_envpool/environment.yml pypi

cloudpickle *
coverage *
dm_control *
expecttest *
future *
hypothesis *
moviepy *
pygame *
pytest-cov *
pytest-error-for-skips *
pytest-instafail *
pytest-mock *
pytest-rerunfailures *
pyyaml *
scipy *

.github/unittest/linux_libs/scripts_gym/environment.yml pypi

cloudpickle *
expecttest *
future *
gym ==0.13
hydra-core *
hypothesis *
moviepy *
patchelf *
pygame *
pyopengl ==3.1.0
pytest *
pytest-cov *
pytest-error-for-skips *
pytest-instafail *
pytest-mock *
pytest-rerunfailures *
pyyaml *
scipy *
tqdm *

.github/unittest/linux_libs/scripts_habitat/environment.yml pypi

cloudpickle *
expecttest *
future *
hydra-core *
hypothesis *
ninja *
pytest *
pytest-cov *
pytest-error-for-skips *
pytest-instafail *
pytest-mock *
pytest-rerunfailures *
pyyaml *
scipy ==1.9.1

.github/unittest/linux_libs/scripts_jumanji/environment.yml pypi

cloudpickle *
expecttest *
future *
hydra-core *
hypothesis *
jumanji *
pytest *
pytest-cov *
pytest-error-for-skips *
pytest-instafail *
pytest-mock *
pytest-rerunfailures *
pyyaml *
scipy *

.github/unittest/linux_libs/scripts_minari/environment.yml pypi

cloudpickle *
expecttest *
future *
hydra-core *
hypothesis *
minari *
pytest *
pytest-cov *
pytest-error-for-skips *
pytest-instafail *
pytest-mock *
pytest-rerunfailures *
pyyaml *
scipy *

.github/unittest/linux_libs/scripts_pettingzoo/environment.yml pypi

autorom *
cloudpickle *
expecttest *
gym *
gym-notices *
importlib-metadata *
pettingzoo ==1.24.1
pytest *
pytest-cov *
pytest-error-for-skips *
pytest-instafail *
pytest-mock *
pytest-rerunfailures *
pyyaml *
six *
zipp *

.github/unittest/linux_libs/scripts_rlhf/environment.yml pypi

cloudpickle *
datasets *
expecttest *
future *
hydra-core *
hypothesis *
pytest *
pytest-cov *
pytest-error-for-skips *
pytest-instafail *
pytest-mock *
pytest-rerunfailures *
pyyaml *
scipy *
transformers *

.github/unittest/linux_libs/scripts_robohive/environment.yml pypi

cloudpickle *
dm_control ==1.0.11
expecttest *
future *
gym ==0.13
hydra-core *
hypothesis *
moviepy *
mujoco ==2.3.3
patchelf *
pygame *
pytest *
pytest-cov *
pytest-error-for-skips *
pytest-instafail *
pytest-mock *
pytest-rerunfailures *
pyyaml *
scipy *
tqdm *

.github/unittest/linux_libs/scripts_sklearn/environment.yml pypi

cloudpickle *
expecttest *
future *
hydra-core *
hypothesis *
pandas *
pytest *
pytest-cov *
pytest-error-for-skips *
pytest-instafail *
pytest-mock *
pytest-rerunfailures *
pyyaml *
scikit-learn *
scipy *

.github/unittest/linux_libs/scripts_smacv2/environment.yml pypi

cloudpickle *
expecttest *
gym *
gym-notices *
importlib-metadata *
numpy ==1.23.0
pytest *
pytest-cov *
pytest-error-for-skips *
pytest-instafail *
pytest-mock *
pytest-rerunfailures *
pyyaml *
zipp *

.github/unittest/linux_libs/scripts_vmas/environment.yml pypi

cloudpickle *
expecttest *
gym *
gym-notices *
importlib-metadata *
numpy *
pyglet ==1.5.27
pytest *
pytest-cov *
pytest-error-for-skips *
pytest-instafail *
pytest-mock *
pytest-rerunfailures *
pyyaml *
scipy *
six *
torch *
vmas *
zipp *

.github/unittest/linux_olddeps/scripts_gym_0_13/environment.yml pypi

cloudpickle *
expecttest *
future *
gym ==0.13
hydra-core *
hypothesis *
moviepy *
patchelf *
pygame *
pyopengl ==3.1.4
pytest *
pytest-cov *
pytest-instafail *
pytest-mock *
pytest-rerunfailures *
pyyaml *
ray <2.8.0
scipy *
tqdm *

.github/unittest/linux_optdeps/scripts/environment.yml pypi

cloudpickle *
coverage *
expecttest *
future *
hypothesis *
pytest *
pytest-cov *
pytest-instafail *
pytest-mock *
pytest-rerunfailures *
pyyaml *
ray <2.8.0
scipy *

.github/unittest/windows_optdepts/scripts/environment.yml pypi

cloudpickle *
coverage *
expecttest *
future *
hypothesis *
pytest *
pytest-cov *
pytest-instafail *
pytest-mock *
pytest-rerunfailures *
pyyaml *
scipy *

examples/rlhf/requirements.txt pypi

PyYAML *
datasets *
hydra-core *
matplotlib *
numpy *
requests *
tiktoken *
tqdm *
transformers *

Score: 23.20685736901273

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Open Sustainable Technology