GenRL is a PyTorch reinforcement learning library centered around reproducible, generalizable algorithm implementations and improving accessibility in Reinforcement Learning
GenRL's current release is at v0.0.2. Expect breaking changes
Reinforcement learning research is moving faster than ever before. In order to keep up with the growing trend and ensure that RL research remains reproducible, GenRL aims to aid faster paper reproduction and benchmarking by providing the following main features:
By integrating these features into GenRL, we aim to eventually support any new algorithm implementation in less than 100 lines.
If you're interested in contributing, feel free to go through the issues and open PRs for code, docs, tests etc. In case of any questions, please check out the Contributing Guidelines
GenRL is compatible with Python 3.6 or later and also depends on
openai-gym. The easiest way to install GenRL is with pip, Python's preferred package installer.
pip install genrl
Note that GenRL is an active project and routinely publishes new releases. In order to upgrade GenRL to the latest version, use pip as follows.
pip install -U genrl
If you intend to install the latest unreleased version of the library (i.e from source), you can simply do:
git clone https://github.com/SforAiDl/genrl.git cd genrl python setup.py install
To train a Soft Actor-Critic model from scratch on the
Pendulum-v0 gym environment and log rewards on tensorboard
import gym from genrl.agents import SAC from genrl.trainers import OffPolicyTrainer from genrl.environments import VectorEnv env = VectorEnv("Pendulum-v0") agent = SAC('mlp', env) trainer = OffPolicyTrainer(agent, env, log_mode=['stdout', 'tensorboard']) trainer.train()
To train a Tabular Dyna-Q model from scratch on the
FrozenLake-v0 gym environment and plot rewards:
import gym from genrl.agents import QLearning from genrl.trainers import ClassicalTrainer env = gym.make("FrozenLake-v0") agent = QLearning(env) trainer = ClassicalTrainer(agent, env, mode="dyna", model="tabular", n_episodes=10000) episode_rewards = trainer.train() trainer.plot(episode_rewards)