<<RepoHeader(rl-texplore-ros-pkg)>>
Documentation
The code in this repository provides agents, environments, and multiple ways for them to communicate (through ROS messages, or by including the agent and environment libraries). There are 5 packages in the repository:
rl_common: Some files that are common to both agents and environments.
rl_msgs: Definitions of ROS messages for agents and envs to communicate.
rl_agent: A library of some RL agents including Q-Learning and TEXPLORE.
rl_env: A library of some RL environments such as Taxi and Fuel World.
rl_experiment: Code to run some RL experiments without ROS message passing.
More details for each of the packages are available at the above links. References for some of the algorithms and environments provided in this package are available at the author's website.
Checking out the code
Check out the code at: http://code.google.com/p/rl-texplore-ros-pkg/source/checkout
Tutorial
For details on how to use this repository, check out the tutorial.
Features
Some of the key features of this package include:
- Implementations of many RL algorithms and environments.
- Uses a set of ROS messages for communicating between RL agents and environment.
Includes the TEXPLORE RL algorithm (see reference).
Includes our real-time parallel architecture for model-based RL (see reference).
- Includes a general model-based agent that can be used with any model learning or planning method.
Agents and environments can be written in any language as long as they use rl_msgs to communicate.
Provides code (rl_experiment package) to run RL experiments and collect reward data.
- Can easily be integrated with robots running ROS to perform learning on them.
- New model learning and planning methods can easily be added and used within the general model based agent and the real time architecture.
