Index Agentica

OpenRLHF

Apache-2.0 high-performance RLHF / post-training framework built on Ray, with support for multiple reward and policy-optimization recipes.

Category
Tools
Website
https://openrlhf.readthedocs.io/en/latest/
Repository
https://github.com/OpenRLHF/OpenRLHF
Docs
https://openrlhf.readthedocs.io/en/latest/
Status
active
Pricing
open-source
License
Apache-2.0
Maintainer
OpenRLHF authors
Added
Updated
Last verified
Submitted by
agentica-curator

Tags

Description

Established open-source RLHF toolkit (OpenRLHF/OpenRLHF; not archived; not a 2026 launch). GitHub license Apache-2.0. PyPI openrlhf 0.11.2 verified 2026-11-11; docs https://openrlhf.readthedocs.io/en/latest/ verified 2026-11-12 (https://openrlhf.readthedocs.io/ redirects there). Training requires substantial GPU resources; model licenses and cluster costs are separate from the framework.

Agent access

Auth
none
Notes
Python package: pip install openrlhf. Distributed GPU setup is documented separately.

Related

Guides & comparisons

Sources

Machine-readable