{
  "type": "comparison",
  "id": "rl-environment-libraries",
  "title": "RL environment libraries compared — NeMo Gym, OpenEnv and Verifiers",
  "summary": "Compare NeMo Gym, OpenEnv and Verifiers as libraries for writing and running RL environments: authoring model, isolation, documented trainers, install paths, licences and current versions. Distinct from Harbor/AgentEnv/Seahaven and from the agent RL stacks comparison.",
  "author": "Agentica Author",
  "tags": [
    "reinforcement-learning",
    "environments",
    "evals",
    "training",
    "python"
  ],
  "published": "2026-11-13",
  "updated": "2026-11-13",
  "last_verified": "2026-11-13",
  "entries": [
    "nemo-gym",
    "openenv",
    "verifiers",
    "prime-rl",
    "nemo-rl",
    "harbor",
    "trl",
    "skyrl",
    "unsloth",
    "openpipe-art",
    "verl",
    "agent-lightning",
    "agentenv-framework",
    "seahaven"
  ],
  "links": {
    "html": "https://indexagentica.com/compare/rl-environment-libraries/",
    "markdown": "https://indexagentica.com/compare/rl-environment-libraries.md",
    "json": "https://indexagentica.com/api/longform/compare/rl-environment-libraries.json",
    "source": "https://github.com/Drudley/indexagentica/blob/main/content-long/compare/rl-environment-libraries.md"
  },
  "status": "published",
  "comparison": {
    "subjects": [
      {
        "id": "nemo-gym",
        "name": "NeMo Gym",
        "summary": "NVIDIA Apache-2.0 library for building, evaluating and scaling agent environments, verifiers and harnesses, including sandboxed code-execution tasks.",
        "url": "https://indexagentica.com/entries/nemo-gym/",
        "json": "https://indexagentica.com/api/entries/nemo-gym.json"
      },
      {
        "id": "openenv",
        "name": "OpenEnv",
        "summary": "BSD-3-Clause framework for building and serving isolated agentic RL environments over a Gymnasium-style reset/step/state API.",
        "url": "https://indexagentica.com/entries/openenv/",
        "json": "https://indexagentica.com/api/entries/openenv.json"
      },
      {
        "id": "verifiers",
        "name": "verifiers",
        "summary": "Prime Intellect’s MIT library for creating LLM reinforcement-learning environments and evals, with a matching PyPI package.",
        "url": "https://indexagentica.com/entries/verifiers/",
        "json": "https://indexagentica.com/api/entries/verifiers.json"
      }
    ],
    "criteria": [
      "Authoring model",
      "Runtime and isolation",
      "Training integrations",
      "Official install and versions",
      "License"
    ],
    "rows": {
      "nemo-gym": {
        "Authoring model": "An environment is a dataset of tasks, an agent harness, a verifier, and per-task state. Tutorials cover single-step and multi-step tool calling, session state, and multi-reward verification. The documented CLI includes gym env start and gym eval run.",
        "Runtime and isolation": "Local coordinating servers for resources, agent and model. Release notes document multiple sandbox providers. A GPU is not required for the library itself; particular resource servers or inference may need one, and the official quick start uses a model API key.",
        "Training integrations": "Official training tutorials cover NeMo RL, Unsloth and VeRL. The ecosystem docs also describe combining Harbor, OpenEnv, Reasoning Gym and Verifiers environments with NeMo Gym's own.",
        "Official install and versions": "Official quick start is git clone, then uv venv --python 3.13.14 && uv sync (Python >=3.13.14), not a pip one-liner. PyPI nemo-gym 0.7.0 matches GitHub v0.7.0 (12 October 2026).",
        "License": "Apache License 2.0 (repository LICENSE)"
      },
      "openenv": {
        "Authoring model": "Subclass Environment and implement reset(), step() and state, plus Action/Observation models. Scaffold with openenv init. Rewards are computed in the environment (observation fields or a rubric). openenv import can wrap a Verifiers or AgentEnv source.",
        "Runtime and isolation": "Each environment is documented as a Docker image that can run locally, on a cloud sandbox, or as a Hugging Face Space, over a Gymnasium-style reset/step/state API on WebSocket/HTTP. openenv serve runs on the host for local development; use Docker or Spaces for isolated training.",
        "Training integrations": "The README and training guide list TRL (environment_factory on GRPOTrainer, and Harbor traces with AsyncGRPOTrainer), Unsloth, SkyRL, ART, Oumi, torchforge, Miles and others. Training stays in the framework; the environment supplies tools and the reward.",
        "Official install and versions": "pip install openenv (Python >=3.10). PyPI and GitHub latest are 0.13.0 (12 November 2026). The project notes that it is in early development and APIs may change.",
        "License": "BSD 3-Clause (repository LICENSE; copyright 2026, Hugging Face, Inc.)"
      },
      "verifiers": {
        "Authoring model": "A Taskset.load() builds Task objects from TaskData (prompt, files, scoring). Most packages need only a Taskset and Task; a custom Env is for bespoke multi-agent control flow. Score with @vf.reward. Isolated grading uses ScoringConfig(mode=\"isolated\").",
        "Runtime and isolation": "An evaluator process plus optional agent and grading sandboxes (Docker and other runtimes are documented). vf-validate can check task setup or a gold solution without calling a model. vf-run runs a few in-process episodes.",
        "Training integrations": "Documented as tightly integrated with prime-rl (the orchestrator drives verifiers environments) and Prime Intellect's Environments Hub and Hosted Training (account and compute cost possible). OpenEnv can import a Verifiers source; NeMo Gym documents a Verifiers agent integration.",
        "Official install and versions": "Getting started is git clone and uv sync (example vf-validate reverse-text -n 1). PyPI verifiers 0.4.1 matches GitHub v0.4.1 (3 November 2026), Python >=3.11,<3.15. The README also recommends the Prime CLI (uv tool install prime).",
        "License": "MIT (repository LICENSE; copyright 2026 Prime Intellect)"
      }
    },
    "table": [
      {
        "entry": "nemo-gym",
        "name": "NeMo Gym",
        "url": "https://indexagentica.com/entries/nemo-gym/",
        "values": {
          "Authoring model": "An environment is a dataset of tasks, an agent harness, a verifier, and per-task state. Tutorials cover single-step and multi-step tool calling, session state, and multi-reward verification. The documented CLI includes gym env start and gym eval run.",
          "Runtime and isolation": "Local coordinating servers for resources, agent and model. Release notes document multiple sandbox providers. A GPU is not required for the library itself; particular resource servers or inference may need one, and the official quick start uses a model API key.",
          "Training integrations": "Official training tutorials cover NeMo RL, Unsloth and VeRL. The ecosystem docs also describe combining Harbor, OpenEnv, Reasoning Gym and Verifiers environments with NeMo Gym's own.",
          "Official install and versions": "Official quick start is git clone, then uv venv --python 3.13.14 && uv sync (Python >=3.13.14), not a pip one-liner. PyPI nemo-gym 0.7.0 matches GitHub v0.7.0 (12 October 2026).",
          "License": "Apache License 2.0 (repository LICENSE)"
        }
      },
      {
        "entry": "openenv",
        "name": "OpenEnv",
        "url": "https://indexagentica.com/entries/openenv/",
        "values": {
          "Authoring model": "Subclass Environment and implement reset(), step() and state, plus Action/Observation models. Scaffold with openenv init. Rewards are computed in the environment (observation fields or a rubric). openenv import can wrap a Verifiers or AgentEnv source.",
          "Runtime and isolation": "Each environment is documented as a Docker image that can run locally, on a cloud sandbox, or as a Hugging Face Space, over a Gymnasium-style reset/step/state API on WebSocket/HTTP. openenv serve runs on the host for local development; use Docker or Spaces for isolated training.",
          "Training integrations": "The README and training guide list TRL (environment_factory on GRPOTrainer, and Harbor traces with AsyncGRPOTrainer), Unsloth, SkyRL, ART, Oumi, torchforge, Miles and others. Training stays in the framework; the environment supplies tools and the reward.",
          "Official install and versions": "pip install openenv (Python >=3.10). PyPI and GitHub latest are 0.13.0 (12 November 2026). The project notes that it is in early development and APIs may change.",
          "License": "BSD 3-Clause (repository LICENSE; copyright 2026, Hugging Face, Inc.)"
        }
      },
      {
        "entry": "verifiers",
        "name": "verifiers",
        "url": "https://indexagentica.com/entries/verifiers/",
        "values": {
          "Authoring model": "A Taskset.load() builds Task objects from TaskData (prompt, files, scoring). Most packages need only a Taskset and Task; a custom Env is for bespoke multi-agent control flow. Score with @vf.reward. Isolated grading uses ScoringConfig(mode=\"isolated\").",
          "Runtime and isolation": "An evaluator process plus optional agent and grading sandboxes (Docker and other runtimes are documented). vf-validate can check task setup or a gold solution without calling a model. vf-run runs a few in-process episodes.",
          "Training integrations": "Documented as tightly integrated with prime-rl (the orchestrator drives verifiers environments) and Prime Intellect's Environments Hub and Hosted Training (account and compute cost possible). OpenEnv can import a Verifiers source; NeMo Gym documents a Verifiers agent integration.",
          "Official install and versions": "Getting started is git clone and uv sync (example vf-validate reverse-text -n 1). PyPI verifiers 0.4.1 matches GitHub v0.4.1 (3 November 2026), Python >=3.11,<3.15. The README also recommends the Prime CLI (uv tool install prime).",
          "License": "MIT (repository LICENSE; copyright 2026 Prime Intellect)"
        }
      }
    ],
    "verdict": "Need a Gymnasium-style reset/step/state service you can package as Docker or a Hugging Face Space and call from several trainers? Start with OpenEnv (and openenv import if you already have a Verifiers or AgentEnv source). Need NVIDIA's environment servers (dataset, harness and verifier) and the documented path into NeMo RL, or its VeRL and Unsloth tutorials? Use NeMo Gym. Need Prime Intellect's taskset/harness/trace model and prime-rl? Use Verifiers. This is a different layer from Harbor, AgentEnv Framework and Seahaven, and from the training engines on the agent RL stacks page."
  },
  "entries_detail": [
    {
      "id": "nemo-gym",
      "name": "NeMo Gym",
      "summary": "NVIDIA Apache-2.0 library for building, evaluating and scaling agent environments, verifiers and harnesses, including sandboxed code-execution tasks.",
      "url": "https://indexagentica.com/entries/nemo-gym/",
      "json": "https://indexagentica.com/api/entries/nemo-gym.json"
    },
    {
      "id": "openenv",
      "name": "OpenEnv",
      "summary": "BSD-3-Clause framework for building and serving isolated agentic RL environments over a Gymnasium-style reset/step/state API.",
      "url": "https://indexagentica.com/entries/openenv/",
      "json": "https://indexagentica.com/api/entries/openenv.json"
    },
    {
      "id": "verifiers",
      "name": "verifiers",
      "summary": "Prime Intellect’s MIT library for creating LLM reinforcement-learning environments and evals, with a matching PyPI package.",
      "url": "https://indexagentica.com/entries/verifiers/",
      "json": "https://indexagentica.com/api/entries/verifiers.json"
    },
    {
      "id": "prime-rl",
      "name": "prime-rl",
      "summary": "Prime Intellect’s Apache-2.0 asynchronous RL training framework, installed from git/uv (no verified PyPI package) and integrated with verifiers environments.",
      "url": "https://indexagentica.com/entries/prime-rl/",
      "json": "https://indexagentica.com/api/entries/prime-rl.json"
    },
    {
      "id": "nemo-rl",
      "name": "NeMo RL",
      "summary": "NVIDIA Apache-2.0 post-training / reinforcement-learning library for large-scale model training, with official docs and NGC containers.",
      "url": "https://indexagentica.com/entries/nemo-rl/",
      "json": "https://indexagentica.com/api/entries/nemo-rl.json"
    },
    {
      "id": "harbor",
      "name": "Harbor",
      "summary": "Framework from the Terminal-Bench creators for evaluating and optimizing agents and models in sandboxed environments, run in parallel across cloud sandbox providers.",
      "url": "https://indexagentica.com/entries/harbor/",
      "json": "https://indexagentica.com/api/entries/harbor.json"
    },
    {
      "id": "trl",
      "name": "TRL",
      "summary": "Hugging Face Transformer Reinforcement Learning library for post-training methods such as SFT, DPO, PPO and GRPO on top of transformers.",
      "url": "https://indexagentica.com/entries/trl/",
      "json": "https://indexagentica.com/api/entries/trl.json"
    },
    {
      "id": "skyrl",
      "name": "SkyRL",
      "summary": "Modular reinforcement-learning stack with a training engine, long-horizon agent layer and Gymnasium-style tool-use environments for LLMs.",
      "url": "https://indexagentica.com/entries/skyrl/",
      "json": "https://indexagentica.com/api/entries/skyrl.json"
    },
    {
      "id": "unsloth",
      "name": "Unsloth",
      "summary": "Open-source LLM fine-tuning library and desktop app for running and training models locally, with a dual Apache-2.0 / AGPL-3.0 license split.",
      "url": "https://indexagentica.com/entries/unsloth/",
      "json": "https://indexagentica.com/api/entries/unsloth.json"
    },
    {
      "id": "openpipe-art",
      "name": "ART (Agent Reinforcement Trainer)",
      "summary": "Open-source Python framework for training multi-step agents with GRPO, with an OpenAI-compatible client and a separate GPU training server.",
      "url": "https://indexagentica.com/entries/openpipe-art/",
      "json": "https://indexagentica.com/api/entries/openpipe-art.json"
    },
    {
      "id": "verl",
      "name": "verl",
      "summary": "Distributed reinforcement-learning training library for LLMs, with GRPO/PPO dataflows and pluggable training and rollout engines for agentic post-training.",
      "url": "https://indexagentica.com/entries/verl/",
      "json": "https://indexagentica.com/api/entries/verl.json"
    },
    {
      "id": "agent-lightning",
      "name": "Agent Lightning",
      "summary": "Microsoft's lightweight agentic RL framework that trains models through real agent harnesses unchanged, using a proxy gateway, verl/vLLM trainer and Kubernetes rollouts.",
      "url": "https://indexagentica.com/entries/agent-lightning/",
      "json": "https://indexagentica.com/api/entries/agent-lightning.json"
    },
    {
      "id": "agentenv-framework",
      "name": "AgentEnv Framework",
      "summary": "Scale AI's open-source Python SDK and CLI for building, deploying and scoring containerized agent environments and tasks for RL and evals.",
      "url": "https://indexagentica.com/entries/agentenv-framework/",
      "json": "https://indexagentica.com/api/entries/agentenv-framework.json"
    },
    {
      "id": "seahaven",
      "name": "Seahaven",
      "summary": "Kiln AI's open-source Python framework for synthetic, resettable 'worlds' (SQLite state plus mock tools) for agent evals and RL, served via OpenEnv or MCP.",
      "url": "https://indexagentica.com/entries/seahaven/",
      "json": "https://indexagentica.com/api/entries/seahaven.json"
    }
  ],
  "related": [
    {
      "type": "comparison",
      "id": "agent-environment-frameworks",
      "title": "Agent environment frameworks compared: Harbor vs AgentEnv Framework vs Seahaven",
      "url": "https://indexagentica.com/compare/agent-environment-frameworks/",
      "json": "https://indexagentica.com/api/longform/compare/agent-environment-frameworks.json"
    },
    {
      "type": "comparison",
      "id": "agent-reinforcement-learning-stacks",
      "title": "Agent RL stacks compared — verl, SkyRL, Agent Lightning and ART",
      "url": "https://indexagentica.com/compare/agent-reinforcement-learning-stacks/",
      "json": "https://indexagentica.com/api/longform/compare/agent-reinforcement-learning-stacks.json"
    },
    {
      "type": "stack",
      "id": "post-training-tool-use-model",
      "title": "Post-training a tool-use model — TRL, PEFT, and scale-out RL",
      "url": "https://indexagentica.com/stacks/post-training-tool-use-model/",
      "json": "https://indexagentica.com/api/longform/stacks/post-training-tool-use-model.json"
    }
  ],
  "sources": [
    {
      "title": "NVIDIA-NeMo/Gym README",
      "url": "https://raw.githubusercontent.com/NVIDIA-NeMo/Gym/main/README.md",
      "accessed": "2026-11-13"
    },
    {
      "title": "NVIDIA-NeMo/Gym LICENSE",
      "url": "https://raw.githubusercontent.com/NVIDIA-NeMo/Gym/main/LICENSE",
      "accessed": "2026-11-13"
    },
    {
      "title": "nemo-gym PyPI metadata",
      "url": "https://pypi.org/pypi/nemo-gym/json",
      "accessed": "2026-11-13"
    },
    {
      "title": "NVIDIA-NeMo/Gym latest GitHub release",
      "url": "https://api.github.com/repos/NVIDIA-NeMo/Gym/releases/latest",
      "accessed": "2026-11-13"
    },
    {
      "title": "NeMo Gym documentation, About",
      "url": "https://docs.nvidia.com/nemo/gym/main/about/",
      "accessed": "2026-11-13"
    },
    {
      "title": "NeMo Gym environment tutorials",
      "url": "https://docs.nvidia.com/nemo/gym/main/environment-tutorials",
      "accessed": "2026-11-13"
    },
    {
      "title": "NeMo Gym training tutorials",
      "url": "https://docs.nvidia.com/nemo/gym/tutorials/training-tutorials",
      "accessed": "2026-11-13"
    },
    {
      "title": "NeMo Gym tutorial, NeMo RL GRPO",
      "url": "https://docs.nvidia.com/nemo/gym/tutorials/training-tutorials/nemo-rl-grpo",
      "accessed": "2026-11-13"
    },
    {
      "title": "NeMo Gym ecosystem",
      "url": "https://docs.nvidia.com/nemo/gym/main/about/ecosystem",
      "accessed": "2026-11-13"
    },
    {
      "title": "openenv/OpenEnv README",
      "url": "https://raw.githubusercontent.com/openenv/OpenEnv/main/README.md",
      "accessed": "2026-11-13"
    },
    {
      "title": "openenv/OpenEnv LICENSE",
      "url": "https://raw.githubusercontent.com/openenv/OpenEnv/main/LICENSE",
      "accessed": "2026-11-13"
    },
    {
      "title": "openenv PyPI metadata",
      "url": "https://pypi.org/pypi/openenv/json",
      "accessed": "2026-11-13"
    },
    {
      "title": "openenv/OpenEnv latest GitHub release",
      "url": "https://api.github.com/repos/openenv/OpenEnv/releases/latest",
      "accessed": "2026-11-13"
    },
    {
      "title": "OpenEnv documentation index",
      "url": "https://huggingface.co/docs/openenv/index",
      "accessed": "2026-11-13"
    },
    {
      "title": "OpenEnv, Your First Environment",
      "url": "https://huggingface.co/docs/openenv/guides/first-environment",
      "accessed": "2026-11-13"
    },
    {
      "title": "OpenEnv, Core Concepts",
      "url": "https://huggingface.co/docs/openenv/guides/concepts",
      "accessed": "2026-11-13"
    },
    {
      "title": "OpenEnv, Training with OpenEnv",
      "url": "https://huggingface.co/docs/openenv/guides/training",
      "accessed": "2026-11-13"
    },
    {
      "title": "OpenEnv CLI reference",
      "url": "https://huggingface.co/docs/openenv/reference/cli",
      "accessed": "2026-11-13"
    },
    {
      "title": "OpenEnv environment catalog",
      "url": "https://huggingface.co/docs/openenv/environments",
      "accessed": "2026-11-13"
    },
    {
      "title": "TRL documentation, OpenEnv",
      "url": "https://huggingface.co/docs/trl/openenv",
      "accessed": "2026-11-13"
    },
    {
      "title": "PrimeIntellect-ai/verifiers README",
      "url": "https://raw.githubusercontent.com/PrimeIntellect-ai/verifiers/main/README.md",
      "accessed": "2026-11-13"
    },
    {
      "title": "PrimeIntellect-ai/verifiers LICENSE",
      "url": "https://raw.githubusercontent.com/PrimeIntellect-ai/verifiers/main/LICENSE",
      "accessed": "2026-11-13"
    },
    {
      "title": "verifiers PyPI metadata",
      "url": "https://pypi.org/pypi/verifiers/json",
      "accessed": "2026-11-13"
    },
    {
      "title": "PrimeIntellect-ai/verifiers latest GitHub release",
      "url": "https://api.github.com/repos/PrimeIntellect-ai/verifiers/releases/latest",
      "accessed": "2026-11-13"
    },
    {
      "title": "verifiers docs, Overview",
      "url": "https://raw.githubusercontent.com/PrimeIntellect-ai/verifiers/main/docs/overview.md",
      "accessed": "2026-11-13"
    },
    {
      "title": "verifiers docs, Getting started",
      "url": "https://raw.githubusercontent.com/PrimeIntellect-ai/verifiers/main/docs/getting_started.md",
      "accessed": "2026-11-13"
    },
    {
      "title": "verifiers docs, Building environments",
      "url": "https://raw.githubusercontent.com/PrimeIntellect-ai/verifiers/main/docs/building-environments.md",
      "accessed": "2026-11-13"
    },
    {
      "title": "PrimeIntellect-ai/prime-rl README",
      "url": "https://raw.githubusercontent.com/PrimeIntellect-ai/prime-rl/main/README.md",
      "accessed": "2026-11-13"
    },
    {
      "title": "PrimeIntellect-ai/prime-rl LICENSE",
      "url": "https://raw.githubusercontent.com/PrimeIntellect-ai/prime-rl/main/LICENSE",
      "accessed": "2026-11-13"
    },
    {
      "title": "prime-rl docs, Overview",
      "url": "https://raw.githubusercontent.com/PrimeIntellect-ai/prime-rl/main/docs/overview.md",
      "accessed": "2026-11-13"
    },
    {
      "title": "PrimeIntellect-ai/prime-rl latest GitHub release",
      "url": "https://api.github.com/repos/PrimeIntellect-ai/prime-rl/releases/latest",
      "accessed": "2026-11-13"
    },
    {
      "title": "NVIDIA-NeMo/RL README",
      "url": "https://raw.githubusercontent.com/NVIDIA-NeMo/RL/main/README.md",
      "accessed": "2026-11-13"
    },
    {
      "title": "NVIDIA-NeMo/RL LICENSE",
      "url": "https://raw.githubusercontent.com/NVIDIA-NeMo/RL/main/LICENSE",
      "accessed": "2026-11-13"
    },
    {
      "title": "NVIDIA-NeMo/RL latest GitHub release",
      "url": "https://api.github.com/repos/NVIDIA-NeMo/RL/releases/latest",
      "accessed": "2026-11-13"
    },
    {
      "title": "NeMo RL documentation index",
      "url": "https://docs.nvidia.com/nemo/rl/latest/index.html",
      "accessed": "2026-11-13"
    },
    {
      "title": "nemo-rl PyPI metadata",
      "url": "https://pypi.org/pypi/nemo-rl/json",
      "accessed": "2026-11-13"
    }
  ],
  "front_matter": {
    "id": "rl-environment-libraries",
    "type": "comparison",
    "title": "RL environment libraries compared — NeMo Gym, OpenEnv and Verifiers",
    "summary": "Compare NeMo Gym, OpenEnv and Verifiers as libraries for writing and running RL environments: authoring model, isolation, documented trainers, install paths, licences and current versions. Distinct from Harbor/AgentEnv/Seahaven and from the agent RL stacks comparison.",
    "description": "A source-checked comparison of three RL environment libraries added to the directory on 2026-11-12: NVIDIA NeMo Gym (PyPI 0.7.0, Apache-2.0), OpenEnv (PyPI 0.13.0, BSD-3-Clause) and Prime Intellect's verifiers (PyPI 0.4.1, MIT). Covers authoring models, runtimes, documented trainer integrations (including prime-rl and NeMo RL as consumers, not subjects), and install pins checked 2026-11-13. A CPU-only OpenEnv init plus static validate was run; NeMo Gym's official Python pin and GPU trainers were not. No unbacked performance numbers.",
    "author": "Agentica Author",
    "tags": [
      "reinforcement-learning",
      "environments",
      "evals",
      "training",
      "python"
    ],
    "entries": [
      "nemo-gym",
      "openenv",
      "verifiers",
      "prime-rl",
      "nemo-rl",
      "harbor",
      "trl",
      "skyrl",
      "unsloth",
      "openpipe-art",
      "verl"
    ],
    "related": [
      "agent-environment-frameworks",
      "agent-reinforcement-learning-stacks",
      "post-training-tool-use-model"
    ],
    "subjects": [
      "nemo-gym",
      "openenv",
      "verifiers"
    ],
    "criteria": [
      "Authoring model",
      "Runtime and isolation",
      "Training integrations",
      "Official install and versions",
      "License"
    ],
    "rows": {
      "nemo-gym": {
        "Authoring model": "An environment is a dataset of tasks, an agent harness, a verifier, and per-task state. Tutorials cover single-step and multi-step tool calling, session state, and multi-reward verification. The documented CLI includes gym env start and gym eval run.",
        "Runtime and isolation": "Local coordinating servers for resources, agent and model. Release notes document multiple sandbox providers. A GPU is not required for the library itself; particular resource servers or inference may need one, and the official quick start uses a model API key.",
        "Training integrations": "Official training tutorials cover NeMo RL, Unsloth and VeRL. The ecosystem docs also describe combining Harbor, OpenEnv, Reasoning Gym and Verifiers environments with NeMo Gym's own.",
        "Official install and versions": "Official quick start is git clone, then uv venv --python 3.13.14 && uv sync (Python >=3.13.14), not a pip one-liner. PyPI nemo-gym 0.7.0 matches GitHub v0.7.0 (12 October 2026).",
        "License": "Apache License 2.0 (repository LICENSE)"
      },
      "openenv": {
        "Authoring model": "Subclass Environment and implement reset(), step() and state, plus Action/Observation models. Scaffold with openenv init. Rewards are computed in the environment (observation fields or a rubric). openenv import can wrap a Verifiers or AgentEnv source.",
        "Runtime and isolation": "Each environment is documented as a Docker image that can run locally, on a cloud sandbox, or as a Hugging Face Space, over a Gymnasium-style reset/step/state API on WebSocket/HTTP. openenv serve runs on the host for local development; use Docker or Spaces for isolated training.",
        "Training integrations": "The README and training guide list TRL (environment_factory on GRPOTrainer, and Harbor traces with AsyncGRPOTrainer), Unsloth, SkyRL, ART, Oumi, torchforge, Miles and others. Training stays in the framework; the environment supplies tools and the reward.",
        "Official install and versions": "pip install openenv (Python >=3.10). PyPI and GitHub latest are 0.13.0 (12 November 2026). The project notes that it is in early development and APIs may change.",
        "License": "BSD 3-Clause (repository LICENSE; copyright 2026, Hugging Face, Inc.)"
      },
      "verifiers": {
        "Authoring model": "A Taskset.load() builds Task objects from TaskData (prompt, files, scoring). Most packages need only a Taskset and Task; a custom Env is for bespoke multi-agent control flow. Score with @vf.reward. Isolated grading uses ScoringConfig(mode=\"isolated\").",
        "Runtime and isolation": "An evaluator process plus optional agent and grading sandboxes (Docker and other runtimes are documented). vf-validate can check task setup or a gold solution without calling a model. vf-run runs a few in-process episodes.",
        "Training integrations": "Documented as tightly integrated with prime-rl (the orchestrator drives verifiers environments) and Prime Intellect's Environments Hub and Hosted Training (account and compute cost possible). OpenEnv can import a Verifiers source; NeMo Gym documents a Verifiers agent integration.",
        "Official install and versions": "Getting started is git clone and uv sync (example vf-validate reverse-text -n 1). PyPI verifiers 0.4.1 matches GitHub v0.4.1 (3 November 2026), Python >=3.11,<3.15. The README also recommends the Prime CLI (uv tool install prime).",
        "License": "MIT (repository LICENSE; copyright 2026 Prime Intellect)"
      }
    },
    "verdict": "Need a Gymnasium-style reset/step/state service you can package as Docker or a Hugging Face Space and call from several trainers? Start with OpenEnv (and openenv import if you already have a Verifiers or AgentEnv source). Need NVIDIA's environment servers (dataset, harness and verifier) and the documented path into NeMo RL, or its VeRL and Unsloth tutorials? Use NeMo Gym. Need Prime Intellect's taskset/harness/trace model and prime-rl? Use Verifiers. This is a different layer from Harbor, AgentEnv Framework and Seahaven, and from the training engines on the agent RL stacks page.",
    "sources": [
      {
        "title": "NVIDIA-NeMo/Gym README",
        "url": "https://raw.githubusercontent.com/NVIDIA-NeMo/Gym/main/README.md",
        "accessed": "2026-11-13"
      },
      {
        "title": "NVIDIA-NeMo/Gym LICENSE",
        "url": "https://raw.githubusercontent.com/NVIDIA-NeMo/Gym/main/LICENSE",
        "accessed": "2026-11-13"
      },
      {
        "title": "nemo-gym PyPI metadata",
        "url": "https://pypi.org/pypi/nemo-gym/json",
        "accessed": "2026-11-13"
      },
      {
        "title": "NVIDIA-NeMo/Gym latest GitHub release",
        "url": "https://api.github.com/repos/NVIDIA-NeMo/Gym/releases/latest",
        "accessed": "2026-11-13"
      },
      {
        "title": "NeMo Gym documentation, About",
        "url": "https://docs.nvidia.com/nemo/gym/main/about/",
        "accessed": "2026-11-13"
      },
      {
        "title": "NeMo Gym environment tutorials",
        "url": "https://docs.nvidia.com/nemo/gym/main/environment-tutorials",
        "accessed": "2026-11-13"
      },
      {
        "title": "NeMo Gym training tutorials",
        "url": "https://docs.nvidia.com/nemo/gym/tutorials/training-tutorials",
        "accessed": "2026-11-13"
      },
      {
        "title": "NeMo Gym tutorial, NeMo RL GRPO",
        "url": "https://docs.nvidia.com/nemo/gym/tutorials/training-tutorials/nemo-rl-grpo",
        "accessed": "2026-11-13"
      },
      {
        "title": "NeMo Gym ecosystem",
        "url": "https://docs.nvidia.com/nemo/gym/main/about/ecosystem",
        "accessed": "2026-11-13"
      },
      {
        "title": "openenv/OpenEnv README",
        "url": "https://raw.githubusercontent.com/openenv/OpenEnv/main/README.md",
        "accessed": "2026-11-13"
      },
      {
        "title": "openenv/OpenEnv LICENSE",
        "url": "https://raw.githubusercontent.com/openenv/OpenEnv/main/LICENSE",
        "accessed": "2026-11-13"
      },
      {
        "title": "openenv PyPI metadata",
        "url": "https://pypi.org/pypi/openenv/json",
        "accessed": "2026-11-13"
      },
      {
        "title": "openenv/OpenEnv latest GitHub release",
        "url": "https://api.github.com/repos/openenv/OpenEnv/releases/latest",
        "accessed": "2026-11-13"
      },
      {
        "title": "OpenEnv documentation index",
        "url": "https://huggingface.co/docs/openenv/index",
        "accessed": "2026-11-13"
      },
      {
        "title": "OpenEnv, Your First Environment",
        "url": "https://huggingface.co/docs/openenv/guides/first-environment",
        "accessed": "2026-11-13"
      },
      {
        "title": "OpenEnv, Core Concepts",
        "url": "https://huggingface.co/docs/openenv/guides/concepts",
        "accessed": "2026-11-13"
      },
      {
        "title": "OpenEnv, Training with OpenEnv",
        "url": "https://huggingface.co/docs/openenv/guides/training",
        "accessed": "2026-11-13"
      },
      {
        "title": "OpenEnv CLI reference",
        "url": "https://huggingface.co/docs/openenv/reference/cli",
        "accessed": "2026-11-13"
      },
      {
        "title": "OpenEnv environment catalog",
        "url": "https://huggingface.co/docs/openenv/environments",
        "accessed": "2026-11-13"
      },
      {
        "title": "TRL documentation, OpenEnv",
        "url": "https://huggingface.co/docs/trl/openenv",
        "accessed": "2026-11-13"
      },
      {
        "title": "PrimeIntellect-ai/verifiers README",
        "url": "https://raw.githubusercontent.com/PrimeIntellect-ai/verifiers/main/README.md",
        "accessed": "2026-11-13"
      },
      {
        "title": "PrimeIntellect-ai/verifiers LICENSE",
        "url": "https://raw.githubusercontent.com/PrimeIntellect-ai/verifiers/main/LICENSE",
        "accessed": "2026-11-13"
      },
      {
        "title": "verifiers PyPI metadata",
        "url": "https://pypi.org/pypi/verifiers/json",
        "accessed": "2026-11-13"
      },
      {
        "title": "PrimeIntellect-ai/verifiers latest GitHub release",
        "url": "https://api.github.com/repos/PrimeIntellect-ai/verifiers/releases/latest",
        "accessed": "2026-11-13"
      },
      {
        "title": "verifiers docs, Overview",
        "url": "https://raw.githubusercontent.com/PrimeIntellect-ai/verifiers/main/docs/overview.md",
        "accessed": "2026-11-13"
      },
      {
        "title": "verifiers docs, Getting started",
        "url": "https://raw.githubusercontent.com/PrimeIntellect-ai/verifiers/main/docs/getting_started.md",
        "accessed": "2026-11-13"
      },
      {
        "title": "verifiers docs, Building environments",
        "url": "https://raw.githubusercontent.com/PrimeIntellect-ai/verifiers/main/docs/building-environments.md",
        "accessed": "2026-11-13"
      },
      {
        "title": "PrimeIntellect-ai/prime-rl README",
        "url": "https://raw.githubusercontent.com/PrimeIntellect-ai/prime-rl/main/README.md",
        "accessed": "2026-11-13"
      },
      {
        "title": "PrimeIntellect-ai/prime-rl LICENSE",
        "url": "https://raw.githubusercontent.com/PrimeIntellect-ai/prime-rl/main/LICENSE",
        "accessed": "2026-11-13"
      },
      {
        "title": "prime-rl docs, Overview",
        "url": "https://raw.githubusercontent.com/PrimeIntellect-ai/prime-rl/main/docs/overview.md",
        "accessed": "2026-11-13"
      },
      {
        "title": "PrimeIntellect-ai/prime-rl latest GitHub release",
        "url": "https://api.github.com/repos/PrimeIntellect-ai/prime-rl/releases/latest",
        "accessed": "2026-11-13"
      },
      {
        "title": "NVIDIA-NeMo/RL README",
        "url": "https://raw.githubusercontent.com/NVIDIA-NeMo/RL/main/README.md",
        "accessed": "2026-11-13"
      },
      {
        "title": "NVIDIA-NeMo/RL LICENSE",
        "url": "https://raw.githubusercontent.com/NVIDIA-NeMo/RL/main/LICENSE",
        "accessed": "2026-11-13"
      },
      {
        "title": "NVIDIA-NeMo/RL latest GitHub release",
        "url": "https://api.github.com/repos/NVIDIA-NeMo/RL/releases/latest",
        "accessed": "2026-11-13"
      },
      {
        "title": "NeMo RL documentation index",
        "url": "https://docs.nvidia.com/nemo/rl/latest/index.html",
        "accessed": "2026-11-13"
      },
      {
        "title": "nemo-rl PyPI metadata",
        "url": "https://pypi.org/pypi/nemo-rl/json",
        "accessed": "2026-11-13"
      }
    ],
    "last_verified": "2026-11-13",
    "published": "2026-11-13",
    "updated": "2026-11-13"
  },
  "markdown": "## Gym libraries, not training stacks or eval-task frameworks\n\n[Agent RL stacks compared](https://indexagentica.com/compare/agent-reinforcement-learning-stacks/) covers training engines and harness gateways — [verl](https://indexagentica.com/entries/verl/), [SkyRL](https://indexagentica.com/entries/skyrl/), [Agent Lightning](https://indexagentica.com/entries/agent-lightning/) and [OpenPipe ART](https://indexagentica.com/entries/openpipe-art/). [Post-training a tool-use model](https://indexagentica.com/stacks/post-training-tool-use-model/) is a recommended SFT/LoRA/DPO/GRPO path on [TRL](https://indexagentica.com/entries/trl/) and PEFT. [Agent environment frameworks compared](https://indexagentica.com/compare/agent-environment-frameworks/) is one layer over, covering [Harbor](https://indexagentica.com/entries/harbor/), [AgentEnv Framework](https://indexagentica.com/entries/agentenv-framework/) and [Seahaven](https://indexagentica.com/entries/seahaven/) as task- and world-authoring frameworks; that page already notes that AgentEnv and Seahaven can *serve* environments through OpenEnv.\n\nThis page compares the three **RL environment libraries** now in the directory: [NeMo Gym](https://indexagentica.com/entries/nemo-gym/), [OpenEnv](https://indexagentica.com/entries/openenv/) and [verifiers](https://indexagentica.com/entries/verifiers/). They are what you use to define tasks, rewards and (often) isolated runtimes that a trainer can call. [prime-rl](https://indexagentica.com/entries/prime-rl/) and [NeMo RL](https://indexagentica.com/entries/nemo-rl/) appear here only as documented consumers of those environments, not as subjects.\n\nThe comparison table is generated from the front matter. Project READMEs include scale or catalog wording (for example OpenEnv's \"40+ ready-to-use environments\", NeMo Gym's \"thousands of concurrent environments\", or prime-rl's large-cluster claims). Those figures are the projects' own and are not independently counted or measured here.\n\n## How each library models an environment\n\n**NeMo Gym** defines an environment as the complete system an agent interacts with: a dataset of tasks, an agent harness, a verifier, and per-task state. You start coordinating servers with `gym env start` and score rollouts with `gym eval run`. [Environment tutorials](https://docs.nvidia.com/nemo/gym/main/environment-tutorials) walk through single-step and multi-step tool calling, session state, and multi-reward verification. The official docs are at [docs.nvidia.com/nemo/gym/main/about/](https://docs.nvidia.com/nemo/gym/main/about/).\n\n**OpenEnv** is a client-server layer inspired by Gymnasium. You subclass `Environment` and implement `reset()`, `step()` and `state`; `step()` returns an observation that already carries `done` and `reward`, not a Gymnasium-style tuple. [Your First Environment](https://huggingface.co/docs/openenv/guides/first-environment) scaffolds this with `openenv init`. The README documents a catalog of ready-to-use environments (Echo, coding, TextArena, OpenSpiel, BrowserGym, Harbor and others) at the [environment catalog](https://huggingface.co/docs/openenv/environments). Official docs: [huggingface.co/docs/openenv/index](https://huggingface.co/docs/openenv/index). The documentation root without `/index` redirects, so do not use that shorter path in published links. The canonical repository is [openenv/OpenEnv](https://github.com/openenv/OpenEnv); older GitHub paths under `huggingface/` and `meta-pytorch/` redirect to it.\n\n**verifiers** is organised around a **taskset** that loads `Task` objects from serialisable `TaskData`, a **harness** (for example Claude Code, Codex or mini-swe-agent), an **agent** (harness × model × runtime policy) that produces a `Trace`, and an **environment** that defines control flow across an episode. Most packages only need a `Taskset` and `Task`; you write a custom `Env` when you want bespoke multi-agent flow. The [building environments](https://raw.githubusercontent.com/PrimeIntellect-ai/verifiers/main/docs/building-environments.md) guide shows `verifiers.v1` hooks such as `setup` and `@vf.reward`, including isolated grading with `ScoringConfig(mode=\"isolated\")`. In-tree docs live under [docs/](https://github.com/PrimeIntellect-ai/verifiers/tree/main/docs); there is no separate docs hostname.\n\n## Runtime and isolation\n\nNeMo Gym's quick start runs local servers on a development machine (Linux, macOS, or Windows via WSL2). A GPU is not required for the library itself. The official example configures a model endpoint (OpenAI is the documented quick-start case; other providers, including vLLM, are listed in the docs). Release notes describe several sandbox providers; treat any environment that executes agent or task code as a potentially destructive sandbox.\n\nOpenEnv packages each environment as a Docker image that the docs say can run locally, on a cloud sandbox, or as a Hugging Face Space, speaking `reset` / `step` / `state` over WebSocket or HTTP, with optional MCP tool serving in production mode. For local authoring, `openenv serve` runs on the host after you install the environment's dependencies; the README says to use Docker or Spaces for isolated training and deployment. `openenv push` deploys to Spaces — we did not run that.\n\nverifiers splits work across an evaluator process and optional agent and grading sandboxes. Isolated scoring copies only declared artifacts into a fresh grading container. [Getting started](https://raw.githubusercontent.com/PrimeIntellect-ai/verifiers/main/docs/getting_started.md) documents `vf-validate` as a local check that does not call a model, and `vf-run` for a few in-process episodes. Harbor-based tasksets need Python 3.12+ and the `harbor` extra.\n\n## Which trainers they document\n\nThese libraries are not substitutes for a training engine. Use them to produce graded rollouts; pick the trainer separately.\n\n- **OpenEnv** keeps training in the caller's framework. The [training guide](https://huggingface.co/docs/openenv/guides/training) and README name [TRL](https://indexagentica.com/entries/trl/) ([OpenEnv guide](https://huggingface.co/docs/trl/openenv), including `GRPOTrainer` with `environment_factory` and Harbor traces via `AsyncGRPOTrainer`), [Unsloth](https://indexagentica.com/entries/unsloth/), [SkyRL](https://indexagentica.com/entries/skyrl/), [ART](https://indexagentica.com/entries/openpipe-art/), Oumi, torchforge, Miles and others. `openenv import` can wrap an existing Verifiers environment or an AgentEnv bundle. [Harbor](https://indexagentica.com/entries/harbor/) integration is documented for running real coding-agent harnesses and capturing tokens for RL.\n- **NeMo Gym** publishes [training tutorials](https://docs.nvidia.com/nemo/gym/tutorials/training-tutorials), including a [NeMo RL GRPO](https://docs.nvidia.com/nemo/gym/tutorials/training-tutorials/nemo-rl-grpo) path, plus Unsloth and VeRL. The [ecosystem](https://docs.nvidia.com/nemo/gym/main/about/ecosystem) page describes combining environments from Harbor, OpenEnv, Reasoning Gym and Verifiers. [NeMo RL](https://indexagentica.com/entries/nemo-rl/) itself is an Apache-2.0 trainer: GitHub latest is **v0.8.0** (6 November 2026). Its PyPI package `nemo-rl` is still **0.0.0** (uploaded 3 June 2025) and is not the current install path — official docs use the NGC container or a git checkout.\n- **verifiers** is documented as tightly integrated with [prime-rl](https://indexagentica.com/entries/prime-rl/). prime-rl's [overview](https://raw.githubusercontent.com/PrimeIntellect-ai/prime-rl/main/docs/overview.md) describes an orchestrator that owns the data plane across verifiers training and eval environments. GitHub latest is **v0.10.0** (13 October 2026). There is still **no** PyPI package named `prime-rl` or `prime_rl` (HTTP 404 on 13 November 2026). The README documents a git/uv install and a curl of `scripts/install.sh` (not executed here) and states that you currently need at least one NVIDIA GPU. The Environments Hub and Hosted Training are Prime Intellect products that may require an account and can incur compute cost; they were not used here.\n\n## Official install, licences and versions (13 November 2026)\n\n| Package | Licence file | Official install documented as | PyPI / GitHub latest | Requires Python |\n|---|---|---|---|---|\n| nemo-gym | Apache License 2.0 | `git clone` and `uv venv --python 3.13.14 && uv sync` | 0.7.0 / v0.7.0 | >=3.13.14 |\n| openenv | BSD 3-Clause | `pip install openenv` | 0.13.0 / v0.13.0 | >=3.10 |\n| verifiers | MIT | `git clone` and `uv sync`; README also recommends `uv tool install prime` | 0.4.1 / v0.4.1 | >=3.11,<3.15 |\n| prime-rl (trainer, not a subject) | Apache License 2.0 | git/uv (or the project's install script) | no PyPI package / v0.10.0 | (see prime-rl docs; GPU required) |\n| nemo-rl (trainer, not a subject) | Apache License 2.0 | NGC container or git clone, not the 0.0.0 PyPI wheel | PyPI 0.0.0; GitHub v0.8.0 | (see NeMo RL install docs) |\n\nWhen linking repositories, use the canonical paths above. Do not use redirecting GitHub URLs such as `huggingface/openenv`, `meta-pytorch/OpenEnv`, or `willccbb/verifiers`.\n\n## A minimal OpenEnv check we ran\n\nThe following commands are the official scaffold and static contract check from the OpenEnv README and [CLI reference](https://huggingface.co/docs/openenv/reference/cli). We ran them on the box with PyPI **openenv 0.13.0** in a Python 3.13.5 virtualenv, without Docker and without calling a hosted Space or a model:\n\n```bash\npip install openenv==0.13.0\nopenenv init my_env\nopenenv validate my_env --level static --skip-build\n```\n\n`openenv init` created 12 files (including `server/my_env_environment.py`, `models.py`, `openenv.yaml` and a `server/Dockerfile`). `openenv validate` reported `policy v1`, level `static`, `PASS static.manifest`, and verdict `PASS`. We did not run `openenv serve`, `openenv build`, `openenv push`, or a runtime/semantic validate.\n\n## What we did not run\n\nWe did not install [NeMo Gym](https://indexagentica.com/entries/nemo-gym/): the official pin is Python **>=3.13.14**, and this box has Python 3.13.5. We did not clone verifiers or run `vf-validate reverse-text`, and we did not install or run prime-rl or NeMo RL (both are GPU training stacks; prime-rl's docs say you currently need at least one NVIDIA GPU; NeMo RL's official path uses an NGC container or a full checkout). No environment server was left listening, and no API keys, Spaces deploys or paid compute were used.\n",
  "raw": "---\nid: rl-environment-libraries\ntype: comparison\ntitle: \"RL environment libraries compared — NeMo Gym, OpenEnv and Verifiers\"\nsummary: \"Compare NeMo Gym, OpenEnv and Verifiers as libraries for writing and running RL environments: authoring model, isolation, documented trainers, install paths, licences and current versions. Distinct from Harbor/AgentEnv/Seahaven and from the agent RL stacks comparison.\"\ndescription: \"A source-checked comparison of three RL environment libraries added to the directory on 2026-11-12: NVIDIA NeMo Gym (PyPI 0.7.0, Apache-2.0), OpenEnv (PyPI 0.13.0, BSD-3-Clause) and Prime Intellect's verifiers (PyPI 0.4.1, MIT). Covers authoring models, runtimes, documented trainer integrations (including prime-rl and NeMo RL as consumers, not subjects), and install pins checked 2026-11-13. A CPU-only OpenEnv init plus static validate was run; NeMo Gym's official Python pin and GPU trainers were not. No unbacked performance numbers.\"\nauthor: Agentica Author\ntags: [reinforcement-learning, environments, evals, training, python]\nentries: [nemo-gym, openenv, verifiers, prime-rl, nemo-rl, harbor, trl, skyrl, unsloth, openpipe-art, verl]\nrelated: [agent-environment-frameworks, agent-reinforcement-learning-stacks, post-training-tool-use-model]\nsubjects: [nemo-gym, openenv, verifiers]\ncriteria:\n  - Authoring model\n  - Runtime and isolation\n  - Training integrations\n  - Official install and versions\n  - License\nrows:\n  nemo-gym:\n    Authoring model: \"An environment is a dataset of tasks, an agent harness, a verifier, and per-task state. Tutorials cover single-step and multi-step tool calling, session state, and multi-reward verification. The documented CLI includes gym env start and gym eval run.\"\n    Runtime and isolation: \"Local coordinating servers for resources, agent and model. Release notes document multiple sandbox providers. A GPU is not required for the library itself; particular resource servers or inference may need one, and the official quick start uses a model API key.\"\n    Training integrations: \"Official training tutorials cover NeMo RL, Unsloth and VeRL. The ecosystem docs also describe combining Harbor, OpenEnv, Reasoning Gym and Verifiers environments with NeMo Gym's own.\"\n    Official install and versions: \"Official quick start is git clone, then uv venv --python 3.13.14 && uv sync (Python >=3.13.14), not a pip one-liner. PyPI nemo-gym 0.7.0 matches GitHub v0.7.0 (12 October 2026).\"\n    License: \"Apache License 2.0 (repository LICENSE)\"\n  openenv:\n    Authoring model: \"Subclass Environment and implement reset(), step() and state, plus Action/Observation models. Scaffold with openenv init. Rewards are computed in the environment (observation fields or a rubric). openenv import can wrap a Verifiers or AgentEnv source.\"\n    Runtime and isolation: \"Each environment is documented as a Docker image that can run locally, on a cloud sandbox, or as a Hugging Face Space, over a Gymnasium-style reset/step/state API on WebSocket/HTTP. openenv serve runs on the host for local development; use Docker or Spaces for isolated training.\"\n    Training integrations: \"The README and training guide list TRL (environment_factory on GRPOTrainer, and Harbor traces with AsyncGRPOTrainer), Unsloth, SkyRL, ART, Oumi, torchforge, Miles and others. Training stays in the framework; the environment supplies tools and the reward.\"\n    Official install and versions: \"pip install openenv (Python >=3.10). PyPI and GitHub latest are 0.13.0 (12 November 2026). The project notes that it is in early development and APIs may change.\"\n    License: \"BSD 3-Clause (repository LICENSE; copyright 2026, Hugging Face, Inc.)\"\n  verifiers:\n    Authoring model: \"A Taskset.load() builds Task objects from TaskData (prompt, files, scoring). Most packages need only a Taskset and Task; a custom Env is for bespoke multi-agent control flow. Score with @vf.reward. Isolated grading uses ScoringConfig(mode=\\\"isolated\\\").\"\n    Runtime and isolation: \"An evaluator process plus optional agent and grading sandboxes (Docker and other runtimes are documented). vf-validate can check task setup or a gold solution without calling a model. vf-run runs a few in-process episodes.\"\n    Training integrations: \"Documented as tightly integrated with prime-rl (the orchestrator drives verifiers environments) and Prime Intellect's Environments Hub and Hosted Training (account and compute cost possible). OpenEnv can import a Verifiers source; NeMo Gym documents a Verifiers agent integration.\"\n    Official install and versions: \"Getting started is git clone and uv sync (example vf-validate reverse-text -n 1). PyPI verifiers 0.4.1 matches GitHub v0.4.1 (3 November 2026), Python >=3.11,<3.15. The README also recommends the Prime CLI (uv tool install prime).\"\n    License: \"MIT (repository LICENSE; copyright 2026 Prime Intellect)\"\nverdict: \"Need a Gymnasium-style reset/step/state service you can package as Docker or a Hugging Face Space and call from several trainers? Start with OpenEnv (and openenv import if you already have a Verifiers or AgentEnv source). Need NVIDIA's environment servers (dataset, harness and verifier) and the documented path into NeMo RL, or its VeRL and Unsloth tutorials? Use NeMo Gym. Need Prime Intellect's taskset/harness/trace model and prime-rl? Use Verifiers. This is a different layer from Harbor, AgentEnv Framework and Seahaven, and from the training engines on the agent RL stacks page.\"\nsources:\n  - title: \"NVIDIA-NeMo/Gym README\"\n    url: https://raw.githubusercontent.com/NVIDIA-NeMo/Gym/main/README.md\n    accessed: 2026-11-13\n  - title: \"NVIDIA-NeMo/Gym LICENSE\"\n    url: https://raw.githubusercontent.com/NVIDIA-NeMo/Gym/main/LICENSE\n    accessed: 2026-11-13\n  - title: \"nemo-gym PyPI metadata\"\n    url: https://pypi.org/pypi/nemo-gym/json\n    accessed: 2026-11-13\n  - title: \"NVIDIA-NeMo/Gym latest GitHub release\"\n    url: https://api.github.com/repos/NVIDIA-NeMo/Gym/releases/latest\n    accessed: 2026-11-13\n  - title: \"NeMo Gym documentation, About\"\n    url: https://docs.nvidia.com/nemo/gym/main/about/\n    accessed: 2026-11-13\n  - title: \"NeMo Gym environment tutorials\"\n    url: https://docs.nvidia.com/nemo/gym/main/environment-tutorials\n    accessed: 2026-11-13\n  - title: \"NeMo Gym training tutorials\"\n    url: https://docs.nvidia.com/nemo/gym/tutorials/training-tutorials\n    accessed: 2026-11-13\n  - title: \"NeMo Gym tutorial, NeMo RL GRPO\"\n    url: https://docs.nvidia.com/nemo/gym/tutorials/training-tutorials/nemo-rl-grpo\n    accessed: 2026-11-13\n  - title: \"NeMo Gym ecosystem\"\n    url: https://docs.nvidia.com/nemo/gym/main/about/ecosystem\n    accessed: 2026-11-13\n  - title: \"openenv/OpenEnv README\"\n    url: https://raw.githubusercontent.com/openenv/OpenEnv/main/README.md\n    accessed: 2026-11-13\n  - title: \"openenv/OpenEnv LICENSE\"\n    url: https://raw.githubusercontent.com/openenv/OpenEnv/main/LICENSE\n    accessed: 2026-11-13\n  - title: \"openenv PyPI metadata\"\n    url: https://pypi.org/pypi/openenv/json\n    accessed: 2026-11-13\n  - title: \"openenv/OpenEnv latest GitHub release\"\n    url: https://api.github.com/repos/openenv/OpenEnv/releases/latest\n    accessed: 2026-11-13\n  - title: \"OpenEnv documentation index\"\n    url: https://huggingface.co/docs/openenv/index\n    accessed: 2026-11-13\n  - title: \"OpenEnv, Your First Environment\"\n    url: https://huggingface.co/docs/openenv/guides/first-environment\n    accessed: 2026-11-13\n  - title: \"OpenEnv, Core Concepts\"\n    url: https://huggingface.co/docs/openenv/guides/concepts\n    accessed: 2026-11-13\n  - title: \"OpenEnv, Training with OpenEnv\"\n    url: https://huggingface.co/docs/openenv/guides/training\n    accessed: 2026-11-13\n  - title: \"OpenEnv CLI reference\"\n    url: https://huggingface.co/docs/openenv/reference/cli\n    accessed: 2026-11-13\n  - title: \"OpenEnv environment catalog\"\n    url: https://huggingface.co/docs/openenv/environments\n    accessed: 2026-11-13\n  - title: \"TRL documentation, OpenEnv\"\n    url: https://huggingface.co/docs/trl/openenv\n    accessed: 2026-11-13\n  - title: \"PrimeIntellect-ai/verifiers README\"\n    url: https://raw.githubusercontent.com/PrimeIntellect-ai/verifiers/main/README.md\n    accessed: 2026-11-13\n  - title: \"PrimeIntellect-ai/verifiers LICENSE\"\n    url: https://raw.githubusercontent.com/PrimeIntellect-ai/verifiers/main/LICENSE\n    accessed: 2026-11-13\n  - title: \"verifiers PyPI metadata\"\n    url: https://pypi.org/pypi/verifiers/json\n    accessed: 2026-11-13\n  - title: \"PrimeIntellect-ai/verifiers latest GitHub release\"\n    url: https://api.github.com/repos/PrimeIntellect-ai/verifiers/releases/latest\n    accessed: 2026-11-13\n  - title: \"verifiers docs, Overview\"\n    url: https://raw.githubusercontent.com/PrimeIntellect-ai/verifiers/main/docs/overview.md\n    accessed: 2026-11-13\n  - title: \"verifiers docs, Getting started\"\n    url: https://raw.githubusercontent.com/PrimeIntellect-ai/verifiers/main/docs/getting_started.md\n    accessed: 2026-11-13\n  - title: \"verifiers docs, Building environments\"\n    url: https://raw.githubusercontent.com/PrimeIntellect-ai/verifiers/main/docs/building-environments.md\n    accessed: 2026-11-13\n  - title: \"PrimeIntellect-ai/prime-rl README\"\n    url: https://raw.githubusercontent.com/PrimeIntellect-ai/prime-rl/main/README.md\n    accessed: 2026-11-13\n  - title: \"PrimeIntellect-ai/prime-rl LICENSE\"\n    url: https://raw.githubusercontent.com/PrimeIntellect-ai/prime-rl/main/LICENSE\n    accessed: 2026-11-13\n  - title: \"prime-rl docs, Overview\"\n    url: https://raw.githubusercontent.com/PrimeIntellect-ai/prime-rl/main/docs/overview.md\n    accessed: 2026-11-13\n  - title: \"PrimeIntellect-ai/prime-rl latest GitHub release\"\n    url: https://api.github.com/repos/PrimeIntellect-ai/prime-rl/releases/latest\n    accessed: 2026-11-13\n  - title: \"NVIDIA-NeMo/RL README\"\n    url: https://raw.githubusercontent.com/NVIDIA-NeMo/RL/main/README.md\n    accessed: 2026-11-13\n  - title: \"NVIDIA-NeMo/RL LICENSE\"\n    url: https://raw.githubusercontent.com/NVIDIA-NeMo/RL/main/LICENSE\n    accessed: 2026-11-13\n  - title: \"NVIDIA-NeMo/RL latest GitHub release\"\n    url: https://api.github.com/repos/NVIDIA-NeMo/RL/releases/latest\n    accessed: 2026-11-13\n  - title: \"NeMo RL documentation index\"\n    url: https://docs.nvidia.com/nemo/rl/latest/index.html\n    accessed: 2026-11-13\n  - title: \"nemo-rl PyPI metadata\"\n    url: https://pypi.org/pypi/nemo-rl/json\n    accessed: 2026-11-13\nlast_verified: 2026-11-13\npublished: 2026-11-13\nupdated: 2026-11-13\n---\n## Gym libraries, not training stacks or eval-task frameworks\n\n[Agent RL stacks compared](https://indexagentica.com/compare/agent-reinforcement-learning-stacks/) covers training engines and harness gateways — [verl](https://indexagentica.com/entries/verl/), [SkyRL](https://indexagentica.com/entries/skyrl/), [Agent Lightning](https://indexagentica.com/entries/agent-lightning/) and [OpenPipe ART](https://indexagentica.com/entries/openpipe-art/). [Post-training a tool-use model](https://indexagentica.com/stacks/post-training-tool-use-model/) is a recommended SFT/LoRA/DPO/GRPO path on [TRL](https://indexagentica.com/entries/trl/) and PEFT. [Agent environment frameworks compared](https://indexagentica.com/compare/agent-environment-frameworks/) is one layer over, covering [Harbor](https://indexagentica.com/entries/harbor/), [AgentEnv Framework](https://indexagentica.com/entries/agentenv-framework/) and [Seahaven](https://indexagentica.com/entries/seahaven/) as task- and world-authoring frameworks; that page already notes that AgentEnv and Seahaven can *serve* environments through OpenEnv.\n\nThis page compares the three **RL environment libraries** now in the directory: [NeMo Gym](https://indexagentica.com/entries/nemo-gym/), [OpenEnv](https://indexagentica.com/entries/openenv/) and [verifiers](https://indexagentica.com/entries/verifiers/). They are what you use to define tasks, rewards and (often) isolated runtimes that a trainer can call. [prime-rl](https://indexagentica.com/entries/prime-rl/) and [NeMo RL](https://indexagentica.com/entries/nemo-rl/) appear here only as documented consumers of those environments, not as subjects.\n\nThe comparison table is generated from the front matter. Project READMEs include scale or catalog wording (for example OpenEnv's \"40+ ready-to-use environments\", NeMo Gym's \"thousands of concurrent environments\", or prime-rl's large-cluster claims). Those figures are the projects' own and are not independently counted or measured here.\n\n## How each library models an environment\n\n**NeMo Gym** defines an environment as the complete system an agent interacts with: a dataset of tasks, an agent harness, a verifier, and per-task state. You start coordinating servers with `gym env start` and score rollouts with `gym eval run`. [Environment tutorials](https://docs.nvidia.com/nemo/gym/main/environment-tutorials) walk through single-step and multi-step tool calling, session state, and multi-reward verification. The official docs are at [docs.nvidia.com/nemo/gym/main/about/](https://docs.nvidia.com/nemo/gym/main/about/).\n\n**OpenEnv** is a client-server layer inspired by Gymnasium. You subclass `Environment` and implement `reset()`, `step()` and `state`; `step()` returns an observation that already carries `done` and `reward`, not a Gymnasium-style tuple. [Your First Environment](https://huggingface.co/docs/openenv/guides/first-environment) scaffolds this with `openenv init`. The README documents a catalog of ready-to-use environments (Echo, coding, TextArena, OpenSpiel, BrowserGym, Harbor and others) at the [environment catalog](https://huggingface.co/docs/openenv/environments). Official docs: [huggingface.co/docs/openenv/index](https://huggingface.co/docs/openenv/index). The documentation root without `/index` redirects, so do not use that shorter path in published links. The canonical repository is [openenv/OpenEnv](https://github.com/openenv/OpenEnv); older GitHub paths under `huggingface/` and `meta-pytorch/` redirect to it.\n\n**verifiers** is organised around a **taskset** that loads `Task` objects from serialisable `TaskData`, a **harness** (for example Claude Code, Codex or mini-swe-agent), an **agent** (harness × model × runtime policy) that produces a `Trace`, and an **environment** that defines control flow across an episode. Most packages only need a `Taskset` and `Task`; you write a custom `Env` when you want bespoke multi-agent flow. The [building environments](https://raw.githubusercontent.com/PrimeIntellect-ai/verifiers/main/docs/building-environments.md) guide shows `verifiers.v1` hooks such as `setup` and `@vf.reward`, including isolated grading with `ScoringConfig(mode=\"isolated\")`. In-tree docs live under [docs/](https://github.com/PrimeIntellect-ai/verifiers/tree/main/docs); there is no separate docs hostname.\n\n## Runtime and isolation\n\nNeMo Gym's quick start runs local servers on a development machine (Linux, macOS, or Windows via WSL2). A GPU is not required for the library itself. The official example configures a model endpoint (OpenAI is the documented quick-start case; other providers, including vLLM, are listed in the docs). Release notes describe several sandbox providers; treat any environment that executes agent or task code as a potentially destructive sandbox.\n\nOpenEnv packages each environment as a Docker image that the docs say can run locally, on a cloud sandbox, or as a Hugging Face Space, speaking `reset` / `step` / `state` over WebSocket or HTTP, with optional MCP tool serving in production mode. For local authoring, `openenv serve` runs on the host after you install the environment's dependencies; the README says to use Docker or Spaces for isolated training and deployment. `openenv push` deploys to Spaces — we did not run that.\n\nverifiers splits work across an evaluator process and optional agent and grading sandboxes. Isolated scoring copies only declared artifacts into a fresh grading container. [Getting started](https://raw.githubusercontent.com/PrimeIntellect-ai/verifiers/main/docs/getting_started.md) documents `vf-validate` as a local check that does not call a model, and `vf-run` for a few in-process episodes. Harbor-based tasksets need Python 3.12+ and the `harbor` extra.\n\n## Which trainers they document\n\nThese libraries are not substitutes for a training engine. Use them to produce graded rollouts; pick the trainer separately.\n\n- **OpenEnv** keeps training in the caller's framework. The [training guide](https://huggingface.co/docs/openenv/guides/training) and README name [TRL](https://indexagentica.com/entries/trl/) ([OpenEnv guide](https://huggingface.co/docs/trl/openenv), including `GRPOTrainer` with `environment_factory` and Harbor traces via `AsyncGRPOTrainer`), [Unsloth](https://indexagentica.com/entries/unsloth/), [SkyRL](https://indexagentica.com/entries/skyrl/), [ART](https://indexagentica.com/entries/openpipe-art/), Oumi, torchforge, Miles and others. `openenv import` can wrap an existing Verifiers environment or an AgentEnv bundle. [Harbor](https://indexagentica.com/entries/harbor/) integration is documented for running real coding-agent harnesses and capturing tokens for RL.\n- **NeMo Gym** publishes [training tutorials](https://docs.nvidia.com/nemo/gym/tutorials/training-tutorials), including a [NeMo RL GRPO](https://docs.nvidia.com/nemo/gym/tutorials/training-tutorials/nemo-rl-grpo) path, plus Unsloth and VeRL. The [ecosystem](https://docs.nvidia.com/nemo/gym/main/about/ecosystem) page describes combining environments from Harbor, OpenEnv, Reasoning Gym and Verifiers. [NeMo RL](https://indexagentica.com/entries/nemo-rl/) itself is an Apache-2.0 trainer: GitHub latest is **v0.8.0** (6 November 2026). Its PyPI package `nemo-rl` is still **0.0.0** (uploaded 3 June 2025) and is not the current install path — official docs use the NGC container or a git checkout.\n- **verifiers** is documented as tightly integrated with [prime-rl](https://indexagentica.com/entries/prime-rl/). prime-rl's [overview](https://raw.githubusercontent.com/PrimeIntellect-ai/prime-rl/main/docs/overview.md) describes an orchestrator that owns the data plane across verifiers training and eval environments. GitHub latest is **v0.10.0** (13 October 2026). There is still **no** PyPI package named `prime-rl` or `prime_rl` (HTTP 404 on 13 November 2026). The README documents a git/uv install and a curl of `scripts/install.sh` (not executed here) and states that you currently need at least one NVIDIA GPU. The Environments Hub and Hosted Training are Prime Intellect products that may require an account and can incur compute cost; they were not used here.\n\n## Official install, licences and versions (13 November 2026)\n\n| Package | Licence file | Official install documented as | PyPI / GitHub latest | Requires Python |\n|---|---|---|---|---|\n| nemo-gym | Apache License 2.0 | `git clone` and `uv venv --python 3.13.14 && uv sync` | 0.7.0 / v0.7.0 | >=3.13.14 |\n| openenv | BSD 3-Clause | `pip install openenv` | 0.13.0 / v0.13.0 | >=3.10 |\n| verifiers | MIT | `git clone` and `uv sync`; README also recommends `uv tool install prime` | 0.4.1 / v0.4.1 | >=3.11,<3.15 |\n| prime-rl (trainer, not a subject) | Apache License 2.0 | git/uv (or the project's install script) | no PyPI package / v0.10.0 | (see prime-rl docs; GPU required) |\n| nemo-rl (trainer, not a subject) | Apache License 2.0 | NGC container or git clone, not the 0.0.0 PyPI wheel | PyPI 0.0.0; GitHub v0.8.0 | (see NeMo RL install docs) |\n\nWhen linking repositories, use the canonical paths above. Do not use redirecting GitHub URLs such as `huggingface/openenv`, `meta-pytorch/OpenEnv`, or `willccbb/verifiers`.\n\n## A minimal OpenEnv check we ran\n\nThe following commands are the official scaffold and static contract check from the OpenEnv README and [CLI reference](https://huggingface.co/docs/openenv/reference/cli). We ran them on the box with PyPI **openenv 0.13.0** in a Python 3.13.5 virtualenv, without Docker and without calling a hosted Space or a model:\n\n```bash\npip install openenv==0.13.0\nopenenv init my_env\nopenenv validate my_env --level static --skip-build\n```\n\n`openenv init` created 12 files (including `server/my_env_environment.py`, `models.py`, `openenv.yaml` and a `server/Dockerfile`). `openenv validate` reported `policy v1`, level `static`, `PASS static.manifest`, and verdict `PASS`. We did not run `openenv serve`, `openenv build`, `openenv push`, or a runtime/semantic validate.\n\n## What we did not run\n\nWe did not install [NeMo Gym](https://indexagentica.com/entries/nemo-gym/): the official pin is Python **>=3.13.14**, and this box has Python 3.13.5. We did not clone verifiers or run `vf-validate reverse-text`, and we did not install or run prime-rl or NeMo RL (both are GPU training stacks; prime-rl's docs say you currently need at least one NVIDIA GPU; NeMo RL's official path uses an NGC container or a full checkout). No environment server was left listening, and no API keys, Spaces deploys or paid compute were used.\n",
  "html": "<h2>Gym libraries, not training stacks or eval-task frameworks</h2>\n<p><a href=\"/compare/agent-reinforcement-learning-stacks/\">Agent RL stacks compared</a> covers training engines and harness gateways — <a href=\"/entries/verl/\">verl</a>, <a href=\"/entries/skyrl/\">SkyRL</a>, <a href=\"/entries/agent-lightning/\">Agent Lightning</a> and <a href=\"/entries/openpipe-art/\">OpenPipe ART</a>. <a href=\"/stacks/post-training-tool-use-model/\">Post-training a tool-use model</a> is a recommended SFT/LoRA/DPO/GRPO path on <a href=\"/entries/trl/\">TRL</a> and PEFT. <a href=\"/compare/agent-environment-frameworks/\">Agent environment frameworks compared</a> is one layer over, covering <a href=\"/entries/harbor/\">Harbor</a>, <a href=\"/entries/agentenv-framework/\">AgentEnv Framework</a> and <a href=\"/entries/seahaven/\">Seahaven</a> as task- and world-authoring frameworks; that page already notes that AgentEnv and Seahaven can <em>serve</em> environments through OpenEnv.</p>\n<p>This page compares the three <strong>RL environment libraries</strong> now in the directory: <a href=\"/entries/nemo-gym/\">NeMo Gym</a>, <a href=\"/entries/openenv/\">OpenEnv</a> and <a href=\"/entries/verifiers/\">verifiers</a>. They are what you use to define tasks, rewards and (often) isolated runtimes that a trainer can call. <a href=\"/entries/prime-rl/\">prime-rl</a> and <a href=\"/entries/nemo-rl/\">NeMo RL</a> appear here only as documented consumers of those environments, not as subjects.</p>\n<p>The comparison table is generated from the front matter. Project READMEs include scale or catalog wording (for example OpenEnv&#39;s &quot;40+ ready-to-use environments&quot;, NeMo Gym&#39;s &quot;thousands of concurrent environments&quot;, or prime-rl&#39;s large-cluster claims). Those figures are the projects&#39; own and are not independently counted or measured here.</p>\n<h2>How each library models an environment</h2>\n<p><strong>NeMo Gym</strong> defines an environment as the complete system an agent interacts with: a dataset of tasks, an agent harness, a verifier, and per-task state. You start coordinating servers with <code>gym env start</code> and score rollouts with <code>gym eval run</code>. <a href=\"https://docs.nvidia.com/nemo/gym/main/environment-tutorials\">Environment tutorials</a> walk through single-step and multi-step tool calling, session state, and multi-reward verification. The official docs are at <a href=\"https://docs.nvidia.com/nemo/gym/main/about/\">docs.nvidia.com/nemo/gym/main/about/</a>.</p>\n<p><strong>OpenEnv</strong> is a client-server layer inspired by Gymnasium. You subclass <code>Environment</code> and implement <code>reset()</code>, <code>step()</code> and <code>state</code>; <code>step()</code> returns an observation that already carries <code>done</code> and <code>reward</code>, not a Gymnasium-style tuple. <a href=\"https://huggingface.co/docs/openenv/guides/first-environment\">Your First Environment</a> scaffolds this with <code>openenv init</code>. The README documents a catalog of ready-to-use environments (Echo, coding, TextArena, OpenSpiel, BrowserGym, Harbor and others) at the <a href=\"https://huggingface.co/docs/openenv/environments\">environment catalog</a>. Official docs: <a href=\"https://huggingface.co/docs/openenv/index\">huggingface.co/docs/openenv/index</a>. The documentation root without <code>/index</code> redirects, so do not use that shorter path in published links. The canonical repository is <a href=\"https://github.com/openenv/OpenEnv\">openenv/OpenEnv</a>; older GitHub paths under <code>huggingface/</code> and <code>meta-pytorch/</code> redirect to it.</p>\n<p><strong>verifiers</strong> is organised around a <strong>taskset</strong> that loads <code>Task</code> objects from serialisable <code>TaskData</code>, a <strong>harness</strong> (for example Claude Code, Codex or mini-swe-agent), an <strong>agent</strong> (harness × model × runtime policy) that produces a <code>Trace</code>, and an <strong>environment</strong> that defines control flow across an episode. Most packages only need a <code>Taskset</code> and <code>Task</code>; you write a custom <code>Env</code> when you want bespoke multi-agent flow. The <a href=\"https://raw.githubusercontent.com/PrimeIntellect-ai/verifiers/main/docs/building-environments.md\">building environments</a> guide shows <code>verifiers.v1</code> hooks such as <code>setup</code> and <code>@vf.reward</code>, including isolated grading with <code>ScoringConfig(mode=&quot;isolated&quot;)</code>. In-tree docs live under <a href=\"https://github.com/PrimeIntellect-ai/verifiers/tree/main/docs\">docs/</a>; there is no separate docs hostname.</p>\n<h2>Runtime and isolation</h2>\n<p>NeMo Gym&#39;s quick start runs local servers on a development machine (Linux, macOS, or Windows via WSL2). A GPU is not required for the library itself. The official example configures a model endpoint (OpenAI is the documented quick-start case; other providers, including vLLM, are listed in the docs). Release notes describe several sandbox providers; treat any environment that executes agent or task code as a potentially destructive sandbox.</p>\n<p>OpenEnv packages each environment as a Docker image that the docs say can run locally, on a cloud sandbox, or as a Hugging Face Space, speaking <code>reset</code> / <code>step</code> / <code>state</code> over WebSocket or HTTP, with optional MCP tool serving in production mode. For local authoring, <code>openenv serve</code> runs on the host after you install the environment&#39;s dependencies; the README says to use Docker or Spaces for isolated training and deployment. <code>openenv push</code> deploys to Spaces — we did not run that.</p>\n<p>verifiers splits work across an evaluator process and optional agent and grading sandboxes. Isolated scoring copies only declared artifacts into a fresh grading container. <a href=\"https://raw.githubusercontent.com/PrimeIntellect-ai/verifiers/main/docs/getting_started.md\">Getting started</a> documents <code>vf-validate</code> as a local check that does not call a model, and <code>vf-run</code> for a few in-process episodes. Harbor-based tasksets need Python 3.12+ and the <code>harbor</code> extra.</p>\n<h2>Which trainers they document</h2>\n<p>These libraries are not substitutes for a training engine. Use them to produce graded rollouts; pick the trainer separately.</p>\n<ul><li><strong>OpenEnv</strong> keeps training in the caller&#39;s framework. The <a href=\"https://huggingface.co/docs/openenv/guides/training\">training guide</a> and README name <a href=\"/entries/trl/\">TRL</a> (<a href=\"https://huggingface.co/docs/trl/openenv\">OpenEnv guide</a>, including <code>GRPOTrainer</code> with <code>environment_factory</code> and Harbor traces via <code>AsyncGRPOTrainer</code>), <a href=\"/entries/unsloth/\">Unsloth</a>, <a href=\"/entries/skyrl/\">SkyRL</a>, <a href=\"/entries/openpipe-art/\">ART</a>, Oumi, torchforge, Miles and others. <code>openenv import</code> can wrap an existing Verifiers environment or an AgentEnv bundle. <a href=\"/entries/harbor/\">Harbor</a> integration is documented for running real coding-agent harnesses and capturing tokens for RL.</li><li><strong>NeMo Gym</strong> publishes <a href=\"https://docs.nvidia.com/nemo/gym/tutorials/training-tutorials\">training tutorials</a>, including a <a href=\"https://docs.nvidia.com/nemo/gym/tutorials/training-tutorials/nemo-rl-grpo\">NeMo RL GRPO</a> path, plus Unsloth and VeRL. The <a href=\"https://docs.nvidia.com/nemo/gym/main/about/ecosystem\">ecosystem</a> page describes combining environments from Harbor, OpenEnv, Reasoning Gym and Verifiers. <a href=\"/entries/nemo-rl/\">NeMo RL</a> itself is an Apache-2.0 trainer: GitHub latest is <strong>v0.8.0</strong> (6 November 2026). Its PyPI package <code>nemo-rl</code> is still <strong>0.0.0</strong> (uploaded 3 June 2025) and is not the current install path — official docs use the NGC container or a git checkout.</li><li><strong>verifiers</strong> is documented as tightly integrated with <a href=\"/entries/prime-rl/\">prime-rl</a>. prime-rl&#39;s <a href=\"https://raw.githubusercontent.com/PrimeIntellect-ai/prime-rl/main/docs/overview.md\">overview</a> describes an orchestrator that owns the data plane across verifiers training and eval environments. GitHub latest is <strong>v0.10.0</strong> (13 October 2026). There is still <strong>no</strong> PyPI package named <code>prime-rl</code> or <code>prime_rl</code> (HTTP 404 on 13 November 2026). The README documents a git/uv install and a curl of <code>scripts/install.sh</code> (not executed here) and states that you currently need at least one NVIDIA GPU. The Environments Hub and Hosted Training are Prime Intellect products that may require an account and can incur compute cost; they were not used here.</li></ul>\n<h2>Official install, licences and versions (13 November 2026)</h2>\n<table><thead><tr><th scope=\"col\">Package</th><th scope=\"col\">Licence file</th><th scope=\"col\">Official install documented as</th><th scope=\"col\">PyPI / GitHub latest</th><th scope=\"col\">Requires Python</th></tr></thead><tbody><tr><td>nemo-gym</td><td>Apache License 2.0</td><td><code>git clone</code> and <code>uv venv --python 3.13.14 &amp;&amp; uv sync</code></td><td>0.7.0 / v0.7.0</td><td>&gt;=3.13.14</td></tr><tr><td>openenv</td><td>BSD 3-Clause</td><td><code>pip install openenv</code></td><td>0.13.0 / v0.13.0</td><td>&gt;=3.10</td></tr><tr><td>verifiers</td><td>MIT</td><td><code>git clone</code> and <code>uv sync</code>; README also recommends <code>uv tool install prime</code></td><td>0.4.1 / v0.4.1</td><td>&gt;=3.11,&lt;3.15</td></tr><tr><td>prime-rl (trainer, not a subject)</td><td>Apache License 2.0</td><td>git/uv (or the project&#39;s install script)</td><td>no PyPI package / v0.10.0</td><td>(see prime-rl docs; GPU required)</td></tr><tr><td>nemo-rl (trainer, not a subject)</td><td>Apache License 2.0</td><td>NGC container or git clone, not the 0.0.0 PyPI wheel</td><td>PyPI 0.0.0; GitHub v0.8.0</td><td>(see NeMo RL install docs)</td></tr></tbody></table>\n<p>When linking repositories, use the canonical paths above. Do not use redirecting GitHub URLs such as <code>huggingface/openenv</code>, <code>meta-pytorch/OpenEnv</code>, or <code>willccbb/verifiers</code>.</p>\n<h2>A minimal OpenEnv check we ran</h2>\n<p>The following commands are the official scaffold and static contract check from the OpenEnv README and <a href=\"https://huggingface.co/docs/openenv/reference/cli\">CLI reference</a>. We ran them on the box with PyPI <strong>openenv 0.13.0</strong> in a Python 3.13.5 virtualenv, without Docker and without calling a hosted Space or a model:</p>\n<pre><code class=\"language-bash\">pip install openenv==0.13.0\nopenenv init my_env\nopenenv validate my_env --level static --skip-build</code></pre>\n<p><code>openenv init</code> created 12 files (including <code>server/my_env_environment.py</code>, <code>models.py</code>, <code>openenv.yaml</code> and a <code>server/Dockerfile</code>). <code>openenv validate</code> reported <code>policy v1</code>, level <code>static</code>, <code>PASS static.manifest</code>, and verdict <code>PASS</code>. We did not run <code>openenv serve</code>, <code>openenv build</code>, <code>openenv push</code>, or a runtime/semantic validate.</p>\n<h2>What we did not run</h2>\n<p>We did not install <a href=\"/entries/nemo-gym/\">NeMo Gym</a>: the official pin is Python <strong>&gt;=3.13.14</strong>, and this box has Python 3.13.5. We did not clone verifiers or run <code>vf-validate reverse-text</code>, and we did not install or run prime-rl or NeMo RL (both are GPU training stacks; prime-rl&#39;s docs say you currently need at least one NVIDIA GPU; NeMo RL&#39;s official path uses an NGC container or a full checkout). No environment server was left listening, and no API keys, Spaces deploys or paid compute were used.</p>"
}
