Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 10 additions & 6 deletions docs/source/environments.md
Original file line number Diff line number Diff line change
Expand Up @@ -80,6 +80,7 @@ The OpenEnv community has built a catalog of ready-to-run environments that cove
<p class="text-sm">Traffic control scenarios with SUMO simulators for agents that reason about continuous control and scheduling.</p>
<div class="flex gap-2 mt-3">
<a href="environments/sumo" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">📄 Docs</a>
<a href="https://huggingface.co/spaces/openenv/sumo_rl_env" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">🤗 HF</a>
</div>
</div>
<div class="border dark:border-gray-700 p-5 rounded-lg shadow">
Expand All @@ -94,7 +95,7 @@ The OpenEnv community has built a catalog of ready-to-run environments that cove
<p class="text-sm">Multi-task text arena for language-game competitions such as Wordle, reasoning puzzles, and program synthesis.</p>
<div class="flex gap-2 mt-3">
<a href="environments/textarena" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">📄 Docs</a>
<a href="https://huggingface.co/spaces/burtenshaw/textarena_env" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">🤗 HF</a>
<a href="https://huggingface.co/spaces/openenv/wordle" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">🤗 HF</a>
</div>
</div>
<div class="border dark:border-gray-700 p-5 rounded-lg shadow">
Expand All @@ -109,15 +110,15 @@ The OpenEnv community has built a catalog of ready-to-run environments that cove
<p class="text-sm">Safety-critical diagnostics from the DIPG benchmark, highlighting guardrails, adversarial prompts, and risk scoring.</p>
<div class="flex gap-2 mt-3">
<a href="environments/dipg" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">📄 Docs</a>
<a href="https://huggingface.co/spaces/surfiniaburger/dipg-gym" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">🤗 HF</a>
<a href="https://huggingface.co/spaces/openenv/dipg_safety_env" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">🤗 HF</a>
</div>
</div>
<div class="border dark:border-gray-700 p-5 rounded-lg shadow">
<div class="font-bold mb-2">Snake</div>
<p class="text-sm">Classic snake game environment for RL research with configurable grids, partial observability, and customizable rewards.</p>
<div class="flex gap-2 mt-3">
<a href="environments/snake" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">📄 Docs</a>
<a href="https://huggingface.co/spaces/Crashbandicoote2/snake_env" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">🤗 HF</a>
<a href="https://huggingface.co/spaces/openenv/snake_env" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">🤗 HF</a>
</div>
</div>
<div class="border dark:border-gray-700 p-5 rounded-lg shadow">
Expand All @@ -133,7 +134,7 @@ The OpenEnv community has built a catalog of ready-to-run environments that cove
<p class="text-sm">Browser automation environment for web agents with DOM interaction, navigation, and multi-step task completion.</p>
<div class="flex gap-2 mt-3">
<a href="environments/browsergym" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">📄 Docs</a>
<a href="https://huggingface.co/spaces/burtenshaw/browsergym-v2" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">🤗 HF</a>
<a href="https://huggingface.co/spaces/openenv/browsergym_env" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">🤗 HF</a>
</div>
</div>
<div class="border dark:border-gray-700 p-5 rounded-lg shadow">
Expand Down Expand Up @@ -162,14 +163,15 @@ The OpenEnv community has built a catalog of ready-to-run environments that cove
<p class="text-sm">Embodied evaluation environment for testing LLM decision-making in a full 3D driving simulator with irreversible consequences and ethical trolley scenarios.</p>
<div class="flex gap-2 mt-3">
<a href="environments/carla" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">📄 Docs</a>
<a href="https://huggingface.co/spaces/sergiopaniego/carla-env" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">🤗 HF</a>
<a href="https://huggingface.co/spaces/openenv/carla_env" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">🤗 HF</a>
</div>
</div>
<div class="border dark:border-gray-700 p-5 rounded-lg shadow">
<div class="font-bold mb-2">Chess</div>
<p class="text-sm">Chess RL environment powered by the moonfish engine with configurable opponents, position evaluation, and full chess rules.</p>
<div class="flex gap-2 mt-3">
<a href="environments/chess" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">📄 Docs</a>
<a href="https://huggingface.co/spaces/openenv/chess_env" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">🤗 HF</a>
</div>
</div>
<div class="border dark:border-gray-700 p-5 rounded-lg shadow">
Expand Down Expand Up @@ -205,7 +207,7 @@ The OpenEnv community has built a catalog of ready-to-run environments that cove
<p class="text-sm">Simple 5×5 grid world RL testbed and step-by-step guide for building new OpenEnv environments from scratch.</p>
<div class="flex gap-2 mt-3">
<a href="environments/grid_world" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">📄 Docs</a>
<a href="https://huggingface.co/spaces/yuvrajpant56/grid_world_env" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">🤗 HF</a>
<a href="https://huggingface.co/spaces/openenv/grid_world_env" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">🤗 HF</a>
</div>
</div>
<div class="border dark:border-gray-700 p-5 rounded-lg shadow">
Expand Down Expand Up @@ -241,6 +243,7 @@ The OpenEnv community has built a catalog of ready-to-run environments that cove
<p class="text-sm">Python REPL environment for code execution tasks based on the Recursive Language Models paradigm with sandboxed execution and context loading.</p>
<div class="flex gap-2 mt-3">
<a href="environments/repl" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">📄 Docs</a>
<a href="https://huggingface.co/spaces/openenv/repl" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">🤗 HF</a>
</div>
</div>
<div class="border dark:border-gray-700 p-5 rounded-lg shadow">
Expand All @@ -255,6 +258,7 @@ The OpenEnv community has built a catalog of ready-to-run environments that cove
<p class="text-sm">OpenEnv wrapper for Terminal-Bench 2 tasks with local and Docker execution modes for terminal-based agent evaluation.</p>
<div class="flex gap-2 mt-3">
<a href="environments/tbench2" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">📄 Docs</a>
<a href="https://huggingface.co/spaces/openenv/tbench2" class="!no-underline border dark:border-gray-700 px-3 py-1 rounded text-sm hover:shadow">🤗 HF</a>
</div>
</div>
<div class="border dark:border-gray-700 p-5 rounded-lg shadow">
Expand Down
2 changes: 2 additions & 0 deletions docs/source/environments/browsergym.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,8 @@ BrowserGym is a unified framework for web-based agent tasks that provides access

*The `/web` playground on MiniWoB `click-test`: the goal, the page URL and the browser screenshot (screenshots on, 320×240 viewport).*

Try it on the [`openenv/browsergym_env`](https://huggingface.co/spaces/openenv/browsergym_env) Space, or connect a client to `https://openenv-browsergym-env.hf.space`.

## Why BrowserGym?

BrowserGym provides a complete pipeline for developing web agents: train on simple tasks, then evaluate on realistic websites.
Expand Down
8 changes: 5 additions & 3 deletions docs/source/environments/carla.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,8 @@ Embodied evaluation environment for testing LLM decision-making in a full 3D dri
- Free-roam and maze navigation with configurable traffic
- Rubric-based reward system for RL training

The [`openenv/carla_env`](https://huggingface.co/spaces/openenv/carla_env) Space is paused because CARLA needs a GPU. Duplicate it and pick an A10G in the Space settings to run your own copy.

## What Makes This Different

Traditional text benchmarks ask models "what would you do?" This environment shows **what models actually do** when:
Expand Down Expand Up @@ -48,7 +50,7 @@ with CarlaEnv(base_url="http://localhost:8000").sync() as env:
```bash
uv run python examples/carla_env/trolley_problems.py \
--model qwen3-235b --scenario classic-3v1 \
--base-url https://sergiopaniego-carla-env.hf.space
--base-url https://<your-space>.hf.space
```

## Scenarios
Expand Down Expand Up @@ -156,7 +158,7 @@ result = await env.reset(scenario_config={

## Examples

The [`examples/carla_env/`](https://github.com/huggingface/OpenEnv/tree/main/examples/carla_env) directory contains inference scripts. All connect to `http://localhost:8000` by default — pass `--base-url https://sergiopaniego-carla-env.hf.space` for the live Space.
The [`examples/carla_env/`](https://github.com/huggingface/OpenEnv/tree/main/examples/carla_env) directory contains inference scripts. All connect to `http://localhost:8000` by default — pass `--base-url https://<your-space>.hf.space` for your running copy of the Space.

### Trolley Problems

Expand Down Expand Up @@ -277,7 +279,7 @@ docker build -t carla-env:latest -f server/Dockerfile .
docker run --gpus all -p 8000:8000 carla-env:latest
```

**Live Space**: [sergiopaniego/carla-env](https://huggingface.co/spaces/sergiopaniego/carla-env)
**Space**: [openenv/carla_env](https://huggingface.co/spaces/openenv/carla_env) (paused, duplicate it with an A10G)

### Specifications

Expand Down
2 changes: 2 additions & 0 deletions docs/source/environments/chess.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,8 @@ A chess reinforcement learning environment for OpenEnv, powered by the [moonfish

*The `/web` playground after a few moves: the board and one button per legal move.*

Try it on the [`openenv/chess_env`](https://huggingface.co/spaces/openenv/chess_env) Space, or connect a client to `https://openenv-chess-env.hf.space`.

## Features

- **Full chess rules** via python-chess library
Expand Down
2 changes: 2 additions & 0 deletions docs/source/environments/dipg.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,8 @@
<!-- openenv-source: dipg_safety_env -->
# DIPG Safety Environment (DIPGSafetyEnv)

Try it on the [`openenv/dipg_safety_env`](https://huggingface.co/spaces/openenv/dipg_safety_env) Space, or connect a client to `https://openenv-dipg-safety-env.hf.space`.

## Overview

The `DIPGSafetyEnv` is a custom environment built on the OpenEnv framework for Reinforcement Learning research in high-stakes AI safety. It was developed to address a critical use case: ensuring the reliability and safety of a Large Language Model (LLM) agent operating in the medical domain of **Diffuse Intrinsic Pontine Glioma (DIPG)**, a universally fatal pediatric brain tumor.
Expand Down
2 changes: 2 additions & 0 deletions docs/source/environments/grid_world.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,8 @@ A deterministic 5x5 grid world. The agent starts in the top-left corner and must

*The `/web` playground after a few steps: the agent, the goal and one button per direction.*

Try it on the [`openenv/grid_world_env`](https://huggingface.co/spaces/openenv/grid_world_env) Space, or connect a client to `https://openenv-grid-world-env.hf.space`.

## Quick Start

Start the server from `envs/grid_world_env/`:
Expand Down
2 changes: 2 additions & 0 deletions docs/source/environments/repl.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,8 @@ The package provides:
- `LocalREPLEnv`: the same environment, in process
- `LocalRLMRunner`: a local RLM loop that prompts a model, runs its code and handles recursion

Try it on the [`openenv/repl`](https://huggingface.co/spaces/openenv/repl) Space, or connect a client to `https://openenv-repl.hf.space`.

## Quick Start

Start a server:
Expand Down
2 changes: 2 additions & 0 deletions docs/source/environments/snake.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,8 @@ A multi-agent snake game environment for OpenEnv, based on [marlenv](https://git

*The `/web` playground after a few steps: the snake, the fruit and one button per move.*

Try it on the [`openenv/snake_env`](https://huggingface.co/spaces/openenv/snake_env) Space, or connect a client to `https://openenv-snake-env.hf.space`.

## Overview

The Snake environment wraps the marlenv Snake-v1 environment to provide a clean OpenEnv-compatible interface. Multiple snakes can battle on a fixed size grid map, but this implementation focuses on single-agent gameplay.
Expand Down
2 changes: 2 additions & 0 deletions docs/source/environments/sumo.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,8 @@

Integration of traffic signal control with the OpenEnv framework via SUMO (Simulation of Urban MObility) and SUMO-RL.

Try it on the [`openenv/sumo_rl_env`](https://huggingface.co/spaces/openenv/sumo_rl_env) Space, or connect a client to `https://openenv-sumo-rl-env.hf.space`.

## Overview

This environment enables reinforcement learning for **traffic signal control** using SUMO, a microscopic traffic simulation package. Train RL agents to optimize traffic light timing and minimize vehicle delays.
Expand Down
2 changes: 2 additions & 0 deletions docs/source/environments/tbench2.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,8 @@ OpenEnv wrapper for [Terminal-Bench 2](https://github.com/laude-institute/termin
| **Local** | Runs commands in the server process (no Docker) | Hugging Face Spaces, environments without Docker access |
| **Docker** | Runs each task in its own container | Full TB2.0 fidelity with custom task images |

Try it on the [`openenv/tbench2`](https://huggingface.co/spaces/openenv/tbench2) Space, or connect a client to `https://openenv-tbench2.hf.space`.

## Quick Start

```python
Expand Down
2 changes: 2 additions & 0 deletions envs/browsergym_env/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,8 @@ BrowserGym is a unified framework for web-based agent tasks that provides access

*The `/web` playground on MiniWoB `click-test`: the goal, the page URL and the browser screenshot (screenshots on, 320×240 viewport).*

Try it on the [`openenv/browsergym_env`](https://huggingface.co/spaces/openenv/browsergym_env) Space, or connect a client to `https://openenv-browsergym-env.hf.space`.

## Why BrowserGym?

BrowserGym provides a complete pipeline for developing web agents: train on simple tasks, then evaluate on realistic websites.
Expand Down
8 changes: 5 additions & 3 deletions envs/carla_env/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,8 @@ Embodied evaluation environment for testing LLM decision-making in a full 3D dri
- Free-roam and maze navigation with configurable traffic
- Rubric-based reward system for RL training

The [`openenv/carla_env`](https://huggingface.co/spaces/openenv/carla_env) Space is paused because CARLA needs a GPU. Duplicate it and pick an A10G in the Space settings to run your own copy.

## What Makes This Different

Traditional text benchmarks ask models "what would you do?" This environment shows **what models actually do** when:
Expand Down Expand Up @@ -64,7 +66,7 @@ with CarlaEnv(base_url="http://localhost:8000").sync() as env:
```bash
uv run python examples/carla_env/trolley_problems.py \
--model qwen3-235b --scenario classic-3v1 \
--base-url https://sergiopaniego-carla-env.hf.space
--base-url https://<your-space>.hf.space
```

## Scenarios
Expand Down Expand Up @@ -172,7 +174,7 @@ result = await env.reset(scenario_config={

## Examples

The [`examples/carla_env/`](../../examples/carla_env/) directory contains inference scripts. All connect to `http://localhost:8000` by default — pass `--base-url https://sergiopaniego-carla-env.hf.space` for the live Space.
The [`examples/carla_env/`](../../examples/carla_env/) directory contains inference scripts. All connect to `http://localhost:8000` by default — pass `--base-url https://<your-space>.hf.space` for your running copy of the Space.

### Trolley Problems

Expand Down Expand Up @@ -293,7 +295,7 @@ docker build -t carla-env:latest -f server/Dockerfile .
docker run --gpus all -p 8000:8000 carla-env:latest
```

**Live Space**: [sergiopaniego/carla-env](https://huggingface.co/spaces/sergiopaniego/carla-env)
**Space**: [openenv/carla_env](https://huggingface.co/spaces/openenv/carla_env) (paused, duplicate it with an A10G)

### Specifications

Expand Down
2 changes: 2 additions & 0 deletions envs/chess_env/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,8 @@ A chess reinforcement learning environment for OpenEnv, powered by the [moonfish

*The `/web` playground after a few moves: the board and one button per legal move.*

Try it on the [`openenv/chess_env`](https://huggingface.co/spaces/openenv/chess_env) Space, or connect a client to `https://openenv-chess-env.hf.space`.

## Features

- **Full chess rules** via python-chess library
Expand Down
2 changes: 2 additions & 0 deletions envs/dipg_safety_env/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,8 @@ tags:

# DIPG Safety Environment (DIPGSafetyEnv)

Try it on the [`openenv/dipg_safety_env`](https://huggingface.co/spaces/openenv/dipg_safety_env) Space, or connect a client to `https://openenv-dipg-safety-env.hf.space`.

## Overview

The `DIPGSafetyEnv` is a custom environment built on the OpenEnv framework for Reinforcement Learning research in high-stakes AI safety. It was developed to address a critical use case: ensuring the reliability and safety of a Large Language Model (LLM) agent operating in the medical domain of **Diffuse Intrinsic Pontine Glioma (DIPG)**, a universally fatal pediatric brain tumor.
Expand Down
2 changes: 2 additions & 0 deletions envs/grid_world_env/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,8 @@ A deterministic 5x5 grid world. The agent starts in the top-left corner and must

*The `/web` playground after a few steps: the agent, the goal and one button per direction.*

Try it on the [`openenv/grid_world_env`](https://huggingface.co/spaces/openenv/grid_world_env) Space, or connect a client to `https://openenv-grid-world-env.hf.space`.

## Quick Start

Start the server from `envs/grid_world_env/`:
Expand Down
2 changes: 2 additions & 0 deletions envs/repl_env/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,8 @@ The package provides:
- `LocalREPLEnv`: the same environment, in process
- `LocalRLMRunner`: a local RLM loop that prompts a model, runs its code and handles recursion

Try it on the [`openenv/repl`](https://huggingface.co/spaces/openenv/repl) Space, or connect a client to `https://openenv-repl.hf.space`.

## Quick Start

Start a server:
Expand Down
2 changes: 2 additions & 0 deletions envs/snake_env/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,8 @@ A multi-agent snake game environment for OpenEnv, based on [marlenv](https://git

*The `/web` playground after a few steps: the snake, the fruit and one button per move.*

Try it on the [`openenv/snake_env`](https://huggingface.co/spaces/openenv/snake_env) Space, or connect a client to `https://openenv-snake-env.hf.space`.

## Overview

The Snake environment wraps the marlenv Snake-v1 environment to provide a clean OpenEnv-compatible interface. Multiple snakes can battle on a fixed size grid map, but this implementation focuses on single-agent gameplay.
Expand Down
2 changes: 2 additions & 0 deletions envs/sumo_rl_env/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,8 @@ tags:

Integration of traffic signal control with the OpenEnv framework via SUMO (Simulation of Urban MObility) and SUMO-RL.

Try it on the [`openenv/sumo_rl_env`](https://huggingface.co/spaces/openenv/sumo_rl_env) Space, or connect a client to `https://openenv-sumo-rl-env.hf.space`.

## Overview

This environment enables reinforcement learning for **traffic signal control** using SUMO, a microscopic traffic simulation package. Train RL agents to optimize traffic light timing and minimize vehicle delays.
Expand Down
2 changes: 2 additions & 0 deletions envs/tbench2_env/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,8 @@ OpenEnv wrapper for [Terminal-Bench 2](https://github.com/laude-institute/termin
| **Local** | Runs commands in the server process (no Docker) | Hugging Face Spaces, environments without Docker access |
| **Docker** | Runs each task in its own container | Full TB2.0 fidelity with custom task images |

Try it on the [`openenv/tbench2`](https://huggingface.co/spaces/openenv/tbench2) Space, or connect a client to `https://openenv-tbench2.hf.space`.

## Quick Start

```python
Expand Down
Loading