Skip to content

feat(website): build a site's server image from source or a registry, and verify its state at /go (FD-4683) - #392

Open
williamloo-scale wants to merge 1 commit into
wloo/web-apps-deployfrom
wloo/web-apps-verifier
Open

williamloo-scale wants to merge 1 commit into
wloo/web-apps-deployfrom
wloo/web-apps-verifier

Conversation

@williamloo-scale

@williamloo-scale williamloo-scale commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

agent-env env website put takes a site's server image from --server-dockerfile (stored with its build context, as an a2a agent's image is), --server-image-ref or GitHub, with --health-path. The older --backend-* flags still work, and a separate frontend image is optional and warned of. A new website_state_verifier step reads each checked session of a website env's sites, or a multi env's, at the site's /go?sid= through /svc/<name>/, the verifier endpoint CUA-Gym sites serve, and checks one dot path of its current_state, initial_state or state_diff each, with rows scored like the other verifiers. With env_version pinned to the version the task deploys, put and preflight refuse checks of sites that version doesn't serve.

Validation: unit suite passes, with tests for the CLI's three image sources and its refusals, check evaluation, pinned-version preflight, and execute reading two sites' /go through a stubbed gateway.

🤖 Generated with Claude Code

RetriggerView in GreptileConfidence Score: 5/5

The PR appears safe to merge; no actionable new issues remain.

Summary

Adds server-image sources to the website CLI and introduces website_state_verifier.

  • Website setup accepts one server image and makes the separate frontend optional.
  • Tasks can check the state reported by each website site and session.

Diagram

sequenceDiagram
    participant Step as Website verifier
    participant Store as Env store
    participant Gateway
    participant Site
    Step->>Store: Read deployed env version
    Step->>Gateway: "GET /svc/name/go?sid=session"
    Gateway->>Site: "GET /go?sid=session"
    Site-->>Step: Session state
    Step->>Step: Evaluate checks and save score
Loading

Reviews (9) · Last reviewed commit: "feat(website): build a site's server ima..." · Reviewed by Greptile

@williamloo-scale
williamloo-scale marked this pull request as ready for review October 29, 2026 21:03
@williamloo-scale
williamloo-scale requested a review from a team as a code owner October 29, 2026 21:03
Comment thread src/agent_env/cli/env/web_apps.py Outdated
Comment thread src/agent_env/task_step/task_steps/verifiers/web_app_state_verifier.py Outdated
@williamloo-scale williamloo-scale changed the title feat(web-apps): web_app_state_verifier step and agent-env env web-apps commands feat(web-apps): web_app_state_verifier step and agent-env env web-apps commands (FD-4683) Oct 29, 2026
Comment thread src/agent_env/task_step/task_steps/verifiers/web_app_state_verifier.py Outdated
@williamloo-scale williamloo-scale changed the title feat(web-apps): web_app_state_verifier step and agent-env env web-apps commands (FD-4683) feat(web-app): web_app_state_verifier step and agent-env env web-app commands (FD-4683) Oct 30, 2026
Comment thread src/agent_env/task_step/task_steps/verifiers/web_app_state_verifier.py Outdated
@williamloo-scale williamloo-scale changed the title feat(web-app): web_app_state_verifier step and agent-env env web-app commands (FD-4683) feat(website): build a site's server image from source or a registry, and verify its state at /go (FD-4683) Oct 30, 2026
Comment thread src/agent_env/cli/env/website.py Outdated
… and verify its state at /go (FD-4683)

agent-env env website put takes the server image from --server-dockerfile, stored with its build context as an a2a
agent's image is, from --server-image-ref, or from GitHub, with --health-path; a separate frontend image is optional
and warned of. The website_state_verifier step reads each checked session of a website env's sites, or a multi
env's, at the site's /go?sid= through /svc/<name>/, the verifier endpoint CUA-Gym sites serve, and checks dot paths
of its current_state, initial_state or state_diff; with env_version pinned, put and preflight refuse checks of sites
that version doesn't serve.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant