Skip to content

Track fleet setup failures as separate incidents - #27

Merged
omry merged 1 commit into
mainfrom
pr27
Oct 19, 2026
Merged

omry merged 1 commit into
mainfrom
pr27

Conversation

@omry

@omry omry commented Oct 19, 2026

Copy link
Copy Markdown
Contributor

Fleet setup monitoring now keeps one issue per failure episode. Continuing failures update the current issue, recovery closes it, and a later regression creates a new issue. Manually closed unresolved issues reopen on the next failing scan.

Record recovery in a hidden body marker and find only the newest matching bot issue with bounded, newest-first pagination. Adopt legacy issues until a new scan confirms recovery. Document the lifecycle and lookup limit, and correct the README inventory to Hydra and OmegaConf.

Validation: 1,095 public tests pass, plus lint, formatting, and runtime type checks. Regression coverage includes recovery, recurrence, manual closure, legacy adoption, pagination, and incomplete lookup.

Fleet setup monitoring now keeps one issue per failure episode. Continuing failures update the current issue, recovery closes it, and a later regression creates a new issue. Manually closed unresolved issues reopen on the next failing scan.

Record recovery in a hidden body marker and find only the newest matching bot issue with bounded, newest-first pagination. Adopt legacy issues until a new scan confirms recovery. Document the lifecycle and lookup limit, and correct the README inventory to Hydra and OmegaConf.

Validation: 1,095 public tests pass, plus lint, formatting, and runtime type checks. Regression coverage includes recovery, recurrence, manual closure, legacy adoption, pagination, and incomplete lookup.
@omry
omry marked this pull request as ready for review October 19, 2026 07:24
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Oct 19, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-10-19T07:30:38.636357Z a8e9fe0 Manual request
🔒 Security Review ✅ Completed 2026-10-19T07:28:22.899704Z a8e9fe0 Draft marked ready
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@omry

omry commented Oct 19, 2026 •

Copy link
Copy Markdown
Contributor Author

PR-cycle state — maintained automatically. Do not edit by hand.

Mechanical PR-cycle state (JSON)
{
  "approval": {
    "candidate_revision_fingerprint": "sha256:89486bb639a32ecbb662306c678b811258d64a486a86ab8e77e336adeee03b31",
    "evidence": {
      "attestations": [],
      "candidate_revision_fingerprint": "sha256:89486bb639a32ecbb662306c678b811258d64a486a86ab8e77e336adeee03b31",
      "check_conclusions": [
        {
          "conclusion": "SUCCESS",
          "name": "test",
          "run_id": 117939211100
        },
        {
          "conclusion": "SUCCESS",
          "name": "toolchain (22, npm, 11.9.0)",
          "run_id": 117939210905
        },
        {
          "conclusion": "SUCCESS",
          "name": "toolchain (22, pnpm, 11.20.0)",
          "run_id": 117939211081
        },
        {
          "conclusion": "SUCCESS",
          "name": "toolchain (22, pnpm, 11.21.0)",
          "run_id": 117939211321
        },
        {
          "conclusion": "SUCCESS",
          "name": "toolchain (24, npm, 11.9.0)",
          "run_id": 117939211068
        },
        {
          "conclusion": "SUCCESS",
          "name": "toolchain (24, pnpm, 11.20.0)",
          "run_id": 117939211237
        },
        {
          "conclusion": "SUCCESS",
          "name": "toolchain (24, pnpm, 11.21.0)",
          "run_id": 117939210918
        }
      ],
      "delivery_deferral_ledger_digest": "sha256:4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945",
      "finding_dispositions_digest": "sha256:4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945",
      "operation_identity": "sha256:5964bf3d18b91ee523e4f949444e95de972471d1050fbd4900aa88921789893b",
      "review_request": {
        "body_digest": "sha256:643e893d1cee73bfd6c7a57cdfb79dba6aa5b08995ebdab6e6818285de808744",
        "id": 6262021358
      },
      "review_result": {
        "body_digest": "sha256:821eca8ace997d6d29ec4748b404c7084754ab5e99e41e257ac18056a383c7ee",
        "id": 6262056451
      }
    },
    "evidence_fingerprint": "sha256:a58ec81c79e7cb7d2ec1c35447d96be62d132c63f6ca8d36dc5263ce57bb1cf8",
    "head_sha": "a8e9fe08f8987e2286a621d30c28e1bdf1b83621",
    "operation_identity": "sha256:5964bf3d18b91ee523e4f949444e95de972471d1050fbd4900aa88921789893b",
    "review_request_id": 6262021358,
    "review_result_id": 6262056451,
    "status": "approved-evidence-recorded"
  },
  "candidate_revision_fingerprint": "sha256:89486bb639a32ecbb662306c678b811258d64a486a86ab8e77e336adeee03b31",
  "check_conclusions": [
    {
      "conclusion": "SUCCESS",
      "name": "test",
      "run_id": 117939211100
    },
    {
      "conclusion": "SUCCESS",
      "name": "toolchain (22, npm, 11.9.0)",
      "run_id": 117939210905
    },
    {
      "conclusion": "SUCCESS",
      "name": "toolchain (22, pnpm, 11.20.0)",
      "run_id": 117939211081
    },
    {
      "conclusion": "SUCCESS",
      "name": "toolchain (22, pnpm, 11.21.0)",
      "run_id": 117939211321
    },
    {
      "conclusion": "SUCCESS",
      "name": "toolchain (24, npm, 11.9.0)",
      "run_id": 117939211068
    },
    {
      "conclusion": "SUCCESS",
      "name": "toolchain (24, pnpm, 11.20.0)",
      "run_id": 117939211237
    },
    {
      "conclusion": "SUCCESS",
      "name": "toolchain (24, pnpm, 11.21.0)",
      "run_id": 117939210918
    }
  ],
  "check_observations": [
    {
      "checks": [
        {
          "conclusion": "SUCCESS",
          "name": "test",
          "run_id": 117939211100,
          "run_status": "completed",
          "status": "success",
          "url": "https://github.com/hydra-ecosystem/github-actions/actions/runs/39215795334/job/117939211100"
        },
        {
          "conclusion": "SUCCESS",
          "name": "toolchain (22, npm, 11.9.0)",
          "run_id": 117939210905,
          "run_status": "completed",
          "status": "success",
          "url": "https://github.com/hydra-ecosystem/github-actions/actions/runs/39215795334/job/117939210905"
        },
        {
          "conclusion": "SUCCESS",
          "name": "toolchain (22, pnpm, 11.20.0)",
          "run_id": 117939211081,
          "run_status": "completed",
          "status": "success",
          "url": "https://github.com/hydra-ecosystem/github-actions/actions/runs/39215795334/job/117939211081"
        },
        {
          "conclusion": "SUCCESS",
          "name": "toolchain (22, pnpm, 11.21.0)",
          "run_id": 117939211321,
          "run_status": "completed",
          "status": "success",
          "url": "https://github.com/hydra-ecosystem/github-actions/actions/runs/39215795334/job/117939211321"
        },
        {
          "conclusion": "SUCCESS",
          "name": "toolchain (24, npm, 11.9.0)",
          "run_id": 117939211068,
          "run_status": "completed",
          "status": "success",
          "url": "https://github.com/hydra-ecosystem/github-actions/actions/runs/39215795334/job/117939211068"
        },
        {
          "conclusion": "SUCCESS",
          "name": "toolchain (24, pnpm, 11.20.0)",
          "run_id": 117939211237,
          "run_status": "completed",
          "status": "success",
          "url": "https://github.com/hydra-ecosystem/github-actions/actions/runs/39215795334/job/117939211237"
        },
        {
          "conclusion": "SUCCESS",
          "name": "toolchain (24, pnpm, 11.21.0)",
          "run_id": 117939210918,
          "run_status": "completed",
          "status": "success",
          "url": "https://github.com/hydra-ecosystem/github-actions/actions/runs/39215795334/job/117939210918"
        }
      ],
      "head_sha": "a8e9fe08f8987e2286a621d30c28e1bdf1b83621",
      "id": "sha256:69fee13dd3050129cfb309ce95fc44256bc0b9603a746de7f60ef26fa566c2ae",
      "required_checks": [
        "test",
        "toolchain (22, npm, 11.9.0)",
        "toolchain (22, pnpm, 11.20.0)",
        "toolchain (22, pnpm, 11.21.0)",
        "toolchain (24, npm, 11.9.0)",
        "toolchain (24, pnpm, 11.20.0)",
        "toolchain (24, pnpm, 11.21.0)"
      ],
      "status": "success"
    }
  ],
  "delivery_deferral_ledger_digest": "sha256:4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945",
  "delivery_deferrals": [],
  "findings": [],
  "pr": {
    "base_ref": "main",
    "base_sha": "cab8ee5903ca229542e84068fa31ce384d4027e9",
    "body_digest": "sha256:0232246917b73f961ddd7813ec0e9a0e7f22be9c870dedd669acc7d8b441e1c8",
    "diff_digest": "sha256:98d28e6d7191c49df2bb03774c9c0a9aeef34e25ce07aea6f7a3e34db5411246",
    "head_ref": "pr27",
    "head_sha": "a8e9fe08f8987e2286a621d30c28e1bdf1b83621",
    "pr": 27,
    "repository": "hydra-ecosystem/github-actions",
    "scope_authority": [],
    "title_digest": "sha256:22837d187c5368e4ee05f4ca73aedea9ed274a04ce2d1e1528464b9245773409"
  },
  "record_version": 4,
  "review_observations": [],
  "review_requests": [
    {
      "base_established_at": "2026-10-19T07:24:34Z",
      "base_ref": "main",
      "base_sha": "cab8ee5903ca229542e84068fa31ce384d4027e9",
      "body_digest": "sha256:643e893d1cee73bfd6c7a57cdfb79dba6aa5b08995ebdab6e6818285de808744",
      "created_at": "2026-10-19T07:28:19Z",
      "head_sha": "a8e9fe08f8987e2286a621d30c28e1bdf1b83621",
      "id": 6262021358,
      "kind": "regular-review"
    }
  ],
  "review_results": [
    {
      "base_ref": "main",
      "base_sha": "cab8ee5903ca229542e84068fa31ce384d4027e9",
      "body_digest": "sha256:821eca8ace997d6d29ec4748b404c7084754ab5e99e41e257ac18056a383c7ee",
      "commit_id": "a8e9fe08f8987e2286a621d30c28e1bdf1b83621",
      "id": 6262056451,
      "inline_message_ids": [],
      "request_comment_id": 6262021358,
      "result_kind": "clean",
      "status": "result",
      "submitted_at": "2026-10-19T07:30:37Z",
      "unresolved_thread_ids": []
    }
  ],
  "revision_fingerprint": "sha256:89486bb639a32ecbb662306c678b811258d64a486a86ab8e77e336adeee03b31",
  "rounds": [
    {
      "applied_fix_paths": [],
      "disposition_changes": [],
      "effective_diff_digest": "sha256:98d28e6d7191c49df2bb03774c9c0a9aeef34e25ce07aea6f7a3e34db5411246",
      "finding_ids": [],
      "invariants": [
        "One issue per confirmed failure episode; unresolved manual closures reopen; recovered history preserved; bounded newest-first bot lookup"
      ],
      "outcome": "clean",
      "proposed_fix_paths": [],
      "resulting_head": "a8e9fe08f8987e2286a621d30c28e1bdf1b83621",
      "review_observation_id": null,
      "review_request_id": 6262021358,
      "review_result_id": 6262056451,
      "reviewed_head": "a8e9fe08f8987e2286a621d30c28e1bdf1b83621",
      "root_cause": null,
      "round": 1,
      "unresolved_current_slice_findings": 0,
      "unresolved_design_blockers": 0
    }
  ],
  "schema": "awd:swe:pr-cycle-state",
  "version": 2
}

@omry

omry commented Oct 19, 2026

Copy link
Copy Markdown
Contributor Author

@codex, regular review a8e9fe0

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Breezy!

Reviewed commit: a8e9fe08f8

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@omry omry added the approved label Oct 19, 2026
@omry
omry merged commit c966afa into main Oct 19, 2026
7 checks passed
@omry
omry deleted the pr27 branch October 19, 2026 07:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant