Repository navigation
Testing a codemod-to-agent review handoff without a model #144
bomtobe-hgkim
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
I saw issue #143 ask how to pass review findings from a run step to the following AI step, and how to test that handoff without a model. A deterministic seam could build the AI prompt from a fixed JSON fixture emitted by the run step, with each finding’s ID, file and line, message, and suggested change. A test can assert that every finding reaches the prompt in stable order without contacting an LLM.
For runs without an agent or API key, a regression test could assert that the review findings still print and the migration keeps its existing exit status. That would cover fallback behavior without model credentials. I haven’t run this workflow; I’m with BOMTOBE, the team building Orke for Claude Code and Codex. This is a test-design suggestion only.
All reactions