Repository navigation
research: draft goal-centred replan ablation - #6764
Draft
loopx-agent wants to merge 4 commits into
Draft
loopx-agent wants to merge 4 commits into
loopx-agent wants to merge 4 commits into
Conversation
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Goal And Delivered Outcome
The original Goal already appears in replan context, but presence alone does not establish that a long-running agent reassesses its most consequential remaining gap. This bilingual Draft proposes a late-checkpoint study that separates whole-goal reflection (G) from a source-bound reading index (C), while retaining the original Goal and complete ordinary input in every cell.
The proposal now specifies the actual delivery boundary: a current, due-replan CLI response may occur inside preparation while checkpoint capture is correctly gated. The advisory must preserve that current response and cannot use source-checkpoint commands as destination admission. Intended base: main. This increment changes documentation only; no shipped runtime, configuration, scoring or experiment behavior changes.
Author Declaration
docs/architecture/rfcs/long-horizon-harness-benchmark-research-program-v0.md.benchmark-toolkitresearch with the native provider; reuse existing TypeScript replan/context and checkpoint selection owners. G/C labels remain local to the study.Scope And Remaining Author Work
The disposable prototype invokes the real destination CLI once and returns one valid JSON frame. It binds the original response and separate advisory, preserves existing projection freshness/omission facts, and falls back to the committed raw response on composition failure without replaying an effect. It is not installed in a runner or offered as a public API. No fixtures, private outputs or model transcripts are published.
Current CLI qualification must cover the whole checkout and actual interpreter; a few unchanged owner files are insufficient. A generated file named model-visible is also insufficient: require the actual client-visible tool response, accepted replan/writeback and subsequent useful work. Retain failed startup/recovery costs. Synthetic transport evidence is distinct from native checkpoint recovery and benchmark outcome evidence.
Remaining author work: qualify the actual pinned warm receiver/model-client path, freeze late-point manifests and treatment bytes before outcomes, then run the authorized matched continuation study. Common fresh reconstruction already includes the original objective, failed alternatives and retained best; G estimates additional reflection beyond that baseline. Do not borrow an existing fresh arm as an unplanned control or exceed the available worker slots and original cumulative budget.
The first C index only organizes already-delivered facts; absent stride-only follow-through and candidate/incumbent bindings remain unknown. No extra retrieval, summary model, stride activation or parallel decision owner is introduced. Keep Draft while this concrete author work is unfinished. Review, merge, installation and scientific acceptance remain separate.
Future-facing pass: reuse the typed readers and pre-decision selector; defer a production abstraction until a real receiver callsite is qualified. Any later caller-facing option must include its necessary frontend/CLI/Lark configuration, readback and disable journey through the existing owner.
Validation
Documentation head:
b48a2c6450bbaeb3ac511cf7d42500a38870ae07, merged from main105c4bc15091afac832495167cb98a1389951a04. Current isolated CLI checks use the pinned receiver checkout, separate from the older-source model characterization. No benchmark, native registration, grading or scientific G/C cell was launched for this increment.Frontend / Visual Evidence
UI impact: none. Plain Markdown study documents and a lower-page adapter-guide link. The current update leaves the opening viewport unchanged. No packaged frontend, installed setting or browser journey is claimed.
Type of Change
LoopX Area
Technical Direction
Existing overall roadmap S11 and long-horizon measurement/episode acceptance. No new roadmap, shared protocol vocabulary, runtime option or second Goal/context owner.
Shared-authority RFC fixture impact
N/A. No authority store, migration, provider or runtime-routing change.
Boundary Checklist