Skip to content

Fix rollout lifecycle, GPU colocation, and Claude Code integration - #2

Merged
AltmanD merged 7 commits into
datamllab:mainfrom
AltmanD:fix/rollout-runtime-and-claude
Oct 29, 2026
Merged

AltmanD merged 7 commits into
datamllab:mainfrom
AltmanD:fix/rollout-runtime-and-claude

Conversation

@AltmanD

@AltmanD AltmanD commented Oct 29, 2026

Copy link
Copy Markdown
Collaborator

修复训练与任务执行中的以下问题:

  • 修复多轮 rollout 的事件循环冲突,释放已落盘轨迹的内存占用,完善 Docker 清理检查机制。
  • 补齐 Slime --colocate 参数,修复后端环境变量未 export 的问题。
  • 修正 Hello World 的网络、资源和奖励输出配置。
  • 统一采样参数类型,避免 1 与 1.0 导致的校验失败。
  • 调整 Claude Code 配置,限制独立辅助上下文,固定已验证的 CLI 版本。

验证:8×H200 上 split 和 colocate 均完成三轮真实推理与训练。

Forward colocate placement to Slime, release sealed trace payloads, and block retries and restarts while cleanup is unresolved. Reuse the embedded rollout loop, drain pending tasks on shutdown, and export bootstrap environment variables. Add focused regressions and lifecycle documentation.

Validation: 293 tests passed with one environment-dependent skip; 11 Runner-environment tests passed. Real GPU acceptance completed three rollout rounds each for split and colocate, plus Docker cleanup and restart checks.
Share ordered task gathering and sibling cancellation between group and batch rollout. Consolidate cleanup marker publication while preserving the first cause and recording Runner identity. Extend cancellation and remote Runner regressions.

Validation: 295 tests passed, one environment-dependent module skipped; git diff --check passed.
@AltmanD
AltmanD merged commit f0fa355 into datamllab:main Oct 29, 2026
6 checks passed
AltmanD pushed a commit to AltmanD/HarborRL-dev that referenced this pull request Nov 11, 2026
Merge lwm_guide_zh.md, lwm_offline_verify_design_zh.md and
lwm_offline_verify_report_zh.md into a single self-contained
docs/algorithms/lwm_offline_zh.md, restructured to a Qwen-AgentWorld-style
standard: abstract, formalized transition model and terminology, numbered
figures/tables with in-text references, metric definitions with acceptance
gates, and an honest analysis/interpretation-boundary section.

Content purification:
- drop all PR references (PR datamllab#2/#16) and local-commit citations; the replay
  push/sample contract is now described inline
- drop branch development history and process notes (split fix, DNS
  unavailability); only current behavior and runnable commands remain
- unify terminology (LWM=Latent World Model with an explicit disambiguation
  from Qwen-AgentWorld's Language World Model; LeWM; JEPA; tb2.1; ATIF)
- replace site-specific absolute paths with placeholders and mark the
  WM_TRAJECTORIES default as must-override
- correct stale output names (replay_buffer.pt, mpc_plan.json) and add the
  online_learner / tb21 env converter entry points

Update docs/README.md, tools/README.md, slime/slime/world_model/README.md
and examples/training/world_model/README.md to point at the merged doc.
References use stable resources only (arXiv, official project pages,
upstream GitHub repos); all links verified reachable.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant