Skip to content

docs: Qwen3.5 single-layer graft Report 16 results - #14

Closed
mvillmow wants to merge 1 commit into
LLM360:mainfrom
mvillmow:graft-single-layer-report-16-25m-results
Closed

mvillmow wants to merge 1 commit into
LLM360:mainfrom
mvillmow:graft-single-layer-report-16-25m-results

Conversation

@mvillmow

Copy link
Copy Markdown

Summary

  • documents the top arm from the 30-arm Qwen3.5 single-layer graft screen
  • compares its complete 1M and 25M MMLU-Pro/BBH evaluations
  • binds the report to immutable checkpoint and evaluation receipt hashes

Result

The combined MMLU-Pro + BBH score changed from 1.134236 at 1M to 1.131933 at 25M (-0.002303).

Validation

  • git diff --check
  • verified checkpoint/evaluation completion receipts and protocol identity
  • MkDocs/pre-commit tooling is unavailable in the current environment

@mvillmow

Copy link
Copy Markdown
Author

Closing because this experiment report was published to the wrong repository. It belongs in the New Developer reporting workflow, not the vLLM source repository.

@mvillmow mvillmow closed this Aug 24, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant