Repository navigation
Fix canonical FP32 gradients and BF16 branch graph lifetime - #56
Merged
CompleteDotTech merged 1 commit intoSep 30, 2026
Merged
Conversation
This was referenced Sep 30, 2026
CompleteDotTech
deleted the
fix/canonical-fp32-and-branch-graph-lifetime
branch
October 1, 2026 18:11
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Changes
Refs #3 and #4. This is a numerical/source repair and scoped evidence delivery; neither issue is closed.
Verification
Limits retained
The exact 32768-branch/65536-aggregate FP32 training resource probe OOMs during forward at the unchanged 70% allocator cap. Full-weight noncheckpointed FP32 resume also OOMs. The graph cleanup allows the same-init BF16 first optimizer step and reload, but resumed backward still OOMs. An allocator experiment is explicitly unsuccessful: expandable segments are unsupported on this Windows runtime. All failures and artifact/attempt histories are preserved.
Historical numerical/rank-8 receipts retain their original source hashes; the later graph cleanup has a separate source-bound receipt. This does not establish full-weight resume, installed serving for every mode, representative predictive quality, or Jev benefit. Overwatch remains archived by user direction.