Skip to content

Rename internal counter bookkeeping field - #8

Open
shrsv wants to merge 1 commit into
mainfrom
scenario/llm-low-confidence
Open

shrsv wants to merge 1 commit into
mainfrom
scenario/llm-low-confidence

Conversation

@shrsv

@shrsv shrsv commented Oct 19, 2026

Copy link
Copy Markdown

Renames an internal field for clarity ahead of a larger metrics change.

Simulated LLM classification for this demo: refactor-only, but at low confidence (3/10) -- the diff touches code the classifier has limited context on.

LiveReview Pre-Commit Check: skipped (iter:1, coverage:0%)
@livereviewbot

Copy link
Copy Markdown
Collaborator

LiveReview automated review

Scanned 1 changed file (+1/-1), a private struct field rename. No line-level findings.

Classifier note: confidence on this classification came back low (3/10) -- the diff is small, but it's reasoning about a field rename with limited surrounding context about how Counters is used elsewhere, so the classifier isn't confident refactor-only is the complete picture here.

@livereviewbot

Copy link
Copy Markdown
Collaborator

Auto-approve policy evaluation

Stage Result
Eligibility ✅ pass
LLM classification gate (refactor-only, confidence 3, required ≥ 8) ❌ fails
Risk score — not reached
Static ruleset gate — not reached

Verdict: BLOCKED at the LLM gate. The classification itself (refactor-only) is a safe-looking class -- but the policy doesn't trust a classification it isn't confident in, no matter how benign the label looks. Low confidence is treated as "we don't actually know what this is," not as "probably fine."

@livereviewbot livereviewbot added auto-approve-demo Scenario in the Auto-Approve Gallery demo held-for-review LiveReview held this PR for human review labels Oct 19, 2026

@livereviewbot livereviewbot left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Auto-approve policy verdict: BLOCKED (LLM gate). Classification confidence (3) is below the org's required threshold (8), regardless of the class label.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

auto-approve-demo Scenario in the Auto-Approve Gallery demo held-for-review LiveReview held this PR for human review

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants