Skip to content

docs: document CFP estimation, semantic duplicate analysis, and eval script in spec - #131

Merged
kenjudy merged 1 commit into
mainfrom
feat/spec-cfp-documentation
Aug 31, 2026
Merged

kenjudy merged 1 commit into
mainfrom
feat/spec-cfp-documentation

Conversation

@kenjudy

@kenjudy kenjudy commented Aug 31, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Adds "Semantic Duplicate Analysis" sub-section to Claude API Integration: forward reference to Metric 9, clarifies this is the second of three Claude-powered analyses
  • Adds "Functional Size Estimation (COSMIC-inspired)" sub-section: when it runs (squashed history + ANTHROPIC_API_KEY), prompt enforcement rules, output location, and explicit status as informational with calibration deferred
  • Adds "Prompt Quality Gate" sub-section: documents scripts/eval-prompts.js and the trigger to run it (before any prompt change)
  • Adds cfp_results to the local_metrics_summary.json output format reference (sha, estimated_cfp_delta, estimated_cfp_breakdown with E/X/R/W)
  • Updates "Cost Estimate" to note CFP adds one API call per squashed commit within the same AI_ANALYSIS_MAX_COMMITS cap

Test plan

  • 824/824 tests pass (docs-only change, pre-commit still runs full suite)

Generated with Claude Code

…script in spec

Adds to the Claude API Integration section:
- Semantic Duplicate Analysis: forward reference to Metric 9 with context
  that this is the second of three Claude-powered analyses
- Functional Size Estimation (COSMIC-inspired): when it runs (squashed
  history + API key), prompt enforcement ("no other text" + test-file
  exclusion), output location (cfp_results in summary JSON + drift report),
  and explicit status as informational pending calibration
- Prompt Quality Gate: documents scripts/eval-prompts.js and when to run it

Adds cfp_results to the local_metrics_summary.json output format reference
(sha, estimated_cfp_delta, estimated_cfp_breakdown with E/X/R/W integers).

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@kenjudy
kenjudy merged commit 2d05555 into main Aug 31, 2026
1 check passed
@kenjudy
kenjudy deleted the feat/spec-cfp-documentation branch August 31, 2026 22:03
@github-actions

Copy link
Copy Markdown

PR Analysis

Size: small (based on production code)
Production Code: 46 lines (1 files)
Test Code: 0 lines (0 files)
Total: 46 lines (1 files)
Test-to-Production Ratio: 0.00:1
No size or quality concerns.

Commit Analysis

Total Commits: 1
Average Commit Size: 46 production lines
Average Files per Commit: 1.0

Metric Value
Large commits (>100 prod lines) 0/1 (0%)
Sprawling commits (>5 files) 0/1 (0%)
Test/prod co-change rate 0/1 (0%)
Message quality 1/1 (100%)
Median net additions ratio 0.96
Test-only commits 0
Production-only commits 1

Commit Details

d0d1654 Ken Judy (8/31/2026)
docs: document CFP estimation, semantic duplicate analysis, and eval script in spec
46 prod lines, 1 files

Test Coverage

Test Adequacy: poor

  • No test changes for production code modifications
  • All commits lack test coverage

DORA Capability Assessment

Archetype: mixed-signals
No clear archetype pattern. Review individual metric thresholds.

Capability Metric Value Target
Small Batches Large commit % 0% <18% (no critical band established)
Small Batches Sprawling commit % 0% <18% (no critical band established)
Version Control Test/prod co-change rate 0% >23% (no critical band established)
Version Control Message quality 100% no band, see spec
AI Risk Signal Net additions ratio (median) 0.96 no band, see spec
Sample size (1 commit) is below the 5-commit convention for a rate verdict (code-quality-metrics-w9f): large-commit %, sprawling-commit % and test/prod co-change rate are reported below without a pass/fail judgement.
Automated by Code Metrics Workflow

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant