Skip to content

feat(ci): automated performance regression detection in CI pipeline (closes #133) - #173

Closed
ranjeet150 wants to merge 1 commit into
VeriNode-Labs:mainfrom
ranjeet150:feat/ci-performance-regression-detection
Closed

ranjeet150 wants to merge 1 commit into
VeriNode-Labs:mainfrom
ranjeet150:feat/ci-performance-regression-detection

Conversation

@ranjeet150

Copy link
Copy Markdown

Automated Performance Regression Detection in CI Pipeline

Closes #133


Summary of Changes

Implements issue #133: a deterministic, dependency-free automated performance regression detection system for CI pipelines, monitoring agents, and canary release gates across all VeriNode services.

Technical Bounds & Invariants Enforced

  • Critical Path Latency Target: P99 < 100 ms (CRITICAL_PATH_P99_TARGET_MS) on all critical execution paths.
  • Availability Target: 99.99% uptime (AVAILABILITY_TARGET_BPS = 9_999).
  • Regression Drift Limits: 5.00% allowable warning tolerance (DEFAULT_MAX_REGRESSION_BPS), 15.00% hard blocker threshold (BLOCKER_REGRESSION_BPS).
  • Security Sign-Off: Mandatory security review gate prior to production canary promotion.

New Files

File Description
src/perf_regression/mod.rs Core engine, baseline tracking, severity classification, canary deployment gate, dashboard snapshot generator, and 16 unit tests
tests/perf_regression_detection_test.rs 11 comprehensive standalone integration tests covering multi-service critical paths, SLA breaches, throughput, and canary rollouts
scripts/detect_perf_regression.py Standalone CI automation script evaluating candidate samples against baselines and outputting diagnostic summary tables
.github/workflows/performance-regression.yml GitHub Actions workflow executing regression integration tests and CI detection script
docs/performance-regression-detection.md Complete architecture design, technical bounds, blue-green deployment strategy, and runbooks

Modified Files

File Change
src/lib.rs Registered pub mod perf_regression; with architectural documentation
Cargo.toml Added [[test]] entry for perf_regression_detection_test
README.md Documented performance regression detection and linked architectural runbook

Verification

  • cargo fmt --all -- --check: Clean (0 diffs)
  • cargo clippy --test perf_regression_detection_test --lib -- -D warnings: 0 warnings
  • cargo test --test perf_regression_detection_test: 11/11 tests pass green
  • cargo test --lib perf_regression::tests: 16/16 unit tests pass green
  • python3 scripts/detect_perf_regression.py: Clean execution with 0 blockers
  • python3 scripts/storage-layout-check.py: Passed with 0 storage slot collisions

…loses VeriNode-Labs#133)

- Implements deterministic, dependency-free performance regression detector in `src/perf_regression/mod.rs`
- Enforces hard critical path P99 latency SLA (< 100ms) and platform availability (99.99%)
- Provides blue-green deployment strategy and canary performance analysis gate with security review sign-off
- Adds comprehensive integration test suite `tests/perf_regression_detection_test.rs` (11 tests) and co-located unit tests (16 tests)
- Adds CI automation script `scripts/detect_perf_regression.py` and GitHub Actions workflow `.github/workflows/performance-regression.yml`
- Adds architectural documentation and runbooks in `docs/performance-regression-detection.md`
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Automated Performance Regression Detection in CI Pipeline

2 participants