Skip to content

feat(observability): scan stage histograms, analyzer saturation, failure taxonomy, and throughput dashboard - #1281

Open
software321dev wants to merge 1 commit into
MDTechLabs:mainfrom
software321dev:feat/batch-1259-1260-1261-1264
Open

software321dev wants to merge 1 commit into
MDTechLabs:mainfrom
software321dev:feat/batch-1259-1260-1261-1264

Conversation

@software321dev

Copy link
Copy Markdown
Contributor

Summary

This PR resolves issues #1259, #1260, #1261, and #1264 with end-to-end observability implementations:

  1. Scan Stage Duration Histograms (Closes Add scan stage duration histograms #1259):

    • Implemented ScanStageHistogramService tracking millisecond latency distributions across all scan pipeline stages (queue, validation, bytecode_analysis, simulation, report_generation).
    • Computes counts, sums, min, max, average, and p50, p90, p95, p99 percentile latencies with configurable histogram buckets.
  2. Analyzer Saturation & Queue Pressure Metrics (Closes Expose analyzer saturation and queue pressure metrics #1260):

    • Implemented AnalyzerSaturationMetricsService capturing queue length, active concurrency, worker capacity utilization percentage, and saturation status flags.
    • Computes weighted saturation indices and triggers alerts when thresholds are exceeded.
  3. Structured Scan Failure Taxonomy (Closes Create structured scan failure taxonomy #1261):

    • Implemented ScanFailureTaxonomyService classifying failures into standard categories (BYTECODE_INVALID, RPC_TIMEOUT, SIMULATION_REVERT, RATE_LIMITED, ANALYZER_CRASH, etc.) with severity levels, retryability classifications, and remediation hints.
    • Provides aggregation by error code and category over observation windows.
  4. Operational Dashboard for Scan Throughput (Closes Add operational dashboard for scan throughput #1264):

    • Implemented ScanThroughputDashboardService aggregating completed, failed, and in-flight scans across sliding time windows (1m, 5m, 15m, 1h).
    • Computes scans-per-second, success/failure rates, error breakdown, queue health, stage latency summaries, and health status indicators (HEALTHY, DEGRADED, CRITICAL).

Issues Addressed

…ure taxonomy, and throughput dashboard

- Issue MDTechLabs#1259: Add scan stage duration histograms with configurable buckets
- Issue MDTechLabs#1260: Expose analyzer saturation and queue pressure metrics
- Issue MDTechLabs#1261: Create structured scan failure taxonomy with retryable classification
- Issue MDTechLabs#1264: Add operational dashboard for scan throughput and files-per-second metrics

Closes MDTechLabs#1259, Closes MDTechLabs#1260, Closes MDTechLabs#1261, Closes MDTechLabs#1264
@drips-wave

drips-wave Bot commented Oct 18, 2026

Copy link
Copy Markdown

@software321dev Great news! 🎉 Based on an automated assessment of this PR, the linked Wave issue(s) no longer count against your application limits.

You can now already apply to more issues while waiting for a review of this PR. Keep up the great work! 🚀

Learn more about application limits

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

1 participant