feat: platform/module test selection with capability x module matrix

[abegnoche]

Summary

Reframes test selection around a platform x module matrix and cleans up the surrounding classification/catalog/reporting machinery. No directory moves or manifest redesign — suites are classified by a single axis key declared in their YAML.

Key changes:

• Selection model: suites declare exactly one axis key under tests: — platform: <name> for a service-line platform (vm, bare_metal, kubernetes, slurm) or module: <name> for an operational concern (iam, network, security, observability, control_plane, image_registry, ...). Provider configs inherit the key via import:. test run gains --platform (run a platform column: the platform config plus every module config, with platform-scoped excludes) and --module (run one module suite); both require --provider and are mutually exclusive with -f.
• Terminology: unify on the existing platform vocabulary (runtime, commands key, upload term, YAML axis key) instead of introducing a competing capability/kind pairing.
• Labels derived from YAML: drop the hand-maintained label allowlists (MODIFIER_LABELS, EXTRA_MODULE_LABELS, SUITE_REQUIRED_LABELS); the required suite label and module axis are derived from each suite's axis key. Labels are otherwise free-form.
• Catalog: versioned envelope with a schemaVersion plus platforms and modules axis lists derived from the suites, so a consumer can build the matrix straight from the catalog. Per-entry axes are split into platforms and modules.
• Unique wiring names: every duplicated generic-check wiring (121 across 12 files) now uses a distinct variant name per wiring (StepSuccessCheck-iam_teardown, GpuCheck-bm_gpu) so catalog entries, JUnit case names, and matrix cells are 1:1 with wirings. variant_required on the reusable classes plus validate_suite_wiring.py enforce global name uniqueness and reject bare wirings.
• Reporting: test-run upload reports a (capability, module) pair — platform runs report (platform, -), module runs inside a --platform column inherit the column as capability, and standalone module runs report (-, module). isvctl deploy resolves the pair through import: via a new effective_axes helper; isvreporter gains --module and passes unknown axis values through instead of coercing to kubernetes.
• Re-homing: host syslog and BMC SEL/telemetry observability checks move from the observability suite to bare_metal (they need a live host/BMC).

Test plan

• make lint && make test
• make demo-test
• python scripts/validate_suite_wiring.py
• make plan renders cleanly

Opened as a draft for review.

[copy-pr-bot]

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

[coderabbitai]

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 9cf64008-0b8b-4ab1-b606-489ba0ad39bb

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

• 🔍 Trigger review

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

---

_{Comment @coderabbitai help to get the list of available commands.}