Agent pack: structured query verbs, drop GQL skills and --with-commands - #102
Merged
Merged
Conversation
2. Worker prep — line offsets + BLAKE3 + bloom on extract workers (SymbolPass1Prep)
3. Tracker mapping — accumulated at commit_node; skips full mmap scan/sort
4. CodeIndex off by default — no code_index.json (was 1.1 GB); code_hash still on nodes
5. Spill sort runs 256 MiB (was 64 MiB)
Signed-off-by: Shaaf Syed <474256+sshaaf@users.noreply.github.com>
• Hash reuse — workers set FileExtraction.file_hash; stream → PipelineStats →
index_files_with_mapping(..., Some(hashes)) (no 71k re-read)
• Empty tracker — detect_changes marks all as added without hashing (still non-empty so stale
snapshots aren’t reused)
• Spill — reusable scratch + bincode::serialize_into
• Pass-1 batch — begin_file_batch / get_mut on tracker keys
Signed-off-by: Shaaf Syed <474256+sshaaf@users.noreply.github.com>
✔ active_tracker_ids Vec push; flush in end_file_batch Signed-off-by: Shaaf Syed <474256+sshaaf@users.noreply.github.com>
Signed-off-by: Shaaf Syed <474256+sshaaf@users.noreply.github.com>
Signed-off-by: Shaaf Syed <474256+sshaaf@users.noreply.github.com>
Signed-off-by: Shaaf Syed <474256+sshaaf@users.noreply.github.com>
Signed-off-by: Shaaf Syed <474256+sshaaf@users.noreply.github.com>
Signed-off-by: Shaaf Syed <474256+sshaaf@users.noreply.github.com>
• inventory --by import-prefix • rgctl status (digest, nodes/edges, kantra findings hint) • rgctl resources (persistence / weblogic / jboss / web / beans) • rgctl rules run <DIR> (--target, --index-only, --catalog) • Skills + encyclopedia migration probe recipe Signed-off-by: Shaaf Syed <474256+sshaaf@users.noreply.github.com>
Signed-off-by: Shaaf Syed <474256+sshaaf@users.noreply.github.com>
Signed-off-by: Shaaf Syed <474256+sshaaf@users.noreply.github.com>
Signed-off-by: Shaaf Syed <474256+sshaaf@users.noreply.github.com>
Signed-off-by: Shaaf Syed <474256+sshaaf@users.noreply.github.com>
• rgctl deps check --osv — manifests + opt-in --include-jars / --include-node-modules • Version engines: Maven (incl. -rhlw-), Cargo, npm, Go • Skill workflow vuln + docs/json-api.md §18 Signed-off-by: Shaaf Syed <474256+sshaaf@users.noreply.github.com>
… first-match-wins apply • Packs: all Tier‑1 languages under crates/rgctl-analysis/rules/taint/ — hardcoded detect_*_patterns removed • CWE: default_cwe_patterns() reads cwe-catalog.yaml • CLI: --taint-rules PATH + .rgctl/taint-rules.d/ (built-in < project < CLI); with_overlays for OSV sinks • Verified: unit + language taint integration + release smoke green; openspec validate clean Signed-off-by: Shaaf Syed <474256+sshaaf@users.noreply.github.com>
…s; table for xalan; runtime_bundled • --package / --methods on find / callers + bundled_presence honesty • Boundary catalogs (Java/Jakarta + Python) + blast-radius --classify-boundary • rgctl taint --sink … --source external (CFG required; declarative overlays) • rgctl vuln analyze --osv … → OpenVEX (openvex crate) • Skill vuln workflow + json-api §18; CoolStore A/B release smoke green Signed-off-by: Shaaf Syed <474256+sshaaf@users.noreply.github.com>
Signed-off-by: Shaaf Syed <474256+sshaaf@users.noreply.github.com>
• Adds javax.xml.transform and com.sun.org.apache.xalan.internal • Sets runtime_bundled: true with a JAXP honesty note • Covered by xalan_includes_jdk_jaxp_aliases; vuln skill honesty updated Signed-off-by: Shaaf Syed <474256+sshaaf@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Agent pack / structured query (earlier on branch)
find/callers/relations/inventory/status/rules run) for agent workflows; remove GQL from skills and the agent pack.rgctl install --with-commands(skills + optional--with-policyonly; install JSONschema_version3).rules run; related skill / encyclopedia / website updates.OpenSpec: OSV deps → declarative taint → reachability / OpenVEX
End-to-end agent path:
1.
add-osv-deps-supply-chainrgctl vuln triage --osv— parse viaosv0.3 schema cratergctl deps check --osv— manifests + opt-in--include-jars/--include-node-modules-rhlw-), Cargo, npm, Gonot_affected|affected_candidateworkflows/vuln.md; json-api §182.
add-declarative-taint-rules(#16)TaintRuleSetloads YAML packs, compiles once per language, first-match-winscrates/rgctl-analysis/rules/taint/— hardcodeddetect_*_patternsremoveddefault_cwe_patterns()reads it--taint-rules PATH+.rgctl/taint-rules.d/(built-in < project < CLI);with_overlaysfor OSV sinks--with-taint)3.
add-vuln-reachability-vexruntime_bundled)find/callers --package+bundled_presencehonesty;callers --methodsblast-radius --classify-boundaryrgctl taint --sink … --source external(CFG required; declarative overlays)rgctl vuln analyze --osv …→ OpenVEX (openvexcrate)Live CoolStore validation (before → after)
gav-namespace-map.jsonrgctl vuln analyze→ OpenVEX in 46ms for both scenariosValidated verdicts
not_affected/component_not_present— 2-phase fast exitnot_affected/vulnerable_code_not_in_execute_path— 5-phase full pipeline; sink-first taint confirmed no external→readValuepathKnown follow-ups (not blocking)
discover --with-cfg --with-taintneeded for PDG-backed taint confidence (cfg_available=falsetoday)javax.xml.transform.*) not yet surfaced infind --packageresolution outputTest plan
cargo test -p rgctl-security --libcargo test -p rgctl-analysis --lib taint boundarycargo test -p rgctl-agent-pack-codegencargo build --release --bin rgctlcargo test --release --test osv_deps_release_smoke -- --ignored --nocapturecargo test --release --test taint_rules_release_smoke -- --ignored --nocapturecargo test --release --test vuln_reachability_release_smoke -- --ignored --nocapture(needsexample/coolstore)vuln triage/deps check/vuln analyze --include-jars libon CoolStore;taint --help; no newrgctl-vulnskill dirs