Skip to content

Compare agentgateway v1.6.0 and Praxis release and nightly builds - #6

Draft
danehans wants to merge 6 commits into
agentgateway:mainfrom
danehans:praxis-ai-proxy
Draft

danehans wants to merge 6 commits into
agentgateway:mainfrom
danehans:praxis-ai-proxy

Conversation

@danehans

@danehans danehans commented Oct 2, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Adds a three-pass CPU comparison of agentgateway v1.6.0 with Praxis core v0.5.2 and nightly-20261002, plus separately pinned Praxis AI v0.5.0 and October 2 nightly. Separate reports cover direct baselines, native AI processing, Gateway API lifecycle, feature evidence and resource usage. Older results remain explicitly historical.

Retains all 822 accepted load cases, competitor leads, setup blocks, exclusions and limitations. Includes sanitized raw evidence, checksums and offline reproduction. GPU inference remains unmeasured; all campaign VMs and boot disks were deleted.

Validation

  • Three complete passes: 360 protocol checks, 60 cancellation checks and 120 AIPerf cases; no confirmed accepted load errors.
  • Frozen snapshot dimensions, Python/shell syntax and JSON checked; seven existing harness tests pass.
  • Reports regenerated from the sanitized public archives; all numeric data and comparison matrices match.
  • Six figures rendered and inspected; local documentation links checked.

Draft for technical review. The comparison is Solo.io-operated, not independent certification.

Qualify native APIs and streaming before Fortio load measurements.
Support direct, agentgateway, and Praxis treatments with retained
failures and separate initial comparison reports.

Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>
Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>
Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>
Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>
@danehans danehans changed the title Add CPU-only agentgateway and Praxis AI benchmarks Add CPU benchmarks for agentgateway and Praxis Oct 2, 2026
Keep release and nightly distributions separate, retain all outcomes,

and include reproducible public evidence.

Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>
Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>
@danehans danehans changed the title Add CPU benchmarks for agentgateway and Praxis Compare agentgateway v1.6.0 and Praxis release and nightly builds Oct 6, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant