Skip to content

[DO NOT MERGE] Benchmark #2801 and #2804 against main - #2803

Draft
bdice wants to merge 4 commits into
NVIDIA:mainfrom
bdice:kmeans-bench
Draft

bdice wants to merge 4 commits into
NVIDIA:mainfrom
bdice:kmeans-bench

Conversation

@bdice

@bdice bdice commented Oct 10, 2026 •

Copy link
Copy Markdown
Contributor

CI-only benchmark harness for #2801 and #2804. Do not merge.

It builds three libcuvs conda packages in one workflow run, from the same tree and with the same recipe: main, main + #2801, and main + #2804 (patches in ci/bench/patches). One benchmark binary (ci/bench/bench.cu, public API only) is compiled once, and each variant gets a copy whose RPATH points at its own libcuvs.so (checked at run time). Variants are interleaved in rounds with rotating order. The workload group comes from the matrix's DEPENDENCIES field: kmeans, ivf, lite, tests, profile and profile2 (see ci/bench/run.sh). ci/bench/summarize.py prints the tables.

Runs: full sweep https://github.com/NVIDIA/cuvs/actions/runs/38154672010; profiles https://github.com/NVIDIA/cuvs/actions/runs/38160888485 and https://github.com/NVIDIA/cuvs/actions/runs/38165062741.

@copy-pr-bot

copy-pr-bot Bot commented Oct 10, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@bdice

bdice commented Oct 10, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 014e241

@bdice

bdice commented Oct 10, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test dedc2b6

@bdice

bdice commented Oct 10, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 362dc16

@bdice

bdice commented Oct 10, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test b9c443e

@bdice
bdice force-pushed the kmeans-bench branch 2 times, most recently from b9c443e to 9c4c6fc Compare October 11, 2026 00:36
@bdice

bdice commented Oct 11, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 9c4c6fc

@bdice

bdice commented Oct 11, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 6d3392c

@bdice

bdice commented Oct 11, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 42aa0b1

@bdice

bdice commented Oct 11, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test b7d3031

@bdice

bdice commented Oct 11, 2026

Copy link
Copy Markdown
Contributor Author

Closing: this was a reproducer/diagnostic PR for workstream E of #2783. The deterministic k-means benchmark is done; the fix is in #2801 and #2804.

@bdice

bdice commented Oct 11, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 6adb3ef

@bdice

bdice commented Oct 11, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 440f808

@bdice

bdice commented Oct 11, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 7ca156f

@bdice

bdice commented Oct 11, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 66f9b96

@bdice

bdice commented Oct 11, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 6750d63

@bdice

bdice commented Oct 11, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test f824c9a

@bdice bdice changed the title [DO NOT MERGE] Benchmark deterministic k-means [DO NOT MERGE] Benchmark #2801 and #2804 against main Oct 11, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

1 participant