Repository navigation
ci(integration): run the slow tier on eight runners - #365
Merged
Merged
Conversation
… the reports to Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
On four runners each shard took 11.5 to 15.9 minutes. The slow tier now runs on eight. run_bundle_built_envs_test.py, 10 of the tier's 48 minutes in one file, is split by test, since its tests share no module fixture. The durations table is rewritten from the last green run's JUnit reports, which predict 6.0 to 6.1 minutes of tests per shard. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Follows #362.
Why
#362's green run took 11.5 to 15.9 minutes per
integration-local-slowshard, against the 10 minutes its table predicted. The tests ran 48 minutes in all against the table's 39, and each runner adds 2 to 3 minutes of setup and first image builds.What
integration-local-slow (1/8)to(8/8). Theintegration-local-slowcheck still passes when every shard does, so the required check keeps its name. The gateway tests stay on two runners.run_bundle_built_envs_test.pyis split by test. It is 10.3 of those 48 minutes in one file, so on eight shards it would hold one runner at about 10 minutes. Its tests share no module fixture or dependency mark (only the function-scopedstate), so they can run on different runners.slow_durations.jsonis rewritten with.github/scripts/slow_test_durations.pyfrom the sixjunit-integration-local-*reports of ci(integration): split the slow tier and the gateway tests across runners #362's green run (40619463107).gh run downloadwrites. This is the last Greptile finding on ci(integration): split the slow tier and the gateway tests across runners #362:junit-integration-local-*/junit-integration-slow.xml. This PR's table was refreshed with exactly that command.split_by_testfiles are split by test) and the Makefile's shard example (2/8).test_shards.py's committed-table test checks that the gateway file is still split and that every listed file exists, instead of pinning the list.Expected: about 6 minutes of tests per slow shard, plus each runner's setup.
Tests
.venv/bin/python -m pytest tst/unit -n auto.venv/bin/python -m pytest tst/unit/test_shards.py tst/unit/test_slow_test_durations_script.py.venv/bin/ruff checkpytest --collect-only -m int_test_slow tst/integration --ignore=…/gateway_test.py, unsharded and withAGENTENV_TEST_SHARD=1/8…8/8gateway_test.pywith1/2and2/2This PR's own CI run is the end-to-end check of the shards' times.
🤖 Generated with Claude Code


Confidence Score: 5/5
The PR appears safe to merge; no actionable issues were found.Summary
The PR expands the slow integration tier from four runners to eight.
No actionable issues were found. This review checked the code paths without running the integration tests.
Reviews (1) · Last reviewed commit: "ci(integration): run the slow tier on ei..." · Reviewed by Greptile