Skip to content

perf(codspeed): Add benchmark suite with CI workflow - #45

Open
cbueth wants to merge 5 commits into
mainfrom
perf/codspeed-benchmarks
Open

perf(codspeed): Add benchmark suite with CI workflow#45
cbueth wants to merge 5 commits into
mainfrom
perf/codspeed-benchmarks

Conversation

@cbueth

@cbueth cbueth commented Jul 29, 2026

Copy link
Copy Markdown
Owner

Add benchmarks using CodSpeed. Cover the core connectivity metrics and network reconstruction. It uses the simulation mode for consistent, comparable perf numbers.

  • 18 reconstruct_network benchmarks (lc/rc/gc/gv across 10, 20, 40, 50 nodes + parallel workers)
  • 6 isolated metric benchmarks (lc/rc/gc/cop/mi/te)
  • 1 find_optimal_lag bench
  • CI workflow that runs them on every push/PR via CodSpeedHQ/action@v4
  • pytest-codspeed in test deps

Benchmarks auto-skip unless --codspeed is passed, so uv run pytest stays fast for normal dev.

@cbueth cbueth self-assigned this Jul 29, 2026
@cbueth cbueth added the enhancement New feature or request label Jul 29, 2026
@cbueth
cbueth force-pushed the perf/codspeed-benchmarks branch 2 times, most recently from a2ecf69 to 8ecafc7 Compare July 29, 2026 10:00
@cbueth
cbueth force-pushed the perf/codspeed-benchmarks branch from 8ecafc7 to 9380487 Compare July 29, 2026 11:22
- NODE_SIZES [5,15] (was [10,20,40,50])
- Remove SMALL_NODES and continuous_data_small (unified)
- Unified _RECON_METRICS = lc/rc/gc/gv
- ts_len 500 → 200 in isolated metric benchmarks
- N_TESTS 5 → 2 (mi/te benchmarks)
- Drop cop/random_patterns from isolated metrics
- Drop continuous_data_20 fixture
- Workers test simplified to [1, 2]
@codspeed-hq

codspeed-hq Bot commented Jul 29, 2026

Copy link
Copy Markdown

Congrats! CodSpeed is installed 🎉

🆕 17 new benchmarks were detected.

You will start to see performance impacts in the reports once the benchmarks are run from your default branch.

Detected benchmarks


Open in CodSpeed

Signed-off-by: Carlson Büth <commit@cbueth.de>
@cbueth
cbueth force-pushed the perf/codspeed-benchmarks branch from 17c311a to 5310a09 Compare July 29, 2026 14:13
cbueth added 2 commits July 29, 2026 16:14
Signed-off-by: Carlson Büth <commit@cbueth.de>
Signed-off-by: Carlson Büth <commit@cbueth.de>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant