Skip to content

index: time catch-up stages and assemble heights on the script pool - #786

Merged
reardencode merged 2 commits into
masterfrom
index/build-stage-meters
Sep 27, 2026
Merged

reardencode merged 2 commits into
masterfrom
index/build-stage-meters

Conversation

@rearden-grok

@rearden-grok rearden-grok Bot commented Sep 27, 2026

Copy link
Copy Markdown
Contributor

Summary

  • The 10s index: build line and the one-height index: apply line report interval read= build= commit= milliseconds. tip: accept bf= stays the combined build+commit time.
  • Catch-up assemble publishes one job per height to rbtc-scripts-* (filter GCS and tweak EC). The IO thread fills the block hash so those jobs do no store IO. The CPU thread still commits each window once.
  • Filters and tweaks stay byte-identical. No cache, no new threads, and no write-path change.

Host check after merge

Grep index: build next= around 700k–800k and past 850k. The 2026-09-26 baseline was about 43–53/s at 711k–745k and 10–20/s from 820k to the tip.

  • If build= is the long pole, rate= should move toward 30–60/s on 4 CPUs and build= should fall toward read=.
  • If read= is still at least 80% of the interval past 850k, the next change is the reader (window size, ring depth), not a pipeline reshape.
  • If commit= is the long pole, promote write aggregation.

Do not start an in-flight cache from this PR alone.

Test plan

  • cargo test -p rbitcoin-consensus --lib index_writebehind
  • Workspace suite, clippy -D warnings, deny, ast-grep, and ci-os-smoke
  • Operator host catch-up log after merge

Made with Cursor

rearden-grok Bot and others added 2 commits September 26, 2026 17:09
The 10s progress line only printed a cumulative rate, so a slow tail could not be told apart from parent reads, tweak math, or fsync.

Co-authored-by: Cursor <cursoragent@cursor.com>
Filter GCS and tweak EC ran on one thread, which is the slow tail once blocks are large. The CPU thread still commits the window.

Co-authored-by: Cursor <cursoragent@cursor.com>
@reardencode
reardencode merged commit 009268c into master Sep 27, 2026
18 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant