Skip to content

perf(index): share resident buffers within query lifetimes - #9844

Draft
BubbleCal wants to merge 5 commits into
yang/layered-rq-open-residencyfrom
yang/layered-rq-resident-sharing
Draft

BubbleCal wants to merge 5 commits into
yang/layered-rq-open-residencyfrom
yang/layered-rq-resident-sharing

Conversation

@BubbleCal

@BubbleCal BubbleCal commented Oct 9, 2026 •

Copy link
Copy Markdown
Contributor

Share resident row-ID and factor buffers across partition views and scope gathered-buffer reuse to a query. Keep cached entries and outward streams independently owned so eviction can reclaim the resident store after live handles are released. Cover ownership, cache charging and ordered Full-query parity.

Dependencies

Stacked directly on #9842.

Validation

Formatting and full-workspace clippy (cargo clippy --all --tests --benches -- -D warnings) passed on this PR tree with macOS arm64 / Rust 1.98.1. All 82 storage and lifetime regressions passed on the final integrated OSS tree.

Performance for this PR head is not separately measured. CI is not awaited.

Tracking

OSS-2567

@github-actions github-actions Bot added A-index Vector index, linalg, tokenizer performance labels Oct 9, 2026
@BubbleCal
BubbleCal force-pushed the yang/layered-rq-resident-sharing branch from a4a54d8 to 1556d91 Compare October 9, 2026 16:48
@BubbleCal
BubbleCal force-pushed the yang/layered-rq-open-residency branch 2 times, most recently from 0d1febf to f931c45 Compare October 9, 2026 18:55
@BubbleCal
BubbleCal force-pushed the yang/layered-rq-resident-sharing branch from 1556d91 to 5dfca17 Compare October 9, 2026 18:55
@BubbleCal
BubbleCal force-pushed the yang/layered-rq-resident-sharing branch from ef34761 to 754445e Compare October 10, 2026 16:03
@BubbleCal
BubbleCal force-pushed the yang/layered-rq-open-residency branch from dd31fc2 to 01a4dd1 Compare October 10, 2026 16:03

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

A-index Vector index, linalg, tokenizer performance

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant