Skip to content

perf: reduce memory usage for index - #537

Merged
aawsome merged 1 commit into
mainfrom
optimize-index-memory
Jul 29, 2026
Merged

perf: reduce memory usage for index#537
aawsome merged 1 commit into
mainfrom
optimize-index-memory

Conversation

@aawsome

@aawsome aawsome commented Jul 29, 2026

Copy link
Copy Markdown
Member

This PR restricts the supported pack count to 2^32. By doing so it allows to store the pack file index as u32 instead of usize reducing the index size per blob from 52 to 48 bytes, i.e. about 7.5% reduction in memory usage (for command which use a full index),

@codecov

codecov Bot commented Jul 29, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 83.33333% with 1 line in your changes missing coverage. Please review.
✅ Project coverage is 52.6%. Comparing base (e8b6425) to head (c3de569).

Files with missing lines Patch % Lines
crates/core/src/index/binarysorted.rs 83.3% 1 Missing ⚠️
Additional details and impacted files
Files with missing lines Coverage Δ
crates/core/src/index/binarysorted.rs 82.3% <83.3%> (-2.1%) ⬇️

... and 20 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@aawsome
aawsome merged commit bf76cb2 into main Jul 29, 2026
25 checks passed
@aawsome
aawsome deleted the optimize-index-memory branch July 29, 2026 18:57
@rustic-release-plz rustic-release-plz Bot mentioned this pull request Jul 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant