Skip to content

perf(index): add fused layered ex-dot kernels - #9831

Open
BubbleCal wants to merge 3 commits into
mainfrom
yang/layered-rq-fused-kernels
Open

BubbleCal wants to merge 3 commits into
mainfrom
yang/layered-rq-fused-kernels

Conversation

@BubbleCal

@BubbleCal BubbleCal commented Oct 9, 2026 •

Copy link
Copy Markdown
Contributor

Add fused prefix ex-dot kernels for layered RaBitQ widths 3 through 9. Support the 1+1, 2+1, 2+2, 4+1, 4+2, 4+3 and 4+4 high/low splits, preserving each native kernel's floating-point accumulation order. Include scalar, NEON, AVX2 and AVX-512 parity coverage across padded dimensions and ordinary query values.

Dependencies

Independent PR targeting main, integrated with Lance main b3c8619886b9, including its native four-chain kernels. Standalone benchmark/POC tools remain excluded.

Validation

On Linux x86_64 with Rust 1.98.1, formatting, full-workspace clippy (--all --tests --benches -- -D warnings), and all 49 prefix-kernel parity cases passed. The same kernel source also passed 49 cases on macOS arm64 before main integration; the integrated composition passed full-workspace clippy and layered integration tests on arm64.

No new performance measurement is claimed. CI is not awaited.

Tracking

OSS-2345

@github-actions github-actions Bot added A-index Vector index, linalg, tokenizer performance labels Oct 9, 2026
@BubbleCal
BubbleCal force-pushed the yang/layered-rq-fused-kernels branch from 51edac7 to 4f43856 Compare October 9, 2026 14:13
@BubbleCal
BubbleCal changed the base branch from yang/layered-rq-cache-pins to yang/layered-rq-native-kernels October 9, 2026 14:14
@BubbleCal
BubbleCal force-pushed the yang/layered-rq-fused-kernels branch from 4f43856 to a9f3adc Compare October 9, 2026 16:48
@BubbleCal
BubbleCal force-pushed the yang/layered-rq-native-kernels branch from c74090f to de9ffbe Compare October 9, 2026 18:55
@BubbleCal
BubbleCal force-pushed the yang/layered-rq-fused-kernels branch from a9f3adc to 1a31588 Compare October 9, 2026 18:55
@BubbleCal
BubbleCal changed the base branch from yang/layered-rq-native-kernels to main October 9, 2026 18:56
@BubbleCal
BubbleCal marked this pull request as ready for review October 11, 2026 13:23

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This repository is configured for manual code reviews. Comment @claude review for a one-time review, or @claude review always to subscribe this PR to a review on every future push.

Tip: disable this comment in your organization's Code Review settings.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

A-index Vector index, linalg, tokenizer performance

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant