Plasma: A Layout-Aware Benchmark Reveals Memory Layout Matters for Graph-based ANNS on GPU

Yutaro Oguri^1,*   Mai Nishimura²   Yusuke Matsui¹

¹The University of Tokyo   ²OMRON SINIC X Corporation

^*Work done as an intern at OMRON SINIC X Corporation

---

📄 Abstract

We propose Plasma, a Platform for Layout-Aware Search and Memory Arrangement: a unified evaluation framework for graph-based Approximate Nearest Neighbor Search (ANNS) on GPU that isolates the effects of graph index topology and memory layout. Graph-based ANNS is essential in modern AI applications such as RAG, and GPU utilization is attracting attention for datasets of millions or more vectors. Our framework extracts the topology of arbitrary graph-based indices and enables execution under a unified, GPU-optimized search algorithm, specifying the correspondence between vertex IDs and positions on memory to allow arbitrary vertex orderings. Through comprehensive experiments, we demonstrate that vertex reordering yields up to 80% (typically 10–30%) QPS improvement while preserving search accuracy.

🚧 Code

Code coming soon.