Fast LLM speculative inference server for consumer hardware.
spark kernel cuda cuda-kernels rocm luce poolside rtx3090 llama-cpp local-ai qwen speculative-decoding strix-halo dflash megakernel speculative-prefill pflash
-
Updated
Jul 10, 2026 - C++