Popular repositories Loading

1. llm-inference-lab llm-inference-lab Public

   面向 AI Infra 的大模型推理实验仓库，涵盖 CUDA/Triton 算子、推理 Runtime、vLLM/SGLang Benchmark 与 Serving 优化。

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

3. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python

4. FlagGems-sglang FlagGems-sglang Public

   Forked from flagos-ai/FlagGems-sglang

   FlagGems-sglang is part of FlagOS. It is a high-performance operator library designed for multiple hardware backends.

   Python

5. rasdaemon rasdaemon Public

   Forked from mchehab/rasdaemon

   Rasdaemon is a RAS (Reliability, Availability and Serviceability) logging tool. It records memory errors, using the EDAC tracing events. EDAC is a Linux kernel subsystem with handles detection of E…

   C