I'm a master's student in Computer Technology at Northwestern Polytechnical University (NWPU). I work on efficient LLM inference and training systems, with a focus on runtime performance, GPU/NPU kernels, and KV cache management.
I'm looking for internships in LLM inference optimization and AI systems, remote or on-site.
- verl-omni: Added CPU placement for native reward models (#694) and migrated the SD3.5 OCR recipe to named rewards (#695).
- vLLM-Omni: Added remote SeedVR2 video restoration for ComfyUI (#8505).
-
verl-omni: Streaming named-reward scoring (#730) and two-rank native PickScore FSDP replicas (#855, draft).
-
Megatron-LM: Activation offloading for GDN recurrence (#7908), microbatch regression coverage (#8243), and context-parallel scheduling metrics (#8431).
-
SGLang-Omni: PersonaPlex streaming and startup improvements, including incremental history and session warmup.
-
vLLM: Multimodal prefix-cache boundary handling for hybrid Mamba models (#56818).
-
Mooncake: Encoder–Prefill–Decode disaggregation and reusable agent state (#2836).
View my upstream pull requests
- MiniCPM-o on Ascend: Optimized multimodal inference across two NPUs, including CPU/NPU overlap, CANN operators, graph execution, and W8A8 quantization.
- Efficient VLM inference: Optimized Qwen3-VL-2B with KV cache reuse, projection fusion, Triton kernels, and CUDA Graphs.
- MetaX C500 kernels: Built and tuned fused quantization kernels with TileLang, profiling, and correctness tests.
- LLM inference, multimodal serving, KV and prefix caching
- Distributed training, activation offloading, and runtime scheduling
- Quantization, GPU/NPU kernels, profiling, and performance analysis
Python · PyTorch · CUDA · Triton · TileLang · CANN / AscendC · vLLM · llama.cpp
- MiniCPM × Ascend Inference Optimization Challenge: 5th on the public leaderboard
- IEEE AICAS 2026 Grand Challenge: 7th place
- CCF Open Source Innovation Competition: Third Prize, Mooncake KVCache
- Huawei MindSpore Model Development Challenge: 3rd place / Silver, S1-MoE
- MetaX Open Source Talent Camp: Best Engineering Practice Award
- Northwestern Polytechnical University: Master's in Computer Technology, 2025–present
- Shaanxi Normal University: Bachelor's in Software Engineering, 2021–2025