Large Language Model Systems Course Project

This project is created for a course project on cloud computing and distributed AI systems.

Objectives

• Study large language model inference systems
• Explore KV cache management
• Understand continuous batching
• Evaluate distributed GPU communication strategies

Experiments

The project will use CloudLab resources for educational experiments on modern AI infrastructure.