README

19.2. Model Formats (gguf & Safetensors)

This section contains documentation for Model Formats (GGUF & Safetensors).

Contents

• [19.2.1. Gguf Format Support](./19.2.1. Gguf Format Support.md)
• [19.2.2. Safetensors Format Support](./19.2.2. Safetensors Format Support.md)
• [19.2.3. Model Quantization Guide](./19.2.3. Model Quantization Guide.md)

Generated on 2025-09-10T07:43:39.257Z