Find your next open-source project

Search by name, purpose, or keyword — or paste a GitHub repository URL
All skills

inference-serving-vllm

Serves LLMs with high throughput using vLLM batching and quantization options.