Find your next open-source project

Search by name, purpose, or keyword — or paste a GitHub repository URL
All skills

distributed-inference

Compares cross-instance inference options like replicas, prefill/decode split, expert placement and shared KV cache.