Skills for your AI assistant
Add a skill and Claude Code, Codex, Cursor or a similar assistant learns one more job.
Model serving
9 skillsHigh-throughput inference serving for teams.
- inference-optimisation16 installsMeasures and tunes local LLM serving speed, testing changes one at a time and keeping a record of results.
- kv-cache-designSpeeds up agent inference and cuts cost by keeping the KV cache intact and avoiding context patterns that break it.
- accelerator-selectionCompares accelerators on capacity, effective compute, memory bandwidth, power and cost for a given model workload.
- agent-runtime-capacityPlans how agent model calls and tool environments are created, kept, released and restored for capacity and latency.
- distributed-inferenceCompares cross-instance inference options like replicas, prefill/decode split, expert placement and shared KV cache.
- inference-servingCompares batching, scheduling, KV cache, offloading and speculative decoding for a single-instance inference service.
- model-footprintCompares how model or architecture changes affect weight size, KV state, forward compute and memory access.
- resource-budgetEstimates whether one model execution fits given hardware and locates compute, memory and serial-wait lower bounds.
- workload-modelingTurns continuous requests, multi-turn agents, real-time interaction or RL traces into capacity and latency loads.