All skills
kv-cache-design
Speeds up agent inference and cuts cost by keeping the KV cache intact and avoiding context patterns that break it.
- Part of bojieli/ai-agent-book
- Machine Learning · Model serving
More Model serving skills
See all- serving-llms-vllm66Serves large language models at high throughput with an OpenAI-compatible API and quantization.
- tensorrt-llm21Runs high-throughput language model inference on NVIDIA GPUs.
- perf-optimization18Routes performance work to the right specialist and applies optimizations or kernels in a safe order.
- inference-optimisation16Measures and tunes local LLM serving speed, testing changes one at a time and keeping a record of results.
Also in this pack
- ai-style16Checks Chinese copy against a checklist that removes the telltale tone of machine-written text.
- pptx14Generates a PowerPoint deck from a paper, outline or structured text.
- data_analysis4Runs auditable math and descriptive statistics on data you have already confirmed.
- coding3Writes and runs Python code to check that scripts and their output are correct.