All skills
vllm
Deploys and serves language models with vLLM behind an OpenAI-compatible endpoint with tool calling.
- Part of Prism-Shadow/penguin-harness
- 2 installs
- Machine Learning · Model serving
More Model serving skills
See all- serving-llms-vllm66Serves large language models at high throughput with an OpenAI-compatible API and quantization.
- tensorrt-llm21Runs high-throughput language model inference on NVIDIA GPUs.
- perf-optimization18Routes performance work to the right specialist and applies optimizations or kernels in a safe order.
- inference-optimisation16Measures and tunes local LLM serving speed, testing changes one at a time and keeping a record of results.
Also in this pack
- humanizer2Rewrites or edits prose in any language so it reads like edited human writing rather than default AI output.
- ollama2Deploys and serves local models with Ollama and exposes an OpenAI-compatible endpoint to apps and agents.
- agent-evaluation1Runs one test agent on one benchmark case once, scores it privately and returns a single protocol result.
- agent-optimization1Improves an agent's state using versioned scores and linked traces from a fixed benchmark.