All skills
omh-inference-serving
Helps choose a serving engine and set up self-hosted LLM serving on GPUs.
- Part of rlaope/oh-my-hermes
- 31 installs
- Machine Learning · Model serving
More Model serving skills
See all- agent-platform-deploy10.3kDeploys models from Model Garden to endpoints and cleans up deployments when done.
- agent-platform-inference9.6kRuns prompts and chat completions against Gemini and third-party models on Google Cloud.
- serving-llms-vllm66Serves large language models at high throughput with an OpenAI-compatible API and quantization.
- tensorrt-llm21Runs high-throughput language model inference on NVIDIA GPUs.
Also in this pack
- review-sweep38Reviews open oh-my-hermes pull requests under REVIEW.md and posts findings as GitHub reviews.
- triage-sweep38Backfills labels across unlabeled oh-my-hermes issues and pull requests.
- omh-build-failure-triage36Classifies build, typecheck and CI failures and points to the likely cause.
- omh-data-analysis35Analyzes a dataset or table you supply and reports what it shows.