All skills
cli-eval
Creates and runs evaluation suites, tracks benchmark progress, and compares model scores from the command line.
- Part of diegosouzapw/OmniRoute
- AI Engineering · Evals and monitoring
More Evals and monitoring skills
See all- caveman-learn133kReviews a Caveman learn report, applies cost-lowering fixes with your consent and reports the savings.
- caveman-optimize132kTurns a Caveman optimization observation into a candidate with a baseline comparison, needing your approval.
- prompt-engineering-patterns24.8kDesigns, debugs and improves prompts using templates, chain-of-thought and few-shot patterns.
- llm-evaluation13.8kSets up automated metrics, human feedback and benchmarks to measure how well your LLM application performs.
Also in this pack
- cli-a2aSends tasks to the OmniRoute A2A server and inspects agent-to-agent skill history from the command line.
- cli-backup-syncTriggers backups, syncs snapshots to cloud storage, and restores OmniRoute data from the command line.
- cli-batchesSubmits and monitors batch inference jobs, uploads files, and retrieves results from the command line.
- cli-chatSends chat completions, streams responses, and starts an interactive chat session from the command line.