All skills
agent-platform-inference
Run a prompt against a Gemini or OpenMaaS model and return the model's answer with the exact project, region, model, and SDK used.
- Part of google/skills
- 9.6k installs
- Machine Learning · Model serving
When to use it
You have a Google Cloud project and a specific model in mind but need working SDK code to call it, or you're hitting a 429, 400, or 404 error during inference.
For example
You say
Use agent-platform-inference to ask deepseek-ai/deepseek-v3.2-maas in project my-project, region global, via the OpenAI SDK: 'Explain vector databases in two sentences.'
You get
- Python inference script
- Model answer with parameters
How it works
- Asks you to confirm project, region, model, SDK, and prompt before running any inference to avoid surprise cost.
- Checks live regional availability for first-party Gemini models before writing code, instead of trusting docs.
Before installing
Needs Google Cloud Application Default Credentials (gcloud auth application-default login) and the aiplatform.googleapis.com API enabled, plus the google-genai, openai, or vertexai Python SDKs.
This skill includes 7 scripts your assistant may run on your computer.
More Model serving skills
See all- serving-llms-vllm66Serves large language models at high throughput with an OpenAI-compatible API and quantization.
- omh-inference-serving31Helps choose a serving engine and set up self-hosted LLM serving on GPUs.
- tensorrt-llm21Runs high-throughput language model inference on NVIDIA GPUs.
- perf-optimization18Routes performance work to the right specialist and applies optimizations or kernels in a safe order.
Also in this pack
- cloud-run-basics19.4kDeploys and manages Cloud Run services, jobs and worker pools.
- gemini-api18.8kWrites code that calls Gemini models for text, images, video, audio, embeddings and more across languages.
- google-cloud-recipe-auth17.1kExplains how to authenticate and authorize users and services to Google Cloud APIs, including IAM and ADC.
- google-cloud-recipe-onboarding16.9kWalks a new developer through creating a Google Cloud account, setting up billing and deploying a first resource.