Vertex AI

A Vertex AI provider forwards Vertex generateContent and rawPredict requests to your Google Cloud project. Use it when clients call Vertex AI publisher-model paths rather than the Gemini Developer API.

See AI Providers if you haven't created a provider before. Field options are in Provider Configuration.

For Google's Gemini Developer API, use Google Gemini instead.

DefaultsCopy Anchor Link

Vertex Generate Content covers Gemini-format calls on Vertex. Vertex Raw Predict covers Anthropic models hosted on Vertex (rawPredict / streamRawPredict).

ConfigureCopy Anchor Link

1. Sidebar > AI Gateway > Providers > Create.
2. Set Provider Type to Vertex AI. Capabilities and auth type fill in from the defaults above.
3. Set Upstream URL to your regional Vertex host, for example https://us-central1-aiplatform.googleapis.com. The host includes the location.
4. Paste a Bearer credential the Vertex endpoint accepts (typically a Google OAuth access token).
5. Set Allow and Block lists. Use the model ids Vertex expects, including publisher-qualified keys when that is how the client sends them.
6. Save, then attach the provider to an AI Gateway resource.

The gateway authenticates with Authorization: Bearer <key>. Add extra capabilities on the General tab only if this Vertex endpoint actually speaks those API formats.

ClientsCopy Anchor Link

Clients that call Vertex generateContent or rawPredict paths work with the default capabilities. Gemini CLI talks the Gemini Developer API (gemini_generate_content), so it needs a Google Gemini provider rather than this one.