Skip to main content
Ollama serves local models with an OpenAI-compatible HTTP API. Create a Custom provider and route to that API so Codex, OpenCode, Open WebUI, and other Chat Completions clients can use models running on a site. Pangolin talks to Ollama at /v1/chat/completions. Use that OpenAI-compatible listener, not Ollama’s native /api/chat path. See Capabilities for the full capability list. Install a site on the same network as Ollama so Pangolin can reach it over the tunnel. See Reach a Self-Hosted API.

​
Configure

  1. Sidebar > AI Gateway > Providers > Create.
  2. Set Provider Type to Custom and give it a name.
  3. Select OpenAI Chat Completions.
  4. Set Routing Mode to Site Targets if Ollama runs on a site’s network. Use Upstream URL (http://<host>:11434) only when the Pangolin node can reach Ollama directly.
  5. Set Auth Type to No Auth on a private LAN. Use Bearer if you set an Ollama API key.
  6. Allow the exact model ids you plan to call, for example llama3.2. See Model Routing.
  7. Save. On the Network tab, add a target: the Ollama host, port 11434, method HTTP.
  8. Attach the provider to an AI Gateway resource.
Then point a client at that resource: Codex, OpenCode, or Open WebUI.