Ollama
Point a Custom provider at Ollama on a Pangolin site
Ollama serves local models with an OpenAI-compatible HTTP API. Create a Custom provider and route to that API so Codex, OpenCode, Open WebUI, and other Chat Completions clients can use models running on a site.
Pangolin talks to Ollama at /v1/chat/completions. Use that OpenAI-compatible listener, not Ollama's native /api/chat path.
See Capabilities for the full capability list.
Install a site on the same network as Ollama so Pangolin can reach it over the tunnel. See Reach a Self-Hosted API.
Configure
- Sidebar > AI Gateway > Providers > Create.
- Set Provider Type to Custom and give it a name.
- Select OpenAI Chat Completions.
- Set Routing Mode to Site Targets if Ollama runs on a site's network. Use Upstream URL (
http://<host>:11434) only when the Pangolin node can reach Ollama directly. - Set Auth Type to No Auth on a private LAN. Use Bearer if you set an Ollama API key.
- Allow the exact model ids you plan to call, for example
llama3.2. See Model Routing. - Save. On the Network tab, add a target: the Ollama host, port
11434, method HTTP. - Attach the provider to an AI Gateway resource.
Then point a client at that resource: Codex, OpenCode, or Open WebUI.
Was this page helpful?

