Neutro Production Architecture Diagram

User Experience

Users reach Open WebUI through the production ingress and authenticate with ESS SSO.
Open WebUI uses Redis, persistent NFS storage, and PostgreSQL for shared application state.

Model Gateway

LiteLLM exposes an internal ClusterIP service and routes configured models to Azure OpenAI.
The Open WebUI-to-LiteLLM provider mapping is runtime configuration and is not asserted as a deployment edge.

Platform Integration

Argo CD reconciles the production overlay while Vault supplies runtime secrets.
Open WebUI and LiteLLM export telemetry to the shared observability platform.