Run open LLMs locally with a REST API and a ChatGPT-like web interface
CIS Level 1 hardened Ubuntu 24.04 LTS image by Lynxroute · unique credentials at first boot · CVE-scanned · SBOM and CIS report inside
| Cloud | Version | Software price | Last build | |
|---|---|---|---|---|
| AWS Marketplace EC2 AMI · all commercial regions | 0.40.11 | $0.05/hr Recommended instance: t3.medium · 5-day free trial | 2026-10-25 | Listing ↗ |
| Azure Marketplace VM image · plan payg-gen2 · Gen2 | 0.35.0 | $0.028/vCPU/hr Recommended VM: Standard_D2s_v3 | 2026-10-02 | Listing ↗ |
Software price only; cloud infrastructure is billed separately by the provider. Prices in USD.
| Base OS | Ubuntu 24.04 LTS |
| Hardening | CIS Level 1, Ubuntu 24.04 LTS (tailored) |
| License | MIT |
| Upstream | Open WebUI |
| Machine-readable | product.json · catalog.json |
Ollama is a Go-based runtime for running large language models locally - it pulls quantized GGUF weights from the public Ollama library and exposes a streaming REST API for inference with optional GPU acceleration via NVIDIA CUDA. Open WebUI is a self-hosted ChatGPT-style web interface (FastAPI + Svelte) that connects to the local Ollama API and lets your team chat with models, manage conversations, upload documents for RAG, run web search, and configure prompt templates. The bundle supports CPU and GPU instance types (g4dn.xlarge, g5.xlarge), embedded SQLite for chat history and user accounts, and Llama, Mistral, Gemma, Phi, Qwen, DeepSeek-R1 and 100+ models pulled on demand. Together they form a complete private AI stack with no external service dependencies.
LICENSING NOTE
Ollama is MIT-licensed. Open WebUI is distributed under the source-available Open WebUI License (not an OSI-approved open-source license). The license permits self-hosted use without restriction; deployments with more than 50 end users in any 30-day window that also modify Open WebUI branding (name, logo) require a commercial Enterprise License from Open WebUI Inc. This image ships Open WebUI with the original branding preserved - the 50-user clause does not apply unless the operator rebrands.
Security hardening:
OS hardening (CIS Level 1):
Compliance artifacts:
Credentials are generated at first boot and written to /root/ollama-credentials.txt.
# subscribe once on the AWS Marketplace listing, then:
aws ec2 run-instances \
--image-id resolve:ssm:/aws/service/marketplace/prod-ujhbnz5tfcyt4/latest \
--instance-type t3.medium --key-name my-key --security-group-ids sg-xxxxxxxx# accept the plan terms once, then:
az vm image terms accept --publisher lynxroute --offer ollama --plan payg-gen2
az vm create -g my-rg -n ollama --size Standard_D2s_v3 \
--image lynxroute:ollama:payg-gen2:latest --admin-username azureuser --generate-ssh-keys
The most recent release with notes; the full release history is in product.json.