Catalog / AI & LLM

AnythingLLM

Private ChatGPT-style workspace that answers questions over your own documents with RAG

CIS Level 1 hardened Ubuntu 24.04 LTS image by Lynxroute · unique credentials at first boot · CVE-scanned · SBOM and CIS report inside

AWS Marketplace1.18.0↗ Azure Marketplace1.17.0↗
Availability and pricing
CloudVersionSoftware priceLast build
AWS Marketplace
EC2 AMI · all commercial regions
1.18.0$0.05/hr
Recommended instance: t3.medium · 5-day free trial
2026-10-23Listing ↗
Azure Marketplace
VM image · plan payg-gen2 · Gen2
1.17.0$0.028/vCPU/hr
Recommended VM: Standard_D2s_v3
2026-10-03Listing ↗

Software price only; cloud infrastructure is billed separately by the provider. Prices in USD.

Image facts
Base OSUbuntu 24.04 LTS
HardeningCIS Level 1, Ubuntu 24.04 LTS (tailored)
LicenseMIT
UpstreamMintplex Labs
Machine-readableproduct.json · catalog.json
What is AnythingLLM

AnythingLLM is an open-source, self-hosted ChatGPT-style application that turns any document collection into a private, queryable workspace. The server is a Node.js application that ingests PDFs, DOCX, HTML, plain text, audio transcripts, and code, chunks and embeds the content into a vector database, and serves a multi-user web UI for chat and AI agents. It supports any LLM provider through a single switch in the admin UI - OpenAI, Anthropic Claude, AWS Bedrock, Azure OpenAI, Google Gemini, Cohere, Mistral, Groq, OpenRouter, Ollama, LM Studio, vLLM, LiteLLM, and many more. AI agents can browse the web, run SQL, call tools, and execute multi-step workflows. Operators get team workspaces with per-workspace document scope, role-based access, public chat embeds, REST API for programmatic access, an OpenAI-compatible developer API, and a built-in admin UI. Persists users, workspaces, chats, documents, and vectors in embedded SQLite and LanceDB - no external database required. MIT license, no vendor lock-in.

What the Lynxroute image adds

Security hardening:

  • Admin user with unique password (EC2 Instance ID) generated at first boot - never baked into the image
  • JWT signing key, encryption signing key, and salt (>=32 chars each) generated at first boot
  • AnythingLLM container bound to 127.0.0.1:3001 only - reachable only through the Nginx reverse proxy with TLS
  • Multi-user mode enabled at first boot - the bootstrap auth window closes immediately after admin creation
  • No provider API keys baked in - operator configures OpenAI, Anthropic, Bedrock, Ollama, etc. in the admin UI after login
  • Anonymous telemetry disabled by default
  • Nginx reverse proxy with TLS, HTTP-to-HTTPS redirect, WebSocket support for streaming chat, security headers
  • UFW firewall pre-configured - only TCP 22, 80, 443 are exposed
  • fail2ban, AppArmor
  • CVE scan - every image is scanned for vulnerabilities before release

Out of the box, with no external services:

  • Embedded LanceDB vector database - file-based, no separate container or network call
  • Native embedder (Xenova/all-MiniLM-L6-v2) running inside the container - no external embedding API key required for RAG
  • SQLite storage for users, workspaces, chats - no external database to provision

OS hardening (CIS Level 1):

  • CIS Ubuntu 24.04 LTS Level 1 benchmark applied via ansible-lockdown
  • auditd, SSH hardening, kernel hardening, IMDSv2 enforced

Compliance artifacts:

  • SBOM - CycloneDX 1.6 at /etc/lynxroute/sbom.json
  • CIS Conformance Report at /etc/lynxroute/cis-report.html
  • CIS Tailored Profile at /usr/share/doc/lynxroute/CIS_TAILORED_PROFILE.md
Deploy

Launch in one command

Credentials are generated at first boot and written to /root/anythingllm-credentials.txt.

# subscribe once on the AWS Marketplace listing, then:
aws ec2 run-instances \
  --image-id resolve:ssm:/aws/service/marketplace/prod-jdgh7celwrac6/latest \
  --instance-type t3.medium --key-name my-key --security-group-ids sg-xxxxxxxx
# accept the plan terms once, then:
az vm image terms accept --publisher lynxroute --offer anythingllm --plan payg-gen2
az vm create -g my-rg -n anythingllm --size Standard_D2s_v3 \
  --image lynxroute:anythingllm:payg-gen2:latest --admin-username azureuser --generate-ssh-keys
Release notes

Latest release

The most recent release with notes; the full release history is in product.json.

AnythingLLM 1.18.0

AWS · 2026-10-23
  • AnythingLLM updated 1.17.0 -> 1.18.0, a bugfix release with no database migrations. MIT unchanged
  • About 50 fixes across attachments, scheduled jobs, data connectors and AstraDB embeddings
  • Security: login no longer reveals whether a username exists, and the embed allowlist is matched by origin
  • Rebuilt on the latest CIS Level 1 hardened Ubuntu 24.04 LTS base, picking up every operating-system security update published since the previous build