2.1.1 Frontend: Open WebUI

Open WebUI

Handle: webui URL: http://localhost:33801

Extensible, self-hosted interface for AI that adapts to your workflow. Open WebUI provides plenty of features and QoL goodies for working with LLMs. Notably:

• Model management - create model instances with pre-configured settings, chat with multiple models at once
• Prompt library
• Persistent chat history
• Document RAG
• Web RAG
• Tools, Functions, Filters

Starting

webui is one of the default services in Harbor, so you don't need to specify anything special to start it.

# webui is one of the
# default services
harbor up

See harbor defaults on managing default services.

Configuration

You can configure Open WebUI in three ways:

• Via WebUI itself: changes are saved in the webui/config.json file, Harbor may override them on restart
  • Copy config changes to the webui/configs/config.override.json in order to persist them over Harbor's default config
• Via environment variables: changes are applied after restarting the Harbor

# Override the WebUI image version
harbor webui version dev-cuda

# Override WebUI default name
harbor webui name "Jarvis"

# Specify custom secret for JWT tokens
harbor webui secret sk-203948

# Set to DEBUG for more visibility
harbor webui log DEBUG