Install Open-WebUI

sudo apt update

sudo apt install

sudo systemctl start docker

sudo systemctl enable docker

sudo usermod -aG docker $USER

sudo chown $USER:$USER /var/run/docker.sock

Have an Nvidia or compatible GPU?

sudo lshw -c display

If you have compatible GPU

docker run -d -p 3000:8080 --gpus=all -v ollama:/root/.ollama -v open-webui:/app/backend/data --name open-webui --restart always

otherwise use the CPU

docker run -d -p 3000:8080 -v ollama:/root/.ollama -v open-webui:/app/backend/data --name open-webui --restart always

Remove the failed GPU installation if you incorrectly installed the GPU version without having a compatible GPU

docker rm open-webui

Rerun either the GPU or CPU version command above. docker run...

After installation, you can access Open WebUI at http://localhost:3000

More commands...

docker stop open-webui

docker restart open-webui

curl -fsSL | sh

You go to the website and get the model command and then goto settings in the webui and put the command in Pull a model from

Other Web UI's - Amazing clean UI with very good web search, my go to currently. (they added the ability to do it all locally very recently!) - Best overall, supports any model format and has many extensions - Has PDF, stable diffusion and web search integration - Has PDF, Web search, best for files ingestion (supports many file formats) - Best for custom characters and roleplay - Has great UI and web search (experimental) - Basic UI that replicated ChatGPT - Basic UI that replicated ChatGPT with PDF integration

More from the comments (Haven't tested myself) : - Easy to install and simple interface

LM Studio - Clean UI, focuses on GGUF format - Nice rich UI with the ability to load extensions for web search, TTS and more - ChatGPT like UI with easy way to download models - very fast and vram efficient - Focuses on PDF files - Supports EXLv2 and LLava

Documentation - Vercel AI SDK - NodeJS/Reactive


docker run --rm --volume /var/run/docker.sock:/var/run/docker.sock containrrr/watchtower --run-once open-webui


📝 📜 ⏱️  ⬆️